-- Logs begin at Thu 2022-08-18 20:51:53 UTC, end at Thu 2022-08-18 22:44:03 UTC. -- Aug 18 21:46:25.367402 dv-cinder-853678-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 21:46:25.376210 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 21:46:25 2022] *** Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: nodename: dv-cinder-853678-3-iscsi Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: machine: x86_64 Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: clock source: unix Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: pcre jit disabled Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: detected number of CPU cores: 4 Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: current working directory: / Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: detected binary path: /usr/bin/uwsgi-core Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: your processes number limit is 47680 Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: your memory page size is 4096 bytes Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: detected max file descriptor number: 2048 Aug 18 21:46:25.378254 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: lock engine: pthread robust mutexes Aug 18 21:46:25.379861 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: thunder lock: enabled Aug 18 21:46:25.379861 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 21:46:25.379861 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 21:46:25.418646 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: Python main interpreter initialized at 0x55b8906ac9c0 Aug 18 21:46:25.418646 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: python threads support enabled Aug 18 21:46:25.418646 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: your server socket listen backlog is limited to 100 connections Aug 18 21:46:25.418646 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: your mercy for graceful operations on workers is 90 seconds Aug 18 21:46:25.419056 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 21:46:25.419056 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: *** Operational MODE: preforking *** Aug 18 21:46:25.419328 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: *** uWSGI is running in multiple interpreter mode *** Aug 18 21:46:25.419328 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: spawned uWSGI master process (pid: 105461) Aug 18 21:46:25.419543 dv-cinder-853678-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 21:46:25.422441 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: spawned uWSGI worker 1 (pid: 105462, cores: 1) Aug 18 21:46:25.422441 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: spawned uWSGI worker 2 (pid: 105463, cores: 1) Aug 18 21:46:25.422441 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 21:46:26.076018 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 21:46:26.087157 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 21:46:27.156073 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 21:46:27.156073 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: from cryptography.utils import int_from_bytes Aug 18 21:46:27.156964 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 21:46:27.156964 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: from cryptography.utils import int_from_bytes Aug 18 21:46:27.159961 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 21:46:27.159961 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: from cryptography.utils import int_from_bytes Aug 18 21:46:27.160372 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 21:46:27.160372 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: from cryptography.utils import int_from_bytes Aug 18 21:46:29.636002 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 21:46:29.636574 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 21:46:29.636747 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 21:46:29.636886 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 21:46:29.637258 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 21:46:29.637338 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 21:46:29.637338 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 21:46:29.637686 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 21:46:29.637814 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.637913 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 21:46:29.638061 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.638174 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 21:46:29.638385 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.638523 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.638706 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.638846 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.639037 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.639187 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.639348 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.639505 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.639666 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.639812 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.639984 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.640103 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.640312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.640408 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.640571 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.640720 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.640883 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.641044 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.641209 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853678-3-iscsi {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.641296 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.641535 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.641649 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.641870 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.642049 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853678-3-iscsi {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.642185 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.642273 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.642493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.642581 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.642796 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.642897 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.643108 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.643194 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.643405 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.643509 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.643725 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.643892 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.644050 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.644326 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.644511 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.644626 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.644817 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.644912 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.645117 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.645319 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.645495 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.645641 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.645802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.645949 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.646098 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.646226 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.646462 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.646669 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.646857 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.647017 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.647233 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.647394 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.647621 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.647774 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853678-3-iscsi {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.647954 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.648179 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.648361 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853678-3-iscsi {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.648523 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.648746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.648934 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.649126 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.649313 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.649473 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.649725 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.649920 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.650083 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.650254 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.650410 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.650548 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.650680 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.650845 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.650974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.651098 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.651222 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.651346 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.651477 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.651645 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.651781 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.651907 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.652031 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.652163 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.652301 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.652427 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.652552 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.652676 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.652811 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.652974 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.653109 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.653235 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.653359 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.653484 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.653636 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.653777 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.653984 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.654116 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.654242 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.654365 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.654489 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.654628 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.654760 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.654886 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.655010 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.655138 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.655263 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.655401 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.655595 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.655726 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.655851 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.655983 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.656124 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.656251 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.656376 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.656508 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.656883 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.657008 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.657142 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.657268 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.657392 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.657522 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.657661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.657808 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.657935 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.658066 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.658191 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.658316 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.658490 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.658629 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.658810 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.658940 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.659125 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.659262 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.659433 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.659570 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.659741 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.659870 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.660042 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.660177 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.660357 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.660496 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.660679 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.660808 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.660986 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.661114 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.661293 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.661435 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.661656 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.661791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.661956 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.662085 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.662258 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.662387 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.662572 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.662709 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.662879 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.663008 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.663183 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.663312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.663486 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.663625 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.663789 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.663925 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.664157 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.664286 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.664411 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.664569 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.664699 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.664871 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.665010 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.665137 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.665261 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.665392 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.665543 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.665718 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.665881 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.666020 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.666191 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.666321 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.666497 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.666640 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.666798 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.666927 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.667104 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.667234 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.667411 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.667618 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.667746 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.667881 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.668013 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.668144 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.668282 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.668420 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.668585 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.668721 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.668888 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.669023 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.669189 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.669327 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.669485 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.669667 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.669808 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.669942 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.670112 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.670243 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.670428 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.670567 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.670727 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.670855 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.671028 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.671166 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.671329 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.671481 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.671631 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.671760 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.671937 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.672074 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.672237 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.672373 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.672537 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.672667 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.672841 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.672969 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.673139 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.673265 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.673437 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.673567 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.673775 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.673904 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.674078 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.674286 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.674415 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.674541 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.674676 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.674801 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.674963 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.675099 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.675263 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.675400 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.675565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.675699 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.675864 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.675991 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.676162 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.676301 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.676463 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.676599 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.676760 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.676889 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.677059 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.677195 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.677355 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.677483 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.677673 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.677816 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.677974 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.678117 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.678272 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.678401 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.678584 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.678715 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.678888 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.679024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.679188 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.679314 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.679487 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.679614 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.680322 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.680502 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.680638 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.680764 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:46:29.680973 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.681103 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.681317 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.681446 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.681655 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.681802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.682000 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.682130 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.682328 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.682457 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.682644 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.682771 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.682962 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.683086 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.683271 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.683404 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.683591 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.683871 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.683998 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.684200 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.684298 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.684509 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.684604 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.684823 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.684908 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.685131 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.685218 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.685448 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.685558 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.685791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.685887 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.686107 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.686196 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.686422 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.686580 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.686723 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.686862 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.687012 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.687162 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.687778 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.687927 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.688070 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.688211 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.688380 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.688532 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.688681 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.688822 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.688962 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.689101 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.689318 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.689463 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.689628 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.689775 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.689915 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.690066 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.690221 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.690362 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.690509 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.690656 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.690796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.690945 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.691093 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.691247 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.691388 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.691527 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.691667 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.691815 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.691956 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.692113 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.692261 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.692417 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.692564 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.692713 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.692853 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.692992 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.693132 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.693271 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.693423 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.693564 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.693729 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.693870 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.694021 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.694161 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.694316 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.694553 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.694718 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.694861 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.695010 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.695150 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.695299 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.696073 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.696218 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.696368 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.696368 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.696649 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.696798 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.696940 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.697079 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.697234 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.697379 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.697528 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.697757 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.697914 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.698055 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.698195 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.698334 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.698483 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.698640 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.698781 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.698927 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.699068 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.699215 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.699369 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.699510 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.699650 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.699789 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.699928 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.700067 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.700214 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.700371 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.700523 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.700663 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.700804 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.700951 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.701100 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.701251 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.701393 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.701532 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.701694 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.701849 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.701991 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.702130 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.702282 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.702421 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.702568 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.702722 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.702865 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.703012 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.703152 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.703299 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.703448 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.703604 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.703753 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.703894 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.704034 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.704196 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.704344 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.704493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.704719 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.704878 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.705020 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.705159 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.705308 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.705449 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.705613 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.705761 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.705903 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.706056 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.706212 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.706354 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.706499 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.706639 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.706785 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.706926 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.707076 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.707224 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.707368 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.707508 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.707647 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.707786 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.707945 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.708094 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.708236 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.708375 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.708515 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.708662 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.708804 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.708943 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.709083 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.709223 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.709370 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.709518 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.709709 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.709864 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.710004 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.710144 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.710293 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.710484 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.710629 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.710769 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.710939 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.711086 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.711227 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.711375 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.711516 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.711654 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.711804 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.711944 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.712264 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.712414 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.712562 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.712704 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.712853 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.712993 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.713145 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.713288 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.713429 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.713568 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.713753 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.713896 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.714050 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.714191 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.714331 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.714470 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.714609 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.714834 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.714991 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.715133 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.715279 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.715474 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.715619 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.715780 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.715928 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.716075 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.716216 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.716355 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.716496 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.716645 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.716793 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.716935 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.717681 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.717842 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.718069 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.718224 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.718365 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.718505 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.718645 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.718796 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.718947 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.719088 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.719234 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.719375 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.719515 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.719655 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.719804 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.719944 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.720094 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.720235 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.720374 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.720522 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.720663 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.720802 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.720942 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.721088 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.721235 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.721388 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.721528 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.721692 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.721833 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.721984 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.722135 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.722285 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.722426 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.722572 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.722713 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.722861 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.723002 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.723154 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.723295 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.723442 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.723582 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.723733 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.723900 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.724041 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.724187 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.724328 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.724479 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.724620 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.724767 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.724995 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.725141 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.725282 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.725421 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.725569 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.725744 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.725906 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.726048 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.726188 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.726332 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.726472 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.727131 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.727283 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.727424 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.727563 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.727707 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.727861 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.728004 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.728155 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.728302 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.728451 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.728599 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.728749 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.728889 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.729030 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.729169 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.729308 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.729448 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.729653 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.729814 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.729956 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.730107 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.730247 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.730386 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.730539 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.730687 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.730828 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.730968 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.731108 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.731256 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.731396 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.731535 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.731675 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.731813 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.731963 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.732115 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.732265 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.732405 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.732545 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.732684 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.732823 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.732971 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.733112 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.733260 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.733400 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.733546 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.733708 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.733876 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.734018 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.734157 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.734297 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.734437 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.734576 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.734724 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.734724 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.735016 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.735227 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.735374 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.735374 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.735655 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.735806 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.735946 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.735946 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.736219 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.736368 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.736515 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.736669 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.736816 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.736962 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.737132 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.737291 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.737440 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.737647 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.737809 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.737966 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.738113 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.738268 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.738415 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.738562 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.738709 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.738866 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.739023 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.739177 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.739324 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.739479 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.739637 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.739784 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.739939 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.740086 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.740233 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.740386 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.740545 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.740693 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.740848 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.741002 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.741149 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.741296 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.741442 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.741617 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.741782 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.741931 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.741931 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.742271 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.742271 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.743049 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.743199 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.743345 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.743498 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.743498 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.743786 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.743951 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.744100 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.744245 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.744390 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.744390 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.744666 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.744821 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.744968 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.745127 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.745368 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.745368 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.745702 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.745873 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.746041 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.746202 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.746350 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.746496 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.746651 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.746798 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.746953 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.747114 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.747269 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.747417 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.747570 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.747717 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.747883 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.747883 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.748184 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.748331 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.748476 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.748621 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.748766 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.748922 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.749069 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.749215 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.749360 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.749506 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.749685 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.749846 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.750005 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.750159 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.750313 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.750473 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.750629 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.750776 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.750923 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.751070 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.751217 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.751363 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.751517 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.751665 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.751811 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.751968 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.752117 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.752263 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.752418 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.752566 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.752719 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.752867 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.753012 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.753168 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.753316 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.753463 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.753654 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.753822 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.753969 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.754132 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.754281 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.754426 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.754572 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.754718 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.754871 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.755027 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.755173 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.755321 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.755554 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.755713 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.755879 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.756027 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.756186 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.756336 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.756488 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.756635 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.756793 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.756947 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.757101 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.757254 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.757409 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.757555 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.757746 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.757940 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.758089 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.758236 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.758383 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.758541 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.758697 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.758854 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.759001 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.759147 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.759293 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.759447 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.759603 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.759760 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.759906 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.760053 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.760198 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.760352 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.760500 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.760647 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.760792 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.760938 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.761083 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.761239 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.761391 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.761539 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.761743 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.761892 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.762055 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.762215 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.762363 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.762509 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.762656 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.762803 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.762955 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.763120 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.763275 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.763422 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.763567 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.763725 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.763879 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.764035 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.764181 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.764327 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.764472 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.764617 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.764773 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.764919 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.765065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.765211 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.765356 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.765502 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.765738 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.765850 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.765850 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.766016 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.766098 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.766184 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.766184 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.766341 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.766421 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.766580 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.766665 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.766753 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.766847 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.766928 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.766928 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.767080 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.767160 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.767247 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.767367 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.767450 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.767553 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.767633 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.767700 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.767775 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.767850 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.767918 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.767983 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.768049 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.768236 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.768410 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.768530 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.768693 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.768843 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.768991 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.769147 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.769304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.769452 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.769651 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.769820 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.769970 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.770131 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.770288 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.770443 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.770598 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.770755 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.770903 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.771060 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.771208 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.771368 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.771515 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.771663 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.771820 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.771980 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.772137 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.772294 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.772448 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.772596 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.772752 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.772912 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.773070 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.773225 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.773373 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.773553 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.773743 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.773743 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.774037 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.774184 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.774330 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.774476 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.774631 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.774778 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.774931 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.775086 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.775234 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.775234 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.775519 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.775667 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.775909 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.776066 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.776216 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.776376 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.776531 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.776685 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.776832 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.776978 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.777125 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.777290 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.777462 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.777683 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.777847 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.778006 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.778153 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.778314 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.778468 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.778616 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.778763 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.778917 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.779064 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.779227 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.779386 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.779541 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.779688 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.779856 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.780004 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.780163 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.780311 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.780465 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.780612 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.780759 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.780913 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.781060 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.781213 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.781367 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.781514 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.781955 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.782130 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.782286 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.782434 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.782582 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.782728 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.782728 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.783015 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.783163 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.783309 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.783309 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.783587 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.783746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.783903 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.784113 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.784272 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.784420 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.784567 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.784722 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.784869 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.785022 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.785168 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.785321 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.785468 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.785648 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.785800 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.786042 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.786203 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.786350 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.786497 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.786653 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.786802 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.786947 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.787094 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.787240 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.787393 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.787548 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.787695 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.787842 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.788000 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.788146 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.788306 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.788454 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.788607 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.788755 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.788901 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.789552 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.789756 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.789908 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.790055 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.790210 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.790357 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.790526 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.790683 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.790832 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.790979 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.791125 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.791279 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.791435 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.791582 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.791728 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.791874 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.792021 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.792167 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.792336 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.792486 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.792639 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.792786 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.792931 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.793085 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.793240 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.793387 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.793532 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.793731 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.793881 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.794038 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.794283 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.794452 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.794608 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.794704 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.794788 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.794869 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.794949 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.795040 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.795131 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.795214 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.795294 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.795374 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.795460 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.795542 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.795641 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.795759 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.795901 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.796083 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.796218 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.796397 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.796527 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.796720 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.796845 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.797136 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.797254 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.797461 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.797573 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.797799 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.797954 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.798120 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.798223 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.798447 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.798538 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.798751 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.798857 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.799059 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.799233 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.799384 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.799532 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.799697 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.799843 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.799989 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.800145 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.800294 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.800447 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.800596 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.800749 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.800897 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.801052 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.801207 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.801356 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.801503 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.801713 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.801866 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.802025 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.802188 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.802340 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.802496 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.802645 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.802802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.802949 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.803103 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.803251 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.803398 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.803544 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.803710 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.803866 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.804020 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.804167 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.804314 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.804459 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.804615 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.805312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.805465 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.805631 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.805631 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.805918 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.806080 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.806181 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.806255 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.806332 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.806520 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.806623 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.806847 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.806950 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.807139 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.807229 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.807465 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.807631 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.807793 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.807895 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.808099 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.808184 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.808424 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.808518 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.808749 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.808921 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.809077 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.809225 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.809380 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.809536 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.809724 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.809874 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.810036 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.810183 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.810342 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.810524 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.810686 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.810836 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.810982 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.811128 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.811283 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.811430 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.811576 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.811730 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.811879 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.812036 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.812196 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.812353 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.812500 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.812646 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.812800 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.812947 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.813103 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.813257 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.813412 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.813559 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.813730 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.813910 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.814061 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.814214 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.814362 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.814508 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.814655 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.814814 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.814962 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.815110 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.815257 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.815461 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.815613 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.815769 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.815927 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.816075 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.816222 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.816464 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.816618 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.816774 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.816923 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.817071 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.817218 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.817364 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.817520 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.817689 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.817841 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.818008 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.818201 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.818290 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.818379 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.818460 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.818538 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.818616 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.818694 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.818772 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.818874 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.818956 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.819035 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.819201 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.819340 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.819509 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.819860 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.820046 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.820185 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.820406 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.820520 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.820727 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.820815 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.821288 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.821386 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.821466 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.821543 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.821689 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.821786 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.822008 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.822102 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.822321 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.822407 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.822627 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.822714 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.822934 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.823020 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.823242 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.823343 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.823564 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.823650 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.823882 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.823974 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.824208 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.824302 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.824521 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.824616 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.824833 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.824919 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.825145 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.825238 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.825450 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.825536 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.825801 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.825889 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.826162 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.826270 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.826476 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.826610 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.826783 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.826879 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.827097 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.827183 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.827411 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.827496 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.827726 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.827829 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.828031 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.828118 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.828341 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.828446 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.828645 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.828739 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.828953 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.829046 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.829258 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.829518 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.829734 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.829904 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.829904 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.830189 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.830189 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.830477 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.830634 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.830797 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.830797 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.831101 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.831263 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.831410 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.831566 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.831750 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.831909 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.832056 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.832056 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.832335 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.832491 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.832638 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.832793 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.832948 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.833115 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.833271 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.833426 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.833574 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.833742 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.833904 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.834064 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.834221 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.834375 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.834530 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.834685 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.834833 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.834981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.835150 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.835298 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.835445 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.835591 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.835746 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.835922 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.836156 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.836306 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.836454 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.836616 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.836835 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.837002 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.837173 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.837339 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.837495 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.837672 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.837837 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.837837 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.838138 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.838138 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.838418 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.838566 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.838711 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.838868 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.839016 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.839174 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.839328 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.839523 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.839742 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.839903 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.840052 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.840207 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.840354 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.840511 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.840669 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.840833 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.840983 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.841130 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.841296 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.841444 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.841617 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.841782 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.841932 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.842079 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.842225 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.842373 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.842533 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.842681 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.842843 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.842992 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.843138 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.843297 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.843454 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.843604 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.843750 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.843905 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.844052 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.844211 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.844368 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.844528 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.844676 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.844824 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.844970 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.845136 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.845284 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.845432 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.845579 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.845752 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.845900 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.846059 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.846208 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.846364 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.846525 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.846681 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.846855 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.847086 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.847250 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.847399 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.847547 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.847693 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.847849 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.847997 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.848151 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.848298 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.848445 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.848602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.848758 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.848905 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.849052 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.849209 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.849356 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.849503 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.849681 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.849913 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.850066 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.850220 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.850368 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.850515 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.850676 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.850834 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.850982 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.851135 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.851294 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.851451 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.852118 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.852269 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.852417 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.852571 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.852721 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.852880 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.853036 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.853196 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.853345 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.853494 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.853703 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.853871 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.854029 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.854185 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.854185 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.854481 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.854629 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.854786 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.854935 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.855082 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.855229 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.855376 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.855531 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.855689 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.855836 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.855993 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.856140 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.856287 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.856443 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.856590 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.856737 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.856884 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.857031 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.857264 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.857426 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.857586 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.857774 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.857924 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.857924 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.858214 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.858362 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.858516 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.858663 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.858817 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.858964 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.859120 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.859268 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.859414 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.859582 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.859730 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.859899 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.860130 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.860285 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.860434 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.860580 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.860727 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.860882 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.861030 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.861185 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.861351 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.861516 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.861696 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.861859 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.862009 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.862157 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.862310 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.862465 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.862613 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.862772 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.862930 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.863078 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.863225 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.863371 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.863529 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.863688 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.863843 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.863990 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.864139 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.864292 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.864449 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.864596 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.864743 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.864743 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.865020 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.865167 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.865400 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.865550 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.865711 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.865801 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.865896 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.865987 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.866077 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.866158 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.866275 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.866373 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.866460 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.866550 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.866630 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.866708 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.866785 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.866945 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.867033 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.867795 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.867893 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.868129 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.868262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.868436 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.868525 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.868742 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.868832 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.869048 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.869135 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.869353 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.869448 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.869688 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.869860 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.870010 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.870239 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.870393 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.870555 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.870704 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.870859 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.871017 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.871164 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.871311 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.871471 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.871621 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.871776 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.871924 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.872071 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.872226 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.872374 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.872521 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.872675 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.872824 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.872987 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.873158 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.873315 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.873315 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.873628 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.873785 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.873943 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.874101 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.874248 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.874407 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.874556 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.874703 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.874850 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.875017 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.875166 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.875313 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.875459 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.875606 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.875761 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.875910 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.876057 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.876211 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.876359 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.876564 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.876725 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.876882 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.877041 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.877187 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.877334 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.877638 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.877814 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.877966 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.878113 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.878260 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.878408 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.878555 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.878711 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.878888 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.879039 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.879205 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.879354 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.879516 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.879665 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.879819 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.879975 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.880131 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.880364 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.880531 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.880680 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.880827 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.880974 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.881132 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.881279 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.881434 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.881582 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.881803 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.881952 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.882101 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.882255 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.882413 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.882561 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.882707 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.882893 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.883050 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.883223 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.883371 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.883524 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.883678 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.883826 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.883973 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.884129 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.884278 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.884425 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.884572 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.884726 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.884880 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.885050 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.885199 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.885347 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.885500 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.885669 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.885834 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.885982 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.886179 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.886338 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.886485 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.886632 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.886792 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.886963 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.887193 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.887347 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.887501 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.887734 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.887904 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.888056 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.888203 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.888357 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.888505 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.888665 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.888813 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.888959 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.889116 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.889263 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.889409 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.889565 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.889738 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.889897 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.890045 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.890191 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.890355 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.890583 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.890737 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.890884 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.891042 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.891190 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.891346 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.891494 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.891649 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.891797 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.891944 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.892098 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.892098 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105463) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 21:46:29.892392 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.892392 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:46:29.892392 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 21:46:30.052245 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO dbcounter [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Registered counter for database nova_api Aug 18 21:46:30.053376 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO dbcounter [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Registered counter for database nova_api Aug 18 21:46:30.074968 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG oslo_db.sqlalchemy.engines [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:46:30.076698 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_db.sqlalchemy.engines [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:46:30.081730 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writer thread running {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:46:30.083328 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writer thread running {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:46:30.138458 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.context [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ef789987-a8d4-40c7-ba3b-98c8afa02e62(cell1) {{(pid=105463) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 21:46:30.138736 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.context [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ef789987-a8d4-40c7-ba3b-98c8afa02e62(cell1) {{(pid=105462) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 21:46:30.142236 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:46:30.142427 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:46:30.142717 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:46:30.142901 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:46:30.144257 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:46:30.144504 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:46:30.144978 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:46:30.145232 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:46:30.145418 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:46:30.145708 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:46:30.147402 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:46:30.147686 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG oslo_concurrency.lockutils [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105462) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:46:30.149432 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO dbcounter [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Registered counter for database nova_cell0 Aug 18 21:46:30.149720 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO dbcounter [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Registered counter for database nova_cell0 Aug 18 21:46:30.155035 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO dbcounter [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Registered counter for database nova_cell1 Aug 18 21:46:30.155400 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO dbcounter [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Registered counter for database nova_cell1 Aug 18 21:46:30.162482 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_db.sqlalchemy.engines [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:46:30.164778 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_db.sqlalchemy.engines [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:46:30.165878 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG oslo_db.sqlalchemy.engines [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:46:30.168944 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG oslo_db.sqlalchemy.engines [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:46:30.169487 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writer thread running {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:46:30.174039 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writer thread running {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:46:30.175045 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writer thread running {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:46:30.177220 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writer thread running {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:46:30.322350 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO dbcounter [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Registered counter for database nova_cell0 Aug 18 21:46:30.324344 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO dbcounter [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Registered counter for database nova_cell0 Aug 18 21:46:30.331590 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_db.sqlalchemy.engines [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105463) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:46:30.333075 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG oslo_db.sqlalchemy.engines [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:46:30.336280 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writer thread running {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:46:30.337368 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writer thread running {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:46:30.677073 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: WARNING keystonemiddleware.auth_token [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 21:46:30.677761 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: WARNING keystonemiddleware.auth_token [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 21:46:30.684957 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: WARNING keystonemiddleware.auth_token [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 21:46:30.685499 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: WARNING keystonemiddleware.auth_token [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 21:46:31.030068 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: WARNING keystonemiddleware.auth_token [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 21:46:31.030344 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: WARNING keystonemiddleware.auth_token [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 21:46:31.036280 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: WARNING keystonemiddleware.auth_token [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 21:46:31.036660 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: WARNING keystonemiddleware.auth_token [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 21:46:31.042115 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b8906ac9c0 pid: 105462 (default app) Aug 18 21:46:31.042668 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b8906ac9c0 pid: 105463 (default app) Aug 18 21:46:31.044225 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:46:31.045403 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-b7bb183b-6867-44a4-944a-138a6f6ab6ad None None] 10.222.0.82 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001746 Aug 18 21:46:31.045846 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 1/1] 10.222.0.82 () {50 vars in 788 bytes} [Thu Aug 18 21:46:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:47:49.081523 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:47:49.082889 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002205 Aug 18 21:47:49.083392 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 1/2] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:47:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:47:49.095465 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_api:SELECT=3 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:47:49.096323 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_cell0:SELECT=3 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:47:49.097365 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_cell1:SELECT=3 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:47:49.098430 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:47:49.967414 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-946635d3-0f33-457c-a19d-c7ab5f28a6ce admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:47:50.000677 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-946635d3-0f33-457c-a19d-c7ab5f28a6ce admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910527 Aug 18 21:47:50.001709 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 2/3] 10.222.0.82 () {60 vars in 1292 bytes} [Thu Aug 18 21:47:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:47:52.409302 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:47:52.409936 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-8235a58b-960b-4e84-b3ab-b330d652d7c8 None None] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001658 Aug 18 21:47:52.410432 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 2/4] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:47:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:47:52.856853 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-e912d12a-51f2-4e8f-9203-1ee2d0e2907e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "name": "cirros256"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:47:52.878085 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:47:52.878085 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: warnings.warn(msg) Aug 18 21:47:52.908180 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-e912d12a-51f2-4e8f-9203-1ee2d0e2907e admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.488685 Aug 18 21:47:52.908759 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 3/5] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 21:47:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:47:52.922839 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_api:SELECT=3 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:47:52.923662 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_cell0:SELECT=3 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:47:52.925091 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_cell1:SELECT=3 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:47:52.926137 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:47:53.141837 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-59611571-5fa9-4bd9-ba2f-8284eaf0ed1e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:47:53.145945 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:47:53.145945 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: warnings.warn(msg) Aug 18 21:47:53.207162 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-59611571-5fa9-4bd9-ba2f-8284eaf0ed1e admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289504 Aug 18 21:47:53.207765 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 3/6] 10.222.0.82 () {64 vars in 1336 bytes} [Thu Aug 18 21:47:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:47:55.572527 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-e912d12a-51f2-4e8f-9203-1ee2d0e2907e admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:47:55.573544 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-e912d12a-51f2-4e8f-9203-1ee2d0e2907e admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 18 21:47:55.573986 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 4/7] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:47:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:47:56.253752 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-23f68212-c320-4369-86f2-138c71358c2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "ram": 512, "vcpus": 1}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:47:56.272880 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:47:56.272880 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: warnings.warn(msg) Aug 18 21:47:56.295012 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-23f68212-c320-4369-86f2-138c71358c2e admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.714752 Aug 18 21:47:56.295662 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 4/8] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 21:47:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:47:56.308044 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-c206ac2a-aa26-4930-a4b3-9d365644b790 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:47:56.311249 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:47:56.311249 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: warnings.warn(msg) Aug 18 21:47:56.344909 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-c206ac2a-aa26-4930-a4b3-9d365644b790 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041067 Aug 18 21:47:56.345637 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 5/9] 10.222.0.82 () {64 vars in 1336 bytes} [Thu Aug 18 21:47:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:47:58.740018 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-23f68212-c320-4369-86f2-138c71358c2e admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:47:58.741078 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-23f68212-c320-4369-86f2-138c71358c2e admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 18 21:47:58.741469 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 5/10] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:47:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:47:59.147879 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-1f39fd02-06f0-4926-a958-eb9cb370f1df admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "disk": 10, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:47:59.167122 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-1f39fd02-06f0-4926-a958-eb9cb370f1df admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419609 Aug 18 21:47:59.167682 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 6/11] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 21:47:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:47:59.179515 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-8bb50967-378f-497d-ad79-957119153aed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:47:59.203212 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-8bb50967-378f-497d-ad79-957119153aed admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027345 Aug 18 21:47:59.203779 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 6/12] 10.222.0.82 () {64 vars in 1336 bytes} [Thu Aug 18 21:47:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:48:01.569481 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-1f39fd02-06f0-4926-a958-eb9cb370f1df admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:01.570540 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-1f39fd02-06f0-4926-a958-eb9cb370f1df admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 18 21:48:01.570941 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 7/13] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:48:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:02.036233 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-7784a5d1-9f92-450b-8684-fb209fe33193 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:02.057462 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-7784a5d1-9f92-450b-8684-fb209fe33193 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479760 Aug 18 21:48:02.065530 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 7/14] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 21:48:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:48:02.070725 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-526d3e94-b225-4b1d-b896-623dd4f864f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:02.096962 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-526d3e94-b225-4b1d-b896-623dd4f864f2 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030318 Aug 18 21:48:02.097553 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 8/15] 10.222.0.82 () {64 vars in 1336 bytes} [Thu Aug 18 21:48:02 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:48:04.474361 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-7784a5d1-9f92-450b-8684-fb209fe33193 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:04.475912 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-7784a5d1-9f92-450b-8684-fb209fe33193 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 18 21:48:04.476326 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 8/16] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:48:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:04.925567 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-d089a7be-819b-4e76-8601-9594791085cb admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G", "ram": 4096, "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d4"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:04.945205 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-d089a7be-819b-4e76-8601-9594791085cb admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462463 Aug 18 21:48:04.951841 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 9/17] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 21:48:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 21:48:04.958114 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-5ca3592e-002e-4be2-accb-61e5a0079732 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:04.985491 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-5ca3592e-002e-4be2-accb-61e5a0079732 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031158 Aug 18 21:48:04.988101 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 9/18] 10.222.0.82 () {64 vars in 1336 bytes} [Thu Aug 18 21:48:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:48:07.403104 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-d089a7be-819b-4e76-8601-9594791085cb admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:07.404120 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-d089a7be-819b-4e76-8601-9594791085cb admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 18 21:48:07.404531 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 10/19] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:48:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:07.833685 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-1059254c-dd7c-4a10-8857-6695e15f18ae admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:07.858049 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-1059254c-dd7c-4a10-8857-6695e15f18ae admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.445937 Aug 18 21:48:07.858588 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 10/20] 10.222.0.82 () {60 vars in 1292 bytes} [Thu Aug 18 21:48:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:48:10.717056 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-d089a7be-819b-4e76-8601-9594791085cb admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:10.718192 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-d089a7be-819b-4e76-8601-9594791085cb admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Aug 18 21:48:10.718616 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 11/21] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:48:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:11.160747 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-21b7c4ed-dfd1-4da9-b47f-ada39892d671 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "vcpus": 1}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:11.181967 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-21b7c4ed-dfd1-4da9-b47f-ada39892d671 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.456699 Aug 18 21:48:11.182615 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 11/22] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 21:48:10 2022] POST /compute/v2.1/flavors => generated 402 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 21:48:11.198532 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-9c3d985a-adef-430b-8626-3d5fed6e379d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:11.235097 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-9c3d985a-adef-430b-8626-3d5fed6e379d admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043084 Aug 18 21:48:11.236072 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 12/23] 10.222.0.82 () {64 vars in 1333 bytes} [Thu Aug 18 21:48:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:48:13.563385 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-21b7c4ed-dfd1-4da9-b47f-ada39892d671 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:13.564401 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-21b7c4ed-dfd1-4da9-b47f-ada39892d671 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 18 21:48:13.564800 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 12/24] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:48:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:13.938429 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-71b4aebc-c8db-424d-b59b-2fc9967c2920 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:13.958092 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-71b4aebc-c8db-424d-b59b-2fc9967c2920 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.386667 Aug 18 21:48:13.958684 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 13/25] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 21:48:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:48:13.970932 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-edf1362f-e6e2-46ce-a4bf-3ae549da9cf4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:13.996378 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-edf1362f-e6e2-46ce-a4bf-3ae549da9cf4 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029184 Aug 18 21:48:13.997223 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 13/26] 10.222.0.82 () {64 vars in 1333 bytes} [Thu Aug 18 21:48:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:48:16.354288 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-71b4aebc-c8db-424d-b59b-2fc9967c2920 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:16.355215 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-71b4aebc-c8db-424d-b59b-2fc9967c2920 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 18 21:48:16.355617 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 14/27] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:48:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:16.810828 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-8eff35e9-e28d-4654-a179-df4d54d7af4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "id": "3", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:16.835918 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-8eff35e9-e28d-4654-a179-df4d54d7af4c admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.474055 Aug 18 21:48:16.836579 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 14/28] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 21:48:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:48:16.848653 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-369e134c-24c1-4dbd-b645-fb3ed4b4f43d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:16.875017 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-369e134c-24c1-4dbd-b645-fb3ed4b4f43d admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029962 Aug 18 21:48:16.875601 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 15/29] 10.222.0.82 () {64 vars in 1333 bytes} [Thu Aug 18 21:48:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:48:19.295786 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-8eff35e9-e28d-4654-a179-df4d54d7af4c admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:19.296782 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-8eff35e9-e28d-4654-a179-df4d54d7af4c admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Aug 18 21:48:19.297182 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 15/30] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:48:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:48:19.812940 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-c780702e-bbab-4b74-abef-6f6dfe8ff99c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 80, "name": "m1.large"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:19.819742 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:48:19.839291 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-c780702e-bbab-4b74-abef-6f6dfe8ff99c admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.533949 Aug 18 21:48:19.841686 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 16/31] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 21:48:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:48:19.852655 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-a4c777dc-a294-4f18-8d2b-6ad3d77111c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:19.886708 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-a4c777dc-a294-4f18-8d2b-6ad3d77111c1 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038532 Aug 18 21:48:19.902930 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 16/32] 10.222.0.82 () {64 vars in 1333 bytes} [Thu Aug 18 21:48:19 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:48:22.254930 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-c780702e-bbab-4b74-abef-6f6dfe8ff99c admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:22.255856 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-c780702e-bbab-4b74-abef-6f6dfe8ff99c admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 18 21:48:22.256833 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 17/33] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:48:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:22.758330 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-a7f2cc64-04cc-461e-8415-79e06403838c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "id": "5", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:22.777928 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-a7f2cc64-04cc-461e-8415-79e06403838c admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.514938 Aug 18 21:48:22.778487 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 17/34] 10.222.0.82 () {64 vars in 1283 bytes} [Thu Aug 18 21:48:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:48:22.793169 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-23448075-1628-41ed-8d96-5ee4013ad1ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:22.825134 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-23448075-1628-41ed-8d96-5ee4013ad1ab admin admin] 10.222.0.82 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037868 Aug 18 21:48:22.826016 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 18/35] 10.222.0.82 () {64 vars in 1333 bytes} [Thu Aug 18 21:48:22 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:48:40.924011 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-a7f2cc64-04cc-461e-8415-79e06403838c admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:40.924940 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-a7f2cc64-04cc-461e-8415-79e06403838c admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 18 21:48:40.925339 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 18/36] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:48:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:40.935924 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:48:41.327121 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-7680e269-7ee2-4e7d-b773-88cbc9dda55e admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:41.346094 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-7680e269-7ee2-4e7d-b773-88cbc9dda55e admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.414572 Aug 18 21:48:41.346635 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 19/37] 10.222.0.82 () {60 vars in 1292 bytes} [Thu Aug 18 21:48:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:48:42.398121 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-a7f2cc64-04cc-461e-8415-79e06403838c admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:42.399158 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-a7f2cc64-04cc-461e-8415-79e06403838c admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 18 21:48:42.399587 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 19/38] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 21:48:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:42.921967 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-098f1cf4-24fd-43aa-914e-316f911fcd11 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:42.927536 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.wsgi [None req-098f1cf4-24fd-43aa-914e-316f911fcd11 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-098f1cf4-24fd-43aa-914e-316f911fcd11 admin admin] Request method failure captured: Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Accept: application/json Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Accept-Encoding: gzip, deflate Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Connection: keep-alive Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Content-Length: 0 Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Host: 10.222.0.82 Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Openstack-Api-Version: compute 2.90 Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Openstack-System-Scope: None Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: User-Agent: python-novaclient Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Auth-Token: gAAAAABi_rO6WaBgLld0Vdzka9cqgw2UyesGM0iw0u3NYLLQe3pHrZ3RWIDu_rcs10wEU9j4_03vET-vDzet6cXdFGy42dMDFxrgAVbOWKV6UMTUkYsf05bsz0BXHQphjY7Q8vS8R31zlOxeVvwgGUM20A1mjAJAiUt5VaPTFCijcE6pLsD8IkU Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Domain-Id: None Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Domain-Name: None Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Identity-Status: Confirmed Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Is-Admin-Project: True Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Project-Domain-Id: default Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Project-Domain-Name: Default Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Project-Id: 940373c3ec634186892a510e45b0afa3 Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Project-Name: admin Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Role: admin,member,reader Aug 18 21:48:42.930862 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Roles: admin,member,reader Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_940373c3ec634186892a510e45b0afa3", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/940373c3ec634186892a510e45b0afa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/940373c3ec634186892a510e45b0afa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/940373c3ec634186892a510e45b0afa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Tenant: admin Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Tenant-Id: 940373c3ec634186892a510e45b0afa3 Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Tenant-Name: admin Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User: admin Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User-Domain-Id: default Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User-Domain-Name: Default Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User-Id: 29b6162ed5d14f26ae87d2e2d8c81d1b Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User-Name: admin Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: method: > Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: exception: Flavor 42 could not be found. Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: action_args: {'id': '42'} Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:48:42.932493 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:48:42.933565 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:42.935065 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-098f1cf4-24fd-43aa-914e-316f911fcd11 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:48:42.936340 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-098f1cf4-24fd-43aa-914e-316f911fcd11 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393922 Aug 18 21:48:42.936340 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 20/39] 10.222.0.82 () {60 vars in 1190 bytes} [Thu Aug 18 21:48:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 21:48:42.942003 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-ada5ca26-c4df-42f3-9c59-a47871e41905 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:42.946197 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:48:42.967872 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-ada5ca26-c4df-42f3-9c59-a47871e41905 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029316 Aug 18 21:48:42.968449 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 20/40] 10.222.0.82 () {60 vars in 1210 bytes} [Thu Aug 18 21:48:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:48:42.978998 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-d31f3b95-32c2-4d7b-89f6-b13441c1f1df admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:43.006356 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-d31f3b95-32c2-4d7b-89f6-b13441c1f1df admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031543 Aug 18 21:48:43.006920 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 21/41] 10.222.0.82 () {60 vars in 1210 bytes} [Thu Aug 18 21:48:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:48:43.016521 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-00c61205-bc2f-4efb-9b25-0ae01e2c3c03 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:43.023530 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.wsgi [None req-00c61205-bc2f-4efb-9b25-0ae01e2c3c03 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-00c61205-bc2f-4efb-9b25-0ae01e2c3c03 admin admin] Request method failure captured: Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Accept: application/json Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Accept-Encoding: gzip, deflate Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Connection: keep-alive Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Content-Length: 0 Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Host: 10.222.0.82 Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Openstack-Api-Version: compute 2.90 Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Openstack-System-Scope: None Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: User-Agent: python-novaclient Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Auth-Token: gAAAAABi_rO6WaBgLld0Vdzka9cqgw2UyesGM0iw0u3NYLLQe3pHrZ3RWIDu_rcs10wEU9j4_03vET-vDzet6cXdFGy42dMDFxrgAVbOWKV6UMTUkYsf05bsz0BXHQphjY7Q8vS8R31zlOxeVvwgGUM20A1mjAJAiUt5VaPTFCijcE6pLsD8IkU Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Domain-Id: None Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Domain-Name: None Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Identity-Status: Confirmed Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Is-Admin-Project: True Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Project-Domain-Id: default Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Project-Domain-Name: Default Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Project-Id: 940373c3ec634186892a510e45b0afa3 Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Project-Name: admin Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Role: admin,member,reader Aug 18 21:48:43.026796 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Roles: admin,member,reader Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_940373c3ec634186892a510e45b0afa3", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/940373c3ec634186892a510e45b0afa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/940373c3ec634186892a510e45b0afa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/940373c3ec634186892a510e45b0afa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Tenant: admin Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Tenant-Id: 940373c3ec634186892a510e45b0afa3 Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Tenant-Name: admin Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User: admin Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User-Domain-Id: default Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User-Domain-Name: Default Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User-Id: 29b6162ed5d14f26ae87d2e2d8c81d1b Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User-Name: admin Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: method: > Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: exception: Flavor 42 could not be found. Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: action_args: {'id': '42'} Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:48:43.028602 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:48:43.029746 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:43.031024 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-00c61205-bc2f-4efb-9b25-0ae01e2c3c03 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:48:43.032250 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-00c61205-bc2f-4efb-9b25-0ae01e2c3c03 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015341 Aug 18 21:48:43.032250 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 21/42] 10.222.0.82 () {60 vars in 1190 bytes} [Thu Aug 18 21:48:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 18 21:48:44.000237 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-d31f3b95-32c2-4d7b-89f6-b13441c1f1df admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:44.001242 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-d31f3b95-32c2-4d7b-89f6-b13441c1f1df admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 18 21:48:44.001656 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 22/43] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 21:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:44.643741 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-cbddaeea-815e-4e6f-a663-66c9cd5c7c0f admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:44.649577 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.wsgi [None req-cbddaeea-815e-4e6f-a663-66c9cd5c7c0f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-cbddaeea-815e-4e6f-a663-66c9cd5c7c0f admin admin] Request method failure captured: Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Accept: application/json Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Accept-Encoding: gzip, deflate Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Connection: keep-alive Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Content-Length: 0 Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Host: 10.222.0.82 Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Openstack-Api-Version: compute 2.90 Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Openstack-System-Scope: None Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: User-Agent: python-novaclient Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Auth-Token: gAAAAABi_rO765aI3iQf9_7Jnjd7q6TFxckrVTPuYK_Q2bFXe2X0oN2ShHrtT_Jw4Y-3k2bXad75WDN13Oe97g9R_FZPl1twk58SoKiB1rUCMu8NUW7nkNd4ZFJQp328Bsv9w8-3-Hd5mVauZ0WAjErlI0HPr6DWgg9D0CsIIZp0FUIImvWxKnY Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Domain-Id: None Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Domain-Name: None Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Identity-Status: Confirmed Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Is-Admin-Project: True Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Project-Domain-Id: default Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Project-Domain-Name: Default Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Project-Id: 940373c3ec634186892a510e45b0afa3 Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Project-Name: admin Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Role: admin,member,reader Aug 18 21:48:44.651097 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Roles: admin,member,reader Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_940373c3ec634186892a510e45b0afa3", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/940373c3ec634186892a510e45b0afa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/940373c3ec634186892a510e45b0afa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/940373c3ec634186892a510e45b0afa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Tenant: admin Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Tenant-Id: 940373c3ec634186892a510e45b0afa3 Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Tenant-Name: admin Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User: admin Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User-Domain-Id: default Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User-Domain-Name: Default Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User-Id: 29b6162ed5d14f26ae87d2e2d8c81d1b Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User-Name: admin Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: method: > Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: exception: Flavor 84 could not be found. Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: action_args: {'id': '84'} Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:48:44.652630 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:48:44.653542 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:44.654855 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-cbddaeea-815e-4e6f-a663-66c9cd5c7c0f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:48:44.656069 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-cbddaeea-815e-4e6f-a663-66c9cd5c7c0f admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.512065 Aug 18 21:48:44.656069 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 22/44] 10.222.0.82 () {60 vars in 1190 bytes} [Thu Aug 18 21:48:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 513 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 21:48:44.663143 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-985e8753-07fb-42b8-b8e5-482d69a4de15 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:44.677971 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-985e8753-07fb-42b8-b8e5-482d69a4de15 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019165 Aug 18 21:48:44.678700 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 23/45] 10.222.0.82 () {60 vars in 1210 bytes} [Thu Aug 18 21:48:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:48:44.687747 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-b71f5b9a-8413-471d-99cb-69fca56c5794 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:44.702721 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-b71f5b9a-8413-471d-99cb-69fca56c5794 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018399 Aug 18 21:48:44.703255 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 23/46] 10.222.0.82 () {60 vars in 1210 bytes} [Thu Aug 18 21:48:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:48:44.713123 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-1653599c-277d-48ae-b55a-6d1c0b3a76f3 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:44.718729 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.wsgi [None req-1653599c-277d-48ae-b55a-6d1c0b3a76f3 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-1653599c-277d-48ae-b55a-6d1c0b3a76f3 admin admin] Request method failure captured: Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Accept: application/json Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Accept-Encoding: gzip, deflate Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Connection: keep-alive Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Content-Length: 0 Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Host: 10.222.0.82 Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Openstack-Api-Version: compute 2.90 Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Openstack-System-Scope: None Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: User-Agent: python-novaclient Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Auth-Token: gAAAAABi_rO765aI3iQf9_7Jnjd7q6TFxckrVTPuYK_Q2bFXe2X0oN2ShHrtT_Jw4Y-3k2bXad75WDN13Oe97g9R_FZPl1twk58SoKiB1rUCMu8NUW7nkNd4ZFJQp328Bsv9w8-3-Hd5mVauZ0WAjErlI0HPr6DWgg9D0CsIIZp0FUIImvWxKnY Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Domain-Id: None Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Domain-Name: None Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Identity-Status: Confirmed Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Is-Admin-Project: True Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Project-Domain-Id: default Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Project-Domain-Name: Default Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Project-Id: 940373c3ec634186892a510e45b0afa3 Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Project-Name: admin Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Role: admin,member,reader Aug 18 21:48:44.720262 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Roles: admin,member,reader Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_940373c3ec634186892a510e45b0afa3", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/940373c3ec634186892a510e45b0afa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/940373c3ec634186892a510e45b0afa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/940373c3ec634186892a510e45b0afa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Tenant: admin Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Tenant-Id: 940373c3ec634186892a510e45b0afa3 Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Tenant-Name: admin Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User: admin Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User-Domain-Id: default Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User-Domain-Name: Default Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User-Id: 29b6162ed5d14f26ae87d2e2d8c81d1b Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User-Name: admin Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: method: > Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: exception: Flavor 84 could not be found. Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: action_args: {'id': '84'} Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:48:44.721791 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:48:44.722661 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:44.723860 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-1653599c-277d-48ae-b55a-6d1c0b3a76f3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:48:44.724979 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-1653599c-277d-48ae-b55a-6d1c0b3a76f3 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012631 Aug 18 21:48:44.724979 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 24/47] 10.222.0.82 () {60 vars in 1190 bytes} [Thu Aug 18 21:48:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 21:48:45.689414 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-b71f5b9a-8413-471d-99cb-69fca56c5794 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:45.690492 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-b71f5b9a-8413-471d-99cb-69fca56c5794 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Aug 18 21:48:45.690888 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 24/48] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 21:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:46.208022 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-78e8c677-7409-4e21-9ebc-cb9228b8077d admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:46.213829 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.wsgi [None req-78e8c677-7409-4e21-9ebc-cb9228b8077d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-78e8c677-7409-4e21-9ebc-cb9228b8077d admin admin] Request method failure captured: Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Accept: application/json Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Accept-Encoding: gzip, deflate Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Connection: keep-alive Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Content-Length: 0 Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Host: 10.222.0.82 Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Openstack-Api-Version: compute 2.90 Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Openstack-System-Scope: None Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: User-Agent: python-novaclient Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Auth-Token: gAAAAABi_rO9jQZi-y7G9-mpxGaWtXPbmykT8AnxKw4Gfvwu7LDvDee9JZpawcOi4Ekx4CyuVvb0hJmAm8i15kG2u8wUzsOvJa9zTaCMT4cc_EyYYvGtO5PWYLdupobO_Y08EfKil43VjNbmCc1gPLlw-5oT7XnRCRw9AUPwL3rkIx-loolyLDE Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Domain-Id: None Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Domain-Name: None Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Identity-Status: Confirmed Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Is-Admin-Project: True Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Project-Domain-Id: default Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Project-Domain-Name: Default Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Project-Id: 940373c3ec634186892a510e45b0afa3 Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Project-Name: admin Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Role: admin,member,reader Aug 18 21:48:46.215312 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Roles: admin,member,reader Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_940373c3ec634186892a510e45b0afa3", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/940373c3ec634186892a510e45b0afa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/940373c3ec634186892a510e45b0afa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/940373c3ec634186892a510e45b0afa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Tenant: admin Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Tenant-Id: 940373c3ec634186892a510e45b0afa3 Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-Tenant-Name: admin Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User: admin Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User-Domain-Id: default Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User-Domain-Name: Default Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User-Id: 29b6162ed5d14f26ae87d2e2d8c81d1b Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: X-User-Name: admin Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: method: > Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: exception: Flavor 451 could not be found. Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: action_args: {'id': '451'} Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:48:46.216972 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:48:46.217974 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: ERROR nova.api.openstack.wsgi Aug 18 21:48:46.219304 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-78e8c677-7409-4e21-9ebc-cb9228b8077d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105462) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:48:46.220530 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-78e8c677-7409-4e21-9ebc-cb9228b8077d admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389354 Aug 18 21:48:46.220530 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 25/49] 10.222.0.82 () {60 vars in 1193 bytes} [Thu Aug 18 21:48:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 21:48:46.227058 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-d7da025a-a557-49cf-bae7-bdb4c55af20b admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:46.242477 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-d7da025a-a557-49cf-bae7-bdb4c55af20b admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019685 Aug 18 21:48:46.243007 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 25/50] 10.222.0.82 () {60 vars in 1210 bytes} [Thu Aug 18 21:48:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:48:46.252508 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:46.267238 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018224 Aug 18 21:48:46.267755 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 26/51] 10.222.0.82 () {60 vars in 1210 bytes} [Thu Aug 18 21:48:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:48:46.276739 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-5dace134-1934-433a-b302-126f52536402 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:46.282175 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.wsgi [None req-5dace134-1934-433a-b302-126f52536402 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-5dace134-1934-433a-b302-126f52536402 admin admin] Request method failure captured: Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Accept: application/json Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Accept-Encoding: gzip, deflate Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Connection: keep-alive Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Content-Length: 0 Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Host: 10.222.0.82 Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Openstack-Api-Version: compute 2.90 Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Openstack-System-Scope: None Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: User-Agent: python-novaclient Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Auth-Token: gAAAAABi_rO9jQZi-y7G9-mpxGaWtXPbmykT8AnxKw4Gfvwu7LDvDee9JZpawcOi4Ekx4CyuVvb0hJmAm8i15kG2u8wUzsOvJa9zTaCMT4cc_EyYYvGtO5PWYLdupobO_Y08EfKil43VjNbmCc1gPLlw-5oT7XnRCRw9AUPwL3rkIx-loolyLDE Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Domain-Id: None Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Domain-Name: None Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Identity-Status: Confirmed Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Is-Admin-Project: True Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Project-Domain-Id: default Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Project-Domain-Name: Default Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Project-Id: 940373c3ec634186892a510e45b0afa3 Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Project-Name: admin Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Role: admin,member,reader Aug 18 21:48:46.284186 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Roles: admin,member,reader Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_940373c3ec634186892a510e45b0afa3", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/940373c3ec634186892a510e45b0afa3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/940373c3ec634186892a510e45b0afa3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/940373c3ec634186892a510e45b0afa3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Tenant: admin Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Tenant-Id: 940373c3ec634186892a510e45b0afa3 Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-Tenant-Name: admin Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User: admin Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User-Domain-Id: default Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User-Domain-Name: Default Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User-Id: 29b6162ed5d14f26ae87d2e2d8c81d1b Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: X-User-Name: admin Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: method: > Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: exception: Flavor 451 could not be found. Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: action_args: {'id': '451'} Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:48:46.285981 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:48:46.286802 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: ERROR nova.api.openstack.wsgi Aug 18 21:48:46.288536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-5dace134-1934-433a-b302-126f52536402 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105463) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:48:46.289566 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-5dace134-1934-433a-b302-126f52536402 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012304 Aug 18 21:48:46.289566 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 26/52] 10.222.0.82 () {60 vars in 1193 bytes} [Thu Aug 18 21:48:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 21:48:47.246667 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:47.247681 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 18 21:48:47.248083 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 27/53] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 21:48:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:47.769948 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-133b3174-eed1-4138-9255-f4ef2c7de52c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:47.789892 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-133b3174-eed1-4138-9255-f4ef2c7de52c admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.403111 Aug 18 21:48:47.790434 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 27/54] 10.222.0.82 () {64 vars in 1235 bytes} [Thu Aug 18 21:48:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:48:48.758420 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:48.759426 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 18 21:48:48.759826 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 28/55] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 21:48:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:48:49.286664 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-6c83c2a3-aed7-4f67-b5c5-3d4d735b77a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:49.306686 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-6c83c2a3-aed7-4f67-b5c5-3d4d735b77a0 admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.408714 Aug 18 21:48:49.307388 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 28/56] 10.222.0.82 () {64 vars in 1235 bytes} [Thu Aug 18 21:48:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 21:48:50.276646 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:50.277963 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 18 21:48:50.278118 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 29/57] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 21:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:50.800130 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-720ac6ca-b21b-467e-85dd-a3870d6128af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:50.819984 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-720ac6ca-b21b-467e-85dd-a3870d6128af admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.402977 Aug 18 21:48:50.820526 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 29/58] 10.222.0.82 () {64 vars in 1235 bytes} [Thu Aug 18 21:48:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:48:51.784448 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:51.785572 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001799 Aug 18 21:48:51.786097 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 30/59] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 21:48:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:52.336227 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-b0bd039c-baaa-4283-a688-5c142af0c9ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:48:52.356625 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-b0bd039c-baaa-4283-a688-5c142af0c9ba admin admin] 10.222.0.82 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.434512 Aug 18 21:48:52.357181 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 30/60] 10.222.0.82 () {64 vars in 1235 bytes} [Thu Aug 18 21:48:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:48:53.328576 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:53.329579 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 18 21:48:53.329995 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 31/61] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 21:48:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:48:53.850681 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-3243f071-fa35-4660-b296-38064083a56f admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:48:53.871656 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-3243f071-fa35-4660-b296-38064083a56f admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401336 Aug 18 21:48:53.872100 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 31/62] 10.222.0.82 () {60 vars in 1202 bytes} [Thu Aug 18 21:48:53 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:49:46.849524 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:49:46.850577 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-32e38528-7d74-40ec-9b40-9e4468068794 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 18 21:49:46.850976 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 32/63] 10.222.0.82 () {54 vars in 931 bytes} [Thu Aug 18 21:49:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:49:46.861517 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:49:47.241637 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-42b5cff5-f24c-4a50-844c-ab4c18ac2233 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:49:47.261576 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-42b5cff5-f24c-4a50-844c-ab4c18ac2233 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404499 Aug 18 21:49:47.262135 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 32/64] 10.222.0.82 () {60 vars in 1292 bytes} [Thu Aug 18 21:49:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:49:47.283511 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG dbcounter [-] [105462] Writing DB stats nova_api:SELECT=14 {{(pid=105462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:49:47.288053 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-1df0c12b-7907-4883-94b9-aca2b8962a24 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:49:47.296227 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-1df0c12b-7907-4883-94b9-aca2b8962a24 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014249 Aug 18 21:49:47.296750 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 33/65] 10.222.0.82 () {60 vars in 1283 bytes} [Thu Aug 18 21:49:47 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:49:47.309553 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-7525f348-d5a9-4472-84b1-c6c3c5308dc0 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:49:47.317213 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-7525f348-d5a9-4472-84b1-c6c3c5308dc0 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011383 Aug 18 21:49:47.317787 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 33/66] 10.222.0.82 () {60 vars in 1286 bytes} [Thu Aug 18 21:49:47 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:49:47.329295 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-6c56bca0-651d-48d5-a4d9-eac818cf6f03 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:49:47.337376 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-6c56bca0-651d-48d5-a4d9-eac818cf6f03 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011700 Aug 18 21:49:47.337927 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 34/67] 10.222.0.82 () {60 vars in 1286 bytes} [Thu Aug 18 21:49:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:49:47.350233 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-e5a245df-dec1-40bd-9a13-fd3df48c8eb7 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:49:47.357778 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-e5a245df-dec1-40bd-9a13-fd3df48c8eb7 admin admin] 10.222.0.82 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011793 Aug 18 21:49:47.358296 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 34/68] 10.222.0.82 () {60 vars in 1283 bytes} [Thu Aug 18 21:49:47 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:52:50.035235 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-6c56bca0-651d-48d5-a4d9-eac818cf6f03 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:52:50.036240 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-6c56bca0-651d-48d5-a4d9-eac818cf6f03 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 18 21:52:50.036632 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 35/69] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 21:52:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:52:50.175748 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_api:SELECT=6 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:52:50.332535 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-8d11f26e-9a9a-4fcc-ab65-d0ad0a6032d1 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:52:50.334914 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:52:50.334914 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: warnings.warn(msg) Aug 18 21:52:50.336062 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8d11f26e-9a9a-4fcc-ab65-d0ad0a6032d1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:52:50.336539 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8d11f26e-9a9a-4fcc-ab65-d0ad0a6032d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:52:50.336968 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8d11f26e-9a9a-4fcc-ab65-d0ad0a6032d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:52:50.337706 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8d11f26e-9a9a-4fcc-ab65-d0ad0a6032d1 admin admin] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:52:50.338153 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8d11f26e-9a9a-4fcc-ab65-d0ad0a6032d1 admin admin] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:52:50.338568 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8d11f26e-9a9a-4fcc-ab65-d0ad0a6032d1 admin admin] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:52:50.373527 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-8d11f26e-9a9a-4fcc-ab65-d0ad0a6032d1 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199125 Aug 18 21:52:50.374212 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 35/70] 10.222.0.82 () {60 vars in 1193 bytes} [Thu Aug 18 21:52:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:52:51.203272 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-6c56bca0-651d-48d5-a4d9-eac818cf6f03 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:52:51.204301 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-6c56bca0-651d-48d5-a4d9-eac818cf6f03 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 18 21:52:51.204690 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 36/71] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 21:52:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:52:51.399943 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-ed4aa515-26a0-4020-8ef8-9e2f646be583 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:52:51.402394 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:52:51.402394 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: warnings.warn(msg) Aug 18 21:52:51.403493 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-ed4aa515-26a0-4020-8ef8-9e2f646be583 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:52:51.403969 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-ed4aa515-26a0-4020-8ef8-9e2f646be583 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:52:51.404394 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-ed4aa515-26a0-4020-8ef8-9e2f646be583 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:52:51.405106 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-ed4aa515-26a0-4020-8ef8-9e2f646be583 admin admin] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:52:51.405551 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-ed4aa515-26a0-4020-8ef8-9e2f646be583 admin admin] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:52:51.406001 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-ed4aa515-26a0-4020-8ef8-9e2f646be583 admin admin] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:52:51.425373 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-ed4aa515-26a0-4020-8ef8-9e2f646be583 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077441 Aug 18 21:52:51.425891 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 36/72] 10.222.0.82 () {60 vars in 1193 bytes} [Thu Aug 18 21:52:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:53:02.651075 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-6c56bca0-651d-48d5-a4d9-eac818cf6f03 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:53:02.652081 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-6c56bca0-651d-48d5-a4d9-eac818cf6f03 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Aug 18 21:53:02.652475 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 37/73] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 21:53:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:53:02.795101 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_cell0:SELECT=4 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:02.795863 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_cell1:SELECT=4 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:02.796454 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG dbcounter [-] [105463] Writing DB stats nova_api:SELECT=8 {{(pid=105463) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:53:02.845083 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-c199cf98-a379-40b3-910c-13421e07c83b admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:53:02.847472 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:53:02.847472 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: warnings.warn(msg) Aug 18 21:53:02.848594 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-c199cf98-a379-40b3-910c-13421e07c83b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:53:02.849075 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-c199cf98-a379-40b3-910c-13421e07c83b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:53:02.849501 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-c199cf98-a379-40b3-910c-13421e07c83b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:53:02.850286 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-c199cf98-a379-40b3-910c-13421e07c83b admin admin] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:53:02.850731 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-c199cf98-a379-40b3-910c-13421e07c83b admin admin] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:53:02.851149 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-c199cf98-a379-40b3-910c-13421e07c83b admin admin] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:53:02.876058 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-c199cf98-a379-40b3-910c-13421e07c83b admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085389 Aug 18 21:53:02.876536 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 37/74] 10.222.0.82 () {60 vars in 1193 bytes} [Thu Aug 18 21:53:02 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:53:03.696117 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: DEBUG nova.api.openstack.wsgi [None req-6c56bca0-651d-48d5-a4d9-eac818cf6f03 admin admin] Calling method '>' {{(pid=105462) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:53:03.697114 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: INFO nova.api.openstack.requestlog [None req-6c56bca0-651d-48d5-a4d9-eac818cf6f03 admin admin] 10.222.0.82 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 18 21:53:03.697509 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: [pid: 105462|app: 0|req: 38/75] 10.222.0.82 () {56 vars in 1074 bytes} [Thu Aug 18 21:53:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:53:03.888231 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG nova.api.openstack.wsgi [None req-8580593a-4671-4b01-950e-6c28a4c3cb10 admin admin] Calling method '>' {{(pid=105463) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:53:03.890646 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:53:03.890646 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: warnings.warn(msg) Aug 18 21:53:03.891719 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8580593a-4671-4b01-950e-6c28a4c3cb10 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:53:03.892191 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8580593a-4671-4b01-950e-6c28a4c3cb10 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:53:03.892617 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8580593a-4671-4b01-950e-6c28a4c3cb10 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:53:03.893326 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8580593a-4671-4b01-950e-6c28a4c3cb10 admin admin] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:53:03.893807 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8580593a-4671-4b01-950e-6c28a4c3cb10 admin admin] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:53:03.894230 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: DEBUG oslo_concurrency.lockutils [None req-8580593a-4671-4b01-950e-6c28a4c3cb10 admin admin] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105463) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:53:03.916520 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: INFO nova.api.openstack.requestlog [None req-8580593a-4671-4b01-950e-6c28a4c3cb10 admin admin] 10.222.0.82 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079856 Aug 18 21:53:03.917012 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: [pid: 105463|app: 0|req: 38/76] 10.222.0.82 () {60 vars in 1193 bytes} [Thu Aug 18 21:53:03 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:54:00.477888 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: Thu Aug 18 21:54:00 2022 - graceful shutdown triggered... Aug 18 21:54:00.478020 dv-cinder-853678-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 18 21:54:00.478895 dv-cinder-853678-3-iscsi devstack@n-api.service[105462]: Gracefully killing worker 1 (pid: 105462)... Aug 18 21:54:00.479295 dv-cinder-853678-3-iscsi devstack@n-api.service[105463]: Gracefully killing worker 2 (pid: 105463)... Aug 18 21:54:01.480003 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: worker 1 buried after 1 seconds Aug 18 21:54:01.480003 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: worker 2 buried after 1 seconds Aug 18 21:54:01.480003 dv-cinder-853678-3-iscsi devstack@n-api.service[105461]: goodbye to uWSGI. Aug 18 21:54:01.481539 dv-cinder-853678-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 18 21:54:01.482122 dv-cinder-853678-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 18 21:54:01.484938 dv-cinder-853678-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 21:54:01.496018 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 21:54:01.498071 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 21:54:01 2022] *** Aug 18 21:54:01.498071 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 21:54:01.498071 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 21:54:01.498071 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: nodename: dv-cinder-853678-3-iscsi Aug 18 21:54:01.498071 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: machine: x86_64 Aug 18 21:54:01.498071 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: clock source: unix Aug 18 21:54:01.498071 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: pcre jit disabled Aug 18 21:54:01.498071 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: detected number of CPU cores: 4 Aug 18 21:54:01.498071 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: current working directory: / Aug 18 21:54:01.498071 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: detected binary path: /usr/bin/uwsgi-core Aug 18 21:54:01.498071 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: your processes number limit is 47680 Aug 18 21:54:01.498908 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: your memory page size is 4096 bytes Aug 18 21:54:01.498908 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: detected max file descriptor number: 2048 Aug 18 21:54:01.498908 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: lock engine: pthread robust mutexes Aug 18 21:54:01.498908 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: thunder lock: enabled Aug 18 21:54:01.498908 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 21:54:01.498908 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 21:54:01.543045 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: Python main interpreter initialized at 0x55b0de5129c0 Aug 18 21:54:01.543045 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: python threads support enabled Aug 18 21:54:01.543045 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: your server socket listen backlog is limited to 100 connections Aug 18 21:54:01.543045 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: your mercy for graceful operations on workers is 90 seconds Aug 18 21:54:01.543639 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 21:54:01.543639 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: *** Operational MODE: preforking *** Aug 18 21:54:01.543912 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: *** uWSGI is running in multiple interpreter mode *** Aug 18 21:54:01.543912 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: spawned uWSGI master process (pid: 120530) Aug 18 21:54:01.544050 dv-cinder-853678-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 21:54:01.547163 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: spawned uWSGI worker 1 (pid: 120538, cores: 1) Aug 18 21:54:01.547163 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: spawned uWSGI worker 2 (pid: 120539, cores: 1) Aug 18 21:54:01.547163 dv-cinder-853678-3-iscsi devstack@n-api.service[120530]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 21:54:02.207738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 21:54:02.223618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 21:54:03.370085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 21:54:03.370085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: from cryptography.utils import int_from_bytes Aug 18 21:54:03.370720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 21:54:03.370720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: from cryptography.utils import int_from_bytes Aug 18 21:54:03.378417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 21:54:03.378417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: from cryptography.utils import int_from_bytes Aug 18 21:54:03.378923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 21:54:03.378923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: from cryptography.utils import int_from_bytes Aug 18 21:54:05.768436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 21:54:05.769097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 21:54:05.769191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 21:54:05.769506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 21:54:05.769795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 21:54:05.770191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.770521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.770845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.771166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.771589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.771905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.772232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.772557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.772891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.773252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.773514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.773876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853678-3-iscsi {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.774202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.774695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.775017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.775359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.775656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.775989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.776310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.776817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.778090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.778633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.779200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.779666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.780156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.780762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.781199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.781663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.782109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.782535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.783181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853678-3-iscsi {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.783555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.784065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.784651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.785194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.785652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.786108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.786699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.787622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.788057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.788485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.790350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.790350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.790350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.790653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.791188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.791617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.792031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.792465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.792821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.793235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.793699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.794130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.794600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.794975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.795328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.795756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.796183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.796633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.797104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.797517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.797956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.798368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.798781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.799192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.799601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.800026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.800448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.800884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.801450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.801906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.802422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.803300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.803711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.804163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.804771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.805160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.805558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.805985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.806373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.806759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.807140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.807534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.807946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.808328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.808650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.809026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.809402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.809823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.810205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.810588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.810962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.811516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.811900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.812280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.812661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.813041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.813480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.813883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.814261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.814645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.815026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.815453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.815848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.816229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.816610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.816992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.817376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.817793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.818321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.819250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.819653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.820235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.820617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.821019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.821575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.821978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.822371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.822746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.823126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.823516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.823895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.824275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.824657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.825036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.825420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.825821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.826205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.826581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.826951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.827341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.827835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.828220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.828606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.828981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.829371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.829815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.830218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.830632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.831021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.831176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 21:54:05.831635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.831733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 21:54:05.831969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 21:54:05.832087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.832338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 21:54:05.832489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.832599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 21:54:05.832905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.833005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.833296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.833395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.833655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.834049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.834238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.834593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.834749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.834868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.835191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.835358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.835652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.835812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.836190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.836350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.836546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.836704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.836858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.837133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.837338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.837497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853678-3-iscsi {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.837673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.837808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.838119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.838292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.838570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.838716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.838896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.839079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.839216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.839528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.839677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.839852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.840041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.840376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.840531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.840688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.840949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.841092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.841296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.841481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.841655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.841972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.842210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.842356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.842603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.842741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.842916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.843119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.843256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.843548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.843683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.843958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853678-3-iscsi {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.844111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.844278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.844490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.844639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.844902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.845036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.845404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.845560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.845766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.845982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.846153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.846372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.846530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.846711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.846853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.847029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.847305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.847501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.847672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.847814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.848003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.848340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.848495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.848728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.848871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.849006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.849183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.849326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.849564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.849748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.849897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.850170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.850307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.850459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.850675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.850819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.851057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.851387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.851540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.851713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.851944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.852103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.852268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.852523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.852677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.852853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.853057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.853192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.853466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.853659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.853796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.853996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.854140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.854398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.854541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.854710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.855017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.855183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.855339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.855543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.855688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.855941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.856174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.856326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.856563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.856711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.856877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.857024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.857336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.82 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.857522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.857703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.82 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.857841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.857975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.858187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.858532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.858687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.858915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.859059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.859208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.859341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.859494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.859694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.859829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.860028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.860192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.860327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.860641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.860785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.860975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.861134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.861275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.861527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.861717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.861854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.862092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.862228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.862461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.862687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.862834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.863063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.863198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.863373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.863621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.863766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.863974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.864118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.864266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.864551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.864701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.864875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.865687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.865796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.866024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.866191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.866397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.866631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.866859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.867006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.867140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.867288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.867576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.867733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.867888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.868071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.868215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.868499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.868742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.868891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.869111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.869258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.869406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.869541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.869738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.869987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.870150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.870324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.870505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.870643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.870951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.871087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.873876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.874040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.874200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.874342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.874493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.874639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.874786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.874952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.875102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.875239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.875374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.875374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.876141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.876255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.876255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.876426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.876513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.876598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.876681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.876681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.876681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.876918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.877013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.877109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.877195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.877289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.877382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.877382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.877534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.877640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.877640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.877796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.877891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.877983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.878067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 21:54:05.878158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.878255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.878349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.878440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.878525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.878602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.881636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.881833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.881998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.882146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.882314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.882458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.882609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.882762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.882912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.883066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.883215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.883363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.883504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.883656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.883892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.884050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.884202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.884354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.884510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.884668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.884812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.884952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.884952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.885234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.885385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.885534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.885731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.885877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.886017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.886170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.886324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.886476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.886617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.886766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.886932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.887220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.887372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.887515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.887680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.887927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.888082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.888239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.888399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.888551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.888710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.888948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.889180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.889422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.889571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.889745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.889897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.890041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.890181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.890333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.890474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.890627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.890768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.890908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.891056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.891210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.891359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.891500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.891648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.891790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.891951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.892106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.892247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.892393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.892544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.892693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.892851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.893001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.893001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.893276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.893425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.893573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.893765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.893926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.894149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.894313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.894465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.894612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.894763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.894957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.895105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.895246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.895246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.895521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.895671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.895813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.895953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.896094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.896242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.896468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.896615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.896765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.896914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.897200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.897362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.897521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.897748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.898006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.898186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.898394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.898394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.898861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.899168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.899423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.899640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.899787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.899930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.900087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.900230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.900379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.900522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.900670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.900888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.901040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.901190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.901351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.901351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.901654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.901814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.901964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.902116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.902267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.902408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.902563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.902715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.902865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.903020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.903162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.903331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.903474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.903629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.903772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.903912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.904052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.904283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.904445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.904594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.904738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.904738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.905014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.905169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.905327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.905470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.905674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.905836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.905979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.905979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.906269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.906420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.906570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.906710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.906859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.907000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.907160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.907469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.907620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.907762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.907904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.908161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.908310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.908459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.908611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.908611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.908896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.908896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.909262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.909438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.909438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.909438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.910066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.910222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.910366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.910506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.910647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.910796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.910940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.911093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.911236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.911384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.911537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.911685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.911836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.912025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.912182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.912325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.912466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.912613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.912613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.912899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.913043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.913190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.913342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.913492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.913665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.913822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.913973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.914115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.914115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.914738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.914738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.915026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.915177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.915318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.915584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.915758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.915908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.916063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.916206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.916356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.916505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.916647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.916796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.916939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.917078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.917229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.917523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.917718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.917873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.918024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.918280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.918442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.918586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.918586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.918863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.919012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.919253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.919481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.919637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.919954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.920102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.920262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.920417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.920566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.920715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.920715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.920984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.921135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.921289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.921440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.921589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.921768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.921910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.922071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.922224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.922366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.922508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.922656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.922797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.922951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.923093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.923241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.923383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.923524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.923664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.923814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.923966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.924107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.924254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.924254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.924538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.924786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.924938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.924938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.925276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.925427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.925578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.925795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.925940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.926093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.926243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.926393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.926544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.926694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.926836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.926985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.927127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.927127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.927413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.928361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.928511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.928654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.928809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.928949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.929101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.929252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.929401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.929645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.929810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.930131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.930289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.930439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.930594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.930743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.930898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.931053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.931204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.931353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.931502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.931644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.931786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.931941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.932676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.932906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.933054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.933216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.933359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.933500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.933663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.933822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.934213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.934366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.934517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.934659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.934659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.935057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.935057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.935338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.935338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.935634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.935783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.935935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.936084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.936226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.936226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.936510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.936510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.936795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.936943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.937092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.937242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.937402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.937402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.937926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.938081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.938239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.938511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.938658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.938658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.938939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.939088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.939231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.939372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.939512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.939770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.939920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.940078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.940400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.940545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.940769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.940913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.941056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.941204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.941357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.941506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.941683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.941838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.941993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.942142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.942284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.942427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.942584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.942738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.942881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.943021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.943162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.943952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.944114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.944267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.944429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.944579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.944722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.944891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.945121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.945275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.945427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.945579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.945748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.945748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.946031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.946175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.946316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.946412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.946490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.946583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.946668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.946750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.946832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.946914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.946997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.947087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.947166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.947251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.947341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.947431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.947523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.947614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.947705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.947804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.947914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.948950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.949257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.949347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.949431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.949522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.949631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.949719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.949817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.949900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.949981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.950081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.950167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.950519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.950615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.950687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.950757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.950757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.950910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.951003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.951003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.951161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.951260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.951260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.951430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.951513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.951596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.951686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.951783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.951937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.952092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.952255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.952409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.952609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.952732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.952948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.953050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.953303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.953394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.953648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.953757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.953955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.954047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.954300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.954432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.954620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.954755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.954960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.955085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.955276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.955412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.955587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.955698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.955983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.956089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.956292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.956385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.956613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.956716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.956931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.957032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.957245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.957345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.957562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.957685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.957900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.957999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.958222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.958327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.958528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.958628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.958873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.958985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.959195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.959303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.959512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.959681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.959820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.959960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.960132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.960285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.960544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.960689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.960827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.960975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.961200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.961365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.961501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.961662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.961863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.961957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.962181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.962285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.962496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.962595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.962811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.962901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.963133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.963226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.963456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.963554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.963771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.963863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.964104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.964196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.964424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.964559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.964737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.964879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.965050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.965216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.965370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.965528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.965707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.965878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.966022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.966211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.966341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.966522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.966672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.966844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.966998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.967163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.967309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.967494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.967628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.967825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.967943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.968142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.968258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.968464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.968562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.968779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.968907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.969112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.969219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.969442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.969579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.969791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.969895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.970101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.970203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.970413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.970537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.970749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.970856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.971066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.971160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.971379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.971487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.971691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.971785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.972001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.972102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.972353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.972462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.972670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.972763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.973037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.973173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.973357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.973714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.974049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.974338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.974465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.974701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.974810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.975018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.975109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.975331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.975419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.975653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.975746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.975971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.976051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.976295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.976417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.976603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.976737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.976915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.977071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.977244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.977883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.978053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.978219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.978368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.978523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.978672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.978852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.979094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.979250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.979397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.979553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.979672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.979672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.979844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.979930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.980020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.980111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.980195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.980363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.980505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.980668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.980795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.980997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.981144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.981318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.981490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.981664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.981752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.981971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.982055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.982293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.982391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.982819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.982924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.982998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.983085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.983235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.983362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.983551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.983803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.983905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.984133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.984233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.984467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.984568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.984780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.984882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.985092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.985192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.985413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.985515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.985753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.985925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.986065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.986200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.986377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.986522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.986694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.986844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.987003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.987160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.987312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.987481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.987622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.987803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.987950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.988128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.988259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.988453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.988628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.988765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.988891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.989194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.989302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.989495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.989618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.989829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.989922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.990677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.990793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.991044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.991146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.991300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.991390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.991617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.991706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.991950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.992076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.992264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.992402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.992580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.992723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.992896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.993046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.993228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.993365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.993543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.993723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.993899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.994048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.994326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.994425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.994648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.994740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.994967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.995135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.995285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.995428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.995582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.995739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.996010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.996153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.996343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.996487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.996673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.996831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.997004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.997142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.997318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.997470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.997643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.997766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.997972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.998078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.998303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.998398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.998626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.998728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.998946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.999048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.999338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.999444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.999577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.999671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.999906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:05.999998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.000236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.000330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.000560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.000659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.000888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.000988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.001218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.001330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.001536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.001658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.001896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.001988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.002260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.002368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.002579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.002671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.002889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.002989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.003208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.003314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.003527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.003624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.003842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.003934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.004155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.004248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.004471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.004570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.004784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.004874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.005101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.005192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.005418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.005514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.005804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.006388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.006610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.006702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.006929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.007019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.007260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.007350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.007575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.007720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.007907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.008085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.008265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.008376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.008556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.008670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.008891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.008972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.009224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.009497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.009620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.009854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.009946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.010182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.010271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.010498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.010617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.010819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.011190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.011381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.011536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.011693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.011846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.011988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.012130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.012275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.012426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.012575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.012727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.012868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.013017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.013158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.013313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.013449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.013711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.013811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.014040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.014146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.014359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.014459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.014670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.014778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.014979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.015071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.015299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.015402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.015610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.015835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.015930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.016189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.016291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.016510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.016602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.016818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.016918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.017126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.017228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.017438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.017530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.017792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.017900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.018106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.018195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.018422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.018579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.018731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.018826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.019038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.019132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.019350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.019655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.019655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.020007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.020154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.020309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.020458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.020604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.020744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.020917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.021060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.021220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.021351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.021510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.021674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.021784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.021878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.021972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.022142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.022240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.022454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.022553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.022764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.022864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.023294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.023404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.023490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.023570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.023790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.023899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.024101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.024200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.024410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.024509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.024728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.024819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.025036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.025286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.025397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.025651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.025760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.025964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.026056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.026292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.026394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.026614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.026705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.026936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.027028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.027258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.027352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.027568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.027658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.027890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.027988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.028209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.028316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.028533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.028638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.028869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.028969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.029201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.029293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.029534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.029783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.029886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.029981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.030215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.030315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.030536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.030749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.030849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.031095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.031194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.031426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.031513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.031769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.031870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.032108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.032206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.032420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.032518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.032733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.032832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.033044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.033136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.033359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.033455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.033701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.033812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.034025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.034115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.034341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.034430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.034659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.034763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.034977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.035065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.035295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.035394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.035614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.035706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.035932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.036021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.036274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.036363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.036604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.036704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.037447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.037548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.037780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.037884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.038103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.038203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.038419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.038657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.038865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.038967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.039474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.039579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.039830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.039936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.040126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.040232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.040518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.040846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.041184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.041418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.041505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.041782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.041890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.042115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.042214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.042443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.042533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.042758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.042859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.043080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.043171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.043401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.043505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.043715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.043814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.044045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.044137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.044356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.044454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.044792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.044884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.045150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.045258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.045478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.045579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.045832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.045926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.046154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.046245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.046483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.046575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.046814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.046919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.047134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.047225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.047448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.047547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.047763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.047854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.048096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.048191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.048440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.048532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.048776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.048886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.049106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.049197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.049418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.049509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.049753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.049884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.050065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.050208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.050383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.050509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.050693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.050786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.051015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.051185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.051361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.051461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.051637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.051734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.051957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.052075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.052254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.052345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.052641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.053236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.053501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.053645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.053844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.053951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.054158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.054250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.054476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.054614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.054787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.054885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.055121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.055229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.055402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.055483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.055709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.055817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.056017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.056115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.056333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.056424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.056642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.056732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.056952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.057053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.057261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.057355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.057570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.057690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.057900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.058006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.058236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.058327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.058574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.058672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.058898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.059021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.059226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.059321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.059544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.059636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.059871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.059971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.060187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.060452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.060552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.060795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.060901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.061129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.061227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.061451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.061549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.061818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.061919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.062137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.062237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.062455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.062547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.062768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.062868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.063087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.063185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.063407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.063506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.063726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.063826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.064048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.064148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.064370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.064461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.064678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.064777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.065001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.065100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.065321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.065418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.065662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.065770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.065986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.066083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.066302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.066394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.066619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.066710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.066935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.067024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.067251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.067395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.067565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.067655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.067880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.067979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.068215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.068332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.068535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.068628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.068850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.068942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.069164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.069312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.069483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.069574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.069835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.069960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.070155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.070256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.070478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.070588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.070786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.070885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.071108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.071207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.071443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.071582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.071769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.071869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.072080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.072179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.072501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.072593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.072819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.072922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.073139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.073235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.073454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.073553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.073789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.073895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.074037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 21:54:06.074137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.074432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.074753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.075094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.075400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.075735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.076081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.076416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.076748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.077064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.077376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.077711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.078034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.078362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.078682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.078995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.079307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.079627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.079937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.080251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.080567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.080879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.081197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.081509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.081848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.082159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.082470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.082781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.083091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.083409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.083721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.084134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.084447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.084759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.085072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.085410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.085783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.086102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.086433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.086751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.087081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.087401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.087732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.088061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.088385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.088706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.089047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.089368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.089714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.090035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.090362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.090681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.091000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.091335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.091678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.091993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.092325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.092655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.092974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.093298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.093643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.093970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.094286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.094604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.094922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.095237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.095552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.095873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.096189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.096505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.096825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.097148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.097482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.097836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.098156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.098489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.098824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.099181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.100021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.100371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.100712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.101032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.101703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.101703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 21:54:06.101932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 21:54:06.135951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO dbcounter [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Registered counter for database nova_api Aug 18 21:54:06.156173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_db.sqlalchemy.engines [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:54:06.163394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writer thread running {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:54:06.163955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO dbcounter [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Registered counter for database nova_api Aug 18 21:54:06.185129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_db.sqlalchemy.engines [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:54:06.191684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writer thread running {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:54:06.218938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.context [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ef789987-a8d4-40c7-ba3b-98c8afa02e62(cell1) {{(pid=120538) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 21:54:06.222949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:54:06.223430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:54:06.225639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:54:06.226530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:54:06.226980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:54:06.228952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:54:06.231035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO dbcounter [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Registered counter for database nova_cell0 Aug 18 21:54:06.235091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO dbcounter [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Registered counter for database nova_cell1 Aug 18 21:54:06.243078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_db.sqlalchemy.engines [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:54:06.244483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_db.sqlalchemy.engines [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:54:06.247882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.context [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ef789987-a8d4-40c7-ba3b-98c8afa02e62(cell1) {{(pid=120539) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 21:54:06.251444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writer thread running {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:54:06.252066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:54:06.252547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:54:06.252836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writer thread running {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:54:06.254163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:54:06.254907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:54:06.255360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:54:06.257399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:54:06.259585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO dbcounter [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Registered counter for database nova_cell0 Aug 18 21:54:06.263629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO dbcounter [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Registered counter for database nova_cell1 Aug 18 21:54:06.271122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_db.sqlalchemy.engines [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:54:06.272468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_db.sqlalchemy.engines [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:54:06.279952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writer thread running {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:54:06.281271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writer thread running {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:54:06.401235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO dbcounter [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Registered counter for database nova_cell0 Aug 18 21:54:06.408246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_db.sqlalchemy.engines [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:54:06.413170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writer thread running {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:54:06.432108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO dbcounter [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Registered counter for database nova_cell0 Aug 18 21:54:06.438869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_db.sqlalchemy.engines [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 21:54:06.443319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writer thread running {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 21:54:06.735826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: WARNING keystonemiddleware.auth_token [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 21:54:06.744159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: WARNING keystonemiddleware.auth_token [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 21:54:06.764652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: WARNING keystonemiddleware.auth_token [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 21:54:06.771973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: WARNING keystonemiddleware.auth_token [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 21:54:07.089020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: WARNING keystonemiddleware.auth_token [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 21:54:07.095660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: WARNING keystonemiddleware.auth_token [None req-1b1382c8-27c8-465e-9b9c-17ac36e9503a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 21:54:07.101657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b0de5129c0 pid: 120538 (default app) Aug 18 21:54:07.112723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: WARNING keystonemiddleware.auth_token [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 21:54:07.119355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: WARNING keystonemiddleware.auth_token [None req-2c9b117b-5a2f-47aa-a869-e577beaf28d8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 21:54:07.124620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b0de5129c0 pid: 120539 (default app) Aug 18 21:54:46.587320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a5e3ed1c-3b1f-4b53-bf6a-e46009d25c80 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] Calling method '.version_select at 0x7fd88bda00d0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:54:46.668627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:46.672192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:46.673162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:46.674174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:47.392129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a5e3ed1c-3b1f-4b53-bf6a-e46009d25c80 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/5844249a-4ec8-4278-bb70-dd6ef637b4da" status: 200 len: 350 microversion: 2.1 time: 1.154769 Aug 18 21:54:47.400719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1/1] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 21:54:46 2022] GET /compute/v2.1/os-volumes/5844249a-4ec8-4278-bb70-dd6ef637b4da => generated 350 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:54:52.897502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f727253d-fd42-486d-b97f-0dcb9b25972c tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] Calling method '.version_select at 0x7fd88bda10d0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:54:52.935146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:52.936407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:52.937503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:52.938964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:54:53.612304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f727253d-fd42-486d-b97f-0dcb9b25972c tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/94d65140-e83e-4084-b90c-bf1e7db26129" status: 200 len: 351 microversion: 2.1 time: 1.215138 Aug 18 21:54:53.617401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1/2] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 21:54:52 2022] GET /compute/v2.1/os-volumes/94d65140-e83e-4084-b90c-bf1e7db26129 => generated 351 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:54:55.041636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2040411875", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "networks": [{"uuid": "ffd18708-2c18-404c-a4c3-a7c552cb5045"}]}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:54:55.242675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] validate_networks() for [('ffd18708-2c18-404c-a4c3-a7c552cb5045', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:54:55.278413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a321bb44-fa32-40ba-9fc1-5e5e35a9c52e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Action: 'create', calling method: .version_select at 0x7fd88bc46160>, body: {"keypair": {"name": "tempest-keypair-1047384521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPd7JqbROl4gRY/ZYlIgHaycRxHZNmY+fbfbbqn7K//MwViZmnb7x9j52Y46z5qdQL8XuebUvbffp0KxxYpYNhO9lPWNekuA1eWFTtz1/BnV0aretDZuwAljbGUv3Uw6Qw=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:54:55.388940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-a321bb44-fa32-40ba-9fc1-5e5e35a9c52e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Getting quotas for project 1c52341f519e47f59defbd74b623efac. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:54:55.399824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-a321bb44-fa32-40ba-9fc1-5e5e35a9c52e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Getting quotas for user a01cda302c5841cc937f219d7a06dc56 and project 1c52341f519e47f59defbd74b623efac. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:54:55.527540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a321bb44-fa32-40ba-9fc1-5e5e35a9c52e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.357703 Aug 18 21:54:55.538428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2/3] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 21:54:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:54:56.646839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:54:56.647875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:54:56.648678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:54:56.649267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:54:56.649938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:54:56.675479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:54:56.678870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:54:56.679343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:54:56.680268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:54:56.682036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:54:56.682494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:54:56.764485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Getting quotas for project 6604f675c98a470db3568612140f7e8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:54:56.773268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Getting quotas for user 1bbaf0feaf294fc79f8f7d8dbcf58851 and project 6604f675c98a470db3568612140f7e8e. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:54:56.787061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:54:56.790757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:54:56.996335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9a2cc8bd-0898-4fdf-af80-b3d0d88b86b3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.051454 Aug 18 21:54:57.004368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2/4] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 21:54:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 2060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:54:57.020399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8d0a5601-2ea3-47be-a042-fa6259ab9cda tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:54:57.022410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8d0a5601-2ea3-47be-a042-fa6259ab9cda tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:54:57.299323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-75344c85-ccd1-4b3d-aa85-654679955b1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Action: 'create', calling method: .version_select at 0x7fd88b2f6dc0>, body: {"keypair": {"name": "tempest-keypair-1329960640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNs2AFfGGZ8vAgLlAnSDN2QCqoVzxyRdS4mW+993unnrz8ko49x672zZnZJgrekY1HX3Q8d0dviFSDRoA/1xU2njsVXh8Nfk3M0gJM66mwyRH3LQjZEcNuAgSUGn2D3sXA=="}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:54:57.362007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-75344c85-ccd1-4b3d-aa85-654679955b1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Getting quotas for project efb811ce4fca47728e61489adbf97434. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:54:57.373056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-75344c85-ccd1-4b3d-aa85-654679955b1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Getting quotas for user e280bab439a3446b993c721bc98c1c6e and project efb811ce4fca47728e61489adbf97434. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:54:57.444570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-75344c85-ccd1-4b3d-aa85-654679955b1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.277824 Aug 18 21:54:57.448668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 3/5] 10.222.0.82 () {62 vars in 1200 bytes} [Thu Aug 18 21:54:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 283 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 18 21:54:57.564481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8d0a5601-2ea3-47be-a042-fa6259ab9cda tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:54:57.632442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8d0a5601-2ea3-47be-a042-fa6259ab9cda tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1215 microversion: 2.1 time: 0.627266 Aug 18 21:54:57.637125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 3/6] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:54:57 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1215 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:54:58.666964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7fec82c7-a053-475e-adcc-dabd6c57d6e4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:54:58.668300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7fec82c7-a053-475e-adcc-dabd6c57d6e4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:54:59.111058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7fec82c7-a053-475e-adcc-dabd6c57d6e4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:54:59.160560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7fec82c7-a053-475e-adcc-dabd6c57d6e4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1215 microversion: 2.1 time: 0.505911 Aug 18 21:54:59.162272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 4/7] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:54:58 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1215 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:54:59.567321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-956261710", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:54:59.704754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] validate_networks() for [('f5079c76-94b9-4b99-ab7f-dc294e97defa', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:54:59.987539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1e0341f5-ce8f-4ed6-bafe-faaa52aa8a37 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] Calling method '.version_select at 0x7fd88b2f6b80>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:00.090359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1e0341f5-ce8f-4ed6-bafe-faaa52aa8a37 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/d0580abc-3c56-48ea-9d80-b1b83c9e2af3" status: 200 len: 351 microversion: 2.1 time: 0.108252 Aug 18 21:55:00.099528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 5/8] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 21:54:59 2022] GET /compute/v2.1/os-volumes/d0580abc-3c56-48ea-9d80-b1b83c9e2af3 => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:00.101617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-823447091", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08ef7d38-de50-45f0-b217-f8b194131841"}], "security_groups": [{"name": "tempest-securitygroup--1034126118"}], "key_name": "tempest-keypair-1047384521", "user_data": "}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:00.297831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] validate_networks() for [('08ef7d38-de50-45f0-b217-f8b194131841', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:55:01.032728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:55:01.033378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:55:01.034004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:55:01.035734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:55:01.036168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:55:01.049042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:01.049548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:01.050439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:01.051723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:01.052276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:01.052788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:01.103326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Getting quotas for project 1c52341f519e47f59defbd74b623efac. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:55:01.121294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Getting quotas for user a01cda302c5841cc937f219d7a06dc56 and project 1c52341f519e47f59defbd74b623efac. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:55:01.186463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:55:01.189475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:55:01.319905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bb18ac84-96b7-410b-a8e6-ad66176c26a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.226202 Aug 18 21:55:01.320727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 6/9] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 21:55:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:55:01.326100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0682df1a-6dae-46b7-9638-290414dacb29 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] Calling method '.version_select at 0x7fd88a263c10>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:01.606358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0682df1a-6dae-46b7-9638-290414dacb29 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] 10.222.0.82 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.284345 Aug 18 21:55:01.607531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 7/10] 10.222.0.82 () {58 vars in 1134 bytes} [Thu Aug 18 21:55:01 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:01.617441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b818f57a-37a8-4d33-9b64-e287ec04cb80 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:01.620550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b818f57a-37a8-4d33-9b64-e287ec04cb80 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:01.646429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b818f57a-37a8-4d33-9b64-e287ec04cb80 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:01.648372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b818f57a-37a8-4d33-9b64-e287ec04cb80 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:01.648870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b818f57a-37a8-4d33-9b64-e287ec04cb80 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:01.652889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b818f57a-37a8-4d33-9b64-e287ec04cb80 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:01.657001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b818f57a-37a8-4d33-9b64-e287ec04cb80 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:01.657621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b818f57a-37a8-4d33-9b64-e287ec04cb80 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:02.226161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:55:02.226836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:55:02.227517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:55:02.230276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:55:02.231084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:55:02.268229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:02.269217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:02.272655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:02.275729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:02.278069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:02.287869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:02.367759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b818f57a-37a8-4d33-9b64-e287ec04cb80 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:02.395257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b818f57a-37a8-4d33-9b64-e287ec04cb80 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1273 microversion: 2.1 time: 0.784394 Aug 18 21:55:02.397152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 8/11] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:01 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1273 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:02.401544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Getting quotas for project 9894625c04a341e3a82584481410cd35. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:55:02.404219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6a99dc32-f6ae-42bf-bfaa-c15efb653fe4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:02.405037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6a99dc32-f6ae-42bf-bfaa-c15efb653fe4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:02.422602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Getting quotas for user 42072422001c4f1684f68baa25517a9e and project 9894625c04a341e3a82584481410cd35. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:55:02.467436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:55:02.477732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:55:02.669742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9913aa27-9e2c-42d7-9624-d7c330f2929f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.218127 Aug 18 21:55:02.672468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 4/12] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 21:54:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 3225 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:55:02.685956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0d84fae-bc4b-4918-b228-27e4351a92a7 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] Calling method '.version_select at 0x7fd88b2d3820>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:03.125905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c0d84fae-bc4b-4918-b228-27e4351a92a7 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] 10.222.0.82 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.451389 Aug 18 21:55:03.135625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 5/13] 10.222.0.82 () {58 vars in 1149 bytes} [Thu Aug 18 21:55:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:03.135625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-95dfa3b9-61d7-4c7b-86a7-16e09a88024d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:03.135625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-95dfa3b9-61d7-4c7b-86a7-16e09a88024d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:03.180124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6a99dc32-f6ae-42bf-bfaa-c15efb653fe4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:03.209217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6a99dc32-f6ae-42bf-bfaa-c15efb653fe4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1237 microversion: 2.1 time: 0.807568 Aug 18 21:55:03.214633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 9/14] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1237 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:03.235077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-76afa148-35f6-487b-a00d-1e8d04cfe6be tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] Calling method '.version_select at 0x7fd88a1fe790>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:03.394709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-95dfa3b9-61d7-4c7b-86a7-16e09a88024d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:03.423313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-95dfa3b9-61d7-4c7b-86a7-16e09a88024d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1221 microversion: 2.1 time: 0.295145 Aug 18 21:55:03.426310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 6/15] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:03 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1221 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:03.447048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-04bc2bfb-58b6-4f82-b730-41db92758f47 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:03.455853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-04bc2bfb-58b6-4f82-b730-41db92758f47 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:03.483732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04bc2bfb-58b6-4f82-b730-41db92758f47 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:03.488792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04bc2bfb-58b6-4f82-b730-41db92758f47 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:03.490882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04bc2bfb-58b6-4f82-b730-41db92758f47 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:03.494482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04bc2bfb-58b6-4f82-b730-41db92758f47 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:03.495228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04bc2bfb-58b6-4f82-b730-41db92758f47 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:03.497801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04bc2bfb-58b6-4f82-b730-41db92758f47 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:03.612730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-76afa148-35f6-487b-a00d-1e8d04cfe6be tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] 10.222.0.82 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.393026 Aug 18 21:55:03.613632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 10/16] 10.222.0.82 () {58 vars in 1134 bytes} [Thu Aug 18 21:55:03 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:03.635602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1191370349", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5f12da2-1a73-4ec6-b81b-e9c9d959cad7"}], "security_groups": [{"name": "tempest-securitygroup--511770891"}], "key_name": "tempest-keypair-1329960640", "user_data": "}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:03.903217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] validate_networks() for [('a5f12da2-1a73-4ec6-b81b-e9c9d959cad7', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:55:04.107830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-04bc2bfb-58b6-4f82-b730-41db92758f47 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:04.129967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-04bc2bfb-58b6-4f82-b730-41db92758f47 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.698206 Aug 18 21:55:04.131547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 7/17] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:03 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:04.139092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-781621096", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:04.223317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] validate_networks() for [('f5079c76-94b9-4b99-ab7f-dc294e97defa', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:55:04.508874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:55:04.509302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:55:04.509862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:55:04.510475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:55:04.510890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:55:04.521717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:04.522451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:04.523062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:04.523974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:04.524595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:04.525028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:04.550215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Getting quotas for project efb811ce4fca47728e61489adbf97434. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:55:04.556368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Getting quotas for user e280bab439a3446b993c721bc98c1c6e and project efb811ce4fca47728e61489adbf97434. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:55:04.574546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:55:04.577012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:55:04.644633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-99aad868-3f82-4fb9-9099-2780468e8a6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.024508 Aug 18 21:55:04.646131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 11/18] 10.222.0.82 () {62 vars in 1188 bytes} [Thu Aug 18 21:55:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 21:55:04.660309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bc142730-4ec6-4b26-b895-0a1b043ac5c5 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] Calling method '.version_select at 0x7fd88c5c1790>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:04.798257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bc142730-4ec6-4b26-b895-0a1b043ac5c5 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] 10.222.0.82 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.150453 Aug 18 21:55:04.799018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 12/19] 10.222.0.82 () {58 vars in 1167 bytes} [Thu Aug 18 21:55:04 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:04.805468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8b62d1e2-fb4f-432a-a034-250b7e1a97e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:04.807324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8b62d1e2-fb4f-432a-a034-250b7e1a97e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:04.815238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b62d1e2-fb4f-432a-a034-250b7e1a97e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:04.817276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b62d1e2-fb4f-432a-a034-250b7e1a97e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:04.818955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b62d1e2-fb4f-432a-a034-250b7e1a97e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:04.819961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b62d1e2-fb4f-432a-a034-250b7e1a97e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:04.820690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b62d1e2-fb4f-432a-a034-250b7e1a97e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:04.821414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b62d1e2-fb4f-432a-a034-250b7e1a97e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:04.907014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8b62d1e2-fb4f-432a-a034-250b7e1a97e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:04.919708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8b62d1e2-fb4f-432a-a034-250b7e1a97e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1241 microversion: 2.1 time: 0.119435 Aug 18 21:55:04.921090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 13/20] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1241 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:04.927441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c33ace98-fc30-4a2f-a1c7-caee65c809a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:04.928692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c33ace98-fc30-4a2f-a1c7-caee65c809a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:05.068853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c33ace98-fc30-4a2f-a1c7-caee65c809a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:05.091614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c33ace98-fc30-4a2f-a1c7-caee65c809a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:05.093426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c33ace98-fc30-4a2f-a1c7-caee65c809a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:05.116089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c33ace98-fc30-4a2f-a1c7-caee65c809a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1282 microversion: 2.20 time: 0.193558 Aug 18 21:55:05.116989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 14/21] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1282 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:05.164217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-14b11daf-d858-490d-bec6-ccd41f1cbc1a tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] Calling method '.version_select at 0x7fd88a15d1f0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:05.266833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:55:05.267423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:55:05.267794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:55:05.268296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:55:05.268897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:55:05.290830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:05.291625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:05.293950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:05.301646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:05.301646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:05.301646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:05.319961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-14b11daf-d858-490d-bec6-ccd41f1cbc1a tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.177106 Aug 18 21:55:05.320767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 15/22] 10.222.0.82 () {58 vars in 1170 bytes} [Thu Aug 18 21:55:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:05.326319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9071e096-0909-4f29-ad1c-d96a41520f30 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:05.327046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9071e096-0909-4f29-ad1c-d96a41520f30 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:05.377788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9071e096-0909-4f29-ad1c-d96a41520f30 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:05.382431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Getting quotas for project 9894625c04a341e3a82584481410cd35. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:55:05.383107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9071e096-0909-4f29-ad1c-d96a41520f30 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:05.383820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9071e096-0909-4f29-ad1c-d96a41520f30 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:05.385934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9071e096-0909-4f29-ad1c-d96a41520f30 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:05.389756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9071e096-0909-4f29-ad1c-d96a41520f30 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:05.393043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9071e096-0909-4f29-ad1c-d96a41520f30 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:05.411569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Getting quotas for user 42072422001c4f1684f68baa25517a9e and project 9894625c04a341e3a82584481410cd35. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:55:05.487977 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:55:05.497057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:55:05.620685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf165290-92d0-4c6e-89cb-3aa1044a117b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.487109 Aug 18 21:55:05.622654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 8/23] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 21:55:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:55:05.628780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b4f9a985-cb2e-47d7-b602-61364c9c3cc5 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] Calling method '.version_select at 0x7fd88a1979d0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:05.705942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9071e096-0909-4f29-ad1c-d96a41520f30 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:05.719556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9071e096-0909-4f29-ad1c-d96a41520f30 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.397129 Aug 18 21:55:05.720164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 16/24] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:05 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:05.739908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-59a107b1-f53d-4d80-b13b-0dcee38bf3df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:05.740795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-59a107b1-f53d-4d80-b13b-0dcee38bf3df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:05.820243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-59a107b1-f53d-4d80-b13b-0dcee38bf3df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:05.828073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-59a107b1-f53d-4d80-b13b-0dcee38bf3df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1221 microversion: 2.1 time: 0.092108 Aug 18 21:55:05.828675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 17/25] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:05 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1221 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:05.845242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b4f9a985-cb2e-47d7-b602-61364c9c3cc5 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.221171 Aug 18 21:55:05.845857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 9/26] 10.222.0.82 () {58 vars in 1155 bytes} [Thu Aug 18 21:55:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:05.861857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f099709a-fb48-4ac6-aeb1-af8d55f35a63 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] Calling method '.version_select at 0x7fd88a198e50>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:05.944056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ac8f3420-f3f4-49cd-b00b-4edc63606300 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:05.945833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ac8f3420-f3f4-49cd-b00b-4edc63606300 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:05.966252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac8f3420-f3f4-49cd-b00b-4edc63606300 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:05.968915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac8f3420-f3f4-49cd-b00b-4edc63606300 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:05.969384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac8f3420-f3f4-49cd-b00b-4edc63606300 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:05.970447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac8f3420-f3f4-49cd-b00b-4edc63606300 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:05.970929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac8f3420-f3f4-49cd-b00b-4edc63606300 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:05.971425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac8f3420-f3f4-49cd-b00b-4edc63606300 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:06.022577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f099709a-fb48-4ac6-aeb1-af8d55f35a63 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.165480 Aug 18 21:55:06.023370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 18/27] 10.222.0.82 () {58 vars in 1188 bytes} [Thu Aug 18 21:55:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:06.038040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4f5a641d-64c4-490f-8af2-444a50a12a36 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] Calling method '.version_select at 0x7fd88a175430>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:06.070113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ac8f3420-f3f4-49cd-b00b-4edc63606300 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:06.080252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ac8f3420-f3f4-49cd-b00b-4edc63606300 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1241 microversion: 2.1 time: 0.141003 Aug 18 21:55:06.097649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 10/28] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1241 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:06.144671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26f434cd-20b2-46a5-ad8f-66324fe79f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:06.145461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26f434cd-20b2-46a5-ad8f-66324fe79f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:06.156885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f434cd-20b2-46a5-ad8f-66324fe79f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:06.157562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f434cd-20b2-46a5-ad8f-66324fe79f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:06.158196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f434cd-20b2-46a5-ad8f-66324fe79f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:06.159273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f434cd-20b2-46a5-ad8f-66324fe79f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:06.160072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f434cd-20b2-46a5-ad8f-66324fe79f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:06.160512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f434cd-20b2-46a5-ad8f-66324fe79f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:06.160959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4f5a641d-64c4-490f-8af2-444a50a12a36 tempest-VolumesTestJSON-1740838476 tempest-VolumesTestJSON-1740838476-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.127876 Aug 18 21:55:06.162186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 19/29] 10.222.0.82 () {58 vars in 1155 bytes} [Thu Aug 18 21:55:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:06.241296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26f434cd-20b2-46a5-ad8f-66324fe79f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:06.251777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26f434cd-20b2-46a5-ad8f-66324fe79f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:06.254587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26f434cd-20b2-46a5-ad8f-66324fe79f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:06.256329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26f434cd-20b2-46a5-ad8f-66324fe79f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1286 microversion: 2.20 time: 0.118248 Aug 18 21:55:06.256865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 11/30] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:06 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:06.743051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-08292f25-b740-479c-a3b0-6d8d5d1e4511 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:06.743637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-08292f25-b740-479c-a3b0-6d8d5d1e4511 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:06.759594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08292f25-b740-479c-a3b0-6d8d5d1e4511 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:06.762446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08292f25-b740-479c-a3b0-6d8d5d1e4511 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:06.764236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08292f25-b740-479c-a3b0-6d8d5d1e4511 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:06.769533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08292f25-b740-479c-a3b0-6d8d5d1e4511 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:06.770225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08292f25-b740-479c-a3b0-6d8d5d1e4511 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:06.771764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08292f25-b740-479c-a3b0-6d8d5d1e4511 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:06.851373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4e773ded-bb0f-4c29-8dcc-e2dcbfd6a802 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:06.852776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4e773ded-bb0f-4c29-8dcc-e2dcbfd6a802 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:06.874587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e773ded-bb0f-4c29-8dcc-e2dcbfd6a802 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:06.875467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e773ded-bb0f-4c29-8dcc-e2dcbfd6a802 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:06.876159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e773ded-bb0f-4c29-8dcc-e2dcbfd6a802 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:06.893850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e773ded-bb0f-4c29-8dcc-e2dcbfd6a802 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:06.894815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e773ded-bb0f-4c29-8dcc-e2dcbfd6a802 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:06.896125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e773ded-bb0f-4c29-8dcc-e2dcbfd6a802 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:07.057245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4e773ded-bb0f-4c29-8dcc-e2dcbfd6a802 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:07.069076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4e773ded-bb0f-4c29-8dcc-e2dcbfd6a802 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1225 microversion: 2.1 time: 0.222670 Aug 18 21:55:07.069685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 12/31] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:06 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1225 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:07.105139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c03a846f-9a0b-4d9b-9e8b-886424725ec9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:07.106229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c03a846f-9a0b-4d9b-9e8b-886424725ec9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:07.116229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c03a846f-9a0b-4d9b-9e8b-886424725ec9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:07.124366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c03a846f-9a0b-4d9b-9e8b-886424725ec9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:07.124978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c03a846f-9a0b-4d9b-9e8b-886424725ec9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:07.126062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c03a846f-9a0b-4d9b-9e8b-886424725ec9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:07.126815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c03a846f-9a0b-4d9b-9e8b-886424725ec9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:07.127334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c03a846f-9a0b-4d9b-9e8b-886424725ec9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:07.260701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c03a846f-9a0b-4d9b-9e8b-886424725ec9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:07.286825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c03a846f-9a0b-4d9b-9e8b-886424725ec9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1233 microversion: 2.1 time: 0.184819 Aug 18 21:55:07.287853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 13/32] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:07 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1233 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:07.290142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-08292f25-b740-479c-a3b0-6d8d5d1e4511 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:07.298936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1353af93-523c-4373-abc9-510bac032d88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:07.299569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1353af93-523c-4373-abc9-510bac032d88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:07.309180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-08292f25-b740-479c-a3b0-6d8d5d1e4511 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.572208 Aug 18 21:55:07.322451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 20/33] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:06 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:07.340760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1353af93-523c-4373-abc9-510bac032d88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:07.341549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1353af93-523c-4373-abc9-510bac032d88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:07.342333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1353af93-523c-4373-abc9-510bac032d88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:07.343298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1353af93-523c-4373-abc9-510bac032d88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:07.344326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1353af93-523c-4373-abc9-510bac032d88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:07.344954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1353af93-523c-4373-abc9-510bac032d88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:07.488687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1353af93-523c-4373-abc9-510bac032d88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:07.529460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1353af93-523c-4373-abc9-510bac032d88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:07.551641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1353af93-523c-4373-abc9-510bac032d88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:07.558019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1353af93-523c-4373-abc9-510bac032d88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1278 microversion: 2.20 time: 0.265356 Aug 18 21:55:07.558625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 14/34] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1278 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:08.093863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-002f6a47-41a7-4097-bb5f-44fd60aa7200 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:08.094707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-002f6a47-41a7-4097-bb5f-44fd60aa7200 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:08.109146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-002f6a47-41a7-4097-bb5f-44fd60aa7200 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:08.109672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-002f6a47-41a7-4097-bb5f-44fd60aa7200 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:08.113758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-002f6a47-41a7-4097-bb5f-44fd60aa7200 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:08.118333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-002f6a47-41a7-4097-bb5f-44fd60aa7200 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:08.120528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-002f6a47-41a7-4097-bb5f-44fd60aa7200 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:08.122425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-002f6a47-41a7-4097-bb5f-44fd60aa7200 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:08.310665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0bf06da6-232a-4cb6-936f-70c7a9c602d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:08.311946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0bf06da6-232a-4cb6-936f-70c7a9c602d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:08.339083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bf06da6-232a-4cb6-936f-70c7a9c602d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:08.340475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bf06da6-232a-4cb6-936f-70c7a9c602d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:08.343646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bf06da6-232a-4cb6-936f-70c7a9c602d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:08.346081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bf06da6-232a-4cb6-936f-70c7a9c602d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:08.347901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bf06da6-232a-4cb6-936f-70c7a9c602d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:08.352349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bf06da6-232a-4cb6-936f-70c7a9c602d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:08.394155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-002f6a47-41a7-4097-bb5f-44fd60aa7200 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:08.414917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-002f6a47-41a7-4097-bb5f-44fd60aa7200 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1217 microversion: 2.1 time: 0.324339 Aug 18 21:55:08.431357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 21/35] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:08 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1217 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:08.452015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-01a7d528-6395-41b3-8167-c8ce29fb66c3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:08.455599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-01a7d528-6395-41b3-8167-c8ce29fb66c3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:08.486490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01a7d528-6395-41b3-8167-c8ce29fb66c3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:08.489749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01a7d528-6395-41b3-8167-c8ce29fb66c3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:08.491573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01a7d528-6395-41b3-8167-c8ce29fb66c3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:08.501035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01a7d528-6395-41b3-8167-c8ce29fb66c3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:08.505347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01a7d528-6395-41b3-8167-c8ce29fb66c3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:08.508071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01a7d528-6395-41b3-8167-c8ce29fb66c3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:08.675266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0bf06da6-232a-4cb6-936f-70c7a9c602d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:08.698100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0bf06da6-232a-4cb6-936f-70c7a9c602d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1289 microversion: 2.1 time: 0.380157 Aug 18 21:55:08.699013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 15/36] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1289 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:08.746773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-16b2c43d-ee11-4ec8-8916-fb7c5eb1f5b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:08.747433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-16b2c43d-ee11-4ec8-8916-fb7c5eb1f5b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:08.789667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16b2c43d-ee11-4ec8-8916-fb7c5eb1f5b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:08.790152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16b2c43d-ee11-4ec8-8916-fb7c5eb1f5b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:08.791073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16b2c43d-ee11-4ec8-8916-fb7c5eb1f5b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:08.791760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16b2c43d-ee11-4ec8-8916-fb7c5eb1f5b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:08.792202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16b2c43d-ee11-4ec8-8916-fb7c5eb1f5b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:08.792478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16b2c43d-ee11-4ec8-8916-fb7c5eb1f5b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:09.051654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-16b2c43d-ee11-4ec8-8916-fb7c5eb1f5b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:09.082886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-16b2c43d-ee11-4ec8-8916-fb7c5eb1f5b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:09.091967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-16b2c43d-ee11-4ec8-8916-fb7c5eb1f5b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:09.095122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-16b2c43d-ee11-4ec8-8916-fb7c5eb1f5b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1342 microversion: 2.20 time: 0.389161 Aug 18 21:55:09.099808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 16/37] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1342 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:09.414830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-01a7d528-6395-41b3-8167-c8ce29fb66c3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:09.428948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-01a7d528-6395-41b3-8167-c8ce29fb66c3 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.991592 Aug 18 21:55:09.432159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 22/38] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:08 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:09.448279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-34afe460-aec8-4701-8627-6a3ae2473f20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:09.448896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-34afe460-aec8-4701-8627-6a3ae2473f20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:09.466165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34afe460-aec8-4701-8627-6a3ae2473f20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:09.467885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34afe460-aec8-4701-8627-6a3ae2473f20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:09.471610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34afe460-aec8-4701-8627-6a3ae2473f20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:09.479044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34afe460-aec8-4701-8627-6a3ae2473f20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:09.479599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34afe460-aec8-4701-8627-6a3ae2473f20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:09.482213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34afe460-aec8-4701-8627-6a3ae2473f20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:09.725448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-61b3d0bf-6a65-4c5f-a924-830999b217c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:09.726743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-61b3d0bf-6a65-4c5f-a924-830999b217c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:09.736912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-34afe460-aec8-4701-8627-6a3ae2473f20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:09.738187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61b3d0bf-6a65-4c5f-a924-830999b217c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:09.747307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61b3d0bf-6a65-4c5f-a924-830999b217c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:09.748380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61b3d0bf-6a65-4c5f-a924-830999b217c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:09.749268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61b3d0bf-6a65-4c5f-a924-830999b217c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:09.750088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61b3d0bf-6a65-4c5f-a924-830999b217c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:09.750545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61b3d0bf-6a65-4c5f-a924-830999b217c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:09.755144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-34afe460-aec8-4701-8627-6a3ae2473f20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1273 microversion: 2.1 time: 0.312160 Aug 18 21:55:09.768370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 17/39] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:09 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1273 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:09.931457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-61b3d0bf-6a65-4c5f-a924-830999b217c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:09.952284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-61b3d0bf-6a65-4c5f-a924-830999b217c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1297 microversion: 2.1 time: 0.232072 Aug 18 21:55:09.952905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 23/40] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1297 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:10.115803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-28c54eac-1f9c-4beb-a27f-384c6b605bd3 req-1f62c437-a8e9-440b-b8b0-73b613e77df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a249d5e7-ea93-4157-87dc-4fd3b6789cdb", "tag": "7cc31b7a-814f-44a7-8ae5-2de63707d442"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:10.119155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2e810c64-8045-4c17-bf6d-1fadc6129776 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:10.119804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2e810c64-8045-4c17-bf6d-1fadc6129776 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:10.129371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e810c64-8045-4c17-bf6d-1fadc6129776 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:10.129974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e810c64-8045-4c17-bf6d-1fadc6129776 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:10.130428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-28c54eac-1f9c-4beb-a27f-384c6b605bd3 req-1f62c437-a8e9-440b-b8b0-73b613e77df1 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:10.130593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e810c64-8045-4c17-bf6d-1fadc6129776 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:10.131203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-28c54eac-1f9c-4beb-a27f-384c6b605bd3 req-1f62c437-a8e9-440b-b8b0-73b613e77df1 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:10.131902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-28c54eac-1f9c-4beb-a27f-384c6b605bd3 req-1f62c437-a8e9-440b-b8b0-73b613e77df1 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:10.132861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e810c64-8045-4c17-bf6d-1fadc6129776 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:10.133343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e810c64-8045-4c17-bf6d-1fadc6129776 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:10.133818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e810c64-8045-4c17-bf6d-1fadc6129776 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:10.154462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-28c54eac-1f9c-4beb-a27f-384c6b605bd3 req-1f62c437-a8e9-440b-b8b0-73b613e77df1 service nova] Creating event network-changed:7cc31b7a-814f-44a7-8ae5-2de63707d442 for instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb on hv-cinder-85367 Aug 18 21:55:10.155341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-28c54eac-1f9c-4beb-a27f-384c6b605bd3 req-1f62c437-a8e9-440b-b8b0-73b613e77df1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 21:55:10.155941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-28c54eac-1f9c-4beb-a27f-384c6b605bd3 req-1f62c437-a8e9-440b-b8b0-73b613e77df1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 21:55:10.157318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3be055d-5a1f-4204-ab42-3aa1258c93c9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:10.158010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3be055d-5a1f-4204-ab42-3aa1258c93c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:10.158659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3be055d-5a1f-4204-ab42-3aa1258c93c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:10.159595 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3be055d-5a1f-4204-ab42-3aa1258c93c9 None None] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:10.160247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3be055d-5a1f-4204-ab42-3aa1258c93c9 None None] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:10.160876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3be055d-5a1f-4204-ab42-3aa1258c93c9 None None] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:10.175033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.compute.rpcapi [None req-b3be055d-5a1f-4204-ab42-3aa1258c93c9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 21:55:10.176328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3be055d-5a1f-4204-ab42-3aa1258c93c9 None None] Releasing lock "compute-rpcapi-router" {{(pid=120539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 21:55:10.196608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b3be055d-5a1f-4204-ab42-3aa1258c93c9 None None] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190807 Aug 18 21:55:10.198128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 18/41] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:10.248369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2e810c64-8045-4c17-bf6d-1fadc6129776 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:10.257490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2e810c64-8045-4c17-bf6d-1fadc6129776 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:10.259060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2e810c64-8045-4c17-bf6d-1fadc6129776 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:10.260209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2e810c64-8045-4c17-bf6d-1fadc6129776 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1352 microversion: 2.20 time: 0.145119 Aug 18 21:55:10.260772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 24/42] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:55:10.459552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f1efa0cb-0890-49bf-b026-34bf27f663aa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:10.460279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f1efa0cb-0890-49bf-b026-34bf27f663aa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:10.467015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1efa0cb-0890-49bf-b026-34bf27f663aa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:10.467499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1efa0cb-0890-49bf-b026-34bf27f663aa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:10.468145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1efa0cb-0890-49bf-b026-34bf27f663aa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:10.468848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1efa0cb-0890-49bf-b026-34bf27f663aa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:10.469520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1efa0cb-0890-49bf-b026-34bf27f663aa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:10.470005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1efa0cb-0890-49bf-b026-34bf27f663aa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:10.686698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f1efa0cb-0890-49bf-b026-34bf27f663aa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:10.704494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f1efa0cb-0890-49bf-b026-34bf27f663aa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.251433 Aug 18 21:55:10.707465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 19/43] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:10 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:10.776904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fad7beeb-bc81-4dd5-bfb2-752af00d4a60 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:10.777985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fad7beeb-bc81-4dd5-bfb2-752af00d4a60 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:10.804211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fad7beeb-bc81-4dd5-bfb2-752af00d4a60 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:10.804746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fad7beeb-bc81-4dd5-bfb2-752af00d4a60 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:10.805200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fad7beeb-bc81-4dd5-bfb2-752af00d4a60 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:10.805979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fad7beeb-bc81-4dd5-bfb2-752af00d4a60 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:10.809741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fad7beeb-bc81-4dd5-bfb2-752af00d4a60 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:10.814844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fad7beeb-bc81-4dd5-bfb2-752af00d4a60 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:10.939418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fad7beeb-bc81-4dd5-bfb2-752af00d4a60 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:10.951433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fad7beeb-bc81-4dd5-bfb2-752af00d4a60 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1273 microversion: 2.1 time: 0.178271 Aug 18 21:55:10.954898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 25/44] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:10 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:10.983438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-21a4e42c-fe59-4c80-b9f1-d7b84dd97751 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:10.984586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-21a4e42c-fe59-4c80-b9f1-d7b84dd97751 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:10.996169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21a4e42c-fe59-4c80-b9f1-d7b84dd97751 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:10.996794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21a4e42c-fe59-4c80-b9f1-d7b84dd97751 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:10.998145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21a4e42c-fe59-4c80-b9f1-d7b84dd97751 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:11.000585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21a4e42c-fe59-4c80-b9f1-d7b84dd97751 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:11.001269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21a4e42c-fe59-4c80-b9f1-d7b84dd97751 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:11.002106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21a4e42c-fe59-4c80-b9f1-d7b84dd97751 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:11.152205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-21a4e42c-fe59-4c80-b9f1-d7b84dd97751 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:11.163368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-21a4e42c-fe59-4c80-b9f1-d7b84dd97751 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1297 microversion: 2.1 time: 0.183681 Aug 18 21:55:11.164324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 20/45] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:10 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1297 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:11.287408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-25e34a5f-218c-4170-ac05-c5e9bfa27462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:11.288252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-25e34a5f-218c-4170-ac05-c5e9bfa27462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:11.291838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:11.303806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25e34a5f-218c-4170-ac05-c5e9bfa27462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:11.304545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25e34a5f-218c-4170-ac05-c5e9bfa27462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:11.305256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25e34a5f-218c-4170-ac05-c5e9bfa27462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:11.306198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25e34a5f-218c-4170-ac05-c5e9bfa27462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:11.306883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25e34a5f-218c-4170-ac05-c5e9bfa27462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:11.307642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25e34a5f-218c-4170-ac05-c5e9bfa27462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:11.401546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-25e34a5f-218c-4170-ac05-c5e9bfa27462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:11.421333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-25e34a5f-218c-4170-ac05-c5e9bfa27462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:11.423219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-25e34a5f-218c-4170-ac05-c5e9bfa27462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:11.424628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-25e34a5f-218c-4170-ac05-c5e9bfa27462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1352 microversion: 2.20 time: 0.142053 Aug 18 21:55:11.426360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 26/46] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1352 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:11.728397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e7539b2a-82ab-4a1a-b505-ea00edbd7513 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:11.729919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e7539b2a-82ab-4a1a-b505-ea00edbd7513 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:11.738073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7539b2a-82ab-4a1a-b505-ea00edbd7513 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:11.739057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7539b2a-82ab-4a1a-b505-ea00edbd7513 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:11.740596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7539b2a-82ab-4a1a-b505-ea00edbd7513 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:11.741636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7539b2a-82ab-4a1a-b505-ea00edbd7513 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:11.742710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7539b2a-82ab-4a1a-b505-ea00edbd7513 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:11.743426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7539b2a-82ab-4a1a-b505-ea00edbd7513 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:11.931533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e7539b2a-82ab-4a1a-b505-ea00edbd7513 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:11.942158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e7539b2a-82ab-4a1a-b505-ea00edbd7513 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.218501 Aug 18 21:55:11.943561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 21/47] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:11 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:11.972748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7c3ab416-25d7-48cb-b0b1-95247cd92427 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:11.974252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7c3ab416-25d7-48cb-b0b1-95247cd92427 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:11.980744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7c3ab416-25d7-48cb-b0b1-95247cd92427 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:11.981578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7c3ab416-25d7-48cb-b0b1-95247cd92427 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:11.982150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7c3ab416-25d7-48cb-b0b1-95247cd92427 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:11.983270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7c3ab416-25d7-48cb-b0b1-95247cd92427 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:11.983806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7c3ab416-25d7-48cb-b0b1-95247cd92427 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:11.984310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7c3ab416-25d7-48cb-b0b1-95247cd92427 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:12.064758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7c3ab416-25d7-48cb-b0b1-95247cd92427 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:12.073097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7c3ab416-25d7-48cb-b0b1-95247cd92427 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1273 microversion: 2.1 time: 0.104333 Aug 18 21:55:12.074241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 27/48] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:11 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:12.190588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7dbcbe24-d257-4fe3-b162-fa2eeda40dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:12.191204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7dbcbe24-d257-4fe3-b162-fa2eeda40dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:12.198841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dbcbe24-d257-4fe3-b162-fa2eeda40dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:12.199551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dbcbe24-d257-4fe3-b162-fa2eeda40dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:12.200141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dbcbe24-d257-4fe3-b162-fa2eeda40dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:12.202018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dbcbe24-d257-4fe3-b162-fa2eeda40dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:12.203217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dbcbe24-d257-4fe3-b162-fa2eeda40dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:12.203809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dbcbe24-d257-4fe3-b162-fa2eeda40dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:12.271675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7dbcbe24-d257-4fe3-b162-fa2eeda40dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:12.281096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7dbcbe24-d257-4fe3-b162-fa2eeda40dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1297 microversion: 2.1 time: 0.094537 Aug 18 21:55:12.281708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 22/49] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:12 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:12.449040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9cca683b-cbd9-4cd6-9489-cd2f4acfc52f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:12.449679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9cca683b-cbd9-4cd6-9489-cd2f4acfc52f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:12.455830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9cca683b-cbd9-4cd6-9489-cd2f4acfc52f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:12.456321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9cca683b-cbd9-4cd6-9489-cd2f4acfc52f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:12.456753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9cca683b-cbd9-4cd6-9489-cd2f4acfc52f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:12.457862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9cca683b-cbd9-4cd6-9489-cd2f4acfc52f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:12.458401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9cca683b-cbd9-4cd6-9489-cd2f4acfc52f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:12.458825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9cca683b-cbd9-4cd6-9489-cd2f4acfc52f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:12.549765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9cca683b-cbd9-4cd6-9489-cd2f4acfc52f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:12.571178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9cca683b-cbd9-4cd6-9489-cd2f4acfc52f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:12.573914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9cca683b-cbd9-4cd6-9489-cd2f4acfc52f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:12.579148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9cca683b-cbd9-4cd6-9489-cd2f4acfc52f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1352 microversion: 2.20 time: 0.133674 Aug 18 21:55:12.580109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 28/50] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:12 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:12.972489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d1580a2a-c522-43ca-951d-f74ef391a912 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:12.973964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d1580a2a-c522-43ca-951d-f74ef391a912 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:12.981174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1580a2a-c522-43ca-951d-f74ef391a912 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:12.982076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1580a2a-c522-43ca-951d-f74ef391a912 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:12.982666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1580a2a-c522-43ca-951d-f74ef391a912 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:12.983627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1580a2a-c522-43ca-951d-f74ef391a912 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:12.984319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1580a2a-c522-43ca-951d-f74ef391a912 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:12.984895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1580a2a-c522-43ca-951d-f74ef391a912 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:13.094918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-56333598-dcea-477e-bc28-2901da057410 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:13.095529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-56333598-dcea-477e-bc28-2901da057410 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:13.117046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56333598-dcea-477e-bc28-2901da057410 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:13.117046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56333598-dcea-477e-bc28-2901da057410 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:13.117046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56333598-dcea-477e-bc28-2901da057410 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:13.117046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56333598-dcea-477e-bc28-2901da057410 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:13.117475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56333598-dcea-477e-bc28-2901da057410 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:13.118961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56333598-dcea-477e-bc28-2901da057410 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:13.198703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d1580a2a-c522-43ca-951d-f74ef391a912 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:13.212828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d1580a2a-c522-43ca-951d-f74ef391a912 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.250422 Aug 18 21:55:13.235180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 23/51] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:12 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:13.243512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-56333598-dcea-477e-bc28-2901da057410 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:13.253149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-56333598-dcea-477e-bc28-2901da057410 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1273 microversion: 2.1 time: 0.162044 Aug 18 21:55:13.254090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 29/52] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:13 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:13.309078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cfe9717a-f898-4427-a34b-d09904a0522e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:13.309967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cfe9717a-f898-4427-a34b-d09904a0522e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:13.316573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cfe9717a-f898-4427-a34b-d09904a0522e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:13.317847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cfe9717a-f898-4427-a34b-d09904a0522e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:13.318458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cfe9717a-f898-4427-a34b-d09904a0522e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:13.319329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cfe9717a-f898-4427-a34b-d09904a0522e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:13.319937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cfe9717a-f898-4427-a34b-d09904a0522e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:13.320506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cfe9717a-f898-4427-a34b-d09904a0522e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:13.389798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cfe9717a-f898-4427-a34b-d09904a0522e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:13.398139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cfe9717a-f898-4427-a34b-d09904a0522e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1297 microversion: 2.1 time: 0.097240 Aug 18 21:55:13.398767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 24/53] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:13.604397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a36d84c3-f23a-4fb2-b373-50c317927028 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:13.605020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a36d84c3-f23a-4fb2-b373-50c317927028 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:13.615334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a36d84c3-f23a-4fb2-b373-50c317927028 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:13.615840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a36d84c3-f23a-4fb2-b373-50c317927028 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:13.616281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a36d84c3-f23a-4fb2-b373-50c317927028 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:13.617004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a36d84c3-f23a-4fb2-b373-50c317927028 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:13.617456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a36d84c3-f23a-4fb2-b373-50c317927028 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:13.617900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a36d84c3-f23a-4fb2-b373-50c317927028 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:13.702302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a36d84c3-f23a-4fb2-b373-50c317927028 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:13.725379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a36d84c3-f23a-4fb2-b373-50c317927028 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:13.727552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a36d84c3-f23a-4fb2-b373-50c317927028 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:13.728988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a36d84c3-f23a-4fb2-b373-50c317927028 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1352 microversion: 2.20 time: 0.128647 Aug 18 21:55:13.742727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 30/54] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:13 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1352 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:14.246396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-58d916fc-bedb-4e51-a1cb-e1f941724341 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:14.246396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-58d916fc-bedb-4e51-a1cb-e1f941724341 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:14.251960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58d916fc-bedb-4e51-a1cb-e1f941724341 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:14.252391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58d916fc-bedb-4e51-a1cb-e1f941724341 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:14.252848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58d916fc-bedb-4e51-a1cb-e1f941724341 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:14.253852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58d916fc-bedb-4e51-a1cb-e1f941724341 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:14.254661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58d916fc-bedb-4e51-a1cb-e1f941724341 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:14.255756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58d916fc-bedb-4e51-a1cb-e1f941724341 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:14.261311 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:14.277260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-395c3234-2da4-4f66-8caf-62136c06a0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:14.279137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-395c3234-2da4-4f66-8caf-62136c06a0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:14.299368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-395c3234-2da4-4f66-8caf-62136c06a0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:14.299732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-395c3234-2da4-4f66-8caf-62136c06a0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:14.300530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-395c3234-2da4-4f66-8caf-62136c06a0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:14.301317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-395c3234-2da4-4f66-8caf-62136c06a0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:14.310429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-395c3234-2da4-4f66-8caf-62136c06a0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:14.311273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-395c3234-2da4-4f66-8caf-62136c06a0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:14.500185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-395c3234-2da4-4f66-8caf-62136c06a0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:14.513453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-395c3234-2da4-4f66-8caf-62136c06a0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1273 microversion: 2.1 time: 0.242410 Aug 18 21:55:14.515316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 31/55] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:14 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1273 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:14.524201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3f0eac89-057c-41f6-8827-dfde02dbbb82 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:14.528071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3f0eac89-057c-41f6-8827-dfde02dbbb82 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:14.555889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:14.560004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f0eac89-057c-41f6-8827-dfde02dbbb82 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:14.563558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f0eac89-057c-41f6-8827-dfde02dbbb82 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:14.564256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f0eac89-057c-41f6-8827-dfde02dbbb82 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:14.573470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f0eac89-057c-41f6-8827-dfde02dbbb82 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:14.575857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f0eac89-057c-41f6-8827-dfde02dbbb82 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:14.577427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f0eac89-057c-41f6-8827-dfde02dbbb82 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:14.642434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:14.796528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-58d916fc-bedb-4e51-a1cb-e1f941724341 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:14.808236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-58d916fc-bedb-4e51-a1cb-e1f941724341 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.567968 Aug 18 21:55:14.812152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 25/56] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:14 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:14.833938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-81a78bb0-5398-41a0-be3e-ceb3e615792e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:14.838559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-81a78bb0-5398-41a0-be3e-ceb3e615792e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:14.864447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81a78bb0-5398-41a0-be3e-ceb3e615792e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:14.865436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81a78bb0-5398-41a0-be3e-ceb3e615792e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:14.866331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81a78bb0-5398-41a0-be3e-ceb3e615792e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:14.867232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81a78bb0-5398-41a0-be3e-ceb3e615792e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:14.869927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81a78bb0-5398-41a0-be3e-ceb3e615792e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:14.870381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81a78bb0-5398-41a0-be3e-ceb3e615792e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:15.199561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81a78bb0-5398-41a0-be3e-ceb3e615792e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:15.218954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81a78bb0-5398-41a0-be3e-ceb3e615792e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:15.226099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-81a78bb0-5398-41a0-be3e-ceb3e615792e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:15.230007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-81a78bb0-5398-41a0-be3e-ceb3e615792e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1352 microversion: 2.20 time: 0.416624 Aug 18 21:55:15.233648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 26/57] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1352 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:15.295279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3f0eac89-057c-41f6-8827-dfde02dbbb82 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:15.310882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3f0eac89-057c-41f6-8827-dfde02dbbb82 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1297 microversion: 2.1 time: 0.793211 Aug 18 21:55:15.312692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 32/58] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1297 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:15.536573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5d2327d4-0320-4a22-97b3-5b838544fc92 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:15.537326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5d2327d4-0320-4a22-97b3-5b838544fc92 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:15.545790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=20 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:15.559650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d2327d4-0320-4a22-97b3-5b838544fc92 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:15.560164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d2327d4-0320-4a22-97b3-5b838544fc92 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:15.560712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d2327d4-0320-4a22-97b3-5b838544fc92 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:15.561857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d2327d4-0320-4a22-97b3-5b838544fc92 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:15.561969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d2327d4-0320-4a22-97b3-5b838544fc92 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:15.562358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d2327d4-0320-4a22-97b3-5b838544fc92 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:15.714569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5d2327d4-0320-4a22-97b3-5b838544fc92 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:15.730655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5d2327d4-0320-4a22-97b3-5b838544fc92 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1281 microversion: 2.1 time: 0.198303 Aug 18 21:55:15.731853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 27/59] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:15 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1281 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:15.836788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-75152045-aee6-455a-88e9-33837f99ab82 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:15.837910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-75152045-aee6-455a-88e9-33837f99ab82 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:15.840621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:15.851498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75152045-aee6-455a-88e9-33837f99ab82 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:15.852152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75152045-aee6-455a-88e9-33837f99ab82 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:15.852803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75152045-aee6-455a-88e9-33837f99ab82 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:15.854230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75152045-aee6-455a-88e9-33837f99ab82 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:15.854953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75152045-aee6-455a-88e9-33837f99ab82 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:15.855523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75152045-aee6-455a-88e9-33837f99ab82 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:16.128763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-75152045-aee6-455a-88e9-33837f99ab82 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:16.145181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-75152045-aee6-455a-88e9-33837f99ab82 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.315795 Aug 18 21:55:16.147900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 33/60] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:15 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:16.256447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2588a611-9be9-4551-866d-8369e7806b4d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:16.257194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2588a611-9be9-4551-866d-8369e7806b4d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:16.263947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2588a611-9be9-4551-866d-8369e7806b4d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:16.264447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2588a611-9be9-4551-866d-8369e7806b4d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:16.264887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2588a611-9be9-4551-866d-8369e7806b4d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:16.265806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2588a611-9be9-4551-866d-8369e7806b4d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:16.266267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2588a611-9be9-4551-866d-8369e7806b4d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:16.266706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2588a611-9be9-4551-866d-8369e7806b4d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:16.338079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aec3926c-12a9-4f2f-90b5-282e67ee9057 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:16.338888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-aec3926c-12a9-4f2f-90b5-282e67ee9057 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:16.345881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aec3926c-12a9-4f2f-90b5-282e67ee9057 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:16.346580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aec3926c-12a9-4f2f-90b5-282e67ee9057 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:16.347421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aec3926c-12a9-4f2f-90b5-282e67ee9057 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:16.349089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aec3926c-12a9-4f2f-90b5-282e67ee9057 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:16.349839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aec3926c-12a9-4f2f-90b5-282e67ee9057 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:16.350536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aec3926c-12a9-4f2f-90b5-282e67ee9057 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:16.416011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2588a611-9be9-4551-866d-8369e7806b4d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:16.429780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aec3926c-12a9-4f2f-90b5-282e67ee9057 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:16.432038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2588a611-9be9-4551-866d-8369e7806b4d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:16.435338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2588a611-9be9-4551-866d-8369e7806b4d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:16.437283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2588a611-9be9-4551-866d-8369e7806b4d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1340 microversion: 2.20 time: 0.185705 Aug 18 21:55:16.438235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 28/61] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1340 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:16.444795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aec3926c-12a9-4f2f-90b5-282e67ee9057 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1295 microversion: 2.1 time: 0.113146 Aug 18 21:55:16.445937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 34/62] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1295 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:16.754169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a08c4021-7167-4e3e-92a7-2c60d64b3b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:16.754840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a08c4021-7167-4e3e-92a7-2c60d64b3b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:16.762083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a08c4021-7167-4e3e-92a7-2c60d64b3b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:16.762774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a08c4021-7167-4e3e-92a7-2c60d64b3b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:16.763988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a08c4021-7167-4e3e-92a7-2c60d64b3b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:16.765010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a08c4021-7167-4e3e-92a7-2c60d64b3b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:16.765475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a08c4021-7167-4e3e-92a7-2c60d64b3b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:16.766242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a08c4021-7167-4e3e-92a7-2c60d64b3b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:16.838162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a08c4021-7167-4e3e-92a7-2c60d64b3b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:16.847342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a08c4021-7167-4e3e-92a7-2c60d64b3b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1279 microversion: 2.1 time: 0.097398 Aug 18 21:55:16.848001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 29/63] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:16 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1279 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:17.167989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7482c023-82e3-4ba7-bf6b-7f53ec54de58 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:17.168610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7482c023-82e3-4ba7-bf6b-7f53ec54de58 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:17.174768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7482c023-82e3-4ba7-bf6b-7f53ec54de58 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:17.175263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7482c023-82e3-4ba7-bf6b-7f53ec54de58 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:17.175721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7482c023-82e3-4ba7-bf6b-7f53ec54de58 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:17.176403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7482c023-82e3-4ba7-bf6b-7f53ec54de58 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:17.177467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7482c023-82e3-4ba7-bf6b-7f53ec54de58 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:17.178088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7482c023-82e3-4ba7-bf6b-7f53ec54de58 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:17.320185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7482c023-82e3-4ba7-bf6b-7f53ec54de58 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:17.328144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7482c023-82e3-4ba7-bf6b-7f53ec54de58 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.164189 Aug 18 21:55:17.329156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 35/64] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:17 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:17.460084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5e32a1cd-9d9b-42fc-b2e2-802209c7bc24 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:17.460695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5e32a1cd-9d9b-42fc-b2e2-802209c7bc24 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:17.466611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e32a1cd-9d9b-42fc-b2e2-802209c7bc24 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:17.467081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e32a1cd-9d9b-42fc-b2e2-802209c7bc24 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:17.467315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ab46df3e-a737-41a7-98dc-dad9acc47a2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:17.467765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e32a1cd-9d9b-42fc-b2e2-802209c7bc24 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:17.468185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e32a1cd-9d9b-42fc-b2e2-802209c7bc24 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:17.468292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ab46df3e-a737-41a7-98dc-dad9acc47a2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:17.468627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e32a1cd-9d9b-42fc-b2e2-802209c7bc24 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:17.469217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e32a1cd-9d9b-42fc-b2e2-802209c7bc24 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:17.475824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab46df3e-a737-41a7-98dc-dad9acc47a2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:17.476318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab46df3e-a737-41a7-98dc-dad9acc47a2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:17.477184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab46df3e-a737-41a7-98dc-dad9acc47a2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:17.477938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab46df3e-a737-41a7-98dc-dad9acc47a2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:17.478395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab46df3e-a737-41a7-98dc-dad9acc47a2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:17.478979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab46df3e-a737-41a7-98dc-dad9acc47a2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:17.554449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ab46df3e-a737-41a7-98dc-dad9acc47a2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:17.564962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ab46df3e-a737-41a7-98dc-dad9acc47a2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1295 microversion: 2.1 time: 0.101940 Aug 18 21:55:17.565682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 36/65] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:17 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1295 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:17.627126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5e32a1cd-9d9b-42fc-b2e2-802209c7bc24 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:17.639072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5e32a1cd-9d9b-42fc-b2e2-802209c7bc24 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:17.640584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5e32a1cd-9d9b-42fc-b2e2-802209c7bc24 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:17.641941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5e32a1cd-9d9b-42fc-b2e2-802209c7bc24 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.186203 Aug 18 21:55:17.642527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 30/66] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:17.868685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a47aa206-adb0-434e-850a-fff1ffc8bdf4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:17.869315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a47aa206-adb0-434e-850a-fff1ffc8bdf4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:17.875205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a47aa206-adb0-434e-850a-fff1ffc8bdf4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:17.875687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a47aa206-adb0-434e-850a-fff1ffc8bdf4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:17.876131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a47aa206-adb0-434e-850a-fff1ffc8bdf4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:17.876828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a47aa206-adb0-434e-850a-fff1ffc8bdf4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:17.877288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a47aa206-adb0-434e-850a-fff1ffc8bdf4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:17.877755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a47aa206-adb0-434e-850a-fff1ffc8bdf4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:17.939988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a47aa206-adb0-434e-850a-fff1ffc8bdf4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:17.948101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a47aa206-adb0-434e-850a-fff1ffc8bdf4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1279 microversion: 2.1 time: 0.083806 Aug 18 21:55:17.948973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 37/67] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:17 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1279 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:18.351411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dfd6725d-df56-43bd-8afe-ceb49ffa1731 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:18.352297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dfd6725d-df56-43bd-8afe-ceb49ffa1731 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:18.360574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfd6725d-df56-43bd-8afe-ceb49ffa1731 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:18.361069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfd6725d-df56-43bd-8afe-ceb49ffa1731 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:18.361510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfd6725d-df56-43bd-8afe-ceb49ffa1731 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:18.362251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfd6725d-df56-43bd-8afe-ceb49ffa1731 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:18.362710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfd6725d-df56-43bd-8afe-ceb49ffa1731 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:18.363132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfd6725d-df56-43bd-8afe-ceb49ffa1731 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:18.585706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5d74ad15-7ebf-433b-8a4b-3e746b005dce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:18.587490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5d74ad15-7ebf-433b-8a4b-3e746b005dce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:18.595424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d74ad15-7ebf-433b-8a4b-3e746b005dce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:18.596085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d74ad15-7ebf-433b-8a4b-3e746b005dce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:18.596798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d74ad15-7ebf-433b-8a4b-3e746b005dce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:18.597699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d74ad15-7ebf-433b-8a4b-3e746b005dce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:18.598313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d74ad15-7ebf-433b-8a4b-3e746b005dce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:18.599688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d74ad15-7ebf-433b-8a4b-3e746b005dce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:18.637466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dfd6725d-df56-43bd-8afe-ceb49ffa1731 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:18.648954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dfd6725d-df56-43bd-8afe-ceb49ffa1731 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.302189 Aug 18 21:55:18.649977 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 31/68] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:18 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:18.668075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dcbaa277-b74e-4928-a471-5a14c9ab99f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:18.668934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dcbaa277-b74e-4928-a471-5a14c9ab99f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:18.678482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:18.681122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dcbaa277-b74e-4928-a471-5a14c9ab99f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:18.682059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dcbaa277-b74e-4928-a471-5a14c9ab99f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:18.682799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dcbaa277-b74e-4928-a471-5a14c9ab99f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:18.683739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dcbaa277-b74e-4928-a471-5a14c9ab99f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:18.684751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dcbaa277-b74e-4928-a471-5a14c9ab99f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:18.685387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dcbaa277-b74e-4928-a471-5a14c9ab99f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:18.881480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5d74ad15-7ebf-433b-8a4b-3e746b005dce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:18.890760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5d74ad15-7ebf-433b-8a4b-3e746b005dce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1295 microversion: 2.1 time: 0.308895 Aug 18 21:55:18.905968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 38/69] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:18 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1295 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:18.968771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7d8bdf5e-0aa5-4719-a43c-df8579400bd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:18.969407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7d8bdf5e-0aa5-4719-a43c-df8579400bd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:18.979554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d8bdf5e-0aa5-4719-a43c-df8579400bd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:18.980470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d8bdf5e-0aa5-4719-a43c-df8579400bd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:18.982514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d8bdf5e-0aa5-4719-a43c-df8579400bd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:18.983677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d8bdf5e-0aa5-4719-a43c-df8579400bd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:18.989840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d8bdf5e-0aa5-4719-a43c-df8579400bd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:18.990303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d8bdf5e-0aa5-4719-a43c-df8579400bd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:19.107639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dcbaa277-b74e-4928-a471-5a14c9ab99f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:19.120202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dcbaa277-b74e-4928-a471-5a14c9ab99f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:19.122061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dcbaa277-b74e-4928-a471-5a14c9ab99f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:19.125069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dcbaa277-b74e-4928-a471-5a14c9ab99f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.461896 Aug 18 21:55:19.126247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 32/70] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:18 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:55:19.280421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7d8bdf5e-0aa5-4719-a43c-df8579400bd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:19.296670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7d8bdf5e-0aa5-4719-a43c-df8579400bd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1279 microversion: 2.1 time: 0.329868 Aug 18 21:55:19.298540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 39/71] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:18 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1279 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:19.676277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-507a65dc-6f9a-4aec-b01a-b465ad5d6a5b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:19.677751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-507a65dc-6f9a-4aec-b01a-b465ad5d6a5b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:19.692147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-507a65dc-6f9a-4aec-b01a-b465ad5d6a5b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:19.694067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-507a65dc-6f9a-4aec-b01a-b465ad5d6a5b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:19.694814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-507a65dc-6f9a-4aec-b01a-b465ad5d6a5b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:19.697066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-507a65dc-6f9a-4aec-b01a-b465ad5d6a5b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:19.698804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-507a65dc-6f9a-4aec-b01a-b465ad5d6a5b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:19.699774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-507a65dc-6f9a-4aec-b01a-b465ad5d6a5b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:19.913455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8c0ddef5-88dc-4f67-808b-db3becab5beb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:19.915044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8c0ddef5-88dc-4f67-808b-db3becab5beb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:19.922709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c0ddef5-88dc-4f67-808b-db3becab5beb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:19.923310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c0ddef5-88dc-4f67-808b-db3becab5beb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:19.923919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c0ddef5-88dc-4f67-808b-db3becab5beb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:19.924774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c0ddef5-88dc-4f67-808b-db3becab5beb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:19.925463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c0ddef5-88dc-4f67-808b-db3becab5beb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:19.926068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c0ddef5-88dc-4f67-808b-db3becab5beb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:20.171997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:20.507914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8c0ddef5-88dc-4f67-808b-db3becab5beb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:20.517474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8c0ddef5-88dc-4f67-808b-db3becab5beb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.606367 Aug 18 21:55:20.518542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 40/72] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:19 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:20.523278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-507a65dc-6f9a-4aec-b01a-b465ad5d6a5b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:20.524822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d25a719b-5481-4180-9163-2c35b35b92c8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:20.525805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d25a719b-5481-4180-9163-2c35b35b92c8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:20.538796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-507a65dc-6f9a-4aec-b01a-b465ad5d6a5b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.868793 Aug 18 21:55:20.539980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 33/73] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:19 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:20.544709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-75eab1c0-236f-4aa4-b444-e98f2dd6932d req-b01e2bd1-40f7-42a2-83ab-eca7dfc5e4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44bde447-4f59-4989-822c-8125ab3befeb", "tag": "e3b890d9-e4dc-4b1c-b774-b4b2c42f8616"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:20.556999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d25a719b-5481-4180-9163-2c35b35b92c8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:20.560486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d25a719b-5481-4180-9163-2c35b35b92c8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:20.563622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d25a719b-5481-4180-9163-2c35b35b92c8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:20.564459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d25a719b-5481-4180-9163-2c35b35b92c8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:20.565033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d25a719b-5481-4180-9163-2c35b35b92c8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:20.566057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d25a719b-5481-4180-9163-2c35b35b92c8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:20.567933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-75eab1c0-236f-4aa4-b444-e98f2dd6932d req-b01e2bd1-40f7-42a2-83ab-eca7dfc5e4a3 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:20.568596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-75eab1c0-236f-4aa4-b444-e98f2dd6932d req-b01e2bd1-40f7-42a2-83ab-eca7dfc5e4a3 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:20.569215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-75eab1c0-236f-4aa4-b444-e98f2dd6932d req-b01e2bd1-40f7-42a2-83ab-eca7dfc5e4a3 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:20.592750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-75eab1c0-236f-4aa4-b444-e98f2dd6932d req-b01e2bd1-40f7-42a2-83ab-eca7dfc5e4a3 service nova] Creating event network-changed:e3b890d9-e4dc-4b1c-b774-b4b2c42f8616 for instance 44bde447-4f59-4989-822c-8125ab3befeb on hv-cinder-85367 Aug 18 21:55:20.600387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-75eab1c0-236f-4aa4-b444-e98f2dd6932d req-b01e2bd1-40f7-42a2-83ab-eca7dfc5e4a3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057102 Aug 18 21:55:20.601465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 34/74] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:20.609555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-530010a1-0f72-4d3a-90d7-c7dfaf06f8f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:20.612636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-530010a1-0f72-4d3a-90d7-c7dfaf06f8f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:20.636755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530010a1-0f72-4d3a-90d7-c7dfaf06f8f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:20.636755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530010a1-0f72-4d3a-90d7-c7dfaf06f8f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:20.636755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530010a1-0f72-4d3a-90d7-c7dfaf06f8f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:20.636755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530010a1-0f72-4d3a-90d7-c7dfaf06f8f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:20.637192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530010a1-0f72-4d3a-90d7-c7dfaf06f8f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:20.637192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530010a1-0f72-4d3a-90d7-c7dfaf06f8f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:20.781574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-530010a1-0f72-4d3a-90d7-c7dfaf06f8f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:20.794839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-530010a1-0f72-4d3a-90d7-c7dfaf06f8f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1279 microversion: 2.1 time: 0.191275 Aug 18 21:55:20.796469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 35/75] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:20 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1279 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:21.130472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d25a719b-5481-4180-9163-2c35b35b92c8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:21.166285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d25a719b-5481-4180-9163-2c35b35b92c8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:21.174778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d25a719b-5481-4180-9163-2c35b35b92c8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:21.175979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d25a719b-5481-4180-9163-2c35b35b92c8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.655677 Aug 18 21:55:21.185748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 41/76] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:20 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:21.543109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5e72fb71-8c6a-4bb5-a97e-6f72a0489bac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:21.543777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5e72fb71-8c6a-4bb5-a97e-6f72a0489bac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:21.553653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e72fb71-8c6a-4bb5-a97e-6f72a0489bac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:21.554416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e72fb71-8c6a-4bb5-a97e-6f72a0489bac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:21.560573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ffa3d4ef-1298-4c04-81ad-5466e1e3dc36 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:21.561191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ffa3d4ef-1298-4c04-81ad-5466e1e3dc36 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:21.564666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e72fb71-8c6a-4bb5-a97e-6f72a0489bac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:21.565413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e72fb71-8c6a-4bb5-a97e-6f72a0489bac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:21.565911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e72fb71-8c6a-4bb5-a97e-6f72a0489bac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:21.566342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e72fb71-8c6a-4bb5-a97e-6f72a0489bac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:21.572786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffa3d4ef-1298-4c04-81ad-5466e1e3dc36 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:21.573281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffa3d4ef-1298-4c04-81ad-5466e1e3dc36 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:21.573738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffa3d4ef-1298-4c04-81ad-5466e1e3dc36 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:21.575156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffa3d4ef-1298-4c04-81ad-5466e1e3dc36 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:21.577424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffa3d4ef-1298-4c04-81ad-5466e1e3dc36 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:21.578265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffa3d4ef-1298-4c04-81ad-5466e1e3dc36 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:21.857394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5e72fb71-8c6a-4bb5-a97e-6f72a0489bac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:21.867835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5e72fb71-8c6a-4bb5-a97e-6f72a0489bac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.328911 Aug 18 21:55:21.869203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 36/77] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:22.023400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ffa3d4ef-1298-4c04-81ad-5466e1e3dc36 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:22.033413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ffa3d4ef-1298-4c04-81ad-5466e1e3dc36 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.476743 Aug 18 21:55:22.034038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 42/78] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:21 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:22.042019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-43f0ecdc-6e99-4c47-8b88-ac9de9c0d6b1 req-518360e4-e5a0-4faf-a14d-08843c2f802a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0426bb7b-e862-4873-9c1e-7878b89cde47", "tag": "a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:22.053299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d58cb4a2-9154-4db3-96da-92e189e67ffe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:22.054038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d58cb4a2-9154-4db3-96da-92e189e67ffe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:22.058919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-43f0ecdc-6e99-4c47-8b88-ac9de9c0d6b1 req-518360e4-e5a0-4faf-a14d-08843c2f802a service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:22.059642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-43f0ecdc-6e99-4c47-8b88-ac9de9c0d6b1 req-518360e4-e5a0-4faf-a14d-08843c2f802a service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:22.060281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-43f0ecdc-6e99-4c47-8b88-ac9de9c0d6b1 req-518360e4-e5a0-4faf-a14d-08843c2f802a service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:22.060683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d58cb4a2-9154-4db3-96da-92e189e67ffe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:22.064074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d58cb4a2-9154-4db3-96da-92e189e67ffe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:22.064074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d58cb4a2-9154-4db3-96da-92e189e67ffe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:22.064074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d58cb4a2-9154-4db3-96da-92e189e67ffe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:22.077378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-43f0ecdc-6e99-4c47-8b88-ac9de9c0d6b1 req-518360e4-e5a0-4faf-a14d-08843c2f802a service nova] Creating event network-changed:a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b for instance 0426bb7b-e862-4873-9c1e-7878b89cde47 on hv-cinder-85367 Aug 18 21:55:22.078954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d58cb4a2-9154-4db3-96da-92e189e67ffe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:22.080284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d58cb4a2-9154-4db3-96da-92e189e67ffe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:22.082442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-43f0ecdc-6e99-4c47-8b88-ac9de9c0d6b1 req-518360e4-e5a0-4faf-a14d-08843c2f802a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211765 Aug 18 21:55:22.083708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 37/79] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:22.205581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5163554a-88fe-44dd-8b18-63edff2730c4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:22.206390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5163554a-88fe-44dd-8b18-63edff2730c4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:22.213484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5163554a-88fe-44dd-8b18-63edff2730c4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:22.214126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5163554a-88fe-44dd-8b18-63edff2730c4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:22.214626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5163554a-88fe-44dd-8b18-63edff2730c4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:22.215532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5163554a-88fe-44dd-8b18-63edff2730c4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:22.216052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5163554a-88fe-44dd-8b18-63edff2730c4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:22.216540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5163554a-88fe-44dd-8b18-63edff2730c4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:22.280805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d58cb4a2-9154-4db3-96da-92e189e67ffe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:22.289194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d58cb4a2-9154-4db3-96da-92e189e67ffe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.242306 Aug 18 21:55:22.290255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 43/80] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:22 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:22.386552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5163554a-88fe-44dd-8b18-63edff2730c4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:22.399356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5163554a-88fe-44dd-8b18-63edff2730c4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:22.401457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5163554a-88fe-44dd-8b18-63edff2730c4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:22.402734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5163554a-88fe-44dd-8b18-63edff2730c4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.205019 Aug 18 21:55:22.403309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 38/81] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:22.638695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-2614b7ca-703f-4b4a-aa8f-70cdb274064f req-d366ed36-5ebd-4f05-88be-bf978e80057f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3851c11-f4ba-40cd-946e-d113ddb6e3b3", "tag": "09c93341-0714-48fb-b589-3f3fe222c0a8"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:22.651899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2614b7ca-703f-4b4a-aa8f-70cdb274064f req-d366ed36-5ebd-4f05-88be-bf978e80057f service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:22.652725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2614b7ca-703f-4b4a-aa8f-70cdb274064f req-d366ed36-5ebd-4f05-88be-bf978e80057f service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:22.653157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2614b7ca-703f-4b4a-aa8f-70cdb274064f req-d366ed36-5ebd-4f05-88be-bf978e80057f service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:22.673966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-2614b7ca-703f-4b4a-aa8f-70cdb274064f req-d366ed36-5ebd-4f05-88be-bf978e80057f service nova] Creating event network-changed:09c93341-0714-48fb-b589-3f3fe222c0a8 for instance b3851c11-f4ba-40cd-946e-d113ddb6e3b3 on hv-cinder-85367 Aug 18 21:55:22.674485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2614b7ca-703f-4b4a-aa8f-70cdb274064f req-d366ed36-5ebd-4f05-88be-bf978e80057f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120538) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 21:55:22.674936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2614b7ca-703f-4b4a-aa8f-70cdb274064f req-d366ed36-5ebd-4f05-88be-bf978e80057f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120538) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 21:55:22.675864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0fcffa2-0895-45a6-aaab-d2ef2802d34d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:22.676429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0fcffa2-0895-45a6-aaab-d2ef2802d34d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:22.676920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0fcffa2-0895-45a6-aaab-d2ef2802d34d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:22.677653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0fcffa2-0895-45a6-aaab-d2ef2802d34d None None] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:22.678103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0fcffa2-0895-45a6-aaab-d2ef2802d34d None None] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:22.678560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0fcffa2-0895-45a6-aaab-d2ef2802d34d None None] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:22.687024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.compute.rpcapi [None req-b0fcffa2-0895-45a6-aaab-d2ef2802d34d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 21:55:22.688087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0fcffa2-0895-45a6-aaab-d2ef2802d34d None None] Releasing lock "compute-rpcapi-router" {{(pid=120538) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 21:55:22.707401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b0fcffa2-0895-45a6-aaab-d2ef2802d34d None None] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072132 Aug 18 21:55:22.708799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 44/82] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:22.889504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-471e9700-2573-4df8-a4db-e17a5a7b902e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:22.890147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-471e9700-2573-4df8-a4db-e17a5a7b902e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:22.896731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-471e9700-2573-4df8-a4db-e17a5a7b902e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:22.897219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-471e9700-2573-4df8-a4db-e17a5a7b902e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:22.897700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-471e9700-2573-4df8-a4db-e17a5a7b902e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:22.898403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-471e9700-2573-4df8-a4db-e17a5a7b902e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:22.898854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-471e9700-2573-4df8-a4db-e17a5a7b902e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:22.899417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-471e9700-2573-4df8-a4db-e17a5a7b902e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:23.056204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-16438f2a-bdb9-4e20-8204-1da3eacabaf2 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:23.057214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-16438f2a-bdb9-4e20-8204-1da3eacabaf2 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:23.066916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16438f2a-bdb9-4e20-8204-1da3eacabaf2 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:23.067262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-471e9700-2573-4df8-a4db-e17a5a7b902e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:23.067868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16438f2a-bdb9-4e20-8204-1da3eacabaf2 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:23.068401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16438f2a-bdb9-4e20-8204-1da3eacabaf2 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:23.069339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16438f2a-bdb9-4e20-8204-1da3eacabaf2 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:23.070060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16438f2a-bdb9-4e20-8204-1da3eacabaf2 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:23.071736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16438f2a-bdb9-4e20-8204-1da3eacabaf2 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:23.087828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-471e9700-2573-4df8-a4db-e17a5a7b902e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.202071 Aug 18 21:55:23.090523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 39/83] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:23.208820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-16438f2a-bdb9-4e20-8204-1da3eacabaf2 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:23.217728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-16438f2a-bdb9-4e20-8204-1da3eacabaf2 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.166332 Aug 18 21:55:23.218102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 45/84] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:23 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:23.312230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-10cb545a-4153-4290-8e03-2b2feda3d6a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:23.312862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-10cb545a-4153-4290-8e03-2b2feda3d6a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:23.318985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10cb545a-4153-4290-8e03-2b2feda3d6a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:23.319655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10cb545a-4153-4290-8e03-2b2feda3d6a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:23.320277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10cb545a-4153-4290-8e03-2b2feda3d6a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:23.321145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10cb545a-4153-4290-8e03-2b2feda3d6a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:23.321671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10cb545a-4153-4290-8e03-2b2feda3d6a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:23.322054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10cb545a-4153-4290-8e03-2b2feda3d6a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:23.427548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-feaf8f7a-0969-419a-93b3-a03c682e6b88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:23.428751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-feaf8f7a-0969-419a-93b3-a03c682e6b88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:23.435007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feaf8f7a-0969-419a-93b3-a03c682e6b88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:23.435975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feaf8f7a-0969-419a-93b3-a03c682e6b88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:23.436738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feaf8f7a-0969-419a-93b3-a03c682e6b88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:23.437637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feaf8f7a-0969-419a-93b3-a03c682e6b88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:23.438260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feaf8f7a-0969-419a-93b3-a03c682e6b88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:23.438695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feaf8f7a-0969-419a-93b3-a03c682e6b88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:23.480242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-10cb545a-4153-4290-8e03-2b2feda3d6a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:23.493142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-10cb545a-4153-4290-8e03-2b2feda3d6a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.184913 Aug 18 21:55:23.494339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 40/85] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:23 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:23.583421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-feaf8f7a-0969-419a-93b3-a03c682e6b88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:23.592243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-feaf8f7a-0969-419a-93b3-a03c682e6b88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:23.593808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-feaf8f7a-0969-419a-93b3-a03c682e6b88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:23.595220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-feaf8f7a-0969-419a-93b3-a03c682e6b88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.172184 Aug 18 21:55:23.595786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 46/86] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:55:24.111330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6e33fc4a-be1a-4ee0-bda5-758a592a2f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:24.112000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6e33fc4a-be1a-4ee0-bda5-758a592a2f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:24.118049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e33fc4a-be1a-4ee0-bda5-758a592a2f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:24.118537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e33fc4a-be1a-4ee0-bda5-758a592a2f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:24.118976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e33fc4a-be1a-4ee0-bda5-758a592a2f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:24.119663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e33fc4a-be1a-4ee0-bda5-758a592a2f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:24.120119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e33fc4a-be1a-4ee0-bda5-758a592a2f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:24.120592 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e33fc4a-be1a-4ee0-bda5-758a592a2f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:24.239247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d9a4086f-a455-4b5a-b607-9ba960b790c1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:24.240105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d9a4086f-a455-4b5a-b607-9ba960b790c1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:24.246824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9a4086f-a455-4b5a-b607-9ba960b790c1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:24.247474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9a4086f-a455-4b5a-b607-9ba960b790c1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:24.248090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9a4086f-a455-4b5a-b607-9ba960b790c1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:24.249112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9a4086f-a455-4b5a-b607-9ba960b790c1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:24.250368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9a4086f-a455-4b5a-b607-9ba960b790c1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:24.250805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9a4086f-a455-4b5a-b607-9ba960b790c1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:24.269859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6e33fc4a-be1a-4ee0-bda5-758a592a2f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:24.284243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6e33fc4a-be1a-4ee0-bda5-758a592a2f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.176693 Aug 18 21:55:24.284823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 41/87] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:24.386703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d9a4086f-a455-4b5a-b607-9ba960b790c1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:24.394753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d9a4086f-a455-4b5a-b607-9ba960b790c1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.159600 Aug 18 21:55:24.395852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 47/88] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:24 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:24.515002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2cc480a8-b70e-4f18-930f-9a5d4bb81086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:24.515625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2cc480a8-b70e-4f18-930f-9a5d4bb81086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:24.522074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cc480a8-b70e-4f18-930f-9a5d4bb81086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:24.522564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cc480a8-b70e-4f18-930f-9a5d4bb81086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:24.523007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cc480a8-b70e-4f18-930f-9a5d4bb81086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:24.523746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cc480a8-b70e-4f18-930f-9a5d4bb81086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:24.524204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cc480a8-b70e-4f18-930f-9a5d4bb81086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:24.524635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cc480a8-b70e-4f18-930f-9a5d4bb81086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:24.618519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-84839f0a-8ab8-4f8a-b3c7-f4d1e94c24e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:24.619130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-84839f0a-8ab8-4f8a-b3c7-f4d1e94c24e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:24.625136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84839f0a-8ab8-4f8a-b3c7-f4d1e94c24e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:24.625646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84839f0a-8ab8-4f8a-b3c7-f4d1e94c24e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:24.626083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84839f0a-8ab8-4f8a-b3c7-f4d1e94c24e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:24.626772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84839f0a-8ab8-4f8a-b3c7-f4d1e94c24e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:24.627217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84839f0a-8ab8-4f8a-b3c7-f4d1e94c24e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:24.627641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84839f0a-8ab8-4f8a-b3c7-f4d1e94c24e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:24.652966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2cc480a8-b70e-4f18-930f-9a5d4bb81086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:24.661053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2cc480a8-b70e-4f18-930f-9a5d4bb81086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.150095 Aug 18 21:55:24.662035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 42/89] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:24 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:24.779036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-84839f0a-8ab8-4f8a-b3c7-f4d1e94c24e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:24.787299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-84839f0a-8ab8-4f8a-b3c7-f4d1e94c24e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:24.788801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-84839f0a-8ab8-4f8a-b3c7-f4d1e94c24e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:24.790012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-84839f0a-8ab8-4f8a-b3c7-f4d1e94c24e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.175355 Aug 18 21:55:24.790810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 48/90] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:24 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:55:25.305889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-56dd07bb-2873-4338-8e66-5e8cb1981bc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:25.306514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-56dd07bb-2873-4338-8e66-5e8cb1981bc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:25.312501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56dd07bb-2873-4338-8e66-5e8cb1981bc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:25.312994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56dd07bb-2873-4338-8e66-5e8cb1981bc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:25.313437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56dd07bb-2873-4338-8e66-5e8cb1981bc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:25.314166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56dd07bb-2873-4338-8e66-5e8cb1981bc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:25.314627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56dd07bb-2873-4338-8e66-5e8cb1981bc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:25.315053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56dd07bb-2873-4338-8e66-5e8cb1981bc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:25.319649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:25.415969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5fe53781-202f-41ee-abfd-f3bf38c013d7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:25.416585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5fe53781-202f-41ee-abfd-f3bf38c013d7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:25.424234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fe53781-202f-41ee-abfd-f3bf38c013d7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:25.424927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fe53781-202f-41ee-abfd-f3bf38c013d7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:25.425364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fe53781-202f-41ee-abfd-f3bf38c013d7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:25.426084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fe53781-202f-41ee-abfd-f3bf38c013d7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:25.426908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fe53781-202f-41ee-abfd-f3bf38c013d7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:25.427331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fe53781-202f-41ee-abfd-f3bf38c013d7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:25.446763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:25.456192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-56dd07bb-2873-4338-8e66-5e8cb1981bc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:25.475459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-56dd07bb-2873-4338-8e66-5e8cb1981bc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.173294 Aug 18 21:55:25.475996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 43/91] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:25.580812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5fe53781-202f-41ee-abfd-f3bf38c013d7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:25.589570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5fe53781-202f-41ee-abfd-f3bf38c013d7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.177523 Aug 18 21:55:25.590485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 49/92] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:25 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:25.682752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f5d03f0b-985c-4f48-a739-38042e7ae6ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:25.683325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f5d03f0b-985c-4f48-a739-38042e7ae6ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:25.689302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5d03f0b-985c-4f48-a739-38042e7ae6ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:25.689817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5d03f0b-985c-4f48-a739-38042e7ae6ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:25.690253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5d03f0b-985c-4f48-a739-38042e7ae6ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:25.690938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5d03f0b-985c-4f48-a739-38042e7ae6ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:25.691389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5d03f0b-985c-4f48-a739-38042e7ae6ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:25.691809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5d03f0b-985c-4f48-a739-38042e7ae6ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:25.816279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fa5241e5-9348-4938-adb3-e3e1511515a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:25.816935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fa5241e5-9348-4938-adb3-e3e1511515a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:25.823045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f5d03f0b-985c-4f48-a739-38042e7ae6ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:25.823646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa5241e5-9348-4938-adb3-e3e1511515a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:25.824131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa5241e5-9348-4938-adb3-e3e1511515a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:25.824564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa5241e5-9348-4938-adb3-e3e1511515a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:25.825258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa5241e5-9348-4938-adb3-e3e1511515a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:25.825734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa5241e5-9348-4938-adb3-e3e1511515a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:25.826156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa5241e5-9348-4938-adb3-e3e1511515a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:25.830571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f5d03f0b-985c-4f48-a739-38042e7ae6ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.151771 Aug 18 21:55:25.831304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 44/93] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:25 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:25.954493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fa5241e5-9348-4938-adb3-e3e1511515a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:25.962806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fa5241e5-9348-4938-adb3-e3e1511515a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:25.964290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fa5241e5-9348-4938-adb3-e3e1511515a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:25.965400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fa5241e5-9348-4938-adb3-e3e1511515a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.153950 Aug 18 21:55:25.966005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 50/94] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:25 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:55:26.495390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-530e2e77-00f2-4e39-8017-96048367c690 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:26.496033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-530e2e77-00f2-4e39-8017-96048367c690 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:26.502270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530e2e77-00f2-4e39-8017-96048367c690 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:26.502408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530e2e77-00f2-4e39-8017-96048367c690 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:26.502844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530e2e77-00f2-4e39-8017-96048367c690 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:26.503540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530e2e77-00f2-4e39-8017-96048367c690 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:26.503993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530e2e77-00f2-4e39-8017-96048367c690 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:26.504413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530e2e77-00f2-4e39-8017-96048367c690 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:26.610959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f39ba872-a6e4-436e-ad3f-30631f91219e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:26.611579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f39ba872-a6e4-436e-ad3f-30631f91219e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:26.617804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f39ba872-a6e4-436e-ad3f-30631f91219e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:26.618299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f39ba872-a6e4-436e-ad3f-30631f91219e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:26.618740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f39ba872-a6e4-436e-ad3f-30631f91219e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:26.619437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f39ba872-a6e4-436e-ad3f-30631f91219e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:26.619890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f39ba872-a6e4-436e-ad3f-30631f91219e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:26.620322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f39ba872-a6e4-436e-ad3f-30631f91219e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:26.631468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-530e2e77-00f2-4e39-8017-96048367c690 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:26.639074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-530e2e77-00f2-4e39-8017-96048367c690 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.147555 Aug 18 21:55:26.639842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 45/95] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:26 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:26.750615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f39ba872-a6e4-436e-ad3f-30631f91219e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:26.758811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f39ba872-a6e4-436e-ad3f-30631f91219e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.151705 Aug 18 21:55:26.759386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 51/96] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:26 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:26.851001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dc19e19a-5db5-4a23-995e-36a3dd61637f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:26.851526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dc19e19a-5db5-4a23-995e-36a3dd61637f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:26.857369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc19e19a-5db5-4a23-995e-36a3dd61637f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:26.857882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc19e19a-5db5-4a23-995e-36a3dd61637f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:26.858309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc19e19a-5db5-4a23-995e-36a3dd61637f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:26.858992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc19e19a-5db5-4a23-995e-36a3dd61637f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:26.859466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc19e19a-5db5-4a23-995e-36a3dd61637f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:26.859887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc19e19a-5db5-4a23-995e-36a3dd61637f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:26.986192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc19e19a-5db5-4a23-995e-36a3dd61637f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:26.988246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1a4420d8-5f8a-4f63-8c18-a11ab2f79e57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:26.988896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1a4420d8-5f8a-4f63-8c18-a11ab2f79e57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:26.994262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dc19e19a-5db5-4a23-995e-36a3dd61637f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.147308 Aug 18 21:55:26.994850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 46/97] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:26 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:26.994993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a4420d8-5f8a-4f63-8c18-a11ab2f79e57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:26.995362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a4420d8-5f8a-4f63-8c18-a11ab2f79e57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:26.995801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a4420d8-5f8a-4f63-8c18-a11ab2f79e57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:26.996505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a4420d8-5f8a-4f63-8c18-a11ab2f79e57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:26.996974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a4420d8-5f8a-4f63-8c18-a11ab2f79e57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:26.997402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a4420d8-5f8a-4f63-8c18-a11ab2f79e57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:27.136855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1a4420d8-5f8a-4f63-8c18-a11ab2f79e57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:27.151272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1a4420d8-5f8a-4f63-8c18-a11ab2f79e57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:27.153954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1a4420d8-5f8a-4f63-8c18-a11ab2f79e57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:27.155706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1a4420d8-5f8a-4f63-8c18-a11ab2f79e57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.171259 Aug 18 21:55:27.157159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 52/98] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:26 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:27.664512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5e6f314e-79d1-46c3-a351-58573462b906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:27.667705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5e6f314e-79d1-46c3-a351-58573462b906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:27.678913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e6f314e-79d1-46c3-a351-58573462b906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:27.680411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e6f314e-79d1-46c3-a351-58573462b906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:27.681066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e6f314e-79d1-46c3-a351-58573462b906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:27.683019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e6f314e-79d1-46c3-a351-58573462b906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:27.684538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e6f314e-79d1-46c3-a351-58573462b906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:27.685677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e6f314e-79d1-46c3-a351-58573462b906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:27.779968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-46b38793-ee37-4846-91e9-0957d2e8eab7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:27.780596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46b38793-ee37-4846-91e9-0957d2e8eab7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:27.790209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b38793-ee37-4846-91e9-0957d2e8eab7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:27.790971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b38793-ee37-4846-91e9-0957d2e8eab7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:27.792005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b38793-ee37-4846-91e9-0957d2e8eab7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:27.792117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b38793-ee37-4846-91e9-0957d2e8eab7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:27.792548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b38793-ee37-4846-91e9-0957d2e8eab7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:27.792972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b38793-ee37-4846-91e9-0957d2e8eab7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:28.023015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-46b38793-ee37-4846-91e9-0957d2e8eab7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:28.034314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-46b38793-ee37-4846-91e9-0957d2e8eab7 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.258162 Aug 18 21:55:28.035348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 53/99] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:27 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:28.043788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0143d820-0eaf-4f11-84f1-c28a1828277b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:28.044586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0143d820-0eaf-4f11-84f1-c28a1828277b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:28.052449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0143d820-0eaf-4f11-84f1-c28a1828277b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:28.053224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0143d820-0eaf-4f11-84f1-c28a1828277b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:28.053959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0143d820-0eaf-4f11-84f1-c28a1828277b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:28.055103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0143d820-0eaf-4f11-84f1-c28a1828277b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:28.055854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0143d820-0eaf-4f11-84f1-c28a1828277b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:28.056462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0143d820-0eaf-4f11-84f1-c28a1828277b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:28.317411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0143d820-0eaf-4f11-84f1-c28a1828277b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:28.327596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0143d820-0eaf-4f11-84f1-c28a1828277b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.289478 Aug 18 21:55:28.328249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 54/100] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:28 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:28.352165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0088a495-51bc-4a2b-ad2c-231b42b37396 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:28.353064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0088a495-51bc-4a2b-ad2c-231b42b37396 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:28.363241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0088a495-51bc-4a2b-ad2c-231b42b37396 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:28.365125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5e6f314e-79d1-46c3-a351-58573462b906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:28.365645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0088a495-51bc-4a2b-ad2c-231b42b37396 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:28.366382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0088a495-51bc-4a2b-ad2c-231b42b37396 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:28.367371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0088a495-51bc-4a2b-ad2c-231b42b37396 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:28.368490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0088a495-51bc-4a2b-ad2c-231b42b37396 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:28.369498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0088a495-51bc-4a2b-ad2c-231b42b37396 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:28.375628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5e6f314e-79d1-46c3-a351-58573462b906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.718873 Aug 18 21:55:28.390371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 47/101] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:28.603015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-ba0bf45f-e4e2-4bd3-863a-b472aab61016 req-35310c1c-9077-4ff2-bcd2-89319f7010d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b079c0d4-5952-4bbf-a148-c34875a08105", "tag": "5a6d88bc-3090-4c5e-ab16-bbb9ec7a68f3"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:28.613896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ba0bf45f-e4e2-4bd3-863a-b472aab61016 req-35310c1c-9077-4ff2-bcd2-89319f7010d3 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:28.614610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ba0bf45f-e4e2-4bd3-863a-b472aab61016 req-35310c1c-9077-4ff2-bcd2-89319f7010d3 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:28.615052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-ba0bf45f-e4e2-4bd3-863a-b472aab61016 req-35310c1c-9077-4ff2-bcd2-89319f7010d3 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:28.626961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-ba0bf45f-e4e2-4bd3-863a-b472aab61016 req-35310c1c-9077-4ff2-bcd2-89319f7010d3 service nova] Creating event network-changed:5a6d88bc-3090-4c5e-ab16-bbb9ec7a68f3 for instance b079c0d4-5952-4bbf-a148-c34875a08105 on hv-cinder-85367 Aug 18 21:55:28.632490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-ba0bf45f-e4e2-4bd3-863a-b472aab61016 req-35310c1c-9077-4ff2-bcd2-89319f7010d3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034302 Aug 18 21:55:28.633190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 48/102] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:55:28.643724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0088a495-51bc-4a2b-ad2c-231b42b37396 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:28.653903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0088a495-51bc-4a2b-ad2c-231b42b37396 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:28.655472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0088a495-51bc-4a2b-ad2c-231b42b37396 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:28.656616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0088a495-51bc-4a2b-ad2c-231b42b37396 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.325484 Aug 18 21:55:28.657139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 55/103] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:29.060297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-84ad3aa1-67ac-488e-91df-071e05021c14 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:29.062531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-84ad3aa1-67ac-488e-91df-071e05021c14 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:29.070566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84ad3aa1-67ac-488e-91df-071e05021c14 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:29.071352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84ad3aa1-67ac-488e-91df-071e05021c14 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:29.072122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84ad3aa1-67ac-488e-91df-071e05021c14 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:29.074130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84ad3aa1-67ac-488e-91df-071e05021c14 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:29.074948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84ad3aa1-67ac-488e-91df-071e05021c14 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:29.076046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84ad3aa1-67ac-488e-91df-071e05021c14 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:29.283288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-84ad3aa1-67ac-488e-91df-071e05021c14 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:29.292368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-84ad3aa1-67ac-488e-91df-071e05021c14 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.237722 Aug 18 21:55:29.293387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 49/104] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:29 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:29.351022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-46174fcf-bfa5-4ef7-a132-839a10a7b2a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:29.352210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46174fcf-bfa5-4ef7-a132-839a10a7b2a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:29.363165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46174fcf-bfa5-4ef7-a132-839a10a7b2a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:29.363672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46174fcf-bfa5-4ef7-a132-839a10a7b2a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:29.364654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46174fcf-bfa5-4ef7-a132-839a10a7b2a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:29.365361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46174fcf-bfa5-4ef7-a132-839a10a7b2a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:29.365860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46174fcf-bfa5-4ef7-a132-839a10a7b2a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:29.366543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46174fcf-bfa5-4ef7-a132-839a10a7b2a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:29.397215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3dbc19bb-88b5-4df1-a9a6-1f3bb6e84478 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:29.398398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3dbc19bb-88b5-4df1-a9a6-1f3bb6e84478 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:29.411421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dbc19bb-88b5-4df1-a9a6-1f3bb6e84478 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:29.412075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dbc19bb-88b5-4df1-a9a6-1f3bb6e84478 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:29.412437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dbc19bb-88b5-4df1-a9a6-1f3bb6e84478 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:29.413153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dbc19bb-88b5-4df1-a9a6-1f3bb6e84478 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:29.414589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dbc19bb-88b5-4df1-a9a6-1f3bb6e84478 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:29.415043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dbc19bb-88b5-4df1-a9a6-1f3bb6e84478 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:29.540943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-46174fcf-bfa5-4ef7-a132-839a10a7b2a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:29.548933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-46174fcf-bfa5-4ef7-a132-839a10a7b2a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.202690 Aug 18 21:55:29.549764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 56/105] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:29 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:29.615079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3dbc19bb-88b5-4df1-a9a6-1f3bb6e84478 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:29.624213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3dbc19bb-88b5-4df1-a9a6-1f3bb6e84478 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.231575 Aug 18 21:55:29.624802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 50/106] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:29 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:29.680013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-01f00eb2-9b7c-4840-a6d8-18456b2ba3a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:29.680648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-01f00eb2-9b7c-4840-a6d8-18456b2ba3a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:29.698272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01f00eb2-9b7c-4840-a6d8-18456b2ba3a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:29.698775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01f00eb2-9b7c-4840-a6d8-18456b2ba3a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:29.699216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01f00eb2-9b7c-4840-a6d8-18456b2ba3a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:29.699929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01f00eb2-9b7c-4840-a6d8-18456b2ba3a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:29.700388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01f00eb2-9b7c-4840-a6d8-18456b2ba3a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:29.700815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01f00eb2-9b7c-4840-a6d8-18456b2ba3a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:29.893181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-01f00eb2-9b7c-4840-a6d8-18456b2ba3a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:29.907986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-01f00eb2-9b7c-4840-a6d8-18456b2ba3a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:29.909657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-01f00eb2-9b7c-4840-a6d8-18456b2ba3a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:29.911005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-01f00eb2-9b7c-4840-a6d8-18456b2ba3a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.234833 Aug 18 21:55:29.911576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 57/107] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:30.314341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae6d310d-6b0f-49e2-8c1e-3f1a6ea034fa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:30.315036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ae6d310d-6b0f-49e2-8c1e-3f1a6ea034fa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:30.321358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6d310d-6b0f-49e2-8c1e-3f1a6ea034fa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:30.322244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6d310d-6b0f-49e2-8c1e-3f1a6ea034fa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:30.322862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6d310d-6b0f-49e2-8c1e-3f1a6ea034fa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:30.323769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6d310d-6b0f-49e2-8c1e-3f1a6ea034fa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:30.324281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6d310d-6b0f-49e2-8c1e-3f1a6ea034fa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:30.324923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6d310d-6b0f-49e2-8c1e-3f1a6ea034fa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:30.474506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ae6d310d-6b0f-49e2-8c1e-3f1a6ea034fa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:30.485807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ae6d310d-6b0f-49e2-8c1e-3f1a6ea034fa tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.175124 Aug 18 21:55:30.486397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 51/108] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:30 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:30.569281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4bc20de8-5f2e-4977-b461-08069cb7f72c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:30.569932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4bc20de8-5f2e-4977-b461-08069cb7f72c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:30.576726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bc20de8-5f2e-4977-b461-08069cb7f72c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:30.577214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bc20de8-5f2e-4977-b461-08069cb7f72c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:30.577908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bc20de8-5f2e-4977-b461-08069cb7f72c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:30.578610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bc20de8-5f2e-4977-b461-08069cb7f72c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:30.579263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bc20de8-5f2e-4977-b461-08069cb7f72c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:30.579689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bc20de8-5f2e-4977-b461-08069cb7f72c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:30.644954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a345be5a-36cf-4072-9ffa-e0cf11b5c595 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:30.646425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a345be5a-36cf-4072-9ffa-e0cf11b5c595 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:30.652580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a345be5a-36cf-4072-9ffa-e0cf11b5c595 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:30.653928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a345be5a-36cf-4072-9ffa-e0cf11b5c595 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:30.654543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a345be5a-36cf-4072-9ffa-e0cf11b5c595 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:30.655416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a345be5a-36cf-4072-9ffa-e0cf11b5c595 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:30.656044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a345be5a-36cf-4072-9ffa-e0cf11b5c595 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:30.656773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a345be5a-36cf-4072-9ffa-e0cf11b5c595 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:30.746112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4bc20de8-5f2e-4977-b461-08069cb7f72c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:30.755648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4bc20de8-5f2e-4977-b461-08069cb7f72c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.190190 Aug 18 21:55:30.756493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 58/109] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:30 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:30.820168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a345be5a-36cf-4072-9ffa-e0cf11b5c595 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:30.829644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a345be5a-36cf-4072-9ffa-e0cf11b5c595 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.189149 Aug 18 21:55:30.830226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 52/110] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:30.937284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0034e5ca-4690-478c-999a-38ab9557845e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:30.937925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0034e5ca-4690-478c-999a-38ab9557845e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:30.950178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0034e5ca-4690-478c-999a-38ab9557845e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:30.955847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0034e5ca-4690-478c-999a-38ab9557845e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:30.956282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0034e5ca-4690-478c-999a-38ab9557845e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:30.957024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0034e5ca-4690-478c-999a-38ab9557845e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:30.957488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0034e5ca-4690-478c-999a-38ab9557845e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:30.958010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0034e5ca-4690-478c-999a-38ab9557845e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:31.509819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-594baaa1-f5d7-4710-b424-9607e278de34 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:31.510365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-594baaa1-f5d7-4710-b424-9607e278de34 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:31.531010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-594baaa1-f5d7-4710-b424-9607e278de34 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:31.531541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-594baaa1-f5d7-4710-b424-9607e278de34 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:31.532133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-594baaa1-f5d7-4710-b424-9607e278de34 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:31.532988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-594baaa1-f5d7-4710-b424-9607e278de34 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:31.533781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-594baaa1-f5d7-4710-b424-9607e278de34 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:31.534223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-594baaa1-f5d7-4710-b424-9607e278de34 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:31.821021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0034e5ca-4690-478c-999a-38ab9557845e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:31.832102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0034e5ca-4690-478c-999a-38ab9557845e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:31.834282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0034e5ca-4690-478c-999a-38ab9557845e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:31.835829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0034e5ca-4690-478c-999a-38ab9557845e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.905177 Aug 18 21:55:31.856953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 59/111] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:31.866135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-10f44a29-33de-4c97-a3c0-5117b7992c06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:31.867537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-10f44a29-33de-4c97-a3c0-5117b7992c06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:31.875706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10f44a29-33de-4c97-a3c0-5117b7992c06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:31.876501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10f44a29-33de-4c97-a3c0-5117b7992c06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:31.877950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10f44a29-33de-4c97-a3c0-5117b7992c06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:31.878916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10f44a29-33de-4c97-a3c0-5117b7992c06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:31.879630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10f44a29-33de-4c97-a3c0-5117b7992c06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:31.880775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10f44a29-33de-4c97-a3c0-5117b7992c06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:31.953410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-594baaa1-f5d7-4710-b424-9607e278de34 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:31.963647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-594baaa1-f5d7-4710-b424-9607e278de34 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.459203 Aug 18 21:55:31.974261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 53/112] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:31 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:31.979099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-12fff59c-7796-47ea-8659-11a7a0cc9540 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:31.979824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-12fff59c-7796-47ea-8659-11a7a0cc9540 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:31.990620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12fff59c-7796-47ea-8659-11a7a0cc9540 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:31.990995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12fff59c-7796-47ea-8659-11a7a0cc9540 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:31.994104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12fff59c-7796-47ea-8659-11a7a0cc9540 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:31.994959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12fff59c-7796-47ea-8659-11a7a0cc9540 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:31.995628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12fff59c-7796-47ea-8659-11a7a0cc9540 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:31.996123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12fff59c-7796-47ea-8659-11a7a0cc9540 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:32.052693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-10f44a29-33de-4c97-a3c0-5117b7992c06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:32.061866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-10f44a29-33de-4c97-a3c0-5117b7992c06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.203230 Aug 18 21:55:32.062453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 60/113] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:31 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:32.147107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-12fff59c-7796-47ea-8659-11a7a0cc9540 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:32.162061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-12fff59c-7796-47ea-8659-11a7a0cc9540 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.188534 Aug 18 21:55:32.167653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 54/114] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:32.861342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-060da5e9-d0ba-4dce-8d93-590f18da757b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:32.862001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-060da5e9-d0ba-4dce-8d93-590f18da757b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:32.867701 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:32.869577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-060da5e9-d0ba-4dce-8d93-590f18da757b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:32.870080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-060da5e9-d0ba-4dce-8d93-590f18da757b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:32.870698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-060da5e9-d0ba-4dce-8d93-590f18da757b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:32.871390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-060da5e9-d0ba-4dce-8d93-590f18da757b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:32.871836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-060da5e9-d0ba-4dce-8d93-590f18da757b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:32.872252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-060da5e9-d0ba-4dce-8d93-590f18da757b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:32.985447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-61b63cfe-3e93-4d05-97fb-980feace0f8d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:32.986080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-61b63cfe-3e93-4d05-97fb-980feace0f8d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:33.007832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61b63cfe-3e93-4d05-97fb-980feace0f8d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:33.008351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61b63cfe-3e93-4d05-97fb-980feace0f8d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:33.008801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61b63cfe-3e93-4d05-97fb-980feace0f8d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:33.009529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61b63cfe-3e93-4d05-97fb-980feace0f8d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:33.010019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61b63cfe-3e93-4d05-97fb-980feace0f8d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:33.014333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61b63cfe-3e93-4d05-97fb-980feace0f8d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:33.051496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-060da5e9-d0ba-4dce-8d93-590f18da757b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:33.061622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-060da5e9-d0ba-4dce-8d93-590f18da757b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:33.063510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-060da5e9-d0ba-4dce-8d93-590f18da757b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:33.064855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-060da5e9-d0ba-4dce-8d93-590f18da757b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.207364 Aug 18 21:55:33.065943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 61/115] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:33.083703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3ac8edf6-b3cd-42fa-975d-820f3251a057 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:33.084321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3ac8edf6-b3cd-42fa-975d-820f3251a057 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:33.090571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ac8edf6-b3cd-42fa-975d-820f3251a057 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:33.091058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ac8edf6-b3cd-42fa-975d-820f3251a057 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:33.091667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ac8edf6-b3cd-42fa-975d-820f3251a057 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:33.092534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ac8edf6-b3cd-42fa-975d-820f3251a057 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:33.092995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ac8edf6-b3cd-42fa-975d-820f3251a057 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:33.093417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ac8edf6-b3cd-42fa-975d-820f3251a057 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:33.180767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-61b63cfe-3e93-4d05-97fb-980feace0f8d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:33.188801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-61b63cfe-3e93-4d05-97fb-980feace0f8d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.207082 Aug 18 21:55:33.189796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 55/116] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:32 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:33.198416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e57bf741-dfc0-4aec-8742-a5c63dbb7729 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:33.199619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e57bf741-dfc0-4aec-8742-a5c63dbb7729 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:33.207277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e57bf741-dfc0-4aec-8742-a5c63dbb7729 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:33.208398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e57bf741-dfc0-4aec-8742-a5c63dbb7729 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:33.208918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e57bf741-dfc0-4aec-8742-a5c63dbb7729 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:33.209868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e57bf741-dfc0-4aec-8742-a5c63dbb7729 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:33.210328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e57bf741-dfc0-4aec-8742-a5c63dbb7729 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:33.210760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e57bf741-dfc0-4aec-8742-a5c63dbb7729 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:33.246455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3ac8edf6-b3cd-42fa-975d-820f3251a057 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:33.259882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3ac8edf6-b3cd-42fa-975d-820f3251a057 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.180411 Aug 18 21:55:33.260610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 62/117] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:33 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:33.357813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e57bf741-dfc0-4aec-8742-a5c63dbb7729 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:33.366380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e57bf741-dfc0-4aec-8742-a5c63dbb7729 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.175182 Aug 18 21:55:33.378027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 56/118] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:33.724613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-70bc26f5-c5f0-4a7d-96dc-65dab8045481 req-f458d791-4a63-4de2-9b9b-b940fba132c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a249d5e7-ea93-4157-87dc-4fd3b6789cdb", "name": "network-vif-plugged", "status": "completed", "tag": "7cc31b7a-814f-44a7-8ae5-2de63707d442"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:33.736708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-70bc26f5-c5f0-4a7d-96dc-65dab8045481 req-f458d791-4a63-4de2-9b9b-b940fba132c4 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:33.737483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-70bc26f5-c5f0-4a7d-96dc-65dab8045481 req-f458d791-4a63-4de2-9b9b-b940fba132c4 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:33.738090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-70bc26f5-c5f0-4a7d-96dc-65dab8045481 req-f458d791-4a63-4de2-9b9b-b940fba132c4 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:33.752734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-70bc26f5-c5f0-4a7d-96dc-65dab8045481 req-f458d791-4a63-4de2-9b9b-b940fba132c4 service nova] Creating event network-vif-plugged:7cc31b7a-814f-44a7-8ae5-2de63707d442 for instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb on hv-cinder-85367 Aug 18 21:55:33.758291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-70bc26f5-c5f0-4a7d-96dc-65dab8045481 req-f458d791-4a63-4de2-9b9b-b940fba132c4 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114900 Aug 18 21:55:33.758966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 63/119] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:34.090567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b5812581-6a15-4aea-a18b-ecab328edfec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:34.092502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b5812581-6a15-4aea-a18b-ecab328edfec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:34.100523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5812581-6a15-4aea-a18b-ecab328edfec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:34.101229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5812581-6a15-4aea-a18b-ecab328edfec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:34.101873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5812581-6a15-4aea-a18b-ecab328edfec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:34.102757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5812581-6a15-4aea-a18b-ecab328edfec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:34.103398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5812581-6a15-4aea-a18b-ecab328edfec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:34.104213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5812581-6a15-4aea-a18b-ecab328edfec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:34.210646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8bcef586-e85c-47c2-8334-108989e4d285 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:34.211346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8bcef586-e85c-47c2-8334-108989e4d285 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:34.220563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8bcef586-e85c-47c2-8334-108989e4d285 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:34.221048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8bcef586-e85c-47c2-8334-108989e4d285 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:34.221483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8bcef586-e85c-47c2-8334-108989e4d285 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:34.222213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8bcef586-e85c-47c2-8334-108989e4d285 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:34.222663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8bcef586-e85c-47c2-8334-108989e4d285 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:34.223249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8bcef586-e85c-47c2-8334-108989e4d285 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:34.263300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b5812581-6a15-4aea-a18b-ecab328edfec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:34.271808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b5812581-6a15-4aea-a18b-ecab328edfec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:34.274347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b5812581-6a15-4aea-a18b-ecab328edfec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:34.278697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b5812581-6a15-4aea-a18b-ecab328edfec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.193810 Aug 18 21:55:34.279258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 57/120] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:34.293379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2ac2c1bc-2496-4cd7-9a94-c0e82132b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:34.294092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2ac2c1bc-2496-4cd7-9a94-c0e82132b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:34.300094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ac2c1bc-2496-4cd7-9a94-c0e82132b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:34.300579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ac2c1bc-2496-4cd7-9a94-c0e82132b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:34.301012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ac2c1bc-2496-4cd7-9a94-c0e82132b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:34.302343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ac2c1bc-2496-4cd7-9a94-c0e82132b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:34.302799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ac2c1bc-2496-4cd7-9a94-c0e82132b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:34.303220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ac2c1bc-2496-4cd7-9a94-c0e82132b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:34.362029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8bcef586-e85c-47c2-8334-108989e4d285 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:34.370398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8bcef586-e85c-47c2-8334-108989e4d285 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.164416 Aug 18 21:55:34.370972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 64/121] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:34 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:34.387866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b817892d-e000-4a11-a651-1e5e4fd65a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:34.388476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b817892d-e000-4a11-a651-1e5e4fd65a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:34.394546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b817892d-e000-4a11-a651-1e5e4fd65a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:34.395032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b817892d-e000-4a11-a651-1e5e4fd65a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:34.395468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b817892d-e000-4a11-a651-1e5e4fd65a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:34.396156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b817892d-e000-4a11-a651-1e5e4fd65a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:34.396614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b817892d-e000-4a11-a651-1e5e4fd65a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:34.397044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b817892d-e000-4a11-a651-1e5e4fd65a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:34.437091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2ac2c1bc-2496-4cd7-9a94-c0e82132b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:34.444841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2ac2c1bc-2496-4cd7-9a94-c0e82132b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.164434 Aug 18 21:55:34.445422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 58/122] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:34 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:34.531027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b817892d-e000-4a11-a651-1e5e4fd65a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:34.539325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b817892d-e000-4a11-a651-1e5e4fd65a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.155148 Aug 18 21:55:34.539913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 65/123] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:35.301907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da9b87e5-ad7f-4803-b4d9-b3c2e15bb1fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:35.302578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-da9b87e5-ad7f-4803-b4d9-b3c2e15bb1fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:35.308696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9b87e5-ad7f-4803-b4d9-b3c2e15bb1fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:35.309220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9b87e5-ad7f-4803-b4d9-b3c2e15bb1fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:35.309715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9b87e5-ad7f-4803-b4d9-b3c2e15bb1fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:35.310420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9b87e5-ad7f-4803-b4d9-b3c2e15bb1fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:35.310874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9b87e5-ad7f-4803-b4d9-b3c2e15bb1fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:35.311331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9b87e5-ad7f-4803-b4d9-b3c2e15bb1fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:35.397982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-32ecc518-ca36-403d-8a4a-a8698c94c4f4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:35.398680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-32ecc518-ca36-403d-8a4a-a8698c94c4f4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:35.406689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32ecc518-ca36-403d-8a4a-a8698c94c4f4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:35.406892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32ecc518-ca36-403d-8a4a-a8698c94c4f4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:35.407505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32ecc518-ca36-403d-8a4a-a8698c94c4f4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:35.408391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32ecc518-ca36-403d-8a4a-a8698c94c4f4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:35.415373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32ecc518-ca36-403d-8a4a-a8698c94c4f4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:35.416372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32ecc518-ca36-403d-8a4a-a8698c94c4f4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:35.519257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-da9b87e5-ad7f-4803-b4d9-b3c2e15bb1fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:35.538703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-da9b87e5-ad7f-4803-b4d9-b3c2e15bb1fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:35.542032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-da9b87e5-ad7f-4803-b4d9-b3c2e15bb1fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:35.543420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da9b87e5-ad7f-4803-b4d9-b3c2e15bb1fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.245824 Aug 18 21:55:35.558724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 59/124] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:35.570395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0305d12a-9496-422f-98bd-62e3a2577712 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:35.571190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0305d12a-9496-422f-98bd-62e3a2577712 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:35.578406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0305d12a-9496-422f-98bd-62e3a2577712 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:35.579567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0305d12a-9496-422f-98bd-62e3a2577712 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:35.580143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0305d12a-9496-422f-98bd-62e3a2577712 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:35.580992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0305d12a-9496-422f-98bd-62e3a2577712 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:35.581568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0305d12a-9496-422f-98bd-62e3a2577712 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:35.582286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0305d12a-9496-422f-98bd-62e3a2577712 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:35.589338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-32ecc518-ca36-403d-8a4a-a8698c94c4f4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:35.593327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:35.603511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-32ecc518-ca36-403d-8a4a-a8698c94c4f4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.215153 Aug 18 21:55:35.604104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 66/125] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:35 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:35.609539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:35.615269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-df45bab8-ea66-4519-991e-f9b09208c33a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:35.616354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-df45bab8-ea66-4519-991e-f9b09208c33a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:35.622687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df45bab8-ea66-4519-991e-f9b09208c33a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:35.623278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df45bab8-ea66-4519-991e-f9b09208c33a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:35.623791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df45bab8-ea66-4519-991e-f9b09208c33a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:35.624562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df45bab8-ea66-4519-991e-f9b09208c33a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:35.625186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df45bab8-ea66-4519-991e-f9b09208c33a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:35.625788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df45bab8-ea66-4519-991e-f9b09208c33a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:35.751073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0305d12a-9496-422f-98bd-62e3a2577712 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:35.759114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0305d12a-9496-422f-98bd-62e3a2577712 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.199046 Aug 18 21:55:35.765637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 60/126] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:35 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:35.771014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-df45bab8-ea66-4519-991e-f9b09208c33a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:35.778754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-df45bab8-ea66-4519-991e-f9b09208c33a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.173495 Aug 18 21:55:35.779322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 67/127] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:35 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:36.574742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf158f02-be1f-436a-b67c-ea3a4a89a2ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:36.575480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf158f02-be1f-436a-b67c-ea3a4a89a2ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:36.582606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf158f02-be1f-436a-b67c-ea3a4a89a2ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:36.585233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf158f02-be1f-436a-b67c-ea3a4a89a2ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:36.587837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf158f02-be1f-436a-b67c-ea3a4a89a2ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:36.588816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf158f02-be1f-436a-b67c-ea3a4a89a2ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:36.589433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf158f02-be1f-436a-b67c-ea3a4a89a2ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:36.589884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf158f02-be1f-436a-b67c-ea3a4a89a2ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:36.626439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-65771cf1-a2fa-440f-a50f-f8e65e523140 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:36.627735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-65771cf1-a2fa-440f-a50f-f8e65e523140 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:36.640166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65771cf1-a2fa-440f-a50f-f8e65e523140 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:36.640840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65771cf1-a2fa-440f-a50f-f8e65e523140 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:36.641278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65771cf1-a2fa-440f-a50f-f8e65e523140 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:36.642042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65771cf1-a2fa-440f-a50f-f8e65e523140 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:36.642497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65771cf1-a2fa-440f-a50f-f8e65e523140 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:36.642929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65771cf1-a2fa-440f-a50f-f8e65e523140 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:36.806694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bf158f02-be1f-436a-b67c-ea3a4a89a2ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:36.818874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bf158f02-be1f-436a-b67c-ea3a4a89a2ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:36.820958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bf158f02-be1f-436a-b67c-ea3a4a89a2ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:36.823001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf158f02-be1f-436a-b67c-ea3a4a89a2ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.252479 Aug 18 21:55:36.824043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 61/128] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:36.842198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8d550027-3736-4aba-a783-a1f48b334e1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:36.843147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8d550027-3736-4aba-a783-a1f48b334e1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:36.852569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-65771cf1-a2fa-440f-a50f-f8e65e523140 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:36.860105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d550027-3736-4aba-a783-a1f48b334e1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:36.861329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d550027-3736-4aba-a783-a1f48b334e1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:36.861809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d550027-3736-4aba-a783-a1f48b334e1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:36.862947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d550027-3736-4aba-a783-a1f48b334e1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:36.863305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-65771cf1-a2fa-440f-a50f-f8e65e523140 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.241787 Aug 18 21:55:36.863825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d550027-3736-4aba-a783-a1f48b334e1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:36.864993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d550027-3736-4aba-a783-a1f48b334e1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:36.865752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 68/129] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:36 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:36.871007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-76e5a219-9c01-4a5b-8e4b-6399641b1890 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:36.872012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-76e5a219-9c01-4a5b-8e4b-6399641b1890 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:36.878376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76e5a219-9c01-4a5b-8e4b-6399641b1890 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:36.879265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76e5a219-9c01-4a5b-8e4b-6399641b1890 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:36.880541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76e5a219-9c01-4a5b-8e4b-6399641b1890 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:36.881483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76e5a219-9c01-4a5b-8e4b-6399641b1890 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:36.882127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76e5a219-9c01-4a5b-8e4b-6399641b1890 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:36.882773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76e5a219-9c01-4a5b-8e4b-6399641b1890 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:37.049374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8d550027-3736-4aba-a783-a1f48b334e1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:37.060000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8d550027-3736-4aba-a783-a1f48b334e1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.234648 Aug 18 21:55:37.060859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 62/130] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:36 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:37.132643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-6e4d957c-a0a6-4484-bf04-4e2bbee718a0 req-885322be-31a6-4975-8d70-2a07d882eeee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44bde447-4f59-4989-822c-8125ab3befeb", "name": "network-vif-plugged", "status": "completed", "tag": "e3b890d9-e4dc-4b1c-b774-b4b2c42f8616"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:37.146919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6e4d957c-a0a6-4484-bf04-4e2bbee718a0 req-885322be-31a6-4975-8d70-2a07d882eeee service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:37.147777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6e4d957c-a0a6-4484-bf04-4e2bbee718a0 req-885322be-31a6-4975-8d70-2a07d882eeee service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:37.148382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-6e4d957c-a0a6-4484-bf04-4e2bbee718a0 req-885322be-31a6-4975-8d70-2a07d882eeee service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:37.171566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-6e4d957c-a0a6-4484-bf04-4e2bbee718a0 req-885322be-31a6-4975-8d70-2a07d882eeee service nova] Creating event network-vif-plugged:e3b890d9-e4dc-4b1c-b774-b4b2c42f8616 for instance 44bde447-4f59-4989-822c-8125ab3befeb on hv-cinder-85367 Aug 18 21:55:37.180148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-76e5a219-9c01-4a5b-8e4b-6399641b1890 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:37.191653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-76e5a219-9c01-4a5b-8e4b-6399641b1890 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.324645 Aug 18 21:55:37.193021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-6e4d957c-a0a6-4484-bf04-4e2bbee718a0 req-885322be-31a6-4975-8d70-2a07d882eeee service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067895 Aug 18 21:55:37.195950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 63/131] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:55:37.198925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 69/132] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:37.850952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9dbfa259-c782-43d1-bad6-3705e06d166b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:37.851794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9dbfa259-c782-43d1-bad6-3705e06d166b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:37.858624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9dbfa259-c782-43d1-bad6-3705e06d166b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:37.859255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9dbfa259-c782-43d1-bad6-3705e06d166b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:37.859763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9dbfa259-c782-43d1-bad6-3705e06d166b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:37.860566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9dbfa259-c782-43d1-bad6-3705e06d166b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:37.861289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9dbfa259-c782-43d1-bad6-3705e06d166b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:37.861898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9dbfa259-c782-43d1-bad6-3705e06d166b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:37.888695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-18ba283c-3339-49da-83fc-f48bdbc49af1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:37.889528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-18ba283c-3339-49da-83fc-f48bdbc49af1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:37.899403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18ba283c-3339-49da-83fc-f48bdbc49af1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:37.900128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18ba283c-3339-49da-83fc-f48bdbc49af1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:37.900621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18ba283c-3339-49da-83fc-f48bdbc49af1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:37.902110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18ba283c-3339-49da-83fc-f48bdbc49af1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:37.902633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18ba283c-3339-49da-83fc-f48bdbc49af1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:37.903259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18ba283c-3339-49da-83fc-f48bdbc49af1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:38.028155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9dbfa259-c782-43d1-bad6-3705e06d166b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:38.038766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9dbfa259-c782-43d1-bad6-3705e06d166b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:38.040556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9dbfa259-c782-43d1-bad6-3705e06d166b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:38.042186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9dbfa259-c782-43d1-bad6-3705e06d166b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.196151 Aug 18 21:55:38.043218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 64/133] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:38.084051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2365315a-3f9f-4e06-98d6-14d3a74dc08b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:38.086191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2365315a-3f9f-4e06-98d6-14d3a74dc08b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:38.093155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2365315a-3f9f-4e06-98d6-14d3a74dc08b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:38.093704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2365315a-3f9f-4e06-98d6-14d3a74dc08b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:38.094988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2365315a-3f9f-4e06-98d6-14d3a74dc08b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:38.095854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2365315a-3f9f-4e06-98d6-14d3a74dc08b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:38.096455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2365315a-3f9f-4e06-98d6-14d3a74dc08b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:38.097033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2365315a-3f9f-4e06-98d6-14d3a74dc08b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:38.097150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-18ba283c-3339-49da-83fc-f48bdbc49af1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:38.105347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-18ba283c-3339-49da-83fc-f48bdbc49af1 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.220621 Aug 18 21:55:38.106573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 70/134] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:37 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:38.226401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a2f4d9e8-8d67-4924-a69b-290e0d37e91a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:38.228205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a2f4d9e8-8d67-4924-a69b-290e0d37e91a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:38.236764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2f4d9e8-8d67-4924-a69b-290e0d37e91a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:38.237556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2f4d9e8-8d67-4924-a69b-290e0d37e91a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:38.238108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2f4d9e8-8d67-4924-a69b-290e0d37e91a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:38.239015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2f4d9e8-8d67-4924-a69b-290e0d37e91a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:38.240701 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2f4d9e8-8d67-4924-a69b-290e0d37e91a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:38.241827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2f4d9e8-8d67-4924-a69b-290e0d37e91a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:38.248979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2365315a-3f9f-4e06-98d6-14d3a74dc08b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:38.258748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2365315a-3f9f-4e06-98d6-14d3a74dc08b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.180365 Aug 18 21:55:38.259274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 65/135] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:38 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:38.459201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a2f4d9e8-8d67-4924-a69b-290e0d37e91a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:38.471037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a2f4d9e8-8d67-4924-a69b-290e0d37e91a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.253067 Aug 18 21:55:38.471813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 71/136] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:38 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:39.064872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-76e096f1-dadc-47c5-9975-63a680512ad2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:39.065528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-76e096f1-dadc-47c5-9975-63a680512ad2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:39.071517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76e096f1-dadc-47c5-9975-63a680512ad2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:39.072007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76e096f1-dadc-47c5-9975-63a680512ad2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:39.072440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76e096f1-dadc-47c5-9975-63a680512ad2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:39.073473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76e096f1-dadc-47c5-9975-63a680512ad2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:39.073953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76e096f1-dadc-47c5-9975-63a680512ad2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:39.074442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76e096f1-dadc-47c5-9975-63a680512ad2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:39.126666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3f86acfd-260c-48d8-8692-85801e4788cb tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:39.127458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3f86acfd-260c-48d8-8692-85801e4788cb tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:39.133892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f86acfd-260c-48d8-8692-85801e4788cb tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:39.134385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f86acfd-260c-48d8-8692-85801e4788cb tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:39.134825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f86acfd-260c-48d8-8692-85801e4788cb tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:39.135523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f86acfd-260c-48d8-8692-85801e4788cb tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:39.136177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f86acfd-260c-48d8-8692-85801e4788cb tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:39.136716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f86acfd-260c-48d8-8692-85801e4788cb tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:39.284712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-76e096f1-dadc-47c5-9975-63a680512ad2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:39.297857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-76e096f1-dadc-47c5-9975-63a680512ad2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:39.298611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3f86acfd-260c-48d8-8692-85801e4788cb tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:39.300219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-76e096f1-dadc-47c5-9975-63a680512ad2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:39.301387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-76e096f1-dadc-47c5-9975-63a680512ad2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.240337 Aug 18 21:55:39.313621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 66/137] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:39.313621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da64c39b-9e75-4d01-92f8-62c1f43dc22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:39.313621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-da64c39b-9e75-4d01-92f8-62c1f43dc22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:39.314382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da64c39b-9e75-4d01-92f8-62c1f43dc22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:39.314872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da64c39b-9e75-4d01-92f8-62c1f43dc22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:39.315298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da64c39b-9e75-4d01-92f8-62c1f43dc22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:39.316156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da64c39b-9e75-4d01-92f8-62c1f43dc22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:39.317190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da64c39b-9e75-4d01-92f8-62c1f43dc22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:39.317850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da64c39b-9e75-4d01-92f8-62c1f43dc22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:39.324026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3f86acfd-260c-48d8-8692-85801e4788cb tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.201087 Aug 18 21:55:39.324452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 72/138] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:39 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:39.491409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-da64c39b-9e75-4d01-92f8-62c1f43dc22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:39.492431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0df5d064-386a-44a8-bda9-fdf765a01416 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:39.493421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0df5d064-386a-44a8-bda9-fdf765a01416 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:39.499939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0df5d064-386a-44a8-bda9-fdf765a01416 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:39.500989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0df5d064-386a-44a8-bda9-fdf765a01416 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:39.501451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0df5d064-386a-44a8-bda9-fdf765a01416 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:39.502699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0df5d064-386a-44a8-bda9-fdf765a01416 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:39.503259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da64c39b-9e75-4d01-92f8-62c1f43dc22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.199008 Aug 18 21:55:39.503556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0df5d064-386a-44a8-bda9-fdf765a01416 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:39.504077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 67/139] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:39 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:39.505218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0df5d064-386a-44a8-bda9-fdf765a01416 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:39.743456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0df5d064-386a-44a8-bda9-fdf765a01416 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:39.753270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0df5d064-386a-44a8-bda9-fdf765a01416 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.264408 Aug 18 21:55:39.763136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 73/140] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:39 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:40.325797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c640f901-90a6-4a4d-a1d6-7da813299773 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:40.326521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c640f901-90a6-4a4d-a1d6-7da813299773 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:40.334622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c640f901-90a6-4a4d-a1d6-7da813299773 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:40.335220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c640f901-90a6-4a4d-a1d6-7da813299773 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:40.335669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c640f901-90a6-4a4d-a1d6-7da813299773 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:40.336374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c640f901-90a6-4a4d-a1d6-7da813299773 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:40.336836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c640f901-90a6-4a4d-a1d6-7da813299773 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:40.337264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c640f901-90a6-4a4d-a1d6-7da813299773 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:40.346770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d17c7e2f-42f1-403d-a0d8-1cc57a75bf41 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:40.347471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d17c7e2f-42f1-403d-a0d8-1cc57a75bf41 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:40.355695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d17c7e2f-42f1-403d-a0d8-1cc57a75bf41 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:40.356274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d17c7e2f-42f1-403d-a0d8-1cc57a75bf41 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:40.356826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d17c7e2f-42f1-403d-a0d8-1cc57a75bf41 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:40.357636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d17c7e2f-42f1-403d-a0d8-1cc57a75bf41 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:40.358170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d17c7e2f-42f1-403d-a0d8-1cc57a75bf41 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:40.358669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d17c7e2f-42f1-403d-a0d8-1cc57a75bf41 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:40.476053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c640f901-90a6-4a4d-a1d6-7da813299773 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:40.484799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c640f901-90a6-4a4d-a1d6-7da813299773 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:40.486344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c640f901-90a6-4a4d-a1d6-7da813299773 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:40.487749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c640f901-90a6-4a4d-a1d6-7da813299773 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.165615 Aug 18 21:55:40.488329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 68/141] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:40.498656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d17c7e2f-42f1-403d-a0d8-1cc57a75bf41 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:40.507207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d17c7e2f-42f1-403d-a0d8-1cc57a75bf41 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.164832 Aug 18 21:55:40.507870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 74/142] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:40 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:40.526262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-65790401-66ad-45a5-8d3f-a342aae32fea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:40.527313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-65790401-66ad-45a5-8d3f-a342aae32fea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:40.533641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65790401-66ad-45a5-8d3f-a342aae32fea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:40.534150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65790401-66ad-45a5-8d3f-a342aae32fea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:40.534563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65790401-66ad-45a5-8d3f-a342aae32fea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:40.535500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65790401-66ad-45a5-8d3f-a342aae32fea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:40.536179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65790401-66ad-45a5-8d3f-a342aae32fea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:40.536821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65790401-66ad-45a5-8d3f-a342aae32fea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:40.689192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-65790401-66ad-45a5-8d3f-a342aae32fea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:40.705002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-65790401-66ad-45a5-8d3f-a342aae32fea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.183129 Aug 18 21:55:40.710329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 69/143] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:40 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:40.783485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eee38c9e-c8df-4752-8bd4-a09e3f4edb13 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:40.787622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eee38c9e-c8df-4752-8bd4-a09e3f4edb13 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:40.798449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eee38c9e-c8df-4752-8bd4-a09e3f4edb13 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:40.799478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eee38c9e-c8df-4752-8bd4-a09e3f4edb13 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:40.800459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eee38c9e-c8df-4752-8bd4-a09e3f4edb13 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:40.802190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eee38c9e-c8df-4752-8bd4-a09e3f4edb13 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:40.802864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eee38c9e-c8df-4752-8bd4-a09e3f4edb13 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:40.803630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eee38c9e-c8df-4752-8bd4-a09e3f4edb13 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:40.934579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-44ab5225-0687-42fc-99ee-3f4e1d4f8e49 req-4dc01eaf-23d3-48e9-bbbc-7ce36c312501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3851c11-f4ba-40cd-946e-d113ddb6e3b3", "name": "network-vif-plugged", "status": "completed", "tag": "09c93341-0714-48fb-b589-3f3fe222c0a8"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:40.951538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-44ab5225-0687-42fc-99ee-3f4e1d4f8e49 req-4dc01eaf-23d3-48e9-bbbc-7ce36c312501 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:40.952205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-44ab5225-0687-42fc-99ee-3f4e1d4f8e49 req-4dc01eaf-23d3-48e9-bbbc-7ce36c312501 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:40.953475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-44ab5225-0687-42fc-99ee-3f4e1d4f8e49 req-4dc01eaf-23d3-48e9-bbbc-7ce36c312501 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:40.982879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-44ab5225-0687-42fc-99ee-3f4e1d4f8e49 req-4dc01eaf-23d3-48e9-bbbc-7ce36c312501 service nova] Creating event network-vif-plugged:09c93341-0714-48fb-b589-3f3fe222c0a8 for instance b3851c11-f4ba-40cd-946e-d113ddb6e3b3 on hv-cinder-85367 Aug 18 21:55:40.995757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-44ab5225-0687-42fc-99ee-3f4e1d4f8e49 req-4dc01eaf-23d3-48e9-bbbc-7ce36c312501 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065543 Aug 18 21:55:40.997327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 70/144] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:55:41.005997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-eee38c9e-c8df-4752-8bd4-a09e3f4edb13 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:41.013642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eee38c9e-c8df-4752-8bd4-a09e3f4edb13 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.242570 Aug 18 21:55:41.014212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 75/145] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:40 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:41.513449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-991b5fe1-bfca-4bec-bb1b-a763bf4ef6d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:41.514407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-991b5fe1-bfca-4bec-bb1b-a763bf4ef6d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:41.526409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991b5fe1-bfca-4bec-bb1b-a763bf4ef6d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:41.529425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991b5fe1-bfca-4bec-bb1b-a763bf4ef6d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:41.530017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991b5fe1-bfca-4bec-bb1b-a763bf4ef6d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:41.530765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991b5fe1-bfca-4bec-bb1b-a763bf4ef6d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:41.531734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5210e734-fd17-419e-83ea-8465f8ba319b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:41.532346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5210e734-fd17-419e-83ea-8465f8ba319b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:41.539415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991b5fe1-bfca-4bec-bb1b-a763bf4ef6d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:41.540530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991b5fe1-bfca-4bec-bb1b-a763bf4ef6d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:41.541831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=99 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:41.545271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5210e734-fd17-419e-83ea-8465f8ba319b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:41.549191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5210e734-fd17-419e-83ea-8465f8ba319b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:41.549582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5210e734-fd17-419e-83ea-8465f8ba319b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:41.550337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5210e734-fd17-419e-83ea-8465f8ba319b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:41.550786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5210e734-fd17-419e-83ea-8465f8ba319b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:41.553035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5210e734-fd17-419e-83ea-8465f8ba319b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:41.779042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-991b5fe1-bfca-4bec-bb1b-a763bf4ef6d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:41.791996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-991b5fe1-bfca-4bec-bb1b-a763bf4ef6d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:41.796329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-991b5fe1-bfca-4bec-bb1b-a763bf4ef6d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:41.798381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-991b5fe1-bfca-4bec-bb1b-a763bf4ef6d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.290158 Aug 18 21:55:41.799314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 71/146] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:41.805121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d129c429-c0dc-4529-b508-ffa8a8944c4c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:41.805987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d129c429-c0dc-4529-b508-ffa8a8944c4c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:41.821998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d129c429-c0dc-4529-b508-ffa8a8944c4c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:41.822719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d129c429-c0dc-4529-b508-ffa8a8944c4c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:41.823751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d129c429-c0dc-4529-b508-ffa8a8944c4c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:41.823866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5210e734-fd17-419e-83ea-8465f8ba319b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:41.824913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d129c429-c0dc-4529-b508-ffa8a8944c4c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:41.825378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d129c429-c0dc-4529-b508-ffa8a8944c4c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:41.825846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d129c429-c0dc-4529-b508-ffa8a8944c4c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:41.834840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5210e734-fd17-419e-83ea-8465f8ba319b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1315 microversion: 2.1 time: 0.306959 Aug 18 21:55:41.845659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 76/147] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:41 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:42.029932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d129c429-c0dc-4529-b508-ffa8a8944c4c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:42.034578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2b70b6b4-2573-49c3-aeed-f90af24de033 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:42.035204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2b70b6b4-2573-49c3-aeed-f90af24de033 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:42.043378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d129c429-c0dc-4529-b508-ffa8a8944c4c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.241978 Aug 18 21:55:42.044281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 72/148] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:41 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:42.045413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b70b6b4-2573-49c3-aeed-f90af24de033 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:42.046262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b70b6b4-2573-49c3-aeed-f90af24de033 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:42.050728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b70b6b4-2573-49c3-aeed-f90af24de033 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:42.052187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b70b6b4-2573-49c3-aeed-f90af24de033 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:42.052806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b70b6b4-2573-49c3-aeed-f90af24de033 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:42.054317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b70b6b4-2573-49c3-aeed-f90af24de033 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:42.298137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2b70b6b4-2573-49c3-aeed-f90af24de033 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:42.309376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2b70b6b4-2573-49c3-aeed-f90af24de033 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.279432 Aug 18 21:55:42.312194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 77/149] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:42.821486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-29a754c6-f553-4c88-af8a-a9fa3f21ea23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:42.823479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-29a754c6-f553-4c88-af8a-a9fa3f21ea23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:42.830162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29a754c6-f553-4c88-af8a-a9fa3f21ea23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:42.830717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29a754c6-f553-4c88-af8a-a9fa3f21ea23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:42.831201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29a754c6-f553-4c88-af8a-a9fa3f21ea23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:42.831925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29a754c6-f553-4c88-af8a-a9fa3f21ea23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:42.833155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29a754c6-f553-4c88-af8a-a9fa3f21ea23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:42.833756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29a754c6-f553-4c88-af8a-a9fa3f21ea23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:42.856818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d7ddb812-865b-402d-9244-807123a4c289 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:42.858229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d7ddb812-865b-402d-9244-807123a4c289 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:42.867212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7ddb812-865b-402d-9244-807123a4c289 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:42.867704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7ddb812-865b-402d-9244-807123a4c289 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:42.868132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7ddb812-865b-402d-9244-807123a4c289 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:42.871434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7ddb812-865b-402d-9244-807123a4c289 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:42.871908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7ddb812-865b-402d-9244-807123a4c289 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:42.872327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7ddb812-865b-402d-9244-807123a4c289 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:43.049267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-29a754c6-f553-4c88-af8a-a9fa3f21ea23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:43.060548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-29a754c6-f553-4c88-af8a-a9fa3f21ea23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:43.062295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-29a754c6-f553-4c88-af8a-a9fa3f21ea23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:43.063433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-29a754c6-f553-4c88-af8a-a9fa3f21ea23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.246577 Aug 18 21:55:43.064181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 73/150] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:43.071626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-13d9be23-bfe4-47c9-a93c-c300838fa8a2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:43.072246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-13d9be23-bfe4-47c9-a93c-c300838fa8a2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:43.077992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13d9be23-bfe4-47c9-a93c-c300838fa8a2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:43.084121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13d9be23-bfe4-47c9-a93c-c300838fa8a2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:43.085770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13d9be23-bfe4-47c9-a93c-c300838fa8a2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:43.087993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13d9be23-bfe4-47c9-a93c-c300838fa8a2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:43.089040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13d9be23-bfe4-47c9-a93c-c300838fa8a2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:43.089481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13d9be23-bfe4-47c9-a93c-c300838fa8a2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:43.126570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d7ddb812-865b-402d-9244-807123a4c289 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:43.151704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d7ddb812-865b-402d-9244-807123a4c289 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1502 microversion: 2.1 time: 0.297570 Aug 18 21:55:43.156382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 78/151] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:42 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1502 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:43.332378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3b624913-2cde-4a79-a64c-30e605337136 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:43.333222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3b624913-2cde-4a79-a64c-30e605337136 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:43.351288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b624913-2cde-4a79-a64c-30e605337136 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:43.352135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b624913-2cde-4a79-a64c-30e605337136 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:43.352743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b624913-2cde-4a79-a64c-30e605337136 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:43.353825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b624913-2cde-4a79-a64c-30e605337136 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:43.360872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b624913-2cde-4a79-a64c-30e605337136 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:43.361702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b624913-2cde-4a79-a64c-30e605337136 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:43.524929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-13d9be23-bfe4-47c9-a93c-c300838fa8a2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:43.534540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-13d9be23-bfe4-47c9-a93c-c300838fa8a2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.469326 Aug 18 21:55:43.535123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 74/152] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:43 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:43.806236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-1848e38c-3f37-41c2-8375-cdbf4316a28c req-48ddd637-51ff-4fbc-a61c-5d1cabc0ba9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b079c0d4-5952-4bbf-a148-c34875a08105", "name": "network-vif-plugged", "status": "completed", "tag": "5a6d88bc-3090-4c5e-ab16-bbb9ec7a68f3"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:43.832272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1848e38c-3f37-41c2-8375-cdbf4316a28c req-48ddd637-51ff-4fbc-a61c-5d1cabc0ba9e service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:43.834065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1848e38c-3f37-41c2-8375-cdbf4316a28c req-48ddd637-51ff-4fbc-a61c-5d1cabc0ba9e service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:43.834979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1848e38c-3f37-41c2-8375-cdbf4316a28c req-48ddd637-51ff-4fbc-a61c-5d1cabc0ba9e service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:43.869084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-1848e38c-3f37-41c2-8375-cdbf4316a28c req-48ddd637-51ff-4fbc-a61c-5d1cabc0ba9e service nova] Creating event network-vif-plugged:5a6d88bc-3090-4c5e-ab16-bbb9ec7a68f3 for instance b079c0d4-5952-4bbf-a148-c34875a08105 on hv-cinder-85367 Aug 18 21:55:43.878628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-1848e38c-3f37-41c2-8375-cdbf4316a28c req-48ddd637-51ff-4fbc-a61c-5d1cabc0ba9e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078567 Aug 18 21:55:43.881741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 75/153] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:55:44.091089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8670858a-821a-4d69-b9e8-18a0a1ff9659 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:44.092181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8670858a-821a-4d69-b9e8-18a0a1ff9659 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:44.107556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8670858a-821a-4d69-b9e8-18a0a1ff9659 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:44.114191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8670858a-821a-4d69-b9e8-18a0a1ff9659 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:44.115089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8670858a-821a-4d69-b9e8-18a0a1ff9659 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:44.116388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8670858a-821a-4d69-b9e8-18a0a1ff9659 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:44.117018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8670858a-821a-4d69-b9e8-18a0a1ff9659 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:44.117587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8670858a-821a-4d69-b9e8-18a0a1ff9659 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:44.314340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3b624913-2cde-4a79-a64c-30e605337136 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:44.325765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3b624913-2cde-4a79-a64c-30e605337136 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1363 microversion: 2.1 time: 0.995082 Aug 18 21:55:44.329395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 79/154] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:43 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1363 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:44.419676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8670858a-821a-4d69-b9e8-18a0a1ff9659 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:44.429269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8670858a-821a-4d69-b9e8-18a0a1ff9659 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:44.430813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8670858a-821a-4d69-b9e8-18a0a1ff9659 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:44.433232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8670858a-821a-4d69-b9e8-18a0a1ff9659 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.347868 Aug 18 21:55:44.434017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 76/155] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:55:44.558959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aceb8445-5714-43bc-80a1-5cc697e7adec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:44.559455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-aceb8445-5714-43bc-80a1-5cc697e7adec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:44.568749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aceb8445-5714-43bc-80a1-5cc697e7adec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:44.569418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aceb8445-5714-43bc-80a1-5cc697e7adec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:44.570431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aceb8445-5714-43bc-80a1-5cc697e7adec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:44.571663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aceb8445-5714-43bc-80a1-5cc697e7adec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:44.572280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aceb8445-5714-43bc-80a1-5cc697e7adec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:44.572865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aceb8445-5714-43bc-80a1-5cc697e7adec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:44.806820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aceb8445-5714-43bc-80a1-5cc697e7adec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:44.822226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aceb8445-5714-43bc-80a1-5cc697e7adec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.266506 Aug 18 21:55:44.840830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 80/156] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:44 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:44.870609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-73fe9f18-ab82-4901-931c-a3f9953cb65d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8eab0042-3a9a-4324-9447-f8b04790dafd"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:44.873942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-73fe9f18-ab82-4901-931c-a3f9953cb65d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:44.882559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73fe9f18-ab82-4901-931c-a3f9953cb65d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:44.883277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73fe9f18-ab82-4901-931c-a3f9953cb65d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:44.883872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73fe9f18-ab82-4901-931c-a3f9953cb65d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:44.884864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73fe9f18-ab82-4901-931c-a3f9953cb65d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:44.885459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73fe9f18-ab82-4901-931c-a3f9953cb65d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:44.886580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73fe9f18-ab82-4901-931c-a3f9953cb65d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:45.351906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5163ecb6-19f6-42df-b9fb-013026982530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:45.352529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5163ecb6-19f6-42df-b9fb-013026982530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:45.359070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5163ecb6-19f6-42df-b9fb-013026982530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:45.359857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5163ecb6-19f6-42df-b9fb-013026982530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:45.360783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5163ecb6-19f6-42df-b9fb-013026982530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:45.361677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5163ecb6-19f6-42df-b9fb-013026982530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:45.362248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5163ecb6-19f6-42df-b9fb-013026982530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:45.362686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5163ecb6-19f6-42df-b9fb-013026982530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:45.412742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:45.430210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-73fe9f18-ab82-4901-931c-a3f9953cb65d tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "POST /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563669 Aug 18 21:55:45.434357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 77/157] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 21:55:44 2022] POST /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb/os-volume_attachments => generated 194 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:45.458224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-717cdf60-f572-4cca-928d-d7e4ce0f2339 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:45.458934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-717cdf60-f572-4cca-928d-d7e4ce0f2339 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:45.473904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717cdf60-f572-4cca-928d-d7e4ce0f2339 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:45.474404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717cdf60-f572-4cca-928d-d7e4ce0f2339 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:45.474845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717cdf60-f572-4cca-928d-d7e4ce0f2339 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:45.475554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717cdf60-f572-4cca-928d-d7e4ce0f2339 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:45.476012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717cdf60-f572-4cca-928d-d7e4ce0f2339 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:45.476440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717cdf60-f572-4cca-928d-d7e4ce0f2339 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:45.629988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5163ecb6-19f6-42df-b9fb-013026982530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:45.641850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5163ecb6-19f6-42df-b9fb-013026982530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1549 microversion: 2.1 time: 0.295015 Aug 18 21:55:45.654986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 81/158] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1549 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:45.668693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ca55f2ea-0cc3-4dbe-8ffb-6decc5557a72 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:45.669487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ca55f2ea-0cc3-4dbe-8ffb-6decc5557a72 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:45.679178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca55f2ea-0cc3-4dbe-8ffb-6decc5557a72 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:45.680275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca55f2ea-0cc3-4dbe-8ffb-6decc5557a72 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:45.681338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca55f2ea-0cc3-4dbe-8ffb-6decc5557a72 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:45.682414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca55f2ea-0cc3-4dbe-8ffb-6decc5557a72 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:45.683474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca55f2ea-0cc3-4dbe-8ffb-6decc5557a72 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:45.683915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca55f2ea-0cc3-4dbe-8ffb-6decc5557a72 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:45.711355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-717cdf60-f572-4cca-928d-d7e4ce0f2339 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:45.729497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-717cdf60-f572-4cca-928d-d7e4ce0f2339 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:45.731018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-717cdf60-f572-4cca-928d-d7e4ce0f2339 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:45.732478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-717cdf60-f572-4cca-928d-d7e4ce0f2339 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.279101 Aug 18 21:55:45.733681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 78/159] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:45 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:45.844364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0b279478-6428-403c-ab11-82fb5e78209b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:45.844982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0b279478-6428-403c-ab11-82fb5e78209b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:45.859554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b279478-6428-403c-ab11-82fb5e78209b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:45.860038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b279478-6428-403c-ab11-82fb5e78209b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:45.860473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b279478-6428-403c-ab11-82fb5e78209b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:45.861177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b279478-6428-403c-ab11-82fb5e78209b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:45.862099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b279478-6428-403c-ab11-82fb5e78209b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:45.862673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b279478-6428-403c-ab11-82fb5e78209b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:45.871238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ca55f2ea-0cc3-4dbe-8ffb-6decc5557a72 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.207591 Aug 18 21:55:45.872399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 82/160] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 21:55:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:55:45.960814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-6aa8fbe2-c4ea-4af9-b508-8cc3a3677283 req-a12a6bef-e58c-450c-8462-75ac8a3d583c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0426bb7b-e862-4873-9c1e-7878b89cde47", "name": "network-vif-plugged", "status": "completed", "tag": "a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:45.979710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6aa8fbe2-c4ea-4af9-b508-8cc3a3677283 req-a12a6bef-e58c-450c-8462-75ac8a3d583c service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:45.980600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6aa8fbe2-c4ea-4af9-b508-8cc3a3677283 req-a12a6bef-e58c-450c-8462-75ac8a3d583c service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:45.981237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6aa8fbe2-c4ea-4af9-b508-8cc3a3677283 req-a12a6bef-e58c-450c-8462-75ac8a3d583c service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:46.013057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-6aa8fbe2-c4ea-4af9-b508-8cc3a3677283 req-a12a6bef-e58c-450c-8462-75ac8a3d583c service nova] Creating event network-vif-plugged:a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b for instance 0426bb7b-e862-4873-9c1e-7878b89cde47 on hv-cinder-85367 Aug 18 21:55:46.023166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-6aa8fbe2-c4ea-4af9-b508-8cc3a3677283 req-a12a6bef-e58c-450c-8462-75ac8a3d583c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066670 Aug 18 21:55:46.029303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 83/161] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:55:46.640947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0b279478-6428-403c-ab11-82fb5e78209b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:46.650162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0b279478-6428-403c-ab11-82fb5e78209b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1321 microversion: 2.1 time: 0.809498 Aug 18 21:55:46.650758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 79/162] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:45 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1321 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:46.760106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f58e2e38-7043-41b7-961a-d3643fd9e80c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:46.762072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f58e2e38-7043-41b7-961a-d3643fd9e80c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:46.774338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f58e2e38-7043-41b7-961a-d3643fd9e80c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:46.776950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f58e2e38-7043-41b7-961a-d3643fd9e80c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:46.777616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f58e2e38-7043-41b7-961a-d3643fd9e80c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:46.779594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f58e2e38-7043-41b7-961a-d3643fd9e80c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:46.781537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f58e2e38-7043-41b7-961a-d3643fd9e80c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:46.782209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f58e2e38-7043-41b7-961a-d3643fd9e80c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:46.822698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:46.976114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f58e2e38-7043-41b7-961a-d3643fd9e80c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:46.988416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f58e2e38-7043-41b7-961a-d3643fd9e80c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:46.993949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f58e2e38-7043-41b7-961a-d3643fd9e80c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:46.995566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f58e2e38-7043-41b7-961a-d3643fd9e80c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.241257 Aug 18 21:55:47.013632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 84/163] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:46 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:47.673861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4abfa079-ed85-40c2-b6e1-7af6f1515b7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:47.674478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4abfa079-ed85-40c2-b6e1-7af6f1515b7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:47.688478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4abfa079-ed85-40c2-b6e1-7af6f1515b7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:47.689157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4abfa079-ed85-40c2-b6e1-7af6f1515b7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:47.689789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4abfa079-ed85-40c2-b6e1-7af6f1515b7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:47.690687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4abfa079-ed85-40c2-b6e1-7af6f1515b7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:47.691314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4abfa079-ed85-40c2-b6e1-7af6f1515b7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:47.691934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4abfa079-ed85-40c2-b6e1-7af6f1515b7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:47.794381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-fc58a5c7-1dfd-48d9-9657-6ed9e89e96ac req-641dc123-bb80-46d0-b74f-c286059013ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3851c11-f4ba-40cd-946e-d113ddb6e3b3", "tag": "09c93341-0714-48fb-b589-3f3fe222c0a8"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:47.805512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-fc58a5c7-1dfd-48d9-9657-6ed9e89e96ac req-641dc123-bb80-46d0-b74f-c286059013ce service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:47.806366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-fc58a5c7-1dfd-48d9-9657-6ed9e89e96ac req-641dc123-bb80-46d0-b74f-c286059013ce service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:47.806985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-fc58a5c7-1dfd-48d9-9657-6ed9e89e96ac req-641dc123-bb80-46d0-b74f-c286059013ce service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:47.819658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-fc58a5c7-1dfd-48d9-9657-6ed9e89e96ac req-641dc123-bb80-46d0-b74f-c286059013ce service nova] Creating event network-changed:09c93341-0714-48fb-b589-3f3fe222c0a8 for instance b3851c11-f4ba-40cd-946e-d113ddb6e3b3 on hv-cinder-85367 Aug 18 21:55:47.826302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-fc58a5c7-1dfd-48d9-9657-6ed9e89e96ac req-641dc123-bb80-46d0-b74f-c286059013ce service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035921 Aug 18 21:55:47.827956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 85/164] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:55:47.982803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4abfa079-ed85-40c2-b6e1-7af6f1515b7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:48.001082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4abfa079-ed85-40c2-b6e1-7af6f1515b7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1516 microversion: 2.1 time: 0.329962 Aug 18 21:55:48.005011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 80/165] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:47 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1516 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:48.027477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c66b08d1-da25-439e-b7be-ff5235ecd37e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:48.028303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c66b08d1-da25-439e-b7be-ff5235ecd37e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:48.045461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da7d1fdc-6acc-41c8-9dfb-ae23a3a12d13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:48.046742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c66b08d1-da25-439e-b7be-ff5235ecd37e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:48.047211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c66b08d1-da25-439e-b7be-ff5235ecd37e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:48.047665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c66b08d1-da25-439e-b7be-ff5235ecd37e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:48.048388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c66b08d1-da25-439e-b7be-ff5235ecd37e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:48.048855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c66b08d1-da25-439e-b7be-ff5235ecd37e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:48.049284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c66b08d1-da25-439e-b7be-ff5235ecd37e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:48.056109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-da7d1fdc-6acc-41c8-9dfb-ae23a3a12d13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:48.072303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da7d1fdc-6acc-41c8-9dfb-ae23a3a12d13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:48.073640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da7d1fdc-6acc-41c8-9dfb-ae23a3a12d13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:48.074067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da7d1fdc-6acc-41c8-9dfb-ae23a3a12d13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:48.074782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da7d1fdc-6acc-41c8-9dfb-ae23a3a12d13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:48.075239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da7d1fdc-6acc-41c8-9dfb-ae23a3a12d13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:48.075673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da7d1fdc-6acc-41c8-9dfb-ae23a3a12d13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:48.133335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-da7d1fdc-6acc-41c8-9dfb-ae23a3a12d13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lazy-loading 'flavor' on Instance uuid b079c0d4-5952-4bbf-a148-c34875a08105 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:55:48.447462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da7d1fdc-6acc-41c8-9dfb-ae23a3a12d13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "POST /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105/action" status: 200 len: 32 microversion: 2.1 time: 0.417104 Aug 18 21:55:48.454034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 81/166] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 21:55:48 2022] POST /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105/action => generated 32 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 21:55:48.462091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-27b86d54-71d1-4015-a324-ff056e662a55 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:48.463351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-27b86d54-71d1-4015-a324-ff056e662a55 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:48.478299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c66b08d1-da25-439e-b7be-ff5235ecd37e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:48.493386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:55:48.497691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c66b08d1-da25-439e-b7be-ff5235ecd37e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:48.501571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c66b08d1-da25-439e-b7be-ff5235ecd37e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:48.504276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c66b08d1-da25-439e-b7be-ff5235ecd37e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1407 microversion: 2.20 time: 0.480708 Aug 18 21:55:48.506092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 86/167] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:48.519212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27b86d54-71d1-4015-a324-ff056e662a55 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:48.522406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27b86d54-71d1-4015-a324-ff056e662a55 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:48.523145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27b86d54-71d1-4015-a324-ff056e662a55 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:48.525327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27b86d54-71d1-4015-a324-ff056e662a55 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:48.525910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27b86d54-71d1-4015-a324-ff056e662a55 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:48.526264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27b86d54-71d1-4015-a324-ff056e662a55 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:48.717653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-27b86d54-71d1-4015-a324-ff056e662a55 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:48.721858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-27b86d54-71d1-4015-a324-ff056e662a55 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.265590 Aug 18 21:55:48.722089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 82/168] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:48 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:49.529834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-686a5d2a-0bef-4bc8-9491-f17b2325d710 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:49.531132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-686a5d2a-0bef-4bc8-9491-f17b2325d710 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:49.538314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-686a5d2a-0bef-4bc8-9491-f17b2325d710 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:49.539206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-686a5d2a-0bef-4bc8-9491-f17b2325d710 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:49.539976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-686a5d2a-0bef-4bc8-9491-f17b2325d710 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:49.540905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-686a5d2a-0bef-4bc8-9491-f17b2325d710 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:49.541834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-686a5d2a-0bef-4bc8-9491-f17b2325d710 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:49.542407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-686a5d2a-0bef-4bc8-9491-f17b2325d710 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:49.744013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-090dae66-11ac-4454-a47a-3ff0fbff51c7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:49.744645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-090dae66-11ac-4454-a47a-3ff0fbff51c7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:49.759811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-090dae66-11ac-4454-a47a-3ff0fbff51c7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:49.760614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-090dae66-11ac-4454-a47a-3ff0fbff51c7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:49.763206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-090dae66-11ac-4454-a47a-3ff0fbff51c7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:49.766377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-090dae66-11ac-4454-a47a-3ff0fbff51c7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:49.767094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-090dae66-11ac-4454-a47a-3ff0fbff51c7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:49.768808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-090dae66-11ac-4454-a47a-3ff0fbff51c7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:50.110541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-686a5d2a-0bef-4bc8-9491-f17b2325d710 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:50.124597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-686a5d2a-0bef-4bc8-9491-f17b2325d710 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:50.131649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-686a5d2a-0bef-4bc8-9491-f17b2325d710 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:50.132868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-686a5d2a-0bef-4bc8-9491-f17b2325d710 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1598 microversion: 2.20 time: 0.607541 Aug 18 21:55:50.133437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 87/169] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:55:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1598 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:55:50.142765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-090dae66-11ac-4454-a47a-3ff0fbff51c7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:50.151072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-090dae66-11ac-4454-a47a-3ff0fbff51c7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.412076 Aug 18 21:55:50.155066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 83/170] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:49 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:50.162008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-29548ea1-be3a-4253-877e-16238d7dd3fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:50.162707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-29548ea1-be3a-4253-877e-16238d7dd3fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:50.169719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29548ea1-be3a-4253-877e-16238d7dd3fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:50.170475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29548ea1-be3a-4253-877e-16238d7dd3fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:50.171065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29548ea1-be3a-4253-877e-16238d7dd3fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:50.171924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29548ea1-be3a-4253-877e-16238d7dd3fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:50.172524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29548ea1-be3a-4253-877e-16238d7dd3fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:50.173092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29548ea1-be3a-4253-877e-16238d7dd3fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:50.307240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-29548ea1-be3a-4253-877e-16238d7dd3fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.150712 Aug 18 21:55:50.308312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 88/171] 10.222.0.82 () {60 vars in 1316 bytes} [Thu Aug 18 21:55:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:55:51.188452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c4f5226f-1427-4b4d-a288-0addc01f3a18 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:51.189695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c4f5226f-1427-4b4d-a288-0addc01f3a18 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:51.202181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4f5226f-1427-4b4d-a288-0addc01f3a18 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:51.203687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4f5226f-1427-4b4d-a288-0addc01f3a18 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:51.204143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4f5226f-1427-4b4d-a288-0addc01f3a18 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:51.210297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4f5226f-1427-4b4d-a288-0addc01f3a18 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:51.210809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4f5226f-1427-4b4d-a288-0addc01f3a18 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:51.214587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4f5226f-1427-4b4d-a288-0addc01f3a18 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:51.539134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c4f5226f-1427-4b4d-a288-0addc01f3a18 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:51.549442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c4f5226f-1427-4b4d-a288-0addc01f3a18 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.365880 Aug 18 21:55:51.551579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 84/172] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:51 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:52.021782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-c447257b-7d4b-4ebe-947e-a0ba4a452727 req-aa82f8a8-1c4e-4a8d-a39a-3f3e00735eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0426bb7b-e862-4873-9c1e-7878b89cde47", "tag": "a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:52.046205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-c447257b-7d4b-4ebe-947e-a0ba4a452727 req-aa82f8a8-1c4e-4a8d-a39a-3f3e00735eb2 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:52.046896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-c447257b-7d4b-4ebe-947e-a0ba4a452727 req-aa82f8a8-1c4e-4a8d-a39a-3f3e00735eb2 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:52.047643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-c447257b-7d4b-4ebe-947e-a0ba4a452727 req-aa82f8a8-1c4e-4a8d-a39a-3f3e00735eb2 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:52.104988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-c447257b-7d4b-4ebe-947e-a0ba4a452727 req-aa82f8a8-1c4e-4a8d-a39a-3f3e00735eb2 service nova] Creating event network-changed:a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b for instance 0426bb7b-e862-4873-9c1e-7878b89cde47 on hv-cinder-85367 Aug 18 21:55:52.125868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-c447257b-7d4b-4ebe-947e-a0ba4a452727 req-aa82f8a8-1c4e-4a8d-a39a-3f3e00735eb2 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108474 Aug 18 21:55:52.127042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 89/173] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:52.573052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a9cd13dd-50b9-4df6-820d-bfcabaa67cc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:52.574278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a9cd13dd-50b9-4df6-820d-bfcabaa67cc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:52.581966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9cd13dd-50b9-4df6-820d-bfcabaa67cc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:52.583033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9cd13dd-50b9-4df6-820d-bfcabaa67cc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:52.583646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9cd13dd-50b9-4df6-820d-bfcabaa67cc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:52.584594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9cd13dd-50b9-4df6-820d-bfcabaa67cc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:52.585362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9cd13dd-50b9-4df6-820d-bfcabaa67cc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:52.586153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9cd13dd-50b9-4df6-820d-bfcabaa67cc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:52.755378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a9cd13dd-50b9-4df6-820d-bfcabaa67cc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:52.770449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a9cd13dd-50b9-4df6-820d-bfcabaa67cc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.201209 Aug 18 21:55:52.771369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 85/174] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:52 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:53.794186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f6fc1a4c-cf0b-4f22-909e-5a8f9080d35d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:53.794927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f6fc1a4c-cf0b-4f22-909e-5a8f9080d35d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:53.804432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6fc1a4c-cf0b-4f22-909e-5a8f9080d35d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:53.804432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6fc1a4c-cf0b-4f22-909e-5a8f9080d35d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:53.804432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6fc1a4c-cf0b-4f22-909e-5a8f9080d35d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:53.804432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6fc1a4c-cf0b-4f22-909e-5a8f9080d35d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:53.804779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6fc1a4c-cf0b-4f22-909e-5a8f9080d35d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:53.804779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6fc1a4c-cf0b-4f22-909e-5a8f9080d35d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:53.962389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f6fc1a4c-cf0b-4f22-909e-5a8f9080d35d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:53.975419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f6fc1a4c-cf0b-4f22-909e-5a8f9080d35d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.185828 Aug 18 21:55:53.990307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 90/175] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:53 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:54.996432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-242c083a-bcdb-4091-996f-a73aaaa86989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:54.997343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-242c083a-bcdb-4091-996f-a73aaaa86989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:55.015124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-242c083a-bcdb-4091-996f-a73aaaa86989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:55.015635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-242c083a-bcdb-4091-996f-a73aaaa86989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:55.016085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-242c083a-bcdb-4091-996f-a73aaaa86989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:55.016818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-242c083a-bcdb-4091-996f-a73aaaa86989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:55.017279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-242c083a-bcdb-4091-996f-a73aaaa86989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:55.017753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-242c083a-bcdb-4091-996f-a73aaaa86989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:55.178287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-242c083a-bcdb-4091-996f-a73aaaa86989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:55.191367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-242c083a-bcdb-4091-996f-a73aaaa86989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.198794 Aug 18 21:55:55.194421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 86/176] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:54 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:55.829230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e3271609-97cd-43eb-bfac-2dd99aa76235 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:55.830389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e3271609-97cd-43eb-bfac-2dd99aa76235 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:55.837507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3271609-97cd-43eb-bfac-2dd99aa76235 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:55.838051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3271609-97cd-43eb-bfac-2dd99aa76235 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:55.838968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3271609-97cd-43eb-bfac-2dd99aa76235 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:55.839885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3271609-97cd-43eb-bfac-2dd99aa76235 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:55.840554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3271609-97cd-43eb-bfac-2dd99aa76235 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:55.841178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3271609-97cd-43eb-bfac-2dd99aa76235 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:55.874601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e3271609-97cd-43eb-bfac-2dd99aa76235 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:55:56.008809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e3271609-97cd-43eb-bfac-2dd99aa76235 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 204 len: 0 microversion: 2.1 time: 0.181729 Aug 18 21:55:56.010178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 91/177] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 21:55:55 2022] DELETE /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:55:56.018800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3e19f8c6-d6ad-414d-ba84-e4f5593d7d5e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:56.019481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3e19f8c6-d6ad-414d-ba84-e4f5593d7d5e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:56.026985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3e19f8c6-d6ad-414d-ba84-e4f5593d7d5e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:56.028151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3e19f8c6-d6ad-414d-ba84-e4f5593d7d5e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:56.028629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3e19f8c6-d6ad-414d-ba84-e4f5593d7d5e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:56.029433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3e19f8c6-d6ad-414d-ba84-e4f5593d7d5e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:56.030015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3e19f8c6-d6ad-414d-ba84-e4f5593d7d5e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:56.030519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3e19f8c6-d6ad-414d-ba84-e4f5593d7d5e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:56.162001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3e19f8c6-d6ad-414d-ba84-e4f5593d7d5e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:56.170563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3e19f8c6-d6ad-414d-ba84-e4f5593d7d5e tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1554 microversion: 2.1 time: 0.155936 Aug 18 21:55:56.171136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 87/178] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:56 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:56.215782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7193652-81eb-4f64-b0cf-31c89e99b348 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:56.216720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f7193652-81eb-4f64-b0cf-31c89e99b348 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:56.222599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7193652-81eb-4f64-b0cf-31c89e99b348 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:56.223526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7193652-81eb-4f64-b0cf-31c89e99b348 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:56.224003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7193652-81eb-4f64-b0cf-31c89e99b348 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:56.224686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7193652-81eb-4f64-b0cf-31c89e99b348 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:56.225168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7193652-81eb-4f64-b0cf-31c89e99b348 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:56.225587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7193652-81eb-4f64-b0cf-31c89e99b348 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:56.363637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f7193652-81eb-4f64-b0cf-31c89e99b348 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:56.371313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f7193652-81eb-4f64-b0cf-31c89e99b348 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.159741 Aug 18 21:55:56.371882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 92/179] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:56 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:57.200921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5527b2ea-3721-4c4d-a4ff-68a1d786feb4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:57.200921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5527b2ea-3721-4c4d-a4ff-68a1d786feb4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:57.208441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5527b2ea-3721-4c4d-a4ff-68a1d786feb4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:57.208932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5527b2ea-3721-4c4d-a4ff-68a1d786feb4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:57.209371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5527b2ea-3721-4c4d-a4ff-68a1d786feb4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:57.210145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5527b2ea-3721-4c4d-a4ff-68a1d786feb4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:57.210608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5527b2ea-3721-4c4d-a4ff-68a1d786feb4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:57.211035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5527b2ea-3721-4c4d-a4ff-68a1d786feb4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:57.360547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5527b2ea-3721-4c4d-a4ff-68a1d786feb4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:57.379090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5527b2ea-3721-4c4d-a4ff-68a1d786feb4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1554 microversion: 2.1 time: 0.189825 Aug 18 21:55:57.380225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 88/180] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:57 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:57.398583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-534d4fee-cdf3-40fd-bcd6-db8026387511 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:57.399272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-534d4fee-cdf3-40fd-bcd6-db8026387511 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:57.412445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-534d4fee-cdf3-40fd-bcd6-db8026387511 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:57.412945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-534d4fee-cdf3-40fd-bcd6-db8026387511 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:57.413419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-534d4fee-cdf3-40fd-bcd6-db8026387511 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:57.414124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-534d4fee-cdf3-40fd-bcd6-db8026387511 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:57.414638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-534d4fee-cdf3-40fd-bcd6-db8026387511 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:57.415115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-534d4fee-cdf3-40fd-bcd6-db8026387511 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:57.564307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-534d4fee-cdf3-40fd-bcd6-db8026387511 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:57.576713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-534d4fee-cdf3-40fd-bcd6-db8026387511 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.182832 Aug 18 21:55:57.577358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 93/181] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:57 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:58.401708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d1aecdc5-49b4-441d-8c31-6d35276caabe tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:58.402316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d1aecdc5-49b4-441d-8c31-6d35276caabe tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:58.408741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1aecdc5-49b4-441d-8c31-6d35276caabe tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:58.409226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1aecdc5-49b4-441d-8c31-6d35276caabe tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:58.409677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1aecdc5-49b4-441d-8c31-6d35276caabe tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:58.410367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1aecdc5-49b4-441d-8c31-6d35276caabe tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:58.410815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1aecdc5-49b4-441d-8c31-6d35276caabe tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:58.411293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1aecdc5-49b4-441d-8c31-6d35276caabe tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:58.581125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d1aecdc5-49b4-441d-8c31-6d35276caabe tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:58.593134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d1aecdc5-49b4-441d-8c31-6d35276caabe tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1554 microversion: 2.1 time: 0.193511 Aug 18 21:55:58.599320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2876cc70-810e-418f-b467-4422ad98a93e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:58.600029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2876cc70-810e-418f-b467-4422ad98a93e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:58.605162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 89/182] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:58 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:58.607277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2876cc70-810e-418f-b467-4422ad98a93e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:58.607994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2876cc70-810e-418f-b467-4422ad98a93e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:58.608640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2876cc70-810e-418f-b467-4422ad98a93e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:58.609822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2876cc70-810e-418f-b467-4422ad98a93e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:58.610465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2876cc70-810e-418f-b467-4422ad98a93e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:58.611075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2876cc70-810e-418f-b467-4422ad98a93e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:58.879994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2876cc70-810e-418f-b467-4422ad98a93e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:58.896367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2876cc70-810e-418f-b467-4422ad98a93e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.300984 Aug 18 21:55:58.899222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 94/183] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:58 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:55:59.382273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-21ce2f30-7ff1-4010-957c-a9eaa2a76318 req-f743f38b-073f-4eb9-8203-b09b749fa91e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a249d5e7-ea93-4157-87dc-4fd3b6789cdb", "name": "network-vif-deleted", "tag": "7cc31b7a-814f-44a7-8ae5-2de63707d442"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:55:59.398358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-21ce2f30-7ff1-4010-957c-a9eaa2a76318 req-f743f38b-073f-4eb9-8203-b09b749fa91e service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:59.400256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-21ce2f30-7ff1-4010-957c-a9eaa2a76318 req-f743f38b-073f-4eb9-8203-b09b749fa91e service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:59.401123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-21ce2f30-7ff1-4010-957c-a9eaa2a76318 req-f743f38b-073f-4eb9-8203-b09b749fa91e service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:59.419025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-21ce2f30-7ff1-4010-957c-a9eaa2a76318 req-f743f38b-073f-4eb9-8203-b09b749fa91e service nova] Creating event network-vif-deleted:7cc31b7a-814f-44a7-8ae5-2de63707d442 for instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb on hv-cinder-85367 Aug 18 21:55:59.425296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-21ce2f30-7ff1-4010-957c-a9eaa2a76318 req-f743f38b-073f-4eb9-8203-b09b749fa91e service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047540 Aug 18 21:55:59.426773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 90/184] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:55:59.631789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-46376612-49ee-410b-b329-807d376b741b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:59.632595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46376612-49ee-410b-b329-807d376b741b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:59.639297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46376612-49ee-410b-b329-807d376b741b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:59.639801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46376612-49ee-410b-b329-807d376b741b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:59.640242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46376612-49ee-410b-b329-807d376b741b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:59.641154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46376612-49ee-410b-b329-807d376b741b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:59.641805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46376612-49ee-410b-b329-807d376b741b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:59.642397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46376612-49ee-410b-b329-807d376b741b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:59.717175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-46376612-49ee-410b-b329-807d376b741b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bbaf0feaf294fc79f8f7d8dbcf58851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6604f675c98a470db3568612140f7e8e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:55:59.729053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-46376612-49ee-410b-b329-807d376b741b tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 200 len: 1346 microversion: 2.1 time: 0.101066 Aug 18 21:55:59.738292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 95/185] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:59 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 1346 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:55:59.938658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ef59065f-59f6-4f3d-b12d-b2c39c11cdb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:55:59.939598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ef59065f-59f6-4f3d-b12d-b2c39c11cdb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:55:59.950357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef59065f-59f6-4f3d-b12d-b2c39c11cdb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:59.950852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef59065f-59f6-4f3d-b12d-b2c39c11cdb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:59.951463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef59065f-59f6-4f3d-b12d-b2c39c11cdb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:55:59.952186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef59065f-59f6-4f3d-b12d-b2c39c11cdb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:55:59.952691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef59065f-59f6-4f3d-b12d-b2c39c11cdb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:55:59.953162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef59065f-59f6-4f3d-b12d-b2c39c11cdb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:00.230871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ef59065f-59f6-4f3d-b12d-b2c39c11cdb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:00.238953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ef59065f-59f6-4f3d-b12d-b2c39c11cdb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.305414 Aug 18 21:56:00.239591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 91/186] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:55:59 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:00.750678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6865102e-13d8-4dd0-962d-ac8ca25aa0d4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:00.752030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6865102e-13d8-4dd0-962d-ac8ca25aa0d4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:00.760060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6865102e-13d8-4dd0-962d-ac8ca25aa0d4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:00.760563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6865102e-13d8-4dd0-962d-ac8ca25aa0d4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:00.761002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6865102e-13d8-4dd0-962d-ac8ca25aa0d4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:00.762166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6865102e-13d8-4dd0-962d-ac8ca25aa0d4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:00.762604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6865102e-13d8-4dd0-962d-ac8ca25aa0d4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:00.763042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6865102e-13d8-4dd0-962d-ac8ca25aa0d4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:00.779383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-6865102e-13d8-4dd0-962d-ac8ca25aa0d4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] HTTP exception thrown: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6865102e-13d8-4dd0-962d-ac8ca25aa0d4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Request method failure captured: Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb HTTP/1.1 Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rUuQSgV7TRKhFzbsH5lkhXbllc5PYH2Hp53teO2OtcNKwPlUNN06m-AjO_-i2EAZk1WTNTwiXGd0NnGKSrrA28GlR2msKwNyOL5ukjgTlQZ8mKIp41apa2VR-rdwBxUIL3mAkkZZWxW-sDHl_szGteTdke-_nMKlQ3wsUhYeE_88K0 Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 6604f675c98a470db3568612140f7e8e Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-DeleteServersTestJSON-1563009591 Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 21:56:00.784748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 21:56:00.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6604f675c98a470db3568612140f7e8e", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6604f675c98a470db3568612140f7e8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6604f675c98a470db3568612140f7e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6604f675c98a470db3568612140f7e8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:56:00.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-DeleteServersTestJSON-1563009591 Aug 18 21:56:00.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 6604f675c98a470db3568612140f7e8e Aug 18 21:56:00.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-DeleteServersTestJSON-1563009591 Aug 18 21:56:00.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-DeleteServersTestJSON-1563009591-project Aug 18 21:56:00.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 21:56:00.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 21:56:00.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 1bbaf0feaf294fc79f8f7d8dbcf58851 Aug 18 21:56:00.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-DeleteServersTestJSON-1563009591-project Aug 18 21:56:00.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 21:56:00.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:00.787176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': 'a249d5e7-ea93-4157-87dc-4fd3b6789cdb'} Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:56:00.788312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:00.790034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:56:00.792710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6865102e-13d8-4dd0-962d-ac8ca25aa0d4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Returning 404 to user: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:56:00.792710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6865102e-13d8-4dd0-962d-ac8ca25aa0d4 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 404 len: 111 microversion: 2.1 time: 0.040259 Aug 18 21:56:00.792710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 96/187] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:00 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:56:00.912621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52b8f70b-47c8-4b14-9b75-bb71093edd74 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:00.915623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-52b8f70b-47c8-4b14-9b75-bb71093edd74 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:00.922560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52b8f70b-47c8-4b14-9b75-bb71093edd74 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:00.923337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52b8f70b-47c8-4b14-9b75-bb71093edd74 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:00.924016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52b8f70b-47c8-4b14-9b75-bb71093edd74 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:00.924904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52b8f70b-47c8-4b14-9b75-bb71093edd74 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:00.925539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52b8f70b-47c8-4b14-9b75-bb71093edd74 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:00.926766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52b8f70b-47c8-4b14-9b75-bb71093edd74 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:00.943291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-52b8f70b-47c8-4b14-9b75-bb71093edd74 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] HTTP exception thrown: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52b8f70b-47c8-4b14-9b75-bb71093edd74 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Request method failure captured: Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb/os-volume_attachments HTTP/1.1 Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rUuQSgV7TRKhFzbsH5lkhXbllc5PYH2Hp53teO2OtcNKwPlUNN06m-AjO_-i2EAZk1WTNTwiXGd0NnGKSrrA28GlR2msKwNyOL5ukjgTlQZ8mKIp41apa2VR-rdwBxUIL3mAkkZZWxW-sDHl_szGteTdke-_nMKlQ3wsUhYeE_88K0 Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 6604f675c98a470db3568612140f7e8e Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-DeleteServersTestJSON-1563009591 Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 21:56:00.959560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 21:56:00.960735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6604f675c98a470db3568612140f7e8e", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6604f675c98a470db3568612140f7e8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6604f675c98a470db3568612140f7e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6604f675c98a470db3568612140f7e8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:56:00.960735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-DeleteServersTestJSON-1563009591 Aug 18 21:56:00.960735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 6604f675c98a470db3568612140f7e8e Aug 18 21:56:00.960735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-DeleteServersTestJSON-1563009591 Aug 18 21:56:00.960735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-DeleteServersTestJSON-1563009591-project Aug 18 21:56:00.960735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 21:56:00.960735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 21:56:00.960735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 1bbaf0feaf294fc79f8f7d8dbcf58851 Aug 18 21:56:00.960735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-DeleteServersTestJSON-1563009591-project Aug 18 21:56:00.960735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 21:56:00.960735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:00.960735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'server_id': 'a249d5e7-ea93-4157-87dc-4fd3b6789cdb'} Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:56:00.961590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:00.966724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:00.967912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52b8f70b-47c8-4b14-9b75-bb71093edd74 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Returning 404 to user: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:56:00.967912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-52b8f70b-47c8-4b14-9b75-bb71093edd74 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052478 Aug 18 21:56:00.967912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 92/188] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:56:00 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:56:01.264440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f8ec8d2e-6a69-4b11-814c-466d5d6076a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:01.264729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f8ec8d2e-6a69-4b11-814c-466d5d6076a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:01.289006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8ec8d2e-6a69-4b11-814c-466d5d6076a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:01.314945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8ec8d2e-6a69-4b11-814c-466d5d6076a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:01.319582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8ec8d2e-6a69-4b11-814c-466d5d6076a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:01.320343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8ec8d2e-6a69-4b11-814c-466d5d6076a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:01.322964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8ec8d2e-6a69-4b11-814c-466d5d6076a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:01.324694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8ec8d2e-6a69-4b11-814c-466d5d6076a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:01.633002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8ec8d2e-6a69-4b11-814c-466d5d6076a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:01.641970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f8ec8d2e-6a69-4b11-814c-466d5d6076a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.383335 Aug 18 21:56:01.672462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 97/189] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:01 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:02.258973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-19dbb9b8-d98c-42dc-ab20-801496dba82f tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:02.259532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-19dbb9b8-d98c-42dc-ab20-801496dba82f tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:02.266114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19dbb9b8-d98c-42dc-ab20-801496dba82f tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:02.266768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19dbb9b8-d98c-42dc-ab20-801496dba82f tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:02.267333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19dbb9b8-d98c-42dc-ab20-801496dba82f tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:02.268195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19dbb9b8-d98c-42dc-ab20-801496dba82f tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:02.268642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19dbb9b8-d98c-42dc-ab20-801496dba82f tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:02.269210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19dbb9b8-d98c-42dc-ab20-801496dba82f tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:02.285117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-19dbb9b8-d98c-42dc-ab20-801496dba82f tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] HTTP exception thrown: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-19dbb9b8-d98c-42dc-ab20-801496dba82f tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Request method failure captured: Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb HTTP/1.1 Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rUuQSgV7TRKhFzbsH5lkhXbllc5PYH2Hp53teO2OtcNKwPlUNN06m-AjO_-i2EAZk1WTNTwiXGd0NnGKSrrA28GlR2msKwNyOL5ukjgTlQZ8mKIp41apa2VR-rdwBxUIL3mAkkZZWxW-sDHl_szGteTdke-_nMKlQ3wsUhYeE_88K0 Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 6604f675c98a470db3568612140f7e8e Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-DeleteServersTestJSON-1563009591 Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 21:56:02.289165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 21:56:02.290589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6604f675c98a470db3568612140f7e8e", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6604f675c98a470db3568612140f7e8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6604f675c98a470db3568612140f7e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6604f675c98a470db3568612140f7e8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:56:02.290589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-DeleteServersTestJSON-1563009591 Aug 18 21:56:02.290589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 6604f675c98a470db3568612140f7e8e Aug 18 21:56:02.290589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-DeleteServersTestJSON-1563009591 Aug 18 21:56:02.290589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-DeleteServersTestJSON-1563009591-project Aug 18 21:56:02.290589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 21:56:02.290589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 21:56:02.290589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 1bbaf0feaf294fc79f8f7d8dbcf58851 Aug 18 21:56:02.290589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-DeleteServersTestJSON-1563009591-project Aug 18 21:56:02.290589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 21:56:02.290589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:02.290589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': 'a249d5e7-ea93-4157-87dc-4fd3b6789cdb'} Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:56:02.291712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:02.293000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:02.296321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-19dbb9b8-d98c-42dc-ab20-801496dba82f tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Returning 404 to user: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:56:02.297841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-19dbb9b8-d98c-42dc-ab20-801496dba82f tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 404 len: 111 microversion: 2.1 time: 0.042684 Aug 18 21:56:02.298568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 93/190] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 21:56:02 2022] DELETE /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 21:56:02.307486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-355a5b34-ffc9-432f-abc3-a3ce96dc8f19 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:02.308102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-355a5b34-ffc9-432f-abc3-a3ce96dc8f19 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] [instance: a249d5e7-ea93-4157-87dc-4fd3b6789cdb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:02.314464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-355a5b34-ffc9-432f-abc3-a3ce96dc8f19 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:02.314964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-355a5b34-ffc9-432f-abc3-a3ce96dc8f19 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:02.315410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-355a5b34-ffc9-432f-abc3-a3ce96dc8f19 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:02.316126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-355a5b34-ffc9-432f-abc3-a3ce96dc8f19 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:02.316696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-355a5b34-ffc9-432f-abc3-a3ce96dc8f19 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:02.317809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-355a5b34-ffc9-432f-abc3-a3ce96dc8f19 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:02.352382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-355a5b34-ffc9-432f-abc3-a3ce96dc8f19 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] HTTP exception thrown: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-355a5b34-ffc9-432f-abc3-a3ce96dc8f19 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Request method failure captured: Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb HTTP/1.1 Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rUuQSgV7TRKhFzbsH5lkhXbllc5PYH2Hp53teO2OtcNKwPlUNN06m-AjO_-i2EAZk1WTNTwiXGd0NnGKSrrA28GlR2msKwNyOL5ukjgTlQZ8mKIp41apa2VR-rdwBxUIL3mAkkZZWxW-sDHl_szGteTdke-_nMKlQ3wsUhYeE_88K0 Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 6604f675c98a470db3568612140f7e8e Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-DeleteServersTestJSON-1563009591 Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 21:56:02.354564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 21:56:02.356025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6604f675c98a470db3568612140f7e8e", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6604f675c98a470db3568612140f7e8e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6604f675c98a470db3568612140f7e8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6604f675c98a470db3568612140f7e8e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:56:02.356025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-DeleteServersTestJSON-1563009591 Aug 18 21:56:02.356025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 6604f675c98a470db3568612140f7e8e Aug 18 21:56:02.356025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-DeleteServersTestJSON-1563009591 Aug 18 21:56:02.356025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-DeleteServersTestJSON-1563009591-project Aug 18 21:56:02.356025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 21:56:02.356025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 21:56:02.356025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 1bbaf0feaf294fc79f8f7d8dbcf58851 Aug 18 21:56:02.356025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-DeleteServersTestJSON-1563009591-project Aug 18 21:56:02.356025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 21:56:02.356025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:02.356025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': 'a249d5e7-ea93-4157-87dc-4fd3b6789cdb'} Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:56:02.356822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. Aug 18 21:56:02.358450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:56:02.361835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-355a5b34-ffc9-432f-abc3-a3ce96dc8f19 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] Returning 404 to user: Instance a249d5e7-ea93-4157-87dc-4fd3b6789cdb could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:56:02.362970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-355a5b34-ffc9-432f-abc3-a3ce96dc8f19 tempest-DeleteServersTestJSON-1563009591 tempest-DeleteServersTestJSON-1563009591-project] 10.222.0.82 "GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb" status: 404 len: 111 microversion: 2.1 time: 0.059258 Aug 18 21:56:02.364336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 98/191] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:02 2022] GET /compute/v2.1/servers/a249d5e7-ea93-4157-87dc-4fd3b6789cdb => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:56:02.666700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4327286d-dc35-491c-adeb-cbb4a41c67f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:02.667321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4327286d-dc35-491c-adeb-cbb4a41c67f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:02.674035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4327286d-dc35-491c-adeb-cbb4a41c67f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:02.674715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4327286d-dc35-491c-adeb-cbb4a41c67f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:02.675322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4327286d-dc35-491c-adeb-cbb4a41c67f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:02.676878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4327286d-dc35-491c-adeb-cbb4a41c67f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:02.677621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4327286d-dc35-491c-adeb-cbb4a41c67f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:02.678191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4327286d-dc35-491c-adeb-cbb4a41c67f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:02.703703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:03.180482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4327286d-dc35-491c-adeb-cbb4a41c67f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:03.190953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4327286d-dc35-491c-adeb-cbb4a41c67f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.528049 Aug 18 21:56:03.191678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 94/192] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:02 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:04.214785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3fc222c0-d3ed-43df-8803-a2076230f34e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:04.216542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3fc222c0-d3ed-43df-8803-a2076230f34e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:04.224212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fc222c0-d3ed-43df-8803-a2076230f34e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:04.225101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fc222c0-d3ed-43df-8803-a2076230f34e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:04.226059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fc222c0-d3ed-43df-8803-a2076230f34e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:04.227063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fc222c0-d3ed-43df-8803-a2076230f34e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:04.228007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fc222c0-d3ed-43df-8803-a2076230f34e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:04.228636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fc222c0-d3ed-43df-8803-a2076230f34e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:04.394346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3fc222c0-d3ed-43df-8803-a2076230f34e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:04.404891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3fc222c0-d3ed-43df-8803-a2076230f34e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.194558 Aug 18 21:56:04.406102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 99/193] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:04 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:05.432757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d765cd66-97ae-4542-9fbb-3212e7b70516 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:05.433459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d765cd66-97ae-4542-9fbb-3212e7b70516 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:05.451976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d765cd66-97ae-4542-9fbb-3212e7b70516 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:05.453005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d765cd66-97ae-4542-9fbb-3212e7b70516 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:05.453648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d765cd66-97ae-4542-9fbb-3212e7b70516 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:05.454584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d765cd66-97ae-4542-9fbb-3212e7b70516 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:05.455198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d765cd66-97ae-4542-9fbb-3212e7b70516 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:05.455781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d765cd66-97ae-4542-9fbb-3212e7b70516 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:05.761325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d765cd66-97ae-4542-9fbb-3212e7b70516 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:05.780201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d765cd66-97ae-4542-9fbb-3212e7b70516 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.351267 Aug 18 21:56:05.782196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 95/194] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:05 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:06.835391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-667bdbfc-c88b-4e89-9047-abe33282684d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:06.836527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-667bdbfc-c88b-4e89-9047-abe33282684d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:06.853931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-667bdbfc-c88b-4e89-9047-abe33282684d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:06.854803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-667bdbfc-c88b-4e89-9047-abe33282684d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:06.855591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-667bdbfc-c88b-4e89-9047-abe33282684d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:06.856836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-667bdbfc-c88b-4e89-9047-abe33282684d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:06.859472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-667bdbfc-c88b-4e89-9047-abe33282684d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:06.860263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-667bdbfc-c88b-4e89-9047-abe33282684d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:07.767022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-667bdbfc-c88b-4e89-9047-abe33282684d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:07.779897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-667bdbfc-c88b-4e89-9047-abe33282684d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.967458 Aug 18 21:56:07.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 100/195] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:06 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:08.806075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ba6b6701-09a1-43c3-b07a-d26d3641b27c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:08.807288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ba6b6701-09a1-43c3-b07a-d26d3641b27c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:08.813695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba6b6701-09a1-43c3-b07a-d26d3641b27c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:08.814318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba6b6701-09a1-43c3-b07a-d26d3641b27c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:08.814814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba6b6701-09a1-43c3-b07a-d26d3641b27c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:08.815695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba6b6701-09a1-43c3-b07a-d26d3641b27c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:08.816216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba6b6701-09a1-43c3-b07a-d26d3641b27c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:08.816777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba6b6701-09a1-43c3-b07a-d26d3641b27c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:08.989213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ba6b6701-09a1-43c3-b07a-d26d3641b27c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:08.998633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ba6b6701-09a1-43c3-b07a-d26d3641b27c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.197815 Aug 18 21:56:08.999779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 96/196] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:08 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:10.022772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-99da6456-3523-4bac-8881-50741d6311c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:10.024290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-99da6456-3523-4bac-8881-50741d6311c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:10.033798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99da6456-3523-4bac-8881-50741d6311c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:10.034533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99da6456-3523-4bac-8881-50741d6311c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:10.035068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99da6456-3523-4bac-8881-50741d6311c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:10.036448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99da6456-3523-4bac-8881-50741d6311c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:10.037206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99da6456-3523-4bac-8881-50741d6311c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:10.041165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99da6456-3523-4bac-8881-50741d6311c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:10.251229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-99da6456-3523-4bac-8881-50741d6311c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:10.259794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-99da6456-3523-4bac-8881-50741d6311c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.242585 Aug 18 21:56:10.260923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 101/197] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:10 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:11.287305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-88e03643-dc2a-455f-a1fd-ef55fafdb342 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:11.288446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-88e03643-dc2a-455f-a1fd-ef55fafdb342 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:11.330056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88e03643-dc2a-455f-a1fd-ef55fafdb342 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:11.331878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88e03643-dc2a-455f-a1fd-ef55fafdb342 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:11.333877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88e03643-dc2a-455f-a1fd-ef55fafdb342 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:11.336186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88e03643-dc2a-455f-a1fd-ef55fafdb342 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:11.337868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88e03643-dc2a-455f-a1fd-ef55fafdb342 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:11.340068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88e03643-dc2a-455f-a1fd-ef55fafdb342 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:12.093278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-88e03643-dc2a-455f-a1fd-ef55fafdb342 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:12.104371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-88e03643-dc2a-455f-a1fd-ef55fafdb342 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.825477 Aug 18 21:56:12.106368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 97/198] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:11 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:13.128937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-15d14663-52bc-42b9-92c3-26a1314773c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:13.130488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-15d14663-52bc-42b9-92c3-26a1314773c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:13.132710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:13.143591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15d14663-52bc-42b9-92c3-26a1314773c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:13.144105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15d14663-52bc-42b9-92c3-26a1314773c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:13.144602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15d14663-52bc-42b9-92c3-26a1314773c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:13.146642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15d14663-52bc-42b9-92c3-26a1314773c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:13.154224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15d14663-52bc-42b9-92c3-26a1314773c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:13.157248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15d14663-52bc-42b9-92c3-26a1314773c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:13.190634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:13.336139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-15d14663-52bc-42b9-92c3-26a1314773c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:13.360834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-15d14663-52bc-42b9-92c3-26a1314773c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.235642 Aug 18 21:56:13.366404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 102/199] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:13 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:14.389413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-988dc747-3629-4b2e-82ca-ba3a1769da8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:14.390978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-988dc747-3629-4b2e-82ca-ba3a1769da8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:14.406774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-988dc747-3629-4b2e-82ca-ba3a1769da8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:14.407282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-988dc747-3629-4b2e-82ca-ba3a1769da8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:14.407729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-988dc747-3629-4b2e-82ca-ba3a1769da8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:14.408441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-988dc747-3629-4b2e-82ca-ba3a1769da8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:14.413182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-988dc747-3629-4b2e-82ca-ba3a1769da8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:14.414101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-988dc747-3629-4b2e-82ca-ba3a1769da8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:14.612835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-988dc747-3629-4b2e-82ca-ba3a1769da8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:14.624392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-988dc747-3629-4b2e-82ca-ba3a1769da8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.239891 Aug 18 21:56:14.625270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 98/200] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:14 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:15.653481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-75300f6f-5d1a-4622-8029-fbed1d066809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:15.654895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-75300f6f-5d1a-4622-8029-fbed1d066809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:15.685945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75300f6f-5d1a-4622-8029-fbed1d066809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:15.686454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75300f6f-5d1a-4622-8029-fbed1d066809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:15.686901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75300f6f-5d1a-4622-8029-fbed1d066809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:15.696759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75300f6f-5d1a-4622-8029-fbed1d066809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:15.697383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75300f6f-5d1a-4622-8029-fbed1d066809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:15.697740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75300f6f-5d1a-4622-8029-fbed1d066809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:16.096996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-75300f6f-5d1a-4622-8029-fbed1d066809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:16.108159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-75300f6f-5d1a-4622-8029-fbed1d066809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.459549 Aug 18 21:56:16.108744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 103/201] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:15 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:17.132620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-32a47580-f7f8-4a0c-a8a9-d9a9fd3af743 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:17.133255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-32a47580-f7f8-4a0c-a8a9-d9a9fd3af743 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:17.142171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32a47580-f7f8-4a0c-a8a9-d9a9fd3af743 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:17.142668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32a47580-f7f8-4a0c-a8a9-d9a9fd3af743 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:17.143113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32a47580-f7f8-4a0c-a8a9-d9a9fd3af743 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:17.152004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32a47580-f7f8-4a0c-a8a9-d9a9fd3af743 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:17.152567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32a47580-f7f8-4a0c-a8a9-d9a9fd3af743 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:17.153017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32a47580-f7f8-4a0c-a8a9-d9a9fd3af743 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:17.396720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-32a47580-f7f8-4a0c-a8a9-d9a9fd3af743 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:17.406861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-32a47580-f7f8-4a0c-a8a9-d9a9fd3af743 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.278227 Aug 18 21:56:17.407468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 99/202] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:17 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:17.910499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-43a203bd-4de8-46e5-9e11-2ff5a1e2fb63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Action: 'create', calling method: .version_select at 0x7fd889f8a310>, body: {"keypair": {"name": "tempest-keypair-1473839402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCTHILibC1mOyLYtfKTd1c5gVxASc0C24I9Jl316DAzqsKxjRmrEssLmxTEh48Jh8+D3Woafr9unaLses9dCifiwiQoQG9MLv/vTu/WZJA3VpgYRaSO2lI49RnaRRPj73Q=="}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:17.934610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-43a203bd-4de8-46e5-9e11-2ff5a1e2fb63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for project aa6929ebd282417cb6ba149f50281240. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:56:17.938611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-43a203bd-4de8-46e5-9e11-2ff5a1e2fb63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for user 7790a2ef47644d62863aafc890d03249 and project aa6929ebd282417cb6ba149f50281240. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:56:17.967797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-43a203bd-4de8-46e5-9e11-2ff5a1e2fb63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.218918 Aug 18 21:56:17.968617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 104/203] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 21:56:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:56:18.436020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-01b9902f-ab47-411f-9dc8-1479ca48ce39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:18.442338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-01b9902f-ab47-411f-9dc8-1479ca48ce39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:18.476351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01b9902f-ab47-411f-9dc8-1479ca48ce39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:18.479718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01b9902f-ab47-411f-9dc8-1479ca48ce39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:18.481121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01b9902f-ab47-411f-9dc8-1479ca48ce39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:18.482691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01b9902f-ab47-411f-9dc8-1479ca48ce39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:18.483850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01b9902f-ab47-411f-9dc8-1479ca48ce39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:18.484869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01b9902f-ab47-411f-9dc8-1479ca48ce39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:19.037038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-01b9902f-ab47-411f-9dc8-1479ca48ce39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:19.050210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-01b9902f-ab47-411f-9dc8-1479ca48ce39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.622595 Aug 18 21:56:19.055392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 100/204] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:18 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:20.086333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0ab7b8b9-172d-4c3a-8629-77723e257b79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:20.087388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0ab7b8b9-172d-4c3a-8629-77723e257b79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:20.107584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ab7b8b9-172d-4c3a-8629-77723e257b79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:20.108544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ab7b8b9-172d-4c3a-8629-77723e257b79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:20.109225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ab7b8b9-172d-4c3a-8629-77723e257b79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:20.110511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ab7b8b9-172d-4c3a-8629-77723e257b79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:20.112432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ab7b8b9-172d-4c3a-8629-77723e257b79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:20.113985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ab7b8b9-172d-4c3a-8629-77723e257b79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:20.546711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0ab7b8b9-172d-4c3a-8629-77723e257b79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:20.552335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1050767649", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4f28e51-196b-4c42-8717-0b4dbb184c81"}], "security_groups": [{"name": "tempest-securitygroup--767880777"}], "key_name": "tempest-keypair-1473839402", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:20.570343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0ab7b8b9-172d-4c3a-8629-77723e257b79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.496492 Aug 18 21:56:20.570950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 105/205] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:20 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:20.583596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=37 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:20.883282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] validate_networks() for [('b4f28e51-196b-4c42-8717-0b4dbb184c81', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:56:21.593427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d26fef29-e5d3-4e00-89ef-723ea1408499 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:21.600560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d26fef29-e5d3-4e00-89ef-723ea1408499 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:21.608447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26fef29-e5d3-4e00-89ef-723ea1408499 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:21.610776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26fef29-e5d3-4e00-89ef-723ea1408499 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:21.611776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26fef29-e5d3-4e00-89ef-723ea1408499 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:21.612713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26fef29-e5d3-4e00-89ef-723ea1408499 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:21.613494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26fef29-e5d3-4e00-89ef-723ea1408499 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:21.614126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26fef29-e5d3-4e00-89ef-723ea1408499 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:21.892036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:56:21.892505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:56:21.892955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:56:21.893375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:56:21.893813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:56:21.909286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:21.909750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:21.911040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:21.912137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:21.912776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:21.913225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:21.935036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for project aa6929ebd282417cb6ba149f50281240. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:56:21.940810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for user 7790a2ef47644d62863aafc890d03249 and project aa6929ebd282417cb6ba149f50281240. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:56:21.954471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:56:21.956803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:56:22.087698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-12485309-1e37-4eec-8a3d-c879c4e7b4e2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.541554 Aug 18 21:56:22.094875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 101/206] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 21:56:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:56:22.101233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-693068a3-4642-4dee-b576-32a10c4e4a14 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:22.109689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-693068a3-4642-4dee-b576-32a10c4e4a14 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:22.219698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-693068a3-4642-4dee-b576-32a10c4e4a14 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:22.229724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-693068a3-4642-4dee-b576-32a10c4e4a14 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1242 microversion: 2.1 time: 0.133316 Aug 18 21:56:22.230892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 102/207] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1242 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:22.257461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d26fef29-e5d3-4e00-89ef-723ea1408499 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:22.266647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d26fef29-e5d3-4e00-89ef-723ea1408499 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.677448 Aug 18 21:56:22.287779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 106/208] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:21 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:23.255717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f74d6124-8290-4f51-b9c3-167a28865d9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:23.261066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f74d6124-8290-4f51-b9c3-167a28865d9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:23.284177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f74d6124-8290-4f51-b9c3-167a28865d9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:23.286480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f74d6124-8290-4f51-b9c3-167a28865d9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:23.287051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f74d6124-8290-4f51-b9c3-167a28865d9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:23.289392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f74d6124-8290-4f51-b9c3-167a28865d9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:23.293211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f74d6124-8290-4f51-b9c3-167a28865d9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:23.293798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f74d6124-8290-4f51-b9c3-167a28865d9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:23.295397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4039ecb6-d3af-480c-879b-8b4aa45b0c94 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:23.296043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4039ecb6-d3af-480c-879b-8b4aa45b0c94 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:23.304719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4039ecb6-d3af-480c-879b-8b4aa45b0c94 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:23.305227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4039ecb6-d3af-480c-879b-8b4aa45b0c94 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:23.305708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4039ecb6-d3af-480c-879b-8b4aa45b0c94 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:23.306438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4039ecb6-d3af-480c-879b-8b4aa45b0c94 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:23.306963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4039ecb6-d3af-480c-879b-8b4aa45b0c94 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:23.307401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4039ecb6-d3af-480c-879b-8b4aa45b0c94 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:23.555803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f74d6124-8290-4f51-b9c3-167a28865d9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:23.571226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f74d6124-8290-4f51-b9c3-167a28865d9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1238 microversion: 2.1 time: 0.322793 Aug 18 21:56:23.571831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 103/209] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:23 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1238 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:23.645561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4039ecb6-d3af-480c-879b-8b4aa45b0c94 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:23.655876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4039ecb6-d3af-480c-879b-8b4aa45b0c94 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1522 microversion: 2.1 time: 0.365192 Aug 18 21:56:23.671428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 107/210] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:23 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:24.594486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fdb61534-48f3-4496-8825-1488e62676eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:24.595111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fdb61534-48f3-4496-8825-1488e62676eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:24.613214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdb61534-48f3-4496-8825-1488e62676eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:24.614321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdb61534-48f3-4496-8825-1488e62676eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:24.614963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdb61534-48f3-4496-8825-1488e62676eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:24.615688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdb61534-48f3-4496-8825-1488e62676eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:24.616148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdb61534-48f3-4496-8825-1488e62676eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:24.616623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdb61534-48f3-4496-8825-1488e62676eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:24.681636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-73fba9a4-97fe-4bf3-82cc-a3e12c1d1146 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:24.683296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-73fba9a4-97fe-4bf3-82cc-a3e12c1d1146 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:24.698097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73fba9a4-97fe-4bf3-82cc-a3e12c1d1146 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:24.698871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73fba9a4-97fe-4bf3-82cc-a3e12c1d1146 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:24.702331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73fba9a4-97fe-4bf3-82cc-a3e12c1d1146 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:24.704378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73fba9a4-97fe-4bf3-82cc-a3e12c1d1146 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:24.707800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73fba9a4-97fe-4bf3-82cc-a3e12c1d1146 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:24.710604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73fba9a4-97fe-4bf3-82cc-a3e12c1d1146 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:24.800525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fdb61534-48f3-4496-8825-1488e62676eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:24.811634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fdb61534-48f3-4496-8825-1488e62676eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1312 microversion: 2.1 time: 0.222542 Aug 18 21:56:24.815222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 104/211] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:24 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1312 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:25.172377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-73fba9a4-97fe-4bf3-82cc-a3e12c1d1146 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:25.182128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-73fba9a4-97fe-4bf3-82cc-a3e12c1d1146 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1502 microversion: 2.1 time: 0.508056 Aug 18 21:56:25.182758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 108/212] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:24 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1502 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:25.208511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6aaea6d9-a604-49ae-816d-1ceb407fde2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:25.210137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6aaea6d9-a604-49ae-816d-1ceb407fde2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:25.241448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6aaea6d9-a604-49ae-816d-1ceb407fde2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:25.241997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6aaea6d9-a604-49ae-816d-1ceb407fde2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:25.242467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6aaea6d9-a604-49ae-816d-1ceb407fde2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:25.243184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6aaea6d9-a604-49ae-816d-1ceb407fde2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:25.243648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6aaea6d9-a604-49ae-816d-1ceb407fde2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:25.245686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6aaea6d9-a604-49ae-816d-1ceb407fde2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:25.464765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6aaea6d9-a604-49ae-816d-1ceb407fde2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:25.476326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6aaea6d9-a604-49ae-816d-1ceb407fde2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1516 microversion: 2.1 time: 0.271891 Aug 18 21:56:25.477265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 105/213] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:25 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1516 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:25.841463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-502192f9-b904-4c75-b1db-0edf3a22e4b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:25.842238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-502192f9-b904-4c75-b1db-0edf3a22e4b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:25.855352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-502192f9-b904-4c75-b1db-0edf3a22e4b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:25.858193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-502192f9-b904-4c75-b1db-0edf3a22e4b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:25.858655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-502192f9-b904-4c75-b1db-0edf3a22e4b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:25.866785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-502192f9-b904-4c75-b1db-0edf3a22e4b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:25.867334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-502192f9-b904-4c75-b1db-0edf3a22e4b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:25.872011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-502192f9-b904-4c75-b1db-0edf3a22e4b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:26.082674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-502192f9-b904-4c75-b1db-0edf3a22e4b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:26.099518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-502192f9-b904-4c75-b1db-0edf3a22e4b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1300 microversion: 2.1 time: 0.262411 Aug 18 21:56:26.106412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 109/214] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1300 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:27.124293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fba79626-794e-4e9a-b91d-44503f996759 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:27.125320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fba79626-794e-4e9a-b91d-44503f996759 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:27.143265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fba79626-794e-4e9a-b91d-44503f996759 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:27.145697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fba79626-794e-4e9a-b91d-44503f996759 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:27.146479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fba79626-794e-4e9a-b91d-44503f996759 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:27.149323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fba79626-794e-4e9a-b91d-44503f996759 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:27.150806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fba79626-794e-4e9a-b91d-44503f996759 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:27.151307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fba79626-794e-4e9a-b91d-44503f996759 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:27.357695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-036ed2ee-da4c-4f15-b849-3ec1ef63f47a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:27.361321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-036ed2ee-da4c-4f15-b849-3ec1ef63f47a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:27.378102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-036ed2ee-da4c-4f15-b849-3ec1ef63f47a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:27.378606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-036ed2ee-da4c-4f15-b849-3ec1ef63f47a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:27.382187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-036ed2ee-da4c-4f15-b849-3ec1ef63f47a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:27.383025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-036ed2ee-da4c-4f15-b849-3ec1ef63f47a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:27.383494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-036ed2ee-da4c-4f15-b849-3ec1ef63f47a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:27.387737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-036ed2ee-da4c-4f15-b849-3ec1ef63f47a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:27.450729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fba79626-794e-4e9a-b91d-44503f996759 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:27.455432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-036ed2ee-da4c-4f15-b849-3ec1ef63f47a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lazy-loading 'flavor' on Instance uuid 44bde447-4f59-4989-822c-8125ab3befeb {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:56:27.465267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fba79626-794e-4e9a-b91d-44503f996759 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.347064 Aug 18 21:56:27.466567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 106/215] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:27.713225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-036ed2ee-da4c-4f15-b849-3ec1ef63f47a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "POST /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb/action" status: 200 len: 32 microversion: 2.1 time: 0.359967 Aug 18 21:56:27.717118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 110/216] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 21:56:27 2022] POST /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 21:56:27.727065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dc2b2b56-7cfd-4d8e-b86d-fd5591ce4152 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:27.727979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dc2b2b56-7cfd-4d8e-b86d-fd5591ce4152 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:27.740098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc2b2b56-7cfd-4d8e-b86d-fd5591ce4152 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:27.742294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc2b2b56-7cfd-4d8e-b86d-fd5591ce4152 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:27.742767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc2b2b56-7cfd-4d8e-b86d-fd5591ce4152 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:27.743515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc2b2b56-7cfd-4d8e-b86d-fd5591ce4152 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:27.743981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc2b2b56-7cfd-4d8e-b86d-fd5591ce4152 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:27.744413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc2b2b56-7cfd-4d8e-b86d-fd5591ce4152 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:28.240195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc2b2b56-7cfd-4d8e-b86d-fd5591ce4152 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:28.255745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dc2b2b56-7cfd-4d8e-b86d-fd5591ce4152 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.530835 Aug 18 21:56:28.256376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 107/217] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:27 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:28.494471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-26f833ec-33e1-4057-af41-7509b329fe33 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:28.495577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-26f833ec-33e1-4057-af41-7509b329fe33 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:28.498958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:28.510816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26f833ec-33e1-4057-af41-7509b329fe33 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:28.514712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26f833ec-33e1-4057-af41-7509b329fe33 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:28.515451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26f833ec-33e1-4057-af41-7509b329fe33 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:28.516417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26f833ec-33e1-4057-af41-7509b329fe33 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:28.517085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26f833ec-33e1-4057-af41-7509b329fe33 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:28.517763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26f833ec-33e1-4057-af41-7509b329fe33 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:29.195847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-26f833ec-33e1-4057-af41-7509b329fe33 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:29.225948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-26f833ec-33e1-4057-af41-7509b329fe33 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.734878 Aug 18 21:56:29.227209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 111/218] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:29.276863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8b656f41-a436-471c-a808-8caeb80877f6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:29.277489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8b656f41-a436-471c-a808-8caeb80877f6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:29.286655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b656f41-a436-471c-a808-8caeb80877f6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:29.287156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b656f41-a436-471c-a808-8caeb80877f6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:29.287600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b656f41-a436-471c-a808-8caeb80877f6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:29.288313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b656f41-a436-471c-a808-8caeb80877f6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:29.292018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b656f41-a436-471c-a808-8caeb80877f6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:29.296106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b656f41-a436-471c-a808-8caeb80877f6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:29.405889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-36036035-ed95-421c-b989-dc60298e85b5 req-c68d4752-9f57-434a-9bfc-ff49f6ddf37d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6f2dae-a492-46e5-ab40-5884ff13d01e", "tag": "4a3c71ba-f9de-4571-b035-a9ed943dcc83"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:29.420100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-36036035-ed95-421c-b989-dc60298e85b5 req-c68d4752-9f57-434a-9bfc-ff49f6ddf37d service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:29.420900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-36036035-ed95-421c-b989-dc60298e85b5 req-c68d4752-9f57-434a-9bfc-ff49f6ddf37d service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:29.422384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-36036035-ed95-421c-b989-dc60298e85b5 req-c68d4752-9f57-434a-9bfc-ff49f6ddf37d service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:29.452674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-36036035-ed95-421c-b989-dc60298e85b5 req-c68d4752-9f57-434a-9bfc-ff49f6ddf37d service nova] Creating event network-changed:4a3c71ba-f9de-4571-b035-a9ed943dcc83 for instance ca6f2dae-a492-46e5-ab40-5884ff13d01e on hv-cinder-85367 Aug 18 21:56:29.467095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-36036035-ed95-421c-b989-dc60298e85b5 req-c68d4752-9f57-434a-9bfc-ff49f6ddf37d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067131 Aug 18 21:56:29.469006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 112/219] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:56:29.629646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8b656f41-a436-471c-a808-8caeb80877f6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:29.637844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8b656f41-a436-471c-a808-8caeb80877f6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.364680 Aug 18 21:56:29.638338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 108/220] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:29 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:30.028525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1383118906", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "networks": [{"uuid": "82a02ec9-f25d-4d9e-a8f8-b419af8b8326"}]}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:30.105429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] validate_networks() for [('82a02ec9-f25d-4d9e-a8f8-b419af8b8326', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:56:30.248550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c6cdfb6-3e99-4730-89f3-b5ac0f922aa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:30.249340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c6cdfb6-3e99-4730-89f3-b5ac0f922aa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:30.256397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c6cdfb6-3e99-4730-89f3-b5ac0f922aa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:30.257315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c6cdfb6-3e99-4730-89f3-b5ac0f922aa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:30.257981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c6cdfb6-3e99-4730-89f3-b5ac0f922aa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:30.259150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c6cdfb6-3e99-4730-89f3-b5ac0f922aa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:30.259960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c6cdfb6-3e99-4730-89f3-b5ac0f922aa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:30.260590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c6cdfb6-3e99-4730-89f3-b5ac0f922aa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:30.491446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4c6cdfb6-3e99-4730-89f3-b5ac0f922aa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:30.516466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c6cdfb6-3e99-4730-89f3-b5ac0f922aa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.271762 Aug 18 21:56:30.517157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 109/221] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:30 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:30.660081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-77d2ca8e-c54b-4964-8f80-19532df8ffbb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:30.661357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-77d2ca8e-c54b-4964-8f80-19532df8ffbb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:30.671427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77d2ca8e-c54b-4964-8f80-19532df8ffbb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:30.677459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77d2ca8e-c54b-4964-8f80-19532df8ffbb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:30.677984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77d2ca8e-c54b-4964-8f80-19532df8ffbb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:30.678747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77d2ca8e-c54b-4964-8f80-19532df8ffbb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:30.680827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77d2ca8e-c54b-4964-8f80-19532df8ffbb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:30.681455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77d2ca8e-c54b-4964-8f80-19532df8ffbb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:30.904968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:56:30.915148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:56:30.915869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:56:30.916358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:56:30.917025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:56:30.927433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:30.932355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:30.932871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:30.934811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:30.935310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:30.942377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-77d2ca8e-c54b-4964-8f80-19532df8ffbb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:30.946091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:30.955021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-77d2ca8e-c54b-4964-8f80-19532df8ffbb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.298941 Aug 18 21:56:30.965534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 110/222] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:30 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:30.994985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Getting quotas for project 3b157ed00f1548f1af769106e03cf9b5. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:56:30.999497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Getting quotas for user 6a40fd568da34b26bd93b8ff0ea92812 and project 3b157ed00f1548f1af769106e03cf9b5. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:56:31.012961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:56:31.015528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:56:31.073916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-92563cc1-eac0-4e52-a60a-01d8bb01d854 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.049972 Aug 18 21:56:31.075555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 113/223] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 21:56:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:56:31.089215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-118adaf6-d9e0-42a2-8d8d-f0d5496023f4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:31.090613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-118adaf6-d9e0-42a2-8d8d-f0d5496023f4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:31.156365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-118adaf6-d9e0-42a2-8d8d-f0d5496023f4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:31.163887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-118adaf6-d9e0-42a2-8d8d-f0d5496023f4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1219 microversion: 2.1 time: 0.080995 Aug 18 21:56:31.164473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 111/224] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:31 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:31.539876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-574da902-fc93-43ff-a1b2-997e94dbba31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:31.540974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-574da902-fc93-43ff-a1b2-997e94dbba31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:31.556087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-574da902-fc93-43ff-a1b2-997e94dbba31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:31.556854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-574da902-fc93-43ff-a1b2-997e94dbba31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:31.557342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-574da902-fc93-43ff-a1b2-997e94dbba31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:31.558138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-574da902-fc93-43ff-a1b2-997e94dbba31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:31.558628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-574da902-fc93-43ff-a1b2-997e94dbba31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:31.559081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-574da902-fc93-43ff-a1b2-997e94dbba31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:31.726798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-574da902-fc93-43ff-a1b2-997e94dbba31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:31.734979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-574da902-fc93-43ff-a1b2-997e94dbba31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.200131 Aug 18 21:56:31.736014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 114/225] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:31 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:31.976457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1aac7753-babe-4e58-8df2-c4a9a52eae5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:31.977706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1aac7753-babe-4e58-8df2-c4a9a52eae5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:31.983862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:31.985533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aac7753-babe-4e58-8df2-c4a9a52eae5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:31.987512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aac7753-babe-4e58-8df2-c4a9a52eae5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:31.987966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aac7753-babe-4e58-8df2-c4a9a52eae5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:31.989363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aac7753-babe-4e58-8df2-c4a9a52eae5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:31.990103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aac7753-babe-4e58-8df2-c4a9a52eae5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:31.990715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aac7753-babe-4e58-8df2-c4a9a52eae5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:32.167886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1aac7753-babe-4e58-8df2-c4a9a52eae5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:32.177014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1aac7753-babe-4e58-8df2-c4a9a52eae5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.204882 Aug 18 21:56:32.186719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 112/226] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:31 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:32.196476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c6527d28-7467-479b-9cd5-0c6ec08f7c45 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:32.197718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c6527d28-7467-479b-9cd5-0c6ec08f7c45 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:32.206806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6527d28-7467-479b-9cd5-0c6ec08f7c45 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:32.208160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6527d28-7467-479b-9cd5-0c6ec08f7c45 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:32.208936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6527d28-7467-479b-9cd5-0c6ec08f7c45 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:32.210118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6527d28-7467-479b-9cd5-0c6ec08f7c45 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:32.210809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6527d28-7467-479b-9cd5-0c6ec08f7c45 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:32.211435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6527d28-7467-479b-9cd5-0c6ec08f7c45 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:32.342818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c6527d28-7467-479b-9cd5-0c6ec08f7c45 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:32.374692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c6527d28-7467-479b-9cd5-0c6ec08f7c45 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1223 microversion: 2.1 time: 0.183102 Aug 18 21:56:32.375687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 115/227] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:32 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1223 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:32.762872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7310f80c-d9af-4020-b08a-d339aa959924 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:32.763685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7310f80c-d9af-4020-b08a-d339aa959924 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:32.773305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7310f80c-d9af-4020-b08a-d339aa959924 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:32.777374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7310f80c-d9af-4020-b08a-d339aa959924 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:32.778083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7310f80c-d9af-4020-b08a-d339aa959924 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:32.783484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7310f80c-d9af-4020-b08a-d339aa959924 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:32.784859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7310f80c-d9af-4020-b08a-d339aa959924 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:32.786040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7310f80c-d9af-4020-b08a-d339aa959924 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:32.789174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=95 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:32.964829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7310f80c-d9af-4020-b08a-d339aa959924 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:32.974125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7310f80c-d9af-4020-b08a-d339aa959924 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.219390 Aug 18 21:56:32.975461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 113/228] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:32 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:33.153263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-57d654cc-96cc-4028-bdd5-831859923d87 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:33.154124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-57d654cc-96cc-4028-bdd5-831859923d87 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:33.161231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57d654cc-96cc-4028-bdd5-831859923d87 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:33.162247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57d654cc-96cc-4028-bdd5-831859923d87 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:33.162769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57d654cc-96cc-4028-bdd5-831859923d87 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:33.163508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57d654cc-96cc-4028-bdd5-831859923d87 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:33.163982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57d654cc-96cc-4028-bdd5-831859923d87 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:33.164410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57d654cc-96cc-4028-bdd5-831859923d87 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:33.200731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-19907985-6e27-47eb-bd2f-6a988b9c611b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:33.201952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-19907985-6e27-47eb-bd2f-6a988b9c611b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:33.207411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-57d654cc-96cc-4028-bdd5-831859923d87 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/ips" status: 200 len: 146 microversion: 2.1 time: 0.046280 Aug 18 21:56:33.216994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 116/229] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 21:56:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/ips => generated 146 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:56:33.218646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19907985-6e27-47eb-bd2f-6a988b9c611b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:33.220088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19907985-6e27-47eb-bd2f-6a988b9c611b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:33.220705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19907985-6e27-47eb-bd2f-6a988b9c611b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:33.221588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19907985-6e27-47eb-bd2f-6a988b9c611b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:33.222417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19907985-6e27-47eb-bd2f-6a988b9c611b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:33.223759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19907985-6e27-47eb-bd2f-6a988b9c611b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:33.383113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-19907985-6e27-47eb-bd2f-6a988b9c611b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:33.393812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-19907985-6e27-47eb-bd2f-6a988b9c611b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.197041 Aug 18 21:56:33.400604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-45c2b3f2-3213-4191-a2fa-0608229d88bd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:33.401695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-45c2b3f2-3213-4191-a2fa-0608229d88bd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:33.411263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c2b3f2-3213-4191-a2fa-0608229d88bd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:33.411618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 114/230] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:33 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:33.412464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c2b3f2-3213-4191-a2fa-0608229d88bd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:33.413346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c2b3f2-3213-4191-a2fa-0608229d88bd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:33.414446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c2b3f2-3213-4191-a2fa-0608229d88bd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:33.415122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c2b3f2-3213-4191-a2fa-0608229d88bd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:33.415881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c2b3f2-3213-4191-a2fa-0608229d88bd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:33.496233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-45c2b3f2-3213-4191-a2fa-0608229d88bd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:33.505335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-45c2b3f2-3213-4191-a2fa-0608229d88bd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1271 microversion: 2.1 time: 0.112906 Aug 18 21:56:33.506255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 117/231] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:33 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:33.996098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7be0bfb3-4d1d-4dda-9769-7d5db6719a8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:33.997239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7be0bfb3-4d1d-4dda-9769-7d5db6719a8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:34.003846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7be0bfb3-4d1d-4dda-9769-7d5db6719a8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:34.005332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7be0bfb3-4d1d-4dda-9769-7d5db6719a8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:34.005961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7be0bfb3-4d1d-4dda-9769-7d5db6719a8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:34.006852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7be0bfb3-4d1d-4dda-9769-7d5db6719a8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:34.007607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7be0bfb3-4d1d-4dda-9769-7d5db6719a8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:34.008189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7be0bfb3-4d1d-4dda-9769-7d5db6719a8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:34.266601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7be0bfb3-4d1d-4dda-9769-7d5db6719a8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:34.280775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7be0bfb3-4d1d-4dda-9769-7d5db6719a8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.288426 Aug 18 21:56:34.282617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 115/232] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:33 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:34.432848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e93a8993-094b-4ad8-9d2c-aa072826a3fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:34.434018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e93a8993-094b-4ad8-9d2c-aa072826a3fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:34.470834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e93a8993-094b-4ad8-9d2c-aa072826a3fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:34.475581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e93a8993-094b-4ad8-9d2c-aa072826a3fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:34.478577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e93a8993-094b-4ad8-9d2c-aa072826a3fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:34.491224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e93a8993-094b-4ad8-9d2c-aa072826a3fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:34.493391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e93a8993-094b-4ad8-9d2c-aa072826a3fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:34.495949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e93a8993-094b-4ad8-9d2c-aa072826a3fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:34.533068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4d1cb4f3-3d5c-4ba2-828a-f55fbc083b0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:34.538682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4d1cb4f3-3d5c-4ba2-828a-f55fbc083b0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:34.571325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d1cb4f3-3d5c-4ba2-828a-f55fbc083b0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:34.572406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d1cb4f3-3d5c-4ba2-828a-f55fbc083b0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:34.575042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d1cb4f3-3d5c-4ba2-828a-f55fbc083b0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:34.579091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d1cb4f3-3d5c-4ba2-828a-f55fbc083b0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:34.582531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d1cb4f3-3d5c-4ba2-828a-f55fbc083b0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:34.586282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d1cb4f3-3d5c-4ba2-828a-f55fbc083b0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:34.905588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4d1cb4f3-3d5c-4ba2-828a-f55fbc083b0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:34.931409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4d1cb4f3-3d5c-4ba2-828a-f55fbc083b0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1277 microversion: 2.1 time: 0.407892 Aug 18 21:56:34.933776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 116/233] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:34 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1277 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:35.230109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e93a8993-094b-4ad8-9d2c-aa072826a3fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:35.252638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e93a8993-094b-4ad8-9d2c-aa072826a3fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.836449 Aug 18 21:56:35.254367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 118/234] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:34 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:35.348284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8ed52ec6-3eb7-42f4-bd53-59e870e2c145 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:35.381749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8ed52ec6-3eb7-42f4-bd53-59e870e2c145 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:35.397916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ed52ec6-3eb7-42f4-bd53-59e870e2c145 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:35.398956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ed52ec6-3eb7-42f4-bd53-59e870e2c145 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:35.400959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ed52ec6-3eb7-42f4-bd53-59e870e2c145 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:35.402006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ed52ec6-3eb7-42f4-bd53-59e870e2c145 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:35.402932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ed52ec6-3eb7-42f4-bd53-59e870e2c145 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:35.403625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ed52ec6-3eb7-42f4-bd53-59e870e2c145 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:35.785582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8ed52ec6-3eb7-42f4-bd53-59e870e2c145 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:35.795388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8ed52ec6-3eb7-42f4-bd53-59e870e2c145 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.489843 Aug 18 21:56:35.798363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 117/235] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:35.961923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-450a487e-b6f0-4efd-959c-fc5a8afeb558 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:35.963373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-450a487e-b6f0-4efd-959c-fc5a8afeb558 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:35.979390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-450a487e-b6f0-4efd-959c-fc5a8afeb558 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:35.980245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-450a487e-b6f0-4efd-959c-fc5a8afeb558 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:35.980884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-450a487e-b6f0-4efd-959c-fc5a8afeb558 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:35.981829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-450a487e-b6f0-4efd-959c-fc5a8afeb558 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:35.982490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-450a487e-b6f0-4efd-959c-fc5a8afeb558 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:35.983176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-450a487e-b6f0-4efd-959c-fc5a8afeb558 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:36.074650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-450a487e-b6f0-4efd-959c-fc5a8afeb558 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:36.080727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:36.094383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-450a487e-b6f0-4efd-959c-fc5a8afeb558 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1277 microversion: 2.1 time: 0.142392 Aug 18 21:56:36.095809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 119/236] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:35 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:36.296676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0e719b10-8d67-4793-84c7-dd77bfe86aed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:36.299656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0e719b10-8d67-4793-84c7-dd77bfe86aed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:36.307915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e719b10-8d67-4793-84c7-dd77bfe86aed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:36.310893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e719b10-8d67-4793-84c7-dd77bfe86aed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:36.311625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e719b10-8d67-4793-84c7-dd77bfe86aed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:36.314249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e719b10-8d67-4793-84c7-dd77bfe86aed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:36.314911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e719b10-8d67-4793-84c7-dd77bfe86aed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:36.315505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e719b10-8d67-4793-84c7-dd77bfe86aed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:36.659081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0e719b10-8d67-4793-84c7-dd77bfe86aed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:36.673619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0e719b10-8d67-4793-84c7-dd77bfe86aed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.382371 Aug 18 21:56:36.678478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 118/237] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:36 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:36.820107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-38cc30d5-90d7-4a82-97a6-757e3ac2e899 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:36.820833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-38cc30d5-90d7-4a82-97a6-757e3ac2e899 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:36.835933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38cc30d5-90d7-4a82-97a6-757e3ac2e899 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:36.848946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38cc30d5-90d7-4a82-97a6-757e3ac2e899 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:36.854769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38cc30d5-90d7-4a82-97a6-757e3ac2e899 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:36.856921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38cc30d5-90d7-4a82-97a6-757e3ac2e899 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:36.863013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38cc30d5-90d7-4a82-97a6-757e3ac2e899 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:36.869526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26c3e697-7ce5-4e42-a2e5-8b22ddfbcba9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2fcff3e-034c-44f8-aa7f-0d16bd20fc26"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:36.872443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26c3e697-7ce5-4e42-a2e5-8b22ddfbcba9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:36.874963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38cc30d5-90d7-4a82-97a6-757e3ac2e899 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:36.891729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26c3e697-7ce5-4e42-a2e5-8b22ddfbcba9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:36.894030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26c3e697-7ce5-4e42-a2e5-8b22ddfbcba9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:36.895455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26c3e697-7ce5-4e42-a2e5-8b22ddfbcba9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:36.897181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26c3e697-7ce5-4e42-a2e5-8b22ddfbcba9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:36.899961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26c3e697-7ce5-4e42-a2e5-8b22ddfbcba9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:36.901026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26c3e697-7ce5-4e42-a2e5-8b22ddfbcba9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:37.531957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26c3e697-7ce5-4e42-a2e5-8b22ddfbcba9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "POST /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.666347 Aug 18 21:56:37.532615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 119/238] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 21:56:36 2022] POST /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 194 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:56:37.555094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-38cc30d5-90d7-4a82-97a6-757e3ac2e899 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:37.567576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-38cc30d5-90d7-4a82-97a6-757e3ac2e899 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.752460 Aug 18 21:56:37.570980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-874fa671-3e07-4b99-9f69-62bf097fc689 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:37.571912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-874fa671-3e07-4b99-9f69-62bf097fc689 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:37.577949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 120/239] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:36 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:37.592085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-874fa671-3e07-4b99-9f69-62bf097fc689 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:37.594172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-874fa671-3e07-4b99-9f69-62bf097fc689 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:37.598128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-874fa671-3e07-4b99-9f69-62bf097fc689 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:37.604956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-874fa671-3e07-4b99-9f69-62bf097fc689 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:37.605533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-874fa671-3e07-4b99-9f69-62bf097fc689 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:37.606291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-874fa671-3e07-4b99-9f69-62bf097fc689 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:37.710895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fff1d4ed-1627-42da-b9e2-9174e5f52c10 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:37.711530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fff1d4ed-1627-42da-b9e2-9174e5f52c10 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:37.720640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fff1d4ed-1627-42da-b9e2-9174e5f52c10 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:37.723966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fff1d4ed-1627-42da-b9e2-9174e5f52c10 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:37.726931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fff1d4ed-1627-42da-b9e2-9174e5f52c10 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:37.732348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fff1d4ed-1627-42da-b9e2-9174e5f52c10 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:37.733131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fff1d4ed-1627-42da-b9e2-9174e5f52c10 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:37.734577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fff1d4ed-1627-42da-b9e2-9174e5f52c10 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:37.889408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-874fa671-3e07-4b99-9f69-62bf097fc689 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:37.905646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-874fa671-3e07-4b99-9f69-62bf097fc689 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.370839 Aug 18 21:56:37.908252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 120/240] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:37 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:37.914191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-cc75b90f-1cfb-4c26-95b2-deedd03bf205 req-35eaf935-765c-4eed-8c32-6bd7ab3dc563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6f2dae-a492-46e5-ab40-5884ff13d01e", "name": "network-vif-plugged", "status": "completed", "tag": "4a3c71ba-f9de-4571-b035-a9ed943dcc83"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:37.925583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cc75b90f-1cfb-4c26-95b2-deedd03bf205 req-35eaf935-765c-4eed-8c32-6bd7ab3dc563 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:37.926590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cc75b90f-1cfb-4c26-95b2-deedd03bf205 req-35eaf935-765c-4eed-8c32-6bd7ab3dc563 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:37.927278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cc75b90f-1cfb-4c26-95b2-deedd03bf205 req-35eaf935-765c-4eed-8c32-6bd7ab3dc563 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:37.948166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-cc75b90f-1cfb-4c26-95b2-deedd03bf205 req-35eaf935-765c-4eed-8c32-6bd7ab3dc563 service nova] Creating event network-vif-plugged:4a3c71ba-f9de-4571-b035-a9ed943dcc83 for instance ca6f2dae-a492-46e5-ab40-5884ff13d01e on hv-cinder-85367 Aug 18 21:56:37.955702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-cc75b90f-1cfb-4c26-95b2-deedd03bf205 req-35eaf935-765c-4eed-8c32-6bd7ab3dc563 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046023 Aug 18 21:56:37.956986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 121/241] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:56:38.094005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-b7841fd3-dce5-4d79-b672-94e2f163958a req-1023dd55-9970-4666-9e44-2dc427120f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa5355b-48a3-4342-998a-e31be1538357", "tag": "742008d4-bf3b-476e-8e19-c9e9c780f008"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:38.111157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b7841fd3-dce5-4d79-b672-94e2f163958a req-1023dd55-9970-4666-9e44-2dc427120f6c service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:38.111670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b7841fd3-dce5-4d79-b672-94e2f163958a req-1023dd55-9970-4666-9e44-2dc427120f6c service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:38.112327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b7841fd3-dce5-4d79-b672-94e2f163958a req-1023dd55-9970-4666-9e44-2dc427120f6c service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:38.149278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-b7841fd3-dce5-4d79-b672-94e2f163958a req-1023dd55-9970-4666-9e44-2dc427120f6c service nova] Creating event network-changed:742008d4-bf3b-476e-8e19-c9e9c780f008 for instance 0aa5355b-48a3-4342-998a-e31be1538357 on hv-cinder-85367 Aug 18 21:56:38.155853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-b7841fd3-dce5-4d79-b672-94e2f163958a req-1023dd55-9970-4666-9e44-2dc427120f6c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066361 Aug 18 21:56:38.157080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 122/242] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:56:38.192388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fff1d4ed-1627-42da-b9e2-9174e5f52c10 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:38.201034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fff1d4ed-1627-42da-b9e2-9174e5f52c10 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.505641 Aug 18 21:56:38.201852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 121/243] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:37 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:38.591796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c1de5483-89aa-4c88-86f6-f8db240fc198 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:38.592497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c1de5483-89aa-4c88-86f6-f8db240fc198 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:38.604507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1de5483-89aa-4c88-86f6-f8db240fc198 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:38.605074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1de5483-89aa-4c88-86f6-f8db240fc198 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:38.605572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1de5483-89aa-4c88-86f6-f8db240fc198 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:38.606365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1de5483-89aa-4c88-86f6-f8db240fc198 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:38.606889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1de5483-89aa-4c88-86f6-f8db240fc198 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:38.607389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1de5483-89aa-4c88-86f6-f8db240fc198 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:38.778748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c1de5483-89aa-4c88-86f6-f8db240fc198 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:38.788477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c1de5483-89aa-4c88-86f6-f8db240fc198 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.201201 Aug 18 21:56:38.789070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 123/244] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:38 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:38.933561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-93296e68-bd8c-4269-ad0a-b76ccf9b83ea tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:38.934876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-93296e68-bd8c-4269-ad0a-b76ccf9b83ea tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:38.947131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93296e68-bd8c-4269-ad0a-b76ccf9b83ea tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:38.948359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93296e68-bd8c-4269-ad0a-b76ccf9b83ea tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:38.949384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93296e68-bd8c-4269-ad0a-b76ccf9b83ea tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:38.950826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93296e68-bd8c-4269-ad0a-b76ccf9b83ea tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:38.951848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93296e68-bd8c-4269-ad0a-b76ccf9b83ea tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:38.952447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93296e68-bd8c-4269-ad0a-b76ccf9b83ea tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:39.102837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-93296e68-bd8c-4269-ad0a-b76ccf9b83ea tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:39.110908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-93296e68-bd8c-4269-ad0a-b76ccf9b83ea tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.185015 Aug 18 21:56:39.124481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 122/245] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:38 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:39.224704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e2401414-fe79-4ffd-9285-be2275351f32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:39.226190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e2401414-fe79-4ffd-9285-be2275351f32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:39.232652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2401414-fe79-4ffd-9285-be2275351f32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:39.233396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2401414-fe79-4ffd-9285-be2275351f32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:39.234057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2401414-fe79-4ffd-9285-be2275351f32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:39.234822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2401414-fe79-4ffd-9285-be2275351f32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:39.235563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2401414-fe79-4ffd-9285-be2275351f32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:39.236039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2401414-fe79-4ffd-9285-be2275351f32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:39.383714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e2401414-fe79-4ffd-9285-be2275351f32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:39.391786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e2401414-fe79-4ffd-9285-be2275351f32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.171645 Aug 18 21:56:39.393777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 124/246] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:39 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:39.812792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4fcae307-c20f-4dee-b412-e6b73a77bd6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:39.813588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4fcae307-c20f-4dee-b412-e6b73a77bd6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:39.820923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fcae307-c20f-4dee-b412-e6b73a77bd6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:39.821427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fcae307-c20f-4dee-b412-e6b73a77bd6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:39.821886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fcae307-c20f-4dee-b412-e6b73a77bd6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:39.822593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fcae307-c20f-4dee-b412-e6b73a77bd6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:39.823051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fcae307-c20f-4dee-b412-e6b73a77bd6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:39.823509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fcae307-c20f-4dee-b412-e6b73a77bd6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:39.992784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4fcae307-c20f-4dee-b412-e6b73a77bd6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:40.001237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4fcae307-c20f-4dee-b412-e6b73a77bd6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.194843 Aug 18 21:56:40.001742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 123/247] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:40.132718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f79ca6a6-b1c9-4d0e-a121-3ce624b449e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:40.133337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f79ca6a6-b1c9-4d0e-a121-3ce624b449e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:40.142169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f79ca6a6-b1c9-4d0e-a121-3ce624b449e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:40.142696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f79ca6a6-b1c9-4d0e-a121-3ce624b449e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:40.143136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f79ca6a6-b1c9-4d0e-a121-3ce624b449e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:40.143844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f79ca6a6-b1c9-4d0e-a121-3ce624b449e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:40.144297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f79ca6a6-b1c9-4d0e-a121-3ce624b449e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:40.144919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f79ca6a6-b1c9-4d0e-a121-3ce624b449e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:40.300427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f79ca6a6-b1c9-4d0e-a121-3ce624b449e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:40.310395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f79ca6a6-b1c9-4d0e-a121-3ce624b449e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.182371 Aug 18 21:56:40.310985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 125/248] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:40 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:40.413226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f5688795-6c57-4aae-adf3-e67243ce7520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:40.414386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f5688795-6c57-4aae-adf3-e67243ce7520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:40.421148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5688795-6c57-4aae-adf3-e67243ce7520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:40.421760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5688795-6c57-4aae-adf3-e67243ce7520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:40.422267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5688795-6c57-4aae-adf3-e67243ce7520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:40.423178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5688795-6c57-4aae-adf3-e67243ce7520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:40.423825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5688795-6c57-4aae-adf3-e67243ce7520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:40.424402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5688795-6c57-4aae-adf3-e67243ce7520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:40.563518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f5688795-6c57-4aae-adf3-e67243ce7520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:40.572334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f5688795-6c57-4aae-adf3-e67243ce7520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.163406 Aug 18 21:56:40.601895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 124/249] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:40 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:41.028712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-03fe0799-8ed2-4062-9897-5dc9bb5fb526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:41.029813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-03fe0799-8ed2-4062-9897-5dc9bb5fb526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:41.038313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03fe0799-8ed2-4062-9897-5dc9bb5fb526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:41.039111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03fe0799-8ed2-4062-9897-5dc9bb5fb526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:41.039883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03fe0799-8ed2-4062-9897-5dc9bb5fb526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:41.040776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03fe0799-8ed2-4062-9897-5dc9bb5fb526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:41.041234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03fe0799-8ed2-4062-9897-5dc9bb5fb526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:41.041682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03fe0799-8ed2-4062-9897-5dc9bb5fb526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:41.161115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=10 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:41.199839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-03fe0799-8ed2-4062-9897-5dc9bb5fb526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:41.210172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-03fe0799-8ed2-4062-9897-5dc9bb5fb526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.190152 Aug 18 21:56:41.211467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 126/250] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:41 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:41.334745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-832baa1a-3add-409e-b58b-33ef30c9b56b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:41.336107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-832baa1a-3add-409e-b58b-33ef30c9b56b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:41.343052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:41.344690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:41.350321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-832baa1a-3add-409e-b58b-33ef30c9b56b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:41.352845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-832baa1a-3add-409e-b58b-33ef30c9b56b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:41.353336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-832baa1a-3add-409e-b58b-33ef30c9b56b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:41.354137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-832baa1a-3add-409e-b58b-33ef30c9b56b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:41.354609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-832baa1a-3add-409e-b58b-33ef30c9b56b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:41.355271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-832baa1a-3add-409e-b58b-33ef30c9b56b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:41.559809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-832baa1a-3add-409e-b58b-33ef30c9b56b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:41.570729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-832baa1a-3add-409e-b58b-33ef30c9b56b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.240744 Aug 18 21:56:41.572007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 125/251] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:41 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:41.595467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-16964d0c-ed15-4fd7-b1eb-027b1b6abac6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:41.596093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-16964d0c-ed15-4fd7-b1eb-027b1b6abac6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:41.614180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16964d0c-ed15-4fd7-b1eb-027b1b6abac6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:41.614940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16964d0c-ed15-4fd7-b1eb-027b1b6abac6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:41.615410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16964d0c-ed15-4fd7-b1eb-027b1b6abac6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:41.616235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16964d0c-ed15-4fd7-b1eb-027b1b6abac6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:41.616695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16964d0c-ed15-4fd7-b1eb-027b1b6abac6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:41.617126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16964d0c-ed15-4fd7-b1eb-027b1b6abac6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:41.802662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-16964d0c-ed15-4fd7-b1eb-027b1b6abac6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:41.811171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-16964d0c-ed15-4fd7-b1eb-027b1b6abac6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.219646 Aug 18 21:56:41.829728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 127/252] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:41 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:42.234174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7caf6afd-7085-4c9e-bf45-99913bc932b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:42.234742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7caf6afd-7085-4c9e-bf45-99913bc932b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:42.242189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7caf6afd-7085-4c9e-bf45-99913bc932b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:42.242991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7caf6afd-7085-4c9e-bf45-99913bc932b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:42.243597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7caf6afd-7085-4c9e-bf45-99913bc932b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:42.244454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7caf6afd-7085-4c9e-bf45-99913bc932b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:42.245234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7caf6afd-7085-4c9e-bf45-99913bc932b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:42.246019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7caf6afd-7085-4c9e-bf45-99913bc932b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:42.383914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7caf6afd-7085-4c9e-bf45-99913bc932b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:42.393866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7caf6afd-7085-4c9e-bf45-99913bc932b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.164177 Aug 18 21:56:42.394603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 126/253] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:42.592686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6434dc5b-5717-4bc9-84a3-4f6344fd0620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:42.593773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6434dc5b-5717-4bc9-84a3-4f6344fd0620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:42.601501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6434dc5b-5717-4bc9-84a3-4f6344fd0620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:42.602148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6434dc5b-5717-4bc9-84a3-4f6344fd0620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:42.602568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6434dc5b-5717-4bc9-84a3-4f6344fd0620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:42.603383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6434dc5b-5717-4bc9-84a3-4f6344fd0620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:42.603917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6434dc5b-5717-4bc9-84a3-4f6344fd0620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:42.604418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6434dc5b-5717-4bc9-84a3-4f6344fd0620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:42.763961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6434dc5b-5717-4bc9-84a3-4f6344fd0620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:42.772792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6434dc5b-5717-4bc9-84a3-4f6344fd0620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.183812 Aug 18 21:56:42.773394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 128/254] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:42 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:42.836664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a10324c5-b392-4fef-82e2-94ca1879d636 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:42.837224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a10324c5-b392-4fef-82e2-94ca1879d636 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:42.843138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a10324c5-b392-4fef-82e2-94ca1879d636 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:42.843612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a10324c5-b392-4fef-82e2-94ca1879d636 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:42.844044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a10324c5-b392-4fef-82e2-94ca1879d636 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:42.844730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a10324c5-b392-4fef-82e2-94ca1879d636 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:42.845178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a10324c5-b392-4fef-82e2-94ca1879d636 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:42.845608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a10324c5-b392-4fef-82e2-94ca1879d636 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:43.031808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a10324c5-b392-4fef-82e2-94ca1879d636 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:43.042329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a10324c5-b392-4fef-82e2-94ca1879d636 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.209084 Aug 18 21:56:43.058058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 127/255] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:42 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:43.415865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-76fda055-0243-4085-8a63-ec5c4db7e58f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:43.416667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-76fda055-0243-4085-8a63-ec5c4db7e58f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:43.423390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76fda055-0243-4085-8a63-ec5c4db7e58f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:43.423953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76fda055-0243-4085-8a63-ec5c4db7e58f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:43.424536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76fda055-0243-4085-8a63-ec5c4db7e58f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:43.425372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76fda055-0243-4085-8a63-ec5c4db7e58f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:43.426638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76fda055-0243-4085-8a63-ec5c4db7e58f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:43.427127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76fda055-0243-4085-8a63-ec5c4db7e58f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:43.505939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-58b06ff8-4360-498a-bd84-ab0db23e67c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Action: 'create', calling method: .version_select at 0x7fd88a185d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2137782897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXtyLJrfQxA9vMUDbV5WkaJ5IwY9ls2tkWEGjuttHFYdARtQm56pYLA3b2Wbyrz5d+ra2Jdb09TPGE3H+gtCEe+duD3eFQqApaWfsbkq3rKMhnsI2w2rTGLL+hOl7AGMw=="}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:43.511345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:43.523781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-58b06ff8-4360-498a-bd84-ab0db23e67c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Getting quotas for project 740832491e454b40a6cd87be4ca40384. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:56:43.527910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-58b06ff8-4360-498a-bd84-ab0db23e67c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Getting quotas for user b51990c984e24a18a85534b121f3d9a0 and project 740832491e454b40a6cd87be4ca40384. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:56:43.552838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-58b06ff8-4360-498a-bd84-ab0db23e67c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051242 Aug 18 21:56:43.563965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 128/256] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 21:56:43 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:56:43.568511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-76fda055-0243-4085-8a63-ec5c4db7e58f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:43.570397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:43.576940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-76fda055-0243-4085-8a63-ec5c4db7e58f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1367 microversion: 2.1 time: 0.165601 Aug 18 21:56:43.577881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 129/257] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:43 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:43.614814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-23079883", "imageRef": "984858d1-200c-44ea-a16f-50f0a86eb7b9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2137782897", "networks": [{"uuid": "33420fca-1b5b-410d-953f-71e36c091f4a"}]}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:43.670510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] validate_networks() for [('33420fca-1b5b-410d-953f-71e36c091f4a', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:56:43.794051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1df91948-6ccf-475a-b845-883421a1f611 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:43.794673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1df91948-6ccf-475a-b845-883421a1f611 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:43.802536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1df91948-6ccf-475a-b845-883421a1f611 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:43.803023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1df91948-6ccf-475a-b845-883421a1f611 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:43.803454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1df91948-6ccf-475a-b845-883421a1f611 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:43.804154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1df91948-6ccf-475a-b845-883421a1f611 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:43.804610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1df91948-6ccf-475a-b845-883421a1f611 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:43.805035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1df91948-6ccf-475a-b845-883421a1f611 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:43.939047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1df91948-6ccf-475a-b845-883421a1f611 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:43.947298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1df91948-6ccf-475a-b845-883421a1f611 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.157394 Aug 18 21:56:43.947783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 130/258] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:43 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:44.066887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3b956a18-74b2-4ce5-8090-0b433f7f8cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:44.067515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3b956a18-74b2-4ce5-8090-0b433f7f8cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:44.074867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b956a18-74b2-4ce5-8090-0b433f7f8cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:44.075373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b956a18-74b2-4ce5-8090-0b433f7f8cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:44.075855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b956a18-74b2-4ce5-8090-0b433f7f8cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:44.076594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b956a18-74b2-4ce5-8090-0b433f7f8cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:44.077243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b956a18-74b2-4ce5-8090-0b433f7f8cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:44.077702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b956a18-74b2-4ce5-8090-0b433f7f8cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:44.245076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3b956a18-74b2-4ce5-8090-0b433f7f8cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:44.251001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:56:44.251433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:56:44.251916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:56:44.252330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:56:44.252746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:56:44.252886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3b956a18-74b2-4ce5-8090-0b433f7f8cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.190343 Aug 18 21:56:44.253494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 131/259] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:44 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:44.261734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:44.262396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:44.262829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:44.263564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:44.264043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:44.264465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:44.281266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Getting quotas for project 740832491e454b40a6cd87be4ca40384. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:56:44.285516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Getting quotas for user b51990c984e24a18a85534b121f3d9a0 and project 740832491e454b40a6cd87be4ca40384. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:56:44.296525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:56:44.298628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='984858d1-200c-44ea-a16f-50f0a86eb7b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:56:44.344186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-134b8898-7bc7-48e2-8a2a-aab3e0b1018e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733191 Aug 18 21:56:44.344860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 129/260] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 21:56:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:56:44.356142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dfd20563-f136-423c-a055-fb08c2c85ceb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:44.356882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dfd20563-f136-423c-a055-fb08c2c85ceb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:44.412491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dfd20563-f136-423c-a055-fb08c2c85ceb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:44.419609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dfd20563-f136-423c-a055-fb08c2c85ceb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1257 microversion: 2.1 time: 0.067466 Aug 18 21:56:44.420181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 132/261] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:44.598274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-deeb10e7-35f9-4e4f-90e6-2fbaaca8d66b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:44.598887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-deeb10e7-35f9-4e4f-90e6-2fbaaca8d66b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:44.604855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deeb10e7-35f9-4e4f-90e6-2fbaaca8d66b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:44.605333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deeb10e7-35f9-4e4f-90e6-2fbaaca8d66b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:44.605796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deeb10e7-35f9-4e4f-90e6-2fbaaca8d66b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:44.606484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deeb10e7-35f9-4e4f-90e6-2fbaaca8d66b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:44.606931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deeb10e7-35f9-4e4f-90e6-2fbaaca8d66b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:44.607351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deeb10e7-35f9-4e4f-90e6-2fbaaca8d66b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:44.739672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-deeb10e7-35f9-4e4f-90e6-2fbaaca8d66b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:44.748168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-deeb10e7-35f9-4e4f-90e6-2fbaaca8d66b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1557 microversion: 2.1 time: 0.153686 Aug 18 21:56:44.749044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 130/262] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:44 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:44.768962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ac7e9520-ad81-49e2-8101-bf86d0be0bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:44.769487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ac7e9520-ad81-49e2-8101-bf86d0be0bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:44.775667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac7e9520-ad81-49e2-8101-bf86d0be0bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:44.776150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac7e9520-ad81-49e2-8101-bf86d0be0bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:44.776586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac7e9520-ad81-49e2-8101-bf86d0be0bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:44.777272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac7e9520-ad81-49e2-8101-bf86d0be0bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:44.777762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac7e9520-ad81-49e2-8101-bf86d0be0bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:44.778177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac7e9520-ad81-49e2-8101-bf86d0be0bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:44.968818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-95d627b9-0c61-4bd7-ac26-6ac67a2e79a5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:44.969655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-95d627b9-0c61-4bd7-ac26-6ac67a2e79a5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:44.977069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95d627b9-0c61-4bd7-ac26-6ac67a2e79a5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:44.977707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95d627b9-0c61-4bd7-ac26-6ac67a2e79a5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:44.978271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95d627b9-0c61-4bd7-ac26-6ac67a2e79a5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:44.980207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95d627b9-0c61-4bd7-ac26-6ac67a2e79a5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:44.980757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95d627b9-0c61-4bd7-ac26-6ac67a2e79a5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:44.981248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95d627b9-0c61-4bd7-ac26-6ac67a2e79a5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:45.078776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ac7e9520-ad81-49e2-8101-bf86d0be0bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.313528 Aug 18 21:56:45.079428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 133/263] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 21:56:44 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-interface => generated 284 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:56:45.116866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-95d627b9-0c61-4bd7-ac26-6ac67a2e79a5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:45.124679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-95d627b9-0c61-4bd7-ac26-6ac67a2e79a5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.160065 Aug 18 21:56:45.125259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 131/264] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:44 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:45.273556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5d5ffe6a-26d7-4b14-999f-3d659d70e7d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:45.274454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5d5ffe6a-26d7-4b14-999f-3d659d70e7d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:45.280563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d5ffe6a-26d7-4b14-999f-3d659d70e7d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:45.281256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d5ffe6a-26d7-4b14-999f-3d659d70e7d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:45.282160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d5ffe6a-26d7-4b14-999f-3d659d70e7d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:45.283102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d5ffe6a-26d7-4b14-999f-3d659d70e7d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:45.283872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d5ffe6a-26d7-4b14-999f-3d659d70e7d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:45.284437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d5ffe6a-26d7-4b14-999f-3d659d70e7d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:45.440427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7bfaa79-04f8-4106-8089-4f37450c49da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:45.441918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f7bfaa79-04f8-4106-8089-4f37450c49da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:45.448297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bfaa79-04f8-4106-8089-4f37450c49da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:45.448927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bfaa79-04f8-4106-8089-4f37450c49da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:45.449376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bfaa79-04f8-4106-8089-4f37450c49da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:45.450164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bfaa79-04f8-4106-8089-4f37450c49da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:45.450757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bfaa79-04f8-4106-8089-4f37450c49da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:45.451252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bfaa79-04f8-4106-8089-4f37450c49da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:45.564545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f7bfaa79-04f8-4106-8089-4f37450c49da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:45.576489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f7bfaa79-04f8-4106-8089-4f37450c49da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1327 microversion: 2.1 time: 0.140048 Aug 18 21:56:45.579091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 132/265] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:45 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1327 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:45.606119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5d5ffe6a-26d7-4b14-999f-3d659d70e7d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:45.615012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5d5ffe6a-26d7-4b14-999f-3d659d70e7d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.345217 Aug 18 21:56:45.615785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 134/266] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:45 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:46.147036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-222fef3a-60a1-4984-b3ac-761492282fd6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:46.149089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-222fef3a-60a1-4984-b3ac-761492282fd6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:46.155628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-222fef3a-60a1-4984-b3ac-761492282fd6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:46.156121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-222fef3a-60a1-4984-b3ac-761492282fd6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:46.156560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-222fef3a-60a1-4984-b3ac-761492282fd6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:46.157269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-222fef3a-60a1-4984-b3ac-761492282fd6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:46.157758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-222fef3a-60a1-4984-b3ac-761492282fd6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:46.158185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-222fef3a-60a1-4984-b3ac-761492282fd6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:46.290558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-d9544a79-fd52-41df-b0ee-1f86196eba8e req-365ba260-0e86-4ef2-906e-33112494cf46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6f2dae-a492-46e5-ab40-5884ff13d01e", "tag": "4a3c71ba-f9de-4571-b035-a9ed943dcc83"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:46.305303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d9544a79-fd52-41df-b0ee-1f86196eba8e req-365ba260-0e86-4ef2-906e-33112494cf46 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:46.306022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d9544a79-fd52-41df-b0ee-1f86196eba8e req-365ba260-0e86-4ef2-906e-33112494cf46 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:46.306935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d9544a79-fd52-41df-b0ee-1f86196eba8e req-365ba260-0e86-4ef2-906e-33112494cf46 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:46.320924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-d9544a79-fd52-41df-b0ee-1f86196eba8e req-365ba260-0e86-4ef2-906e-33112494cf46 service nova] Creating event network-changed:4a3c71ba-f9de-4571-b035-a9ed943dcc83 for instance ca6f2dae-a492-46e5-ab40-5884ff13d01e on hv-cinder-85367 Aug 18 21:56:46.328250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-d9544a79-fd52-41df-b0ee-1f86196eba8e req-365ba260-0e86-4ef2-906e-33112494cf46 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041425 Aug 18 21:56:46.331974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 135/267] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:56:46.346206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-222fef3a-60a1-4984-b3ac-761492282fd6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:46.354880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-222fef3a-60a1-4984-b3ac-761492282fd6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.212729 Aug 18 21:56:46.355466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 133/268] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:46 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:46.601444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4e10fc48-eaec-49dd-bb91-4cac826a7e92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:46.602325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4e10fc48-eaec-49dd-bb91-4cac826a7e92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:46.610246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e10fc48-eaec-49dd-bb91-4cac826a7e92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:46.610737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e10fc48-eaec-49dd-bb91-4cac826a7e92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:46.611180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e10fc48-eaec-49dd-bb91-4cac826a7e92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:46.612039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e10fc48-eaec-49dd-bb91-4cac826a7e92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:46.612512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e10fc48-eaec-49dd-bb91-4cac826a7e92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:46.613462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e10fc48-eaec-49dd-bb91-4cac826a7e92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:46.636776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e59a2164-3d7b-47a5-bb1c-eba818938d48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:46.637465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e59a2164-3d7b-47a5-bb1c-eba818938d48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:46.644887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e59a2164-3d7b-47a5-bb1c-eba818938d48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:46.647423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e59a2164-3d7b-47a5-bb1c-eba818938d48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:46.648094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e59a2164-3d7b-47a5-bb1c-eba818938d48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:46.652823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e59a2164-3d7b-47a5-bb1c-eba818938d48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:46.653522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e59a2164-3d7b-47a5-bb1c-eba818938d48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:46.654291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e59a2164-3d7b-47a5-bb1c-eba818938d48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:46.866924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4e10fc48-eaec-49dd-bb91-4cac826a7e92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:46.877236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4e10fc48-eaec-49dd-bb91-4cac826a7e92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.280527 Aug 18 21:56:46.895495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 136/269] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:46 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:46.912632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e59a2164-3d7b-47a5-bb1c-eba818938d48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:46.931512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e59a2164-3d7b-47a5-bb1c-eba818938d48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.298546 Aug 18 21:56:46.932130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 134/270] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:46 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:47.382596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9c6b17ca-5d02-4b87-9a36-2f991376b09d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:47.383241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9c6b17ca-5d02-4b87-9a36-2f991376b09d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:47.394048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c6b17ca-5d02-4b87-9a36-2f991376b09d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:47.394995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c6b17ca-5d02-4b87-9a36-2f991376b09d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:47.395799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c6b17ca-5d02-4b87-9a36-2f991376b09d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:47.396909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c6b17ca-5d02-4b87-9a36-2f991376b09d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:47.397925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c6b17ca-5d02-4b87-9a36-2f991376b09d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:47.398678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c6b17ca-5d02-4b87-9a36-2f991376b09d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:47.730122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9c6b17ca-5d02-4b87-9a36-2f991376b09d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:47.741953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9c6b17ca-5d02-4b87-9a36-2f991376b09d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.370632 Aug 18 21:56:47.749641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 137/271] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:47 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:47.766498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f9a678e1-9cd9-435c-881a-d7c408918ade tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:47.767851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f9a678e1-9cd9-435c-881a-d7c408918ade tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:47.779540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9a678e1-9cd9-435c-881a-d7c408918ade tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:47.780355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9a678e1-9cd9-435c-881a-d7c408918ade tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:47.781758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9a678e1-9cd9-435c-881a-d7c408918ade tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:47.785346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9a678e1-9cd9-435c-881a-d7c408918ade tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:47.788112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9a678e1-9cd9-435c-881a-d7c408918ade tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:47.788914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9a678e1-9cd9-435c-881a-d7c408918ade tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:47.841703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f9a678e1-9cd9-435c-881a-d7c408918ade tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/ips" status: 200 len: 151 microversion: 2.20 time: 0.080816 Aug 18 21:56:47.846366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 135/272] 10.222.0.82 () {60 vars in 1289 bytes} [Thu Aug 18 21:56:47 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/ips => generated 151 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:56:47.901956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c74692e2-8a19-4eac-a1ad-fb045662c6f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:47.902581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c74692e2-8a19-4eac-a1ad-fb045662c6f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:47.917262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c74692e2-8a19-4eac-a1ad-fb045662c6f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:47.919648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c74692e2-8a19-4eac-a1ad-fb045662c6f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:47.920288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c74692e2-8a19-4eac-a1ad-fb045662c6f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:47.924340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c74692e2-8a19-4eac-a1ad-fb045662c6f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:47.925346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c74692e2-8a19-4eac-a1ad-fb045662c6f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:47.926076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c74692e2-8a19-4eac-a1ad-fb045662c6f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:47.960065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-28087135-1051-4536-aa2c-bc47c5c330a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:47.962278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-28087135-1051-4536-aa2c-bc47c5c330a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:47.983027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28087135-1051-4536-aa2c-bc47c5c330a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:47.983536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28087135-1051-4536-aa2c-bc47c5c330a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:47.983980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28087135-1051-4536-aa2c-bc47c5c330a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:47.984701 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28087135-1051-4536-aa2c-bc47c5c330a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:47.985156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28087135-1051-4536-aa2c-bc47c5c330a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:47.989541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28087135-1051-4536-aa2c-bc47c5c330a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:48.217237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c74692e2-8a19-4eac-a1ad-fb045662c6f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:48.233577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-28087135-1051-4536-aa2c-bc47c5c330a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:48.241074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c74692e2-8a19-4eac-a1ad-fb045662c6f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.343420 Aug 18 21:56:48.243785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-28087135-1051-4536-aa2c-bc47c5c330a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.291370 Aug 18 21:56:48.244888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 136/273] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:47 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:48.248726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 138/274] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:47 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:48.763444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8b012c89-bad9-4ca1-be60-93cd086a6a43 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:48.764116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8b012c89-bad9-4ca1-be60-93cd086a6a43 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:48.775417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b012c89-bad9-4ca1-be60-93cd086a6a43 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:48.776009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b012c89-bad9-4ca1-be60-93cd086a6a43 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:48.776363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b012c89-bad9-4ca1-be60-93cd086a6a43 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:48.777088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b012c89-bad9-4ca1-be60-93cd086a6a43 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:48.777553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b012c89-bad9-4ca1-be60-93cd086a6a43 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:48.778013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b012c89-bad9-4ca1-be60-93cd086a6a43 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:48.962047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-2ee4ef57-8b81-46e1-b562-d39f68230211 req-d1b96629-6d9d-4de4-83e4-55f54695aee2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa5355b-48a3-4342-998a-e31be1538357", "name": "network-vif-plugged", "status": "completed", "tag": "742008d4-bf3b-476e-8e19-c9e9c780f008"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:48.973211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-2ee4ef57-8b81-46e1-b562-d39f68230211 req-d1b96629-6d9d-4de4-83e4-55f54695aee2 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:48.979274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-2ee4ef57-8b81-46e1-b562-d39f68230211 req-d1b96629-6d9d-4de4-83e4-55f54695aee2 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:48.979961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-2ee4ef57-8b81-46e1-b562-d39f68230211 req-d1b96629-6d9d-4de4-83e4-55f54695aee2 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:49.008140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-2ee4ef57-8b81-46e1-b562-d39f68230211 req-d1b96629-6d9d-4de4-83e4-55f54695aee2 service nova] Creating event network-vif-plugged:742008d4-bf3b-476e-8e19-c9e9c780f008 for instance 0aa5355b-48a3-4342-998a-e31be1538357 on hv-cinder-85367 Aug 18 21:56:49.014247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-2ee4ef57-8b81-46e1-b562-d39f68230211 req-d1b96629-6d9d-4de4-83e4-55f54695aee2 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059404 Aug 18 21:56:49.015670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 139/275] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:56:49.076589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8b012c89-bad9-4ca1-be60-93cd086a6a43 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:49.109728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8b012c89-bad9-4ca1-be60-93cd086a6a43 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.329572 Aug 18 21:56:49.109728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 137/276] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:48 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:49.274150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a3970665-e717-445a-8d4c-af775c512cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:49.275010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a3970665-e717-445a-8d4c-af775c512cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:49.279079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5980b0c9-79a6-4503-9559-aad4c64e6b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:49.279857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5980b0c9-79a6-4503-9559-aad4c64e6b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:49.283260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:49.285021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3970665-e717-445a-8d4c-af775c512cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:49.286216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3970665-e717-445a-8d4c-af775c512cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:49.287222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3970665-e717-445a-8d4c-af775c512cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:49.288065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3970665-e717-445a-8d4c-af775c512cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:49.288196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5980b0c9-79a6-4503-9559-aad4c64e6b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:49.288723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3970665-e717-445a-8d4c-af775c512cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:49.289244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3970665-e717-445a-8d4c-af775c512cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:49.289365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5980b0c9-79a6-4503-9559-aad4c64e6b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:49.289949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5980b0c9-79a6-4503-9559-aad4c64e6b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:49.290658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5980b0c9-79a6-4503-9559-aad4c64e6b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:49.291115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5980b0c9-79a6-4503-9559-aad4c64e6b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:49.291778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5980b0c9-79a6-4503-9559-aad4c64e6b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:49.334232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:49.503133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5980b0c9-79a6-4503-9559-aad4c64e6b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:49.522273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5980b0c9-79a6-4503-9559-aad4c64e6b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.246881 Aug 18 21:56:49.536954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 138/277] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:49 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:49.552900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a3970665-e717-445a-8d4c-af775c512cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:49.578361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a3970665-e717-445a-8d4c-af775c512cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.309260 Aug 18 21:56:49.581557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 140/278] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:49 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:50.116880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d3c54f27-2ba8-43c5-b344-0a19a43d9275 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:50.117498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d3c54f27-2ba8-43c5-b344-0a19a43d9275 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:50.123942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c54f27-2ba8-43c5-b344-0a19a43d9275 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:50.124459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c54f27-2ba8-43c5-b344-0a19a43d9275 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:50.125019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c54f27-2ba8-43c5-b344-0a19a43d9275 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:50.126113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c54f27-2ba8-43c5-b344-0a19a43d9275 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:50.126787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c54f27-2ba8-43c5-b344-0a19a43d9275 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:50.127438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c54f27-2ba8-43c5-b344-0a19a43d9275 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:50.226883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8e82f80d-e227-466f-808f-91341efb2ac6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:50.227528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8e82f80d-e227-466f-808f-91341efb2ac6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:50.234668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e82f80d-e227-466f-808f-91341efb2ac6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:50.235386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e82f80d-e227-466f-808f-91341efb2ac6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:50.236017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e82f80d-e227-466f-808f-91341efb2ac6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:50.236896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e82f80d-e227-466f-808f-91341efb2ac6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:50.237515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e82f80d-e227-466f-808f-91341efb2ac6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:50.239336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e82f80d-e227-466f-808f-91341efb2ac6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:50.270593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-8e82f80d-e227-466f-808f-91341efb2ac6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lazy-loading 'flavor' on Instance uuid 0426bb7b-e862-4873-9c1e-7878b89cde47 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:56:50.288349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d3c54f27-2ba8-43c5-b344-0a19a43d9275 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:50.299251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d3c54f27-2ba8-43c5-b344-0a19a43d9275 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.187283 Aug 18 21:56:50.299836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 139/279] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:50 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:50.502093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8e82f80d-e227-466f-808f-91341efb2ac6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "POST /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/action" status: 202 len: 0 microversion: 2.20 time: 0.281369 Aug 18 21:56:50.506993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 141/280] 10.222.0.82 () {62 vars in 1319 bytes} [Thu Aug 18 21:56:50 2022] POST /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:56:50.511904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9ae97520-e580-47bf-9333-fbdf2a59719f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:50.512720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9ae97520-e580-47bf-9333-fbdf2a59719f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:50.520867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ae97520-e580-47bf-9333-fbdf2a59719f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:50.521389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ae97520-e580-47bf-9333-fbdf2a59719f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:50.521902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ae97520-e580-47bf-9333-fbdf2a59719f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:50.522653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ae97520-e580-47bf-9333-fbdf2a59719f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:50.523114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ae97520-e580-47bf-9333-fbdf2a59719f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:50.523582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ae97520-e580-47bf-9333-fbdf2a59719f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:50.544262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-008dbb39-dd1b-419e-96d8-3de84ebf6ab1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:50.545225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-008dbb39-dd1b-419e-96d8-3de84ebf6ab1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:50.552481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-008dbb39-dd1b-419e-96d8-3de84ebf6ab1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:50.552974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-008dbb39-dd1b-419e-96d8-3de84ebf6ab1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:50.553415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-008dbb39-dd1b-419e-96d8-3de84ebf6ab1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:50.554149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-008dbb39-dd1b-419e-96d8-3de84ebf6ab1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:50.554609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-008dbb39-dd1b-419e-96d8-3de84ebf6ab1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:50.555040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-008dbb39-dd1b-419e-96d8-3de84ebf6ab1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:50.704868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-008dbb39-dd1b-419e-96d8-3de84ebf6ab1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:50.732948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-008dbb39-dd1b-419e-96d8-3de84ebf6ab1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.193001 Aug 18 21:56:50.734888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 142/281] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:50.742470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f150419f-d0fd-44f6-b182-0c1c8d2b5542 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:50.743260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f150419f-d0fd-44f6-b182-0c1c8d2b5542 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:50.752295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f150419f-d0fd-44f6-b182-0c1c8d2b5542 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:50.752991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f150419f-d0fd-44f6-b182-0c1c8d2b5542 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:50.753627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f150419f-d0fd-44f6-b182-0c1c8d2b5542 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:50.754387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f150419f-d0fd-44f6-b182-0c1c8d2b5542 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:50.754854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f150419f-d0fd-44f6-b182-0c1c8d2b5542 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:50.755317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f150419f-d0fd-44f6-b182-0c1c8d2b5542 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:50.757843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9ae97520-e580-47bf-9333-fbdf2a59719f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:50.767422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9ae97520-e580-47bf-9333-fbdf2a59719f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:50.769070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9ae97520-e580-47bf-9333-fbdf2a59719f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:50.770495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9ae97520-e580-47bf-9333-fbdf2a59719f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.262624 Aug 18 21:56:50.782887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 140/282] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:56:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:56:50.946916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f150419f-d0fd-44f6-b182-0c1c8d2b5542 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:50.957653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f150419f-d0fd-44f6-b182-0c1c8d2b5542 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.221146 Aug 18 21:56:50.958241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 143/283] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:50 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:51.320565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0ea949c6-ef14-4792-a113-6d16be7c418a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:51.321245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0ea949c6-ef14-4792-a113-6d16be7c418a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:51.329960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ea949c6-ef14-4792-a113-6d16be7c418a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:51.330553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ea949c6-ef14-4792-a113-6d16be7c418a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:51.331050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ea949c6-ef14-4792-a113-6d16be7c418a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:51.332447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ea949c6-ef14-4792-a113-6d16be7c418a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:51.333018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ea949c6-ef14-4792-a113-6d16be7c418a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:51.333511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ea949c6-ef14-4792-a113-6d16be7c418a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:51.492850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0ea949c6-ef14-4792-a113-6d16be7c418a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:51.501442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0ea949c6-ef14-4792-a113-6d16be7c418a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.184812 Aug 18 21:56:51.502577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 141/284] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:51 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:51.756126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-572a2252-af2e-46f4-9a87-648abb6781d7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:51.756772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-572a2252-af2e-46f4-9a87-648abb6781d7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:51.764611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-572a2252-af2e-46f4-9a87-648abb6781d7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:51.765215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-572a2252-af2e-46f4-9a87-648abb6781d7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:51.765679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-572a2252-af2e-46f4-9a87-648abb6781d7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:51.766393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-572a2252-af2e-46f4-9a87-648abb6781d7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:51.766844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-572a2252-af2e-46f4-9a87-648abb6781d7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:51.767482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-572a2252-af2e-46f4-9a87-648abb6781d7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:51.798543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0550629c-f8ee-4737-9860-2d92116f1b65 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:51.799166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0550629c-f8ee-4737-9860-2d92116f1b65 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:51.821226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0550629c-f8ee-4737-9860-2d92116f1b65 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:51.821762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0550629c-f8ee-4737-9860-2d92116f1b65 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:51.822203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0550629c-f8ee-4737-9860-2d92116f1b65 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:51.822922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0550629c-f8ee-4737-9860-2d92116f1b65 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:51.823379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0550629c-f8ee-4737-9860-2d92116f1b65 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:51.823810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0550629c-f8ee-4737-9860-2d92116f1b65 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:51.970090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-572a2252-af2e-46f4-9a87-648abb6781d7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:51.978920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-572a2252-af2e-46f4-9a87-648abb6781d7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.227868 Aug 18 21:56:51.979548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 144/285] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:51.984032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7ea4c9e5-10b1-4f50-94b1-c58f295e8913 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:51.984651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7ea4c9e5-10b1-4f50-94b1-c58f295e8913 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:51.990821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ea4c9e5-10b1-4f50-94b1-c58f295e8913 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:51.991316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ea4c9e5-10b1-4f50-94b1-c58f295e8913 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:51.991772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ea4c9e5-10b1-4f50-94b1-c58f295e8913 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:51.992473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ea4c9e5-10b1-4f50-94b1-c58f295e8913 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:51.992935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ea4c9e5-10b1-4f50-94b1-c58f295e8913 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:51.993376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ea4c9e5-10b1-4f50-94b1-c58f295e8913 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:52.039167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0550629c-f8ee-4737-9860-2d92116f1b65 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:52.048478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0550629c-f8ee-4737-9860-2d92116f1b65 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:52.050021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0550629c-f8ee-4737-9860-2d92116f1b65 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:52.051281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0550629c-f8ee-4737-9860-2d92116f1b65 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.257000 Aug 18 21:56:52.051855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 142/286] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:56:51 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:56:52.151513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7ea4c9e5-10b1-4f50-94b1-c58f295e8913 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:52.160445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7ea4c9e5-10b1-4f50-94b1-c58f295e8913 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.179298 Aug 18 21:56:52.163879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 145/287] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:51 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:52.523012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-208b5be4-980a-4d7d-8e1b-11f360080d56 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:52.523635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-208b5be4-980a-4d7d-8e1b-11f360080d56 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:52.530484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-208b5be4-980a-4d7d-8e1b-11f360080d56 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:52.531229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-208b5be4-980a-4d7d-8e1b-11f360080d56 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:52.532117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-208b5be4-980a-4d7d-8e1b-11f360080d56 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:52.533062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-208b5be4-980a-4d7d-8e1b-11f360080d56 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:52.533748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-208b5be4-980a-4d7d-8e1b-11f360080d56 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:52.534431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-208b5be4-980a-4d7d-8e1b-11f360080d56 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:52.756924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-208b5be4-980a-4d7d-8e1b-11f360080d56 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:52.765410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-208b5be4-980a-4d7d-8e1b-11f360080d56 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.247030 Aug 18 21:56:52.766224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 143/288] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:52 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:52.999733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f941ce45-881d-41bf-a74e-be32c4d4e2ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:53.000383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f941ce45-881d-41bf-a74e-be32c4d4e2ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:53.007046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f941ce45-881d-41bf-a74e-be32c4d4e2ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:53.007543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f941ce45-881d-41bf-a74e-be32c4d4e2ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:53.007982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f941ce45-881d-41bf-a74e-be32c4d4e2ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:53.008774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f941ce45-881d-41bf-a74e-be32c4d4e2ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:53.009234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f941ce45-881d-41bf-a74e-be32c4d4e2ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:53.009702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f941ce45-881d-41bf-a74e-be32c4d4e2ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:53.076766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1cd241ef-cb81-4e9b-affa-9f8c78989f07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:53.078055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1cd241ef-cb81-4e9b-affa-9f8c78989f07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:53.085541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1cd241ef-cb81-4e9b-affa-9f8c78989f07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:53.086506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1cd241ef-cb81-4e9b-affa-9f8c78989f07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:53.087074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1cd241ef-cb81-4e9b-affa-9f8c78989f07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:53.087874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1cd241ef-cb81-4e9b-affa-9f8c78989f07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:53.088408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1cd241ef-cb81-4e9b-affa-9f8c78989f07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:53.088915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1cd241ef-cb81-4e9b-affa-9f8c78989f07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:53.156249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f941ce45-881d-41bf-a74e-be32c4d4e2ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:53.168626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f941ce45-881d-41bf-a74e-be32c4d4e2ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.172006 Aug 18 21:56:53.169556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 146/289] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:53.183263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f19a15d8-73a7-4318-ac63-af26e97e5468 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:53.183974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f19a15d8-73a7-4318-ac63-af26e97e5468 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:53.192245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f19a15d8-73a7-4318-ac63-af26e97e5468 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:53.192803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f19a15d8-73a7-4318-ac63-af26e97e5468 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:53.193310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f19a15d8-73a7-4318-ac63-af26e97e5468 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:53.208077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f19a15d8-73a7-4318-ac63-af26e97e5468 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:53.208900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f19a15d8-73a7-4318-ac63-af26e97e5468 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:53.210506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f19a15d8-73a7-4318-ac63-af26e97e5468 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:53.216703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:53.247992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1cd241ef-cb81-4e9b-affa-9f8c78989f07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:53.257868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1cd241ef-cb81-4e9b-affa-9f8c78989f07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:53.259333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1cd241ef-cb81-4e9b-affa-9f8c78989f07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:53.260513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1cd241ef-cb81-4e9b-affa-9f8c78989f07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.189486 Aug 18 21:56:53.261078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 144/290] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:56:53 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:56:53.365085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f19a15d8-73a7-4318-ac63-af26e97e5468 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:53.372981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f19a15d8-73a7-4318-ac63-af26e97e5468 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.193691 Aug 18 21:56:53.373572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 147/291] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:53 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:53.789920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ab558446-a0fb-46e3-8b08-4af79133eda3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:53.791280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ab558446-a0fb-46e3-8b08-4af79133eda3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:53.824246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab558446-a0fb-46e3-8b08-4af79133eda3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:53.824920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab558446-a0fb-46e3-8b08-4af79133eda3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:53.825368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab558446-a0fb-46e3-8b08-4af79133eda3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:53.826118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab558446-a0fb-46e3-8b08-4af79133eda3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:53.826577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab558446-a0fb-46e3-8b08-4af79133eda3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:53.827010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab558446-a0fb-46e3-8b08-4af79133eda3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:54.013067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ab558446-a0fb-46e3-8b08-4af79133eda3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:54.021372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ab558446-a0fb-46e3-8b08-4af79133eda3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.237973 Aug 18 21:56:54.022513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 145/292] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:53 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:54.195569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0449571-2b1b-47df-9cd6-72eb2a27f847 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:54.196927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d0449571-2b1b-47df-9cd6-72eb2a27f847 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:54.203681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0449571-2b1b-47df-9cd6-72eb2a27f847 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:54.204287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0449571-2b1b-47df-9cd6-72eb2a27f847 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:54.204652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0449571-2b1b-47df-9cd6-72eb2a27f847 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:54.205521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0449571-2b1b-47df-9cd6-72eb2a27f847 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:54.206007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0449571-2b1b-47df-9cd6-72eb2a27f847 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:54.206470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0449571-2b1b-47df-9cd6-72eb2a27f847 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:54.285411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a6cd5d30-a188-4150-9e3d-eb3d58950265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:54.286072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a6cd5d30-a188-4150-9e3d-eb3d58950265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:54.288282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:54.305885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=10 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:54.320735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6cd5d30-a188-4150-9e3d-eb3d58950265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:54.321343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6cd5d30-a188-4150-9e3d-eb3d58950265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:54.321842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6cd5d30-a188-4150-9e3d-eb3d58950265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:54.322567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6cd5d30-a188-4150-9e3d-eb3d58950265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:54.323025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6cd5d30-a188-4150-9e3d-eb3d58950265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:54.323450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6cd5d30-a188-4150-9e3d-eb3d58950265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:54.416906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d0449571-2b1b-47df-9cd6-72eb2a27f847 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:54.419602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:54.439121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d0449571-2b1b-47df-9cd6-72eb2a27f847 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.247141 Aug 18 21:56:54.440251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 148/293] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:54 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:54.456211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-63a021f1-3eda-4c95-bf51-788483b773d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:54.458232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-63a021f1-3eda-4c95-bf51-788483b773d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:54.474806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63a021f1-3eda-4c95-bf51-788483b773d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:54.475567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63a021f1-3eda-4c95-bf51-788483b773d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:54.478560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63a021f1-3eda-4c95-bf51-788483b773d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:54.479642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63a021f1-3eda-4c95-bf51-788483b773d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:54.480440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63a021f1-3eda-4c95-bf51-788483b773d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:54.481059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63a021f1-3eda-4c95-bf51-788483b773d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:54.556206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a6cd5d30-a188-4150-9e3d-eb3d58950265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:54.575792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a6cd5d30-a188-4150-9e3d-eb3d58950265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:54.584430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a6cd5d30-a188-4150-9e3d-eb3d58950265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:54.586001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a6cd5d30-a188-4150-9e3d-eb3d58950265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.305198 Aug 18 21:56:54.595258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 146/294] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:56:54 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:56:54.652407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-63a021f1-3eda-4c95-bf51-788483b773d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:54.668362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-63a021f1-3eda-4c95-bf51-788483b773d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.225876 Aug 18 21:56:54.669190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 149/295] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:54 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:55.045032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1315198d-364f-4158-b598-85c9cc32e78d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:55.045552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1315198d-364f-4158-b598-85c9cc32e78d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:55.051756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1315198d-364f-4158-b598-85c9cc32e78d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:55.052312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1315198d-364f-4158-b598-85c9cc32e78d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:55.052811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1315198d-364f-4158-b598-85c9cc32e78d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:55.053508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1315198d-364f-4158-b598-85c9cc32e78d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:55.053999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1315198d-364f-4158-b598-85c9cc32e78d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:55.054421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1315198d-364f-4158-b598-85c9cc32e78d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:55.229864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1315198d-364f-4158-b598-85c9cc32e78d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:55.243140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1315198d-364f-4158-b598-85c9cc32e78d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.201769 Aug 18 21:56:55.244246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 147/296] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:55 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:55.461427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-95503ad2-df0e-4818-a670-9a19b2702e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:55.462242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-95503ad2-df0e-4818-a670-9a19b2702e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:55.468776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95503ad2-df0e-4818-a670-9a19b2702e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:55.469366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95503ad2-df0e-4818-a670-9a19b2702e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:55.470071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95503ad2-df0e-4818-a670-9a19b2702e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:55.470980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95503ad2-df0e-4818-a670-9a19b2702e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:55.471512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95503ad2-df0e-4818-a670-9a19b2702e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:55.472008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95503ad2-df0e-4818-a670-9a19b2702e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:55.616401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-86357cf7-e734-4345-9f04-b1214d3e0d99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:55.617548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-86357cf7-e734-4345-9f04-b1214d3e0d99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:55.630879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86357cf7-e734-4345-9f04-b1214d3e0d99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:55.632800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86357cf7-e734-4345-9f04-b1214d3e0d99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:55.635017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86357cf7-e734-4345-9f04-b1214d3e0d99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:55.636245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86357cf7-e734-4345-9f04-b1214d3e0d99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:55.638258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86357cf7-e734-4345-9f04-b1214d3e0d99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:55.638982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86357cf7-e734-4345-9f04-b1214d3e0d99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:55.693283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-95503ad2-df0e-4818-a670-9a19b2702e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:55.703327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-95503ad2-df0e-4818-a670-9a19b2702e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.246868 Aug 18 21:56:55.719114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 150/297] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:55 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:55.731398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b7bfbfb-60e2-4b77-bc27-525acc61ffe7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:55.732554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5b7bfbfb-60e2-4b77-bc27-525acc61ffe7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:55.755838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b7bfbfb-60e2-4b77-bc27-525acc61ffe7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:55.756467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b7bfbfb-60e2-4b77-bc27-525acc61ffe7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:55.756988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b7bfbfb-60e2-4b77-bc27-525acc61ffe7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:55.757835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b7bfbfb-60e2-4b77-bc27-525acc61ffe7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:55.758383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b7bfbfb-60e2-4b77-bc27-525acc61ffe7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:55.758818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b7bfbfb-60e2-4b77-bc27-525acc61ffe7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:56.005076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5b7bfbfb-60e2-4b77-bc27-525acc61ffe7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:56.013471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-86357cf7-e734-4345-9f04-b1214d3e0d99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:56.024762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-86357cf7-e734-4345-9f04-b1214d3e0d99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:56.026301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-86357cf7-e734-4345-9f04-b1214d3e0d99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:56.028136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5b7bfbfb-60e2-4b77-bc27-525acc61ffe7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.311556 Aug 18 21:56:56.037632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 151/298] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:55 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:56.037805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-86357cf7-e734-4345-9f04-b1214d3e0d99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.419351 Aug 18 21:56:56.037805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 148/299] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:56:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:56:56.266804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f157b8d7-d45c-455b-acb3-b75a69e3da20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:56.267436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f157b8d7-d45c-455b-acb3-b75a69e3da20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:56.282084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f157b8d7-d45c-455b-acb3-b75a69e3da20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:56.282519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f157b8d7-d45c-455b-acb3-b75a69e3da20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:56.282958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f157b8d7-d45c-455b-acb3-b75a69e3da20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:56.290790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-eddff935-ec1d-4106-8653-20bb42a205fc req-f3913aab-45d8-49b4-b917-a63aa1193200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b11b63-0232-4f27-bacb-2e3872f6ae18", "tag": "98ccabc6-a7d1-4192-af56-2e746060a479"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:56.291398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f157b8d7-d45c-455b-acb3-b75a69e3da20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:56.293022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f157b8d7-d45c-455b-acb3-b75a69e3da20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:56.293707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f157b8d7-d45c-455b-acb3-b75a69e3da20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:56.307788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-eddff935-ec1d-4106-8653-20bb42a205fc req-f3913aab-45d8-49b4-b917-a63aa1193200 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:56.308278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-eddff935-ec1d-4106-8653-20bb42a205fc req-f3913aab-45d8-49b4-b917-a63aa1193200 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:56.309036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-eddff935-ec1d-4106-8653-20bb42a205fc req-f3913aab-45d8-49b4-b917-a63aa1193200 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:56.321991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-eddff935-ec1d-4106-8653-20bb42a205fc req-f3913aab-45d8-49b4-b917-a63aa1193200 service nova] Creating event network-changed:98ccabc6-a7d1-4192-af56-2e746060a479 for instance e7b11b63-0232-4f27-bacb-2e3872f6ae18 on hv-cinder-85367 Aug 18 21:56:56.328021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-eddff935-ec1d-4106-8653-20bb42a205fc req-f3913aab-45d8-49b4-b917-a63aa1193200 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041982 Aug 18 21:56:56.329005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 149/300] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:56:56.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f157b8d7-d45c-455b-acb3-b75a69e3da20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:56.450378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f157b8d7-d45c-455b-acb3-b75a69e3da20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.187616 Aug 18 21:56:56.450948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 152/301] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:56 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:56.727522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3ff36eb5-d122-4e94-9cc1-18d34ee0866e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:56.728327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3ff36eb5-d122-4e94-9cc1-18d34ee0866e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:56.734640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ff36eb5-d122-4e94-9cc1-18d34ee0866e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:56.735192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ff36eb5-d122-4e94-9cc1-18d34ee0866e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:56.735713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ff36eb5-d122-4e94-9cc1-18d34ee0866e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:56.736503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ff36eb5-d122-4e94-9cc1-18d34ee0866e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:56.737021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ff36eb5-d122-4e94-9cc1-18d34ee0866e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:56.737503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ff36eb5-d122-4e94-9cc1-18d34ee0866e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:56.880870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3ff36eb5-d122-4e94-9cc1-18d34ee0866e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:56.889304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3ff36eb5-d122-4e94-9cc1-18d34ee0866e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.166064 Aug 18 21:56:56.889928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 150/302] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:56 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:57.050975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-661a2193-44ad-490c-a185-8d18f43d3dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:57.052902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-661a2193-44ad-490c-a185-8d18f43d3dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:57.053046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a49ca68d-7939-43c5-8a99-0cf7f246c76b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:57.053367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a49ca68d-7939-43c5-8a99-0cf7f246c76b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:57.059678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-661a2193-44ad-490c-a185-8d18f43d3dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:57.059678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-661a2193-44ad-490c-a185-8d18f43d3dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:57.059946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a49ca68d-7939-43c5-8a99-0cf7f246c76b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:57.060035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-661a2193-44ad-490c-a185-8d18f43d3dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:57.060249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a49ca68d-7939-43c5-8a99-0cf7f246c76b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:57.060687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-661a2193-44ad-490c-a185-8d18f43d3dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:57.060798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a49ca68d-7939-43c5-8a99-0cf7f246c76b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:57.061207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-661a2193-44ad-490c-a185-8d18f43d3dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:57.061529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a49ca68d-7939-43c5-8a99-0cf7f246c76b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:57.061806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-661a2193-44ad-490c-a185-8d18f43d3dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:57.062752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a49ca68d-7939-43c5-8a99-0cf7f246c76b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:57.063198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a49ca68d-7939-43c5-8a99-0cf7f246c76b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:57.209373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a49ca68d-7939-43c5-8a99-0cf7f246c76b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:57.213319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-661a2193-44ad-490c-a185-8d18f43d3dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:57.230475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a49ca68d-7939-43c5-8a99-0cf7f246c76b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:57.232044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a49ca68d-7939-43c5-8a99-0cf7f246c76b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:57.234681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-661a2193-44ad-490c-a185-8d18f43d3dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.187420 Aug 18 21:56:57.245655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 153/303] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:57 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:57.245866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a49ca68d-7939-43c5-8a99-0cf7f246c76b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.191115 Aug 18 21:56:57.254222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 151/304] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:56:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:56:57.260547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cc53ec58-b9f3-4e4a-828a-0dec60cb6b23 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:57.268068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc53ec58-b9f3-4e4a-828a-0dec60cb6b23 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:57.268800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc53ec58-b9f3-4e4a-828a-0dec60cb6b23 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:57.270187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc53ec58-b9f3-4e4a-828a-0dec60cb6b23 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:57.336633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cc53ec58-b9f3-4e4a-828a-0dec60cb6b23 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Going to try to stop instance {{(pid=120539) force_stop /opt/stack/nova/nova/compute/api.py:2752}} Aug 18 21:56:57.384888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cc53ec58-b9f3-4e4a-828a-0dec60cb6b23 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "POST /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/action" status: 202 len: 0 microversion: 2.1 time: 0.147884 Aug 18 21:56:57.388856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 154/305] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 21:56:57 2022] POST /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:56:57.394580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f061791c-cf32-416a-90be-da99250b7b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:57.395195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f061791c-cf32-416a-90be-da99250b7b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:57.401047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f061791c-cf32-416a-90be-da99250b7b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:57.401526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f061791c-cf32-416a-90be-da99250b7b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:57.402014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f061791c-cf32-416a-90be-da99250b7b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:57.402702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f061791c-cf32-416a-90be-da99250b7b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:57.403265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f061791c-cf32-416a-90be-da99250b7b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:57.403692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f061791c-cf32-416a-90be-da99250b7b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:57.471555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5fd519db-c152-497f-bd75-2b5c5096c8c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:57.472761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5fd519db-c152-497f-bd75-2b5c5096c8c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:57.478795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd519db-c152-497f-bd75-2b5c5096c8c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:57.479354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd519db-c152-497f-bd75-2b5c5096c8c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:57.479743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd519db-c152-497f-bd75-2b5c5096c8c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:57.480442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd519db-c152-497f-bd75-2b5c5096c8c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:57.480904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd519db-c152-497f-bd75-2b5c5096c8c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:57.481330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd519db-c152-497f-bd75-2b5c5096c8c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:57.534004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f061791c-cf32-416a-90be-da99250b7b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:57.542936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f061791c-cf32-416a-90be-da99250b7b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.152356 Aug 18 21:56:57.543512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 152/306] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:57 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:57.607753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5fd519db-c152-497f-bd75-2b5c5096c8c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:57.616522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5fd519db-c152-497f-bd75-2b5c5096c8c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.149223 Aug 18 21:56:57.617097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 155/307] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:57 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:57.911624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-622080fd-1bd0-4ec5-8e9f-28c73dc07fc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:57.912235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-622080fd-1bd0-4ec5-8e9f-28c73dc07fc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:57.918526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-622080fd-1bd0-4ec5-8e9f-28c73dc07fc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:57.919013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-622080fd-1bd0-4ec5-8e9f-28c73dc07fc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:57.919497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-622080fd-1bd0-4ec5-8e9f-28c73dc07fc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:57.920200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-622080fd-1bd0-4ec5-8e9f-28c73dc07fc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:57.920648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-622080fd-1bd0-4ec5-8e9f-28c73dc07fc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:57.921062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-622080fd-1bd0-4ec5-8e9f-28c73dc07fc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.055835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-622080fd-1bd0-4ec5-8e9f-28c73dc07fc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:58.063470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-622080fd-1bd0-4ec5-8e9f-28c73dc07fc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.156966 Aug 18 21:56:58.064037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 153/308] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:58.263761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a879dfcb-38e6-4b02-a8eb-4135f4e6826e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:58.264707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a879dfcb-38e6-4b02-a8eb-4135f4e6826e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:58.268584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e9eecc66-3609-4fad-af55-9bd7faedfd3f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:58.269835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e9eecc66-3609-4fad-af55-9bd7faedfd3f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:58.272206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a879dfcb-38e6-4b02-a8eb-4135f4e6826e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.272698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a879dfcb-38e6-4b02-a8eb-4135f4e6826e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.273128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a879dfcb-38e6-4b02-a8eb-4135f4e6826e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.273864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a879dfcb-38e6-4b02-a8eb-4135f4e6826e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.274322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a879dfcb-38e6-4b02-a8eb-4135f4e6826e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.274747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a879dfcb-38e6-4b02-a8eb-4135f4e6826e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.276070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9eecc66-3609-4fad-af55-9bd7faedfd3f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.276563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9eecc66-3609-4fad-af55-9bd7faedfd3f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.277005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9eecc66-3609-4fad-af55-9bd7faedfd3f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.277737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9eecc66-3609-4fad-af55-9bd7faedfd3f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.278197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9eecc66-3609-4fad-af55-9bd7faedfd3f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.278624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9eecc66-3609-4fad-af55-9bd7faedfd3f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.492091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a879dfcb-38e6-4b02-a8eb-4135f4e6826e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:58.500255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a879dfcb-38e6-4b02-a8eb-4135f4e6826e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1502 microversion: 2.1 time: 0.243403 Aug 18 21:56:58.500839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 156/309] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:58 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1502 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:56:58.521033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0d888bd5-2476-43db-9be3-72a3595a1153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b98d2f62-2306-4766-8247-a84cfedfee4c"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:58.523861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0d888bd5-2476-43db-9be3-72a3595a1153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:58.530032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d888bd5-2476-43db-9be3-72a3595a1153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.530525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d888bd5-2476-43db-9be3-72a3595a1153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.530964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d888bd5-2476-43db-9be3-72a3595a1153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.531667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d888bd5-2476-43db-9be3-72a3595a1153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.532126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d888bd5-2476-43db-9be3-72a3595a1153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.532549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d888bd5-2476-43db-9be3-72a3595a1153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.555188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e9eecc66-3609-4fad-af55-9bd7faedfd3f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:58.559367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-0d888bd5-2476-43db-9be3-72a3595a1153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] HTTP exception thrown: Cannot 'attach_volume' instance 44bde447-4f59-4989-822c-8125ab3befeb while it is in vm_state rescued Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0d888bd5-2476-43db-9be3-72a3595a1153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Request method failure captured: Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: POST /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb/os-volume_attachments HTTP/1.1 Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 74 Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rUzAZHR_MTPG4eJ3KFYVTA565onzDKJxO1xSy-9It6A9DtmJ6F300Tyn7MqouaxuXCF3bBRuEPysbl4Qlry_Z0Mjpi9pocsEF0UrU9WWgJizF4d5s1BWfgp-r109oWhu2RDYnEoBMuaK1MUk3rKA7u7FJnLkZ8ikFqp1sSliWh_1qU Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 9894625c04a341e3a82584481410cd35 Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1925617752 Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 21:56:58.561072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 21:56:58.562664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9894625c04a341e3a82584481410cd35", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9894625c04a341e3a82584481410cd35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9894625c04a341e3a82584481410cd35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9894625c04a341e3a82584481410cd35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:56:58.562664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1925617752 Aug 18 21:56:58.562664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 9894625c04a341e3a82584481410cd35 Aug 18 21:56:58.562664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1925617752 Aug 18 21:56:58.562664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-ServerRescueNegativeTestJSON-1925617752-project Aug 18 21:56:58.562664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 21:56:58.562664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 21:56:58.562664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 42072422001c4f1684f68baa25517a9e Aug 18 21:56:58.562664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1925617752-project Aug 18 21:56:58.562664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Aug 18 21:56:58.562664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {"volumeAttachment": {"volumeId": "b98d2f62-2306-4766-8247-a84cfedfee4c"}} Aug 18 21:56:58.562664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Cannot 'attach_volume' instance 44bde447-4f59-4989-822c-8125ab3befeb while it is in vm_state rescued Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'server_id': '44bde447-4f59-4989-822c-8125ab3befeb', 'body': {'volumeAttachment': {'volumeId': 'b98d2f62-2306-4766-8247-a84cfedfee4c'}}} Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 44bde447-4f59-4989-822c-8125ab3befeb in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:56:58.563516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 44bde447-4f59-4989-822c-8125ab3befeb while it is in vm_state rescued Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:56:58.564735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:56:58.565967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:56:58.565967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:56:58.565967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 44bde447-4f59-4989-822c-8125ab3befeb while it is in vm_state rescued Aug 18 21:56:58.565967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:56:58.565967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0d888bd5-2476-43db-9be3-72a3595a1153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Returning 409 to user: Cannot 'attach_volume' instance 44bde447-4f59-4989-822c-8125ab3befeb while it is in vm_state rescued {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:56:58.565967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0d888bd5-2476-43db-9be3-72a3595a1153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "POST /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045648 Aug 18 21:56:58.565967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 157/310] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 21:56:58 2022] POST /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 21:56:58.566399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e9eecc66-3609-4fad-af55-9bd7faedfd3f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:58.566399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e9eecc66-3609-4fad-af55-9bd7faedfd3f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:58.566652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e9eecc66-3609-4fad-af55-9bd7faedfd3f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.302832 Aug 18 21:56:58.567261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 154/311] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:56:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:56:58.568105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9fa9452b-7c69-4d89-9625-790cfe1f157e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:58.568720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9fa9452b-7c69-4d89-9625-790cfe1f157e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:58.572102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6650b2ed-654b-4937-b408-d74024f78c5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:56:58.572644 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6650b2ed-654b-4937-b408-d74024f78c5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:58.574761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fa9452b-7c69-4d89-9625-790cfe1f157e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.575254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fa9452b-7c69-4d89-9625-790cfe1f157e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.575689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fa9452b-7c69-4d89-9625-790cfe1f157e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.576376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fa9452b-7c69-4d89-9625-790cfe1f157e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.576830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fa9452b-7c69-4d89-9625-790cfe1f157e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.577249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fa9452b-7c69-4d89-9625-790cfe1f157e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.578527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6650b2ed-654b-4937-b408-d74024f78c5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.579054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6650b2ed-654b-4937-b408-d74024f78c5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.579494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6650b2ed-654b-4937-b408-d74024f78c5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.580191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6650b2ed-654b-4937-b408-d74024f78c5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.580647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6650b2ed-654b-4937-b408-d74024f78c5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.581075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6650b2ed-654b-4937-b408-d74024f78c5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.609081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:56:58.650498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6650b2ed-654b-4937-b408-d74024f78c5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "POST /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb/action" status: 202 len: 0 microversion: 2.1 time: 0.081849 Aug 18 21:56:58.651377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 155/312] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 21:56:58 2022] POST /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:56:58.656234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-613f4631-e340-4617-b842-1ddb3cf98f70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:58.656941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-613f4631-e340-4617-b842-1ddb3cf98f70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:58.663791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-613f4631-e340-4617-b842-1ddb3cf98f70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.664277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-613f4631-e340-4617-b842-1ddb3cf98f70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.664712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-613f4631-e340-4617-b842-1ddb3cf98f70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.665435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-613f4631-e340-4617-b842-1ddb3cf98f70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.665919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-613f4631-e340-4617-b842-1ddb3cf98f70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.666345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-613f4631-e340-4617-b842-1ddb3cf98f70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.797373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9fa9452b-7c69-4d89-9625-790cfe1f157e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:58.806752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9fa9452b-7c69-4d89-9625-790cfe1f157e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.242531 Aug 18 21:56:58.807333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 158/313] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:58 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:58.812022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5574f223-12ae-42f0-8625-d24cd585c921 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:58.812835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5574f223-12ae-42f0-8625-d24cd585c921 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:58.819985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5574f223-12ae-42f0-8625-d24cd585c921 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.820489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5574f223-12ae-42f0-8625-d24cd585c921 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.820932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5574f223-12ae-42f0-8625-d24cd585c921 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.821689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5574f223-12ae-42f0-8625-d24cd585c921 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:58.822189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5574f223-12ae-42f0-8625-d24cd585c921 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:58.822623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5574f223-12ae-42f0-8625-d24cd585c921 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:58.826757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-613f4631-e340-4617-b842-1ddb3cf98f70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:58.835185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-613f4631-e340-4617-b842-1ddb3cf98f70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1319 microversion: 2.1 time: 0.182777 Aug 18 21:56:58.835877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 156/314] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:58 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:59.099770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6f84ea4c-b993-4d31-8096-be43d54941ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:59.103440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6f84ea4c-b993-4d31-8096-be43d54941ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:59.111953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f84ea4c-b993-4d31-8096-be43d54941ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:59.112601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f84ea4c-b993-4d31-8096-be43d54941ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:59.113215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f84ea4c-b993-4d31-8096-be43d54941ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:59.113984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f84ea4c-b993-4d31-8096-be43d54941ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:59.114442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f84ea4c-b993-4d31-8096-be43d54941ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:59.114864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f84ea4c-b993-4d31-8096-be43d54941ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:59.223861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5574f223-12ae-42f0-8625-d24cd585c921 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:59.235931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5574f223-12ae-42f0-8625-d24cd585c921 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1510 microversion: 2.1 time: 0.427341 Aug 18 21:56:59.236848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 159/315] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:58 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1510 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:59.366652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6f84ea4c-b993-4d31-8096-be43d54941ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:59.376500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6f84ea4c-b993-4d31-8096-be43d54941ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.292525 Aug 18 21:56:59.390024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 157/316] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:56:59.589743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26f7838f-ec6b-4d92-a6e1-51403eeddb11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:59.590296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26f7838f-ec6b-4d92-a6e1-51403eeddb11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:59.596780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f7838f-ec6b-4d92-a6e1-51403eeddb11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:59.598013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f7838f-ec6b-4d92-a6e1-51403eeddb11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:59.598367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f7838f-ec6b-4d92-a6e1-51403eeddb11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:59.599067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f7838f-ec6b-4d92-a6e1-51403eeddb11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:59.599527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f7838f-ec6b-4d92-a6e1-51403eeddb11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:59.599957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f7838f-ec6b-4d92-a6e1-51403eeddb11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:59.726346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26f7838f-ec6b-4d92-a6e1-51403eeddb11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:59.734387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26f7838f-ec6b-4d92-a6e1-51403eeddb11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:59.735917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26f7838f-ec6b-4d92-a6e1-51403eeddb11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:56:59.737074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26f7838f-ec6b-4d92-a6e1-51403eeddb11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.151411 Aug 18 21:56:59.737657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 160/317] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:56:59 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:56:59.828422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8f84aa83-d429-4d4c-a5c3-851745688bbd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:59.829134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8f84aa83-d429-4d4c-a5c3-851745688bbd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:59.836050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f84aa83-d429-4d4c-a5c3-851745688bbd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:59.836536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f84aa83-d429-4d4c-a5c3-851745688bbd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:59.836971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f84aa83-d429-4d4c-a5c3-851745688bbd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:59.837697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f84aa83-d429-4d4c-a5c3-851745688bbd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:59.838180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f84aa83-d429-4d4c-a5c3-851745688bbd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:59.838577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f84aa83-d429-4d4c-a5c3-851745688bbd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:59.857428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9468d904-bd60-434c-858b-75c435b32b47 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:56:59.858148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9468d904-bd60-434c-858b-75c435b32b47 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:56:59.865113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9468d904-bd60-434c-858b-75c435b32b47 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:59.865983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9468d904-bd60-434c-858b-75c435b32b47 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:59.866692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9468d904-bd60-434c-858b-75c435b32b47 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:56:59.868525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9468d904-bd60-434c-858b-75c435b32b47 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:56:59.869217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9468d904-bd60-434c-858b-75c435b32b47 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:56:59.869905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9468d904-bd60-434c-858b-75c435b32b47 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:00.008514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9468d904-bd60-434c-858b-75c435b32b47 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:00.016775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9468d904-bd60-434c-858b-75c435b32b47 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1508 microversion: 2.1 time: 0.164367 Aug 18 21:57:00.017345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 161/318] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:59 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:00.258799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e0c41398-5638-4edd-a150-2943e5b4b050 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:00.259426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e0c41398-5638-4edd-a150-2943e5b4b050 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:00.265470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0c41398-5638-4edd-a150-2943e5b4b050 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:00.266002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0c41398-5638-4edd-a150-2943e5b4b050 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:00.266440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0c41398-5638-4edd-a150-2943e5b4b050 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:00.267501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0c41398-5638-4edd-a150-2943e5b4b050 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:00.267621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0c41398-5638-4edd-a150-2943e5b4b050 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:00.268002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0c41398-5638-4edd-a150-2943e5b4b050 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:00.371526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8f84aa83-d429-4d4c-a5c3-851745688bbd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:00.393155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8f84aa83-d429-4d4c-a5c3-851745688bbd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.565974 Aug 18 21:57:00.396428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 158/319] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:56:59 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:00.402911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07b07df9-ed08-4539-ac61-26c38652fc13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:00.406560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07b07df9-ed08-4539-ac61-26c38652fc13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:00.426795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07b07df9-ed08-4539-ac61-26c38652fc13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:00.428013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07b07df9-ed08-4539-ac61-26c38652fc13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:00.430682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07b07df9-ed08-4539-ac61-26c38652fc13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:00.431791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07b07df9-ed08-4539-ac61-26c38652fc13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:00.432739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07b07df9-ed08-4539-ac61-26c38652fc13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:00.436412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07b07df9-ed08-4539-ac61-26c38652fc13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:00.457734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e0c41398-5638-4edd-a150-2943e5b4b050 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:00.483201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e0c41398-5638-4edd-a150-2943e5b4b050 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1510 microversion: 2.1 time: 0.228241 Aug 18 21:57:00.493231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 162/320] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:00 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:00.693542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-07b07df9-ed08-4539-ac61-26c38652fc13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:00.701627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07b07df9-ed08-4539-ac61-26c38652fc13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.303898 Aug 18 21:57:00.702205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 159/321] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:00 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:00.759910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a0129309-0fcf-45fc-9ee6-54fb2027fe28 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:00.760537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a0129309-0fcf-45fc-9ee6-54fb2027fe28 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:00.767374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0129309-0fcf-45fc-9ee6-54fb2027fe28 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:00.767871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0129309-0fcf-45fc-9ee6-54fb2027fe28 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:00.768307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0129309-0fcf-45fc-9ee6-54fb2027fe28 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:00.769684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0129309-0fcf-45fc-9ee6-54fb2027fe28 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:00.770332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0129309-0fcf-45fc-9ee6-54fb2027fe28 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:00.770947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0129309-0fcf-45fc-9ee6-54fb2027fe28 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:00.776008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:00.960992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a0129309-0fcf-45fc-9ee6-54fb2027fe28 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:00.971422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a0129309-0fcf-45fc-9ee6-54fb2027fe28 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:00.972966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a0129309-0fcf-45fc-9ee6-54fb2027fe28 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:00.974211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a0129309-0fcf-45fc-9ee6-54fb2027fe28 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.219075 Aug 18 21:57:00.985925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 163/322] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:00 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:01.419370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1c28d334-7f80-4348-9695-803abc6e79dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:01.420344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1c28d334-7f80-4348-9695-803abc6e79dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:01.428857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c28d334-7f80-4348-9695-803abc6e79dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:01.429266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c28d334-7f80-4348-9695-803abc6e79dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:01.429734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c28d334-7f80-4348-9695-803abc6e79dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:01.430463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c28d334-7f80-4348-9695-803abc6e79dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:01.430920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c28d334-7f80-4348-9695-803abc6e79dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:01.431347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c28d334-7f80-4348-9695-803abc6e79dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:01.506418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9c03a4b3-0b83-4820-a82f-c63cda0e26dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:01.507244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9c03a4b3-0b83-4820-a82f-c63cda0e26dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:01.514794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c03a4b3-0b83-4820-a82f-c63cda0e26dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:01.515105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c03a4b3-0b83-4820-a82f-c63cda0e26dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:01.515556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c03a4b3-0b83-4820-a82f-c63cda0e26dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:01.516251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c03a4b3-0b83-4820-a82f-c63cda0e26dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:01.516703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c03a4b3-0b83-4820-a82f-c63cda0e26dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:01.517123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c03a4b3-0b83-4820-a82f-c63cda0e26dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:01.568536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1c28d334-7f80-4348-9695-803abc6e79dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:01.577349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1c28d334-7f80-4348-9695-803abc6e79dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.163596 Aug 18 21:57:01.578370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 160/323] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:01 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:01.655672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9c03a4b3-0b83-4820-a82f-c63cda0e26dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:01.666483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9c03a4b3-0b83-4820-a82f-c63cda0e26dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1510 microversion: 2.1 time: 0.164477 Aug 18 21:57:01.667068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 164/324] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:01 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:01.723548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3a3a6bc6-f52d-46dd-a544-4a89b4015925 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:01.724245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3a3a6bc6-f52d-46dd-a544-4a89b4015925 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:01.730194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a3a6bc6-f52d-46dd-a544-4a89b4015925 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:01.730681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a3a6bc6-f52d-46dd-a544-4a89b4015925 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:01.731117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a3a6bc6-f52d-46dd-a544-4a89b4015925 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:01.731806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a3a6bc6-f52d-46dd-a544-4a89b4015925 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:01.732261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a3a6bc6-f52d-46dd-a544-4a89b4015925 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:01.732685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a3a6bc6-f52d-46dd-a544-4a89b4015925 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:01.863567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3a3a6bc6-f52d-46dd-a544-4a89b4015925 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:01.871249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3a3a6bc6-f52d-46dd-a544-4a89b4015925 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.152112 Aug 18 21:57:01.871821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 161/325] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:01 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:01.997725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-61461eba-f427-4841-9efc-00bdc413506d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:01.998328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-61461eba-f427-4841-9efc-00bdc413506d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:02.005067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61461eba-f427-4841-9efc-00bdc413506d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:02.005547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61461eba-f427-4841-9efc-00bdc413506d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:02.006003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61461eba-f427-4841-9efc-00bdc413506d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:02.006694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61461eba-f427-4841-9efc-00bdc413506d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:02.007148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61461eba-f427-4841-9efc-00bdc413506d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:02.007569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61461eba-f427-4841-9efc-00bdc413506d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:02.137251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-61461eba-f427-4841-9efc-00bdc413506d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:02.146786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-61461eba-f427-4841-9efc-00bdc413506d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:02.148319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-61461eba-f427-4841-9efc-00bdc413506d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:02.149477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-61461eba-f427-4841-9efc-00bdc413506d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.155765 Aug 18 21:57:02.150077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 165/326] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:02.600329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-857222dd-cffa-45dd-bb42-08b1a98d1f24 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:02.600952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-857222dd-cffa-45dd-bb42-08b1a98d1f24 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:02.606930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-857222dd-cffa-45dd-bb42-08b1a98d1f24 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:02.607416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-857222dd-cffa-45dd-bb42-08b1a98d1f24 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:02.607854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-857222dd-cffa-45dd-bb42-08b1a98d1f24 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:02.608542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-857222dd-cffa-45dd-bb42-08b1a98d1f24 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:02.609000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-857222dd-cffa-45dd-bb42-08b1a98d1f24 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:02.609426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-857222dd-cffa-45dd-bb42-08b1a98d1f24 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:02.688333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9e21a2e5-9045-4478-bf10-cb9e1489dee7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:02.688951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9e21a2e5-9045-4478-bf10-cb9e1489dee7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:02.695595 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e21a2e5-9045-4478-bf10-cb9e1489dee7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:02.696080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e21a2e5-9045-4478-bf10-cb9e1489dee7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:02.696706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e21a2e5-9045-4478-bf10-cb9e1489dee7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:02.697572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e21a2e5-9045-4478-bf10-cb9e1489dee7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:02.698202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e21a2e5-9045-4478-bf10-cb9e1489dee7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:02.698808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e21a2e5-9045-4478-bf10-cb9e1489dee7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:02.769485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-857222dd-cffa-45dd-bb42-08b1a98d1f24 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:02.778867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-857222dd-cffa-45dd-bb42-08b1a98d1f24 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.182295 Aug 18 21:57:02.793191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 162/327] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:02.844361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e21a2e5-9045-4478-bf10-cb9e1489dee7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:02.852673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9e21a2e5-9045-4478-bf10-cb9e1489dee7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1510 microversion: 2.1 time: 0.168771 Aug 18 21:57:02.853292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 166/328] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:02 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:02.891448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-77bdec11-212d-4ae5-b524-97bbf0f62a94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:02.892066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-77bdec11-212d-4ae5-b524-97bbf0f62a94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:02.898067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77bdec11-212d-4ae5-b524-97bbf0f62a94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:02.898556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77bdec11-212d-4ae5-b524-97bbf0f62a94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:02.898992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77bdec11-212d-4ae5-b524-97bbf0f62a94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:02.899683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77bdec11-212d-4ae5-b524-97bbf0f62a94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:02.900137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77bdec11-212d-4ae5-b524-97bbf0f62a94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:02.900562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77bdec11-212d-4ae5-b524-97bbf0f62a94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:03.032101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-77bdec11-212d-4ae5-b524-97bbf0f62a94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:03.042867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-77bdec11-212d-4ae5-b524-97bbf0f62a94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.154927 Aug 18 21:57:03.043521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 163/329] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:02 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:03.172667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-33c5e917-f9b0-432f-bdaa-198a7d99ed82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:03.173204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-33c5e917-f9b0-432f-bdaa-198a7d99ed82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:03.179947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33c5e917-f9b0-432f-bdaa-198a7d99ed82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:03.180458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33c5e917-f9b0-432f-bdaa-198a7d99ed82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:03.180886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33c5e917-f9b0-432f-bdaa-198a7d99ed82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:03.181629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33c5e917-f9b0-432f-bdaa-198a7d99ed82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:03.182090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33c5e917-f9b0-432f-bdaa-198a7d99ed82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:03.182518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33c5e917-f9b0-432f-bdaa-198a7d99ed82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:03.322431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-33c5e917-f9b0-432f-bdaa-198a7d99ed82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:03.330935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-33c5e917-f9b0-432f-bdaa-198a7d99ed82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:03.332948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-33c5e917-f9b0-432f-bdaa-198a7d99ed82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:03.335910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-33c5e917-f9b0-432f-bdaa-198a7d99ed82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.165541 Aug 18 21:57:03.335910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 167/330] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:03.801544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3582cd5f-ac4e-4b10-af04-a2ec44c18fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:03.802239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3582cd5f-ac4e-4b10-af04-a2ec44c18fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:03.808327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3582cd5f-ac4e-4b10-af04-a2ec44c18fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:03.808825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3582cd5f-ac4e-4b10-af04-a2ec44c18fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:03.809270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3582cd5f-ac4e-4b10-af04-a2ec44c18fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:03.810010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3582cd5f-ac4e-4b10-af04-a2ec44c18fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:03.810473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3582cd5f-ac4e-4b10-af04-a2ec44c18fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:03.810906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3582cd5f-ac4e-4b10-af04-a2ec44c18fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:03.874270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-89ce5f51-b09f-4ffc-956b-ed38467bb60a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:03.875016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-89ce5f51-b09f-4ffc-956b-ed38467bb60a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:03.881881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ce5f51-b09f-4ffc-956b-ed38467bb60a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:03.882384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ce5f51-b09f-4ffc-956b-ed38467bb60a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:03.882826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ce5f51-b09f-4ffc-956b-ed38467bb60a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:03.883530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ce5f51-b09f-4ffc-956b-ed38467bb60a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:03.883986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ce5f51-b09f-4ffc-956b-ed38467bb60a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:03.884414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ce5f51-b09f-4ffc-956b-ed38467bb60a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:03.944094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3582cd5f-ac4e-4b10-af04-a2ec44c18fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:03.952352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3582cd5f-ac4e-4b10-af04-a2ec44c18fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.155292 Aug 18 21:57:03.952940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 164/331] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:04.014412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-89ce5f51-b09f-4ffc-956b-ed38467bb60a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:04.022196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-89ce5f51-b09f-4ffc-956b-ed38467bb60a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1516 microversion: 2.1 time: 0.151757 Aug 18 21:57:04.022758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 168/332] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:03 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:04.064480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5e53b4ee-bb02-470d-a417-7c34d9ff8630 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:04.065167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5e53b4ee-bb02-470d-a417-7c34d9ff8630 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:04.068252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:04.073753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e53b4ee-bb02-470d-a417-7c34d9ff8630 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:04.074250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e53b4ee-bb02-470d-a417-7c34d9ff8630 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:04.074787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e53b4ee-bb02-470d-a417-7c34d9ff8630 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:04.075393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e53b4ee-bb02-470d-a417-7c34d9ff8630 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:04.075853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e53b4ee-bb02-470d-a417-7c34d9ff8630 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:04.076285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e53b4ee-bb02-470d-a417-7c34d9ff8630 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:04.225144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5e53b4ee-bb02-470d-a417-7c34d9ff8630 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:04.233576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5e53b4ee-bb02-470d-a417-7c34d9ff8630 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.172960 Aug 18 21:57:04.234620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 165/333] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:04.357439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c864e6be-cbfc-4a62-b6fa-0e4e67f29d62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:04.358067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c864e6be-cbfc-4a62-b6fa-0e4e67f29d62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:04.365292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c864e6be-cbfc-4a62-b6fa-0e4e67f29d62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:04.365537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c864e6be-cbfc-4a62-b6fa-0e4e67f29d62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:04.365992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c864e6be-cbfc-4a62-b6fa-0e4e67f29d62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:04.366678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c864e6be-cbfc-4a62-b6fa-0e4e67f29d62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:04.367124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c864e6be-cbfc-4a62-b6fa-0e4e67f29d62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:04.367541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c864e6be-cbfc-4a62-b6fa-0e4e67f29d62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:04.494414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c864e6be-cbfc-4a62-b6fa-0e4e67f29d62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:04.502511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c864e6be-cbfc-4a62-b6fa-0e4e67f29d62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:04.504053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c864e6be-cbfc-4a62-b6fa-0e4e67f29d62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:04.505196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c864e6be-cbfc-4a62-b6fa-0e4e67f29d62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.151652 Aug 18 21:57:04.505784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 169/334] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:04.809391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-c4496afd-0059-4d3d-842a-35a14239b466 req-13ae41e1-f3e9-41c2-8212-19f8ba0e7272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b11b63-0232-4f27-bacb-2e3872f6ae18", "name": "network-vif-plugged", "status": "completed", "tag": "98ccabc6-a7d1-4192-af56-2e746060a479"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:04.821352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-c4496afd-0059-4d3d-842a-35a14239b466 req-13ae41e1-f3e9-41c2-8212-19f8ba0e7272 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:04.821866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-c4496afd-0059-4d3d-842a-35a14239b466 req-13ae41e1-f3e9-41c2-8212-19f8ba0e7272 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:04.822395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-c4496afd-0059-4d3d-842a-35a14239b466 req-13ae41e1-f3e9-41c2-8212-19f8ba0e7272 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:04.834797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-c4496afd-0059-4d3d-842a-35a14239b466 req-13ae41e1-f3e9-41c2-8212-19f8ba0e7272 service nova] Creating event network-vif-plugged:98ccabc6-a7d1-4192-af56-2e746060a479 for instance e7b11b63-0232-4f27-bacb-2e3872f6ae18 on hv-cinder-85367 Aug 18 21:57:04.839705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-c4496afd-0059-4d3d-842a-35a14239b466 req-13ae41e1-f3e9-41c2-8212-19f8ba0e7272 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034196 Aug 18 21:57:04.840394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 166/335] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:57:04.979031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b6ff2e2d-4baf-4206-b28a-7e770791a02e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:04.980295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b6ff2e2d-4baf-4206-b28a-7e770791a02e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:04.987885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6ff2e2d-4baf-4206-b28a-7e770791a02e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:04.988373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6ff2e2d-4baf-4206-b28a-7e770791a02e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:04.988810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6ff2e2d-4baf-4206-b28a-7e770791a02e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:04.989580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6ff2e2d-4baf-4206-b28a-7e770791a02e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:04.990206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6ff2e2d-4baf-4206-b28a-7e770791a02e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:04.990402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6ff2e2d-4baf-4206-b28a-7e770791a02e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:05.126599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b6ff2e2d-4baf-4206-b28a-7e770791a02e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:05.135856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b6ff2e2d-4baf-4206-b28a-7e770791a02e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.164986 Aug 18 21:57:05.136426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 170/336] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:05.255602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-879744bd-4734-431b-92a1-b380ebe6a88b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:05.256306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-879744bd-4734-431b-92a1-b380ebe6a88b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:05.262910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-879744bd-4734-431b-92a1-b380ebe6a88b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:05.263401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-879744bd-4734-431b-92a1-b380ebe6a88b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:05.263838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-879744bd-4734-431b-92a1-b380ebe6a88b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:05.264547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-879744bd-4734-431b-92a1-b380ebe6a88b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:05.265004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-879744bd-4734-431b-92a1-b380ebe6a88b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:05.265426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-879744bd-4734-431b-92a1-b380ebe6a88b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:05.399962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4498fee2-4e45-4f52-85ff-e11de8727214 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Action: 'create', calling method: .version_select at 0x7fd8896a03a0>, body: {"keypair": {"name": "tempest-keypair-2136457162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNF/xJBFgyw4The1Ff8YwTUTUAlxGzdxFWqMiqQ/NTAtkvfuZkQRbpOEgVxAcZK8qNYuCPtDd+Fsj2HlIz5y+HhAMr7s32UTcaftA8P3b+KAEgGTcd1j+hSF49wn01ptg=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:05.400467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-879744bd-4734-431b-92a1-b380ebe6a88b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:05.407774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-879744bd-4734-431b-92a1-b380ebe6a88b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.156845 Aug 18 21:57:05.408550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 167/337] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:05 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:05.414212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-4498fee2-4e45-4f52-85ff-e11de8727214 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Getting quotas for project 9894625c04a341e3a82584481410cd35. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:57:05.418280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-4498fee2-4e45-4f52-85ff-e11de8727214 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Getting quotas for user 42072422001c4f1684f68baa25517a9e and project 9894625c04a341e3a82584481410cd35. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:57:05.440857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4498fee2-4e45-4f52-85ff-e11de8727214 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048490 Aug 18 21:57:05.442291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 171/338] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 21:57:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:57:05.530315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0f0b7fe4-b103-478c-a3d2-859aa8c0690f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:05.531247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0f0b7fe4-b103-478c-a3d2-859aa8c0690f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:05.537611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f0b7fe4-b103-478c-a3d2-859aa8c0690f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:05.538124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f0b7fe4-b103-478c-a3d2-859aa8c0690f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:05.538565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f0b7fe4-b103-478c-a3d2-859aa8c0690f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:05.539285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f0b7fe4-b103-478c-a3d2-859aa8c0690f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:05.539749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f0b7fe4-b103-478c-a3d2-859aa8c0690f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:05.540184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f0b7fe4-b103-478c-a3d2-859aa8c0690f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:05.690522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0f0b7fe4-b103-478c-a3d2-859aa8c0690f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:05.699649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0f0b7fe4-b103-478c-a3d2-859aa8c0690f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:05.701145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0f0b7fe4-b103-478c-a3d2-859aa8c0690f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:05.702344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0f0b7fe4-b103-478c-a3d2-859aa8c0690f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.177366 Aug 18 21:57:05.702997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 168/339] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:06.158770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-483a27f5-2f76-48fc-a0f3-09df2ed4600b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:06.159221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-483a27f5-2f76-48fc-a0f3-09df2ed4600b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:06.167077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-483a27f5-2f76-48fc-a0f3-09df2ed4600b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:06.168181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-483a27f5-2f76-48fc-a0f3-09df2ed4600b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:06.168816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-483a27f5-2f76-48fc-a0f3-09df2ed4600b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:06.169730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-483a27f5-2f76-48fc-a0f3-09df2ed4600b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:06.170358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-483a27f5-2f76-48fc-a0f3-09df2ed4600b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:06.170944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-483a27f5-2f76-48fc-a0f3-09df2ed4600b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:06.379387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-483a27f5-2f76-48fc-a0f3-09df2ed4600b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:06.390727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-483a27f5-2f76-48fc-a0f3-09df2ed4600b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.237446 Aug 18 21:57:06.397316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 172/340] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:06.430877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1662cd52-2966-4669-8f43-f064e1cfad2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:06.433238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1662cd52-2966-4669-8f43-f064e1cfad2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:06.438056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1662cd52-2966-4669-8f43-f064e1cfad2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:06.438671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1662cd52-2966-4669-8f43-f064e1cfad2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:06.439205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1662cd52-2966-4669-8f43-f064e1cfad2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:06.440002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1662cd52-2966-4669-8f43-f064e1cfad2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:06.440675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1662cd52-2966-4669-8f43-f064e1cfad2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:06.441938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1662cd52-2966-4669-8f43-f064e1cfad2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:06.586074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1662cd52-2966-4669-8f43-f064e1cfad2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:06.594443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1662cd52-2966-4669-8f43-f064e1cfad2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1357 microversion: 2.1 time: 0.169939 Aug 18 21:57:06.595032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 169/341] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:06 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:06.725154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-54c5d4a1-329c-4953-9ebb-d85df95885be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:06.725965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-54c5d4a1-329c-4953-9ebb-d85df95885be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:06.732375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54c5d4a1-329c-4953-9ebb-d85df95885be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:06.732856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54c5d4a1-329c-4953-9ebb-d85df95885be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:06.733295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54c5d4a1-329c-4953-9ebb-d85df95885be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:06.734020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54c5d4a1-329c-4953-9ebb-d85df95885be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:06.734478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54c5d4a1-329c-4953-9ebb-d85df95885be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:06.734902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54c5d4a1-329c-4953-9ebb-d85df95885be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:06.791537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1876811748", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f5079c76-94b9-4b99-ab7f-dc294e97defa"}], "security_groups": [{"name": "tempest-securitygroup--211016846"}], "key_name": "tempest-keypair-2136457162", "user_data": "}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:06.887346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-54c5d4a1-329c-4953-9ebb-d85df95885be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:06.897523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-54c5d4a1-329c-4953-9ebb-d85df95885be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:06.899274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-54c5d4a1-329c-4953-9ebb-d85df95885be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:06.900443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-54c5d4a1-329c-4953-9ebb-d85df95885be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.179448 Aug 18 21:57:06.907627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 173/342] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:06 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:06.917473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] validate_networks() for [('f5079c76-94b9-4b99-ab7f-dc294e97defa', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:57:07.294541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:57:07.294972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:57:07.295446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:57:07.295907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:57:07.296328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:57:07.305217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:07.305729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:07.306168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:07.306897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:07.307350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:07.307777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:07.325550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Getting quotas for project 9894625c04a341e3a82584481410cd35. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:57:07.330312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Getting quotas for user 42072422001c4f1684f68baa25517a9e and project 9894625c04a341e3a82584481410cd35. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:57:07.343499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:57:07.345824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:57:07.391285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-59c23d55-6582-48ad-a34a-1c00a1d35b76 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.604168 Aug 18 21:57:07.392053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 170/343] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 21:57:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:57:07.403619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5271575b-19c1-41a3-b511-bc202d3c92c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:07.404244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5271575b-19c1-41a3-b511-bc202d3c92c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:07.418713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fd35e2d2-943f-403e-aeff-1577fc5ad15b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:07.419321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fd35e2d2-943f-403e-aeff-1577fc5ad15b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:07.426737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd35e2d2-943f-403e-aeff-1577fc5ad15b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:07.427221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd35e2d2-943f-403e-aeff-1577fc5ad15b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:07.427653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd35e2d2-943f-403e-aeff-1577fc5ad15b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:07.428349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd35e2d2-943f-403e-aeff-1577fc5ad15b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:07.428801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd35e2d2-943f-403e-aeff-1577fc5ad15b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:07.429221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd35e2d2-943f-403e-aeff-1577fc5ad15b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:07.461323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5271575b-19c1-41a3-b511-bc202d3c92c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:07.468392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5271575b-19c1-41a3-b511-bc202d3c92c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1246 microversion: 2.1 time: 0.068537 Aug 18 21:57:07.468964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 174/344] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:07 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1246 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:07.569730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fd35e2d2-943f-403e-aeff-1577fc5ad15b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:07.578097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fd35e2d2-943f-403e-aeff-1577fc5ad15b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.163582 Aug 18 21:57:07.578751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 171/345] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:07 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:07.616071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bac78f74-9119-423a-bbb9-8c73c1f4c5f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:07.616801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bac78f74-9119-423a-bbb9-8c73c1f4c5f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:07.623012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bac78f74-9119-423a-bbb9-8c73c1f4c5f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:07.623466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bac78f74-9119-423a-bbb9-8c73c1f4c5f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:07.623903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bac78f74-9119-423a-bbb9-8c73c1f4c5f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:07.624724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bac78f74-9119-423a-bbb9-8c73c1f4c5f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:07.625069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bac78f74-9119-423a-bbb9-8c73c1f4c5f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:07.625501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bac78f74-9119-423a-bbb9-8c73c1f4c5f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:07.770413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bac78f74-9119-423a-bbb9-8c73c1f4c5f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:07.778673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bac78f74-9119-423a-bbb9-8c73c1f4c5f0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1547 microversion: 2.1 time: 0.166619 Aug 18 21:57:07.779254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 175/346] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:07.801073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-16af3afa-258e-4288-bdac-f982846f059f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:07.801837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-16af3afa-258e-4288-bdac-f982846f059f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:07.808210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16af3afa-258e-4288-bdac-f982846f059f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:07.808708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16af3afa-258e-4288-bdac-f982846f059f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:07.809150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16af3afa-258e-4288-bdac-f982846f059f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:07.809921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16af3afa-258e-4288-bdac-f982846f059f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:07.810387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16af3afa-258e-4288-bdac-f982846f059f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:07.810819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16af3afa-258e-4288-bdac-f982846f059f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:07.925572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a42c7934-1107-4074-b4f4-b00b3390be8c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:07.927620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a42c7934-1107-4074-b4f4-b00b3390be8c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:07.933817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a42c7934-1107-4074-b4f4-b00b3390be8c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:07.934335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a42c7934-1107-4074-b4f4-b00b3390be8c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:07.934820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a42c7934-1107-4074-b4f4-b00b3390be8c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:07.935522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a42c7934-1107-4074-b4f4-b00b3390be8c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:07.936187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a42c7934-1107-4074-b4f4-b00b3390be8c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:07.936622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a42c7934-1107-4074-b4f4-b00b3390be8c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:07.957671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-16af3afa-258e-4288-bdac-f982846f059f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:07.961417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:07.969458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-16af3afa-258e-4288-bdac-f982846f059f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1547 microversion: 2.1 time: 0.172276 Aug 18 21:57:07.972256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 172/347] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:07.990949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-78e0bd00-02b2-40ba-a62c-8fba5f3e7261 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:07.995897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-78e0bd00-02b2-40ba-a62c-8fba5f3e7261 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:07.996790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-78e0bd00-02b2-40ba-a62c-8fba5f3e7261 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Searching by: {'deleted': False, 'project_id': '740832491e454b40a6cd87be4ca40384'} {{(pid=120538) get_all /opt/stack/nova/nova/compute/api.py:3007}} Aug 18 21:57:08.005395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78e0bd00-02b2-40ba-a62c-8fba5f3e7261 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:08.005902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78e0bd00-02b2-40ba-a62c-8fba5f3e7261 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:08.006550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78e0bd00-02b2-40ba-a62c-8fba5f3e7261 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:08.007483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78e0bd00-02b2-40ba-a62c-8fba5f3e7261 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:08.008109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78e0bd00-02b2-40ba-a62c-8fba5f3e7261 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:08.008694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78e0bd00-02b2-40ba-a62c-8fba5f3e7261 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:08.100870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a42c7934-1107-4074-b4f4-b00b3390be8c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:08.111334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a42c7934-1107-4074-b4f4-b00b3390be8c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:08.113378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.multi_cell_list [None req-78e0bd00-02b2-40ba-a62c-8fba5f3e7261 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120538) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 21:57:08.113553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a42c7934-1107-4074-b4f4-b00b3390be8c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:08.115527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a42c7934-1107-4074-b4f4-b00b3390be8c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.196265 Aug 18 21:57:08.116089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 176/348] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:57:08.213550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-78e0bd00-02b2-40ba-a62c-8fba5f3e7261 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.226322 Aug 18 21:57:08.214233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 173/349] 10.222.0.82 () {58 vars in 1125 bytes} [Thu Aug 18 21:57:07 2022] GET /compute/v2.1/servers => generated 341 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:57:08.225508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-76a8b4f0-93e0-41b1-addd-19e7f0382b25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:08.226089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-76a8b4f0-93e0-41b1-addd-19e7f0382b25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:08.232074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76a8b4f0-93e0-41b1-addd-19e7f0382b25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:08.232553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76a8b4f0-93e0-41b1-addd-19e7f0382b25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:08.232984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76a8b4f0-93e0-41b1-addd-19e7f0382b25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:08.233692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76a8b4f0-93e0-41b1-addd-19e7f0382b25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:08.234147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76a8b4f0-93e0-41b1-addd-19e7f0382b25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:08.234566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76a8b4f0-93e0-41b1-addd-19e7f0382b25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:08.368154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-76a8b4f0-93e0-41b1-addd-19e7f0382b25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:08.376439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-76a8b4f0-93e0-41b1-addd-19e7f0382b25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1547 microversion: 2.1 time: 0.154810 Aug 18 21:57:08.377037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 177/350] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:08 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:08.490163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-49ef081d-08f1-4314-a73d-1c3656dd1e6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:08.490695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-49ef081d-08f1-4314-a73d-1c3656dd1e6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:08.496765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49ef081d-08f1-4314-a73d-1c3656dd1e6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:08.497445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49ef081d-08f1-4314-a73d-1c3656dd1e6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:08.497955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49ef081d-08f1-4314-a73d-1c3656dd1e6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:08.498666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49ef081d-08f1-4314-a73d-1c3656dd1e6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:08.499127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49ef081d-08f1-4314-a73d-1c3656dd1e6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:08.499737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49ef081d-08f1-4314-a73d-1c3656dd1e6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:08.584043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-49ef081d-08f1-4314-a73d-1c3656dd1e6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:08.596430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-49ef081d-08f1-4314-a73d-1c3656dd1e6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1306 microversion: 2.1 time: 0.108888 Aug 18 21:57:08.597728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 174/351] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:08 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1306 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:08.602953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f1d5e76b-4d20-42a8-99e3-4e3e2077825b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:08.603967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f1d5e76b-4d20-42a8-99e3-4e3e2077825b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:08.616772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1d5e76b-4d20-42a8-99e3-4e3e2077825b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:08.617346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1d5e76b-4d20-42a8-99e3-4e3e2077825b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:08.617821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1d5e76b-4d20-42a8-99e3-4e3e2077825b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:08.618664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1d5e76b-4d20-42a8-99e3-4e3e2077825b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:08.619148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1d5e76b-4d20-42a8-99e3-4e3e2077825b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:08.619579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1d5e76b-4d20-42a8-99e3-4e3e2077825b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:08.823043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f1d5e76b-4d20-42a8-99e3-4e3e2077825b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:08.843634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f1d5e76b-4d20-42a8-99e3-4e3e2077825b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.247528 Aug 18 21:57:08.844368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 178/352] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:09.139310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-364ab7a0-8262-4eeb-baa5-21bfcd34635f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:09.139940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-364ab7a0-8262-4eeb-baa5-21bfcd34635f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:09.145975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-364ab7a0-8262-4eeb-baa5-21bfcd34635f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:09.146456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-364ab7a0-8262-4eeb-baa5-21bfcd34635f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:09.146889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-364ab7a0-8262-4eeb-baa5-21bfcd34635f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:09.147588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-364ab7a0-8262-4eeb-baa5-21bfcd34635f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:09.148051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-364ab7a0-8262-4eeb-baa5-21bfcd34635f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:09.148476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-364ab7a0-8262-4eeb-baa5-21bfcd34635f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:09.340551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-364ab7a0-8262-4eeb-baa5-21bfcd34635f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:09.348842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-364ab7a0-8262-4eeb-baa5-21bfcd34635f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:09.350382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-364ab7a0-8262-4eeb-baa5-21bfcd34635f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:09.351534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-364ab7a0-8262-4eeb-baa5-21bfcd34635f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.216055 Aug 18 21:57:09.352095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 175/353] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:09.619806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-84a739bb-5db4-4a85-ab2b-6b24fcbce170 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:09.620427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-84a739bb-5db4-4a85-ab2b-6b24fcbce170 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:09.626552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84a739bb-5db4-4a85-ab2b-6b24fcbce170 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:09.627026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84a739bb-5db4-4a85-ab2b-6b24fcbce170 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:09.627469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84a739bb-5db4-4a85-ab2b-6b24fcbce170 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:09.628169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84a739bb-5db4-4a85-ab2b-6b24fcbce170 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:09.628659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84a739bb-5db4-4a85-ab2b-6b24fcbce170 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:09.629081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84a739bb-5db4-4a85-ab2b-6b24fcbce170 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:09.772590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-84a739bb-5db4-4a85-ab2b-6b24fcbce170 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:09.780429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-84a739bb-5db4-4a85-ab2b-6b24fcbce170 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1371 microversion: 2.1 time: 0.164874 Aug 18 21:57:09.781078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 179/354] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:09 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:09.864481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-74c1279d-6092-418f-baeb-f6e1f025d810 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:09.865711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-74c1279d-6092-418f-baeb-f6e1f025d810 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:09.871820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74c1279d-6092-418f-baeb-f6e1f025d810 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:09.872304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74c1279d-6092-418f-baeb-f6e1f025d810 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:09.872743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74c1279d-6092-418f-baeb-f6e1f025d810 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:09.873489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74c1279d-6092-418f-baeb-f6e1f025d810 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:09.873969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74c1279d-6092-418f-baeb-f6e1f025d810 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:09.874398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74c1279d-6092-418f-baeb-f6e1f025d810 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:10.093445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-74c1279d-6092-418f-baeb-f6e1f025d810 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:10.103739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-74c1279d-6092-418f-baeb-f6e1f025d810 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.243229 Aug 18 21:57:10.104483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 176/355] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:10.109183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69d2ad8e-997b-4834-983a-8a3d67e298f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9793aeb-8666-4b6c-9f30-e26675b395f9"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:10.112409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-69d2ad8e-997b-4834-983a-8a3d67e298f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:10.119058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69d2ad8e-997b-4834-983a-8a3d67e298f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:10.119541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69d2ad8e-997b-4834-983a-8a3d67e298f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:10.119979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69d2ad8e-997b-4834-983a-8a3d67e298f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:10.120848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69d2ad8e-997b-4834-983a-8a3d67e298f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:10.121302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69d2ad8e-997b-4834-983a-8a3d67e298f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:10.121757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69d2ad8e-997b-4834-983a-8a3d67e298f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:10.169969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-fda6aca7-d4df-43f4-865b-544575f75045 req-b0d2bfae-63a2-4fd6-9266-cc348d958bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f260fb-84bc-434c-b885-0a8f54494162", "tag": "859d4e5f-383d-4366-b08c-f0d6c9520205"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:10.182884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-fda6aca7-d4df-43f4-865b-544575f75045 req-b0d2bfae-63a2-4fd6-9266-cc348d958bdc service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:10.183561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-fda6aca7-d4df-43f4-865b-544575f75045 req-b0d2bfae-63a2-4fd6-9266-cc348d958bdc service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:10.184008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-fda6aca7-d4df-43f4-865b-544575f75045 req-b0d2bfae-63a2-4fd6-9266-cc348d958bdc service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:10.196873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-fda6aca7-d4df-43f4-865b-544575f75045 req-b0d2bfae-63a2-4fd6-9266-cc348d958bdc service nova] Creating event network-changed:859d4e5f-383d-4366-b08c-f0d6c9520205 for instance c3f260fb-84bc-434c-b885-0a8f54494162 on hv-cinder-85367 Aug 18 21:57:10.203508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-fda6aca7-d4df-43f4-865b-544575f75045 req-b0d2bfae-63a2-4fd6-9266-cc348d958bdc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036488 Aug 18 21:57:10.204530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 177/356] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:57:10.384997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b9fa70a2-80fc-42c8-afe8-ce43310cf39d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:10.386134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b9fa70a2-80fc-42c8-afe8-ce43310cf39d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:10.394491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9fa70a2-80fc-42c8-afe8-ce43310cf39d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:10.395196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9fa70a2-80fc-42c8-afe8-ce43310cf39d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:10.395831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9fa70a2-80fc-42c8-afe8-ce43310cf39d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:10.396666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9fa70a2-80fc-42c8-afe8-ce43310cf39d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:10.397442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9fa70a2-80fc-42c8-afe8-ce43310cf39d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:10.398287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9fa70a2-80fc-42c8-afe8-ce43310cf39d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:10.418343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:10.455363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-69d2ad8e-997b-4834-983a-8a3d67e298f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "POST /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352582 Aug 18 21:57:10.456599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 180/357] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 21:57:10 2022] POST /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:57:10.653678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b9fa70a2-80fc-42c8-afe8-ce43310cf39d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:10.662509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b9fa70a2-80fc-42c8-afe8-ce43310cf39d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:10.664023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b9fa70a2-80fc-42c8-afe8-ce43310cf39d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:10.665178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b9fa70a2-80fc-42c8-afe8-ce43310cf39d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.286461 Aug 18 21:57:10.665772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 178/358] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:10.803714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-49667d1a-40d8-40a4-9460-f7c87562e6ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:10.804352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-49667d1a-40d8-40a4-9460-f7c87562e6ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:10.810840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49667d1a-40d8-40a4-9460-f7c87562e6ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:10.811329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49667d1a-40d8-40a4-9460-f7c87562e6ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:10.811803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49667d1a-40d8-40a4-9460-f7c87562e6ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:10.812506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49667d1a-40d8-40a4-9460-f7c87562e6ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:10.812967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49667d1a-40d8-40a4-9460-f7c87562e6ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:10.813396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49667d1a-40d8-40a4-9460-f7c87562e6ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:10.946274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-49667d1a-40d8-40a4-9460-f7c87562e6ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:10.954018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-49667d1a-40d8-40a4-9460-f7c87562e6ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1371 microversion: 2.1 time: 0.155378 Aug 18 21:57:10.954589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 181/359] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:10 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:11.125156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-99fea3d3-f6e7-4fa3-abd4-5f42caf3316b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:11.125867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-99fea3d3-f6e7-4fa3-abd4-5f42caf3316b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:11.132372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99fea3d3-f6e7-4fa3-abd4-5f42caf3316b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:11.132886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99fea3d3-f6e7-4fa3-abd4-5f42caf3316b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:11.133310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99fea3d3-f6e7-4fa3-abd4-5f42caf3316b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:11.134050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99fea3d3-f6e7-4fa3-abd4-5f42caf3316b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:11.134512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99fea3d3-f6e7-4fa3-abd4-5f42caf3316b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:11.134941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99fea3d3-f6e7-4fa3-abd4-5f42caf3316b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:11.266025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-99fea3d3-f6e7-4fa3-abd4-5f42caf3316b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:11.275104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-99fea3d3-f6e7-4fa3-abd4-5f42caf3316b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.154525 Aug 18 21:57:11.275684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 179/360] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:11.687840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3eab8866-a9af-4786-bd46-9f56e4726b19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:11.688483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3eab8866-a9af-4786-bd46-9f56e4726b19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:11.695835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3eab8866-a9af-4786-bd46-9f56e4726b19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:11.696316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3eab8866-a9af-4786-bd46-9f56e4726b19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:11.696748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3eab8866-a9af-4786-bd46-9f56e4726b19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:11.697437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3eab8866-a9af-4786-bd46-9f56e4726b19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:11.697911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3eab8866-a9af-4786-bd46-9f56e4726b19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:11.698334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3eab8866-a9af-4786-bd46-9f56e4726b19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:11.829414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3eab8866-a9af-4786-bd46-9f56e4726b19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:11.838108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3eab8866-a9af-4786-bd46-9f56e4726b19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:11.839615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3eab8866-a9af-4786-bd46-9f56e4726b19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:11.840756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3eab8866-a9af-4786-bd46-9f56e4726b19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.156849 Aug 18 21:57:11.841322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 182/361] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:11.975576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-55e0685f-55f8-4135-ad7b-41aa5deafc21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:11.976204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-55e0685f-55f8-4135-ad7b-41aa5deafc21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:11.982292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55e0685f-55f8-4135-ad7b-41aa5deafc21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:11.982774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55e0685f-55f8-4135-ad7b-41aa5deafc21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:11.983214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55e0685f-55f8-4135-ad7b-41aa5deafc21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:11.983933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55e0685f-55f8-4135-ad7b-41aa5deafc21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:11.984389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55e0685f-55f8-4135-ad7b-41aa5deafc21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:11.984817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55e0685f-55f8-4135-ad7b-41aa5deafc21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:12.126407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-55e0685f-55f8-4135-ad7b-41aa5deafc21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:12.134752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-55e0685f-55f8-4135-ad7b-41aa5deafc21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1371 microversion: 2.1 time: 0.162943 Aug 18 21:57:12.135340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 180/362] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:12.297302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ce57b6ba-4154-422f-b552-6baf062a32d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:12.298031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ce57b6ba-4154-422f-b552-6baf062a32d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:12.304962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce57b6ba-4154-422f-b552-6baf062a32d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:12.305516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce57b6ba-4154-422f-b552-6baf062a32d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:12.305985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce57b6ba-4154-422f-b552-6baf062a32d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:12.306667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce57b6ba-4154-422f-b552-6baf062a32d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:12.307116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce57b6ba-4154-422f-b552-6baf062a32d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:12.307534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce57b6ba-4154-422f-b552-6baf062a32d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:12.452462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ce57b6ba-4154-422f-b552-6baf062a32d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:12.461438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ce57b6ba-4154-422f-b552-6baf062a32d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.167888 Aug 18 21:57:12.464197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 183/363] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:12 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:12.863168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-764def3f-364c-4524-a215-47b807980a96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:12.863817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-764def3f-364c-4524-a215-47b807980a96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:12.872273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-764def3f-364c-4524-a215-47b807980a96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:12.872767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-764def3f-364c-4524-a215-47b807980a96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:12.873206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-764def3f-364c-4524-a215-47b807980a96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:12.873945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-764def3f-364c-4524-a215-47b807980a96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:12.874402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-764def3f-364c-4524-a215-47b807980a96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:12.874829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-764def3f-364c-4524-a215-47b807980a96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:13.009816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-764def3f-364c-4524-a215-47b807980a96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:13.017766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-764def3f-364c-4524-a215-47b807980a96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:13.019766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-764def3f-364c-4524-a215-47b807980a96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:13.020903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-764def3f-364c-4524-a215-47b807980a96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.161687 Aug 18 21:57:13.021458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 181/364] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:12 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:13.155642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a826b031-2298-4f78-b833-fc0c9767c9b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:13.156281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a826b031-2298-4f78-b833-fc0c9767c9b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:13.158243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:13.164180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a826b031-2298-4f78-b833-fc0c9767c9b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:13.164663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a826b031-2298-4f78-b833-fc0c9767c9b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:13.165096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a826b031-2298-4f78-b833-fc0c9767c9b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:13.165820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a826b031-2298-4f78-b833-fc0c9767c9b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:13.166275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a826b031-2298-4f78-b833-fc0c9767c9b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:13.166699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a826b031-2298-4f78-b833-fc0c9767c9b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:13.296004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a826b031-2298-4f78-b833-fc0c9767c9b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:13.304059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a826b031-2298-4f78-b833-fc0c9767c9b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1371 microversion: 2.1 time: 0.152294 Aug 18 21:57:13.304636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 184/365] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:13.483082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-11edefcd-93e3-46b5-980c-92449d9c94e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:13.483721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-11edefcd-93e3-46b5-980c-92449d9c94e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:13.489785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11edefcd-93e3-46b5-980c-92449d9c94e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:13.490266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11edefcd-93e3-46b5-980c-92449d9c94e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:13.490695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11edefcd-93e3-46b5-980c-92449d9c94e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:13.491382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11edefcd-93e3-46b5-980c-92449d9c94e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:13.491833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11edefcd-93e3-46b5-980c-92449d9c94e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:13.492255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11edefcd-93e3-46b5-980c-92449d9c94e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:13.618850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-11edefcd-93e3-46b5-980c-92449d9c94e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:13.627427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-11edefcd-93e3-46b5-980c-92449d9c94e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.148147 Aug 18 21:57:13.627993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 182/366] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:14.044768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26be71b0-e217-46c8-b2ee-9194dc839f8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:14.045385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26be71b0-e217-46c8-b2ee-9194dc839f8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:14.052011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26be71b0-e217-46c8-b2ee-9194dc839f8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:14.052499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26be71b0-e217-46c8-b2ee-9194dc839f8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:14.052934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26be71b0-e217-46c8-b2ee-9194dc839f8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:14.053645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26be71b0-e217-46c8-b2ee-9194dc839f8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:14.054107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26be71b0-e217-46c8-b2ee-9194dc839f8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:14.054536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26be71b0-e217-46c8-b2ee-9194dc839f8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:14.183802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26be71b0-e217-46c8-b2ee-9194dc839f8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:14.191833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26be71b0-e217-46c8-b2ee-9194dc839f8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:14.193433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26be71b0-e217-46c8-b2ee-9194dc839f8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:14.194624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26be71b0-e217-46c8-b2ee-9194dc839f8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.154023 Aug 18 21:57:14.195190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 185/367] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:14.326463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f6c79dd1-0347-4a3c-8e65-b2522e6b037c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:14.327082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f6c79dd1-0347-4a3c-8e65-b2522e6b037c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:14.333488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6c79dd1-0347-4a3c-8e65-b2522e6b037c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:14.334010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6c79dd1-0347-4a3c-8e65-b2522e6b037c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:14.334454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6c79dd1-0347-4a3c-8e65-b2522e6b037c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:14.335289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6c79dd1-0347-4a3c-8e65-b2522e6b037c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:14.336231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6c79dd1-0347-4a3c-8e65-b2522e6b037c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:14.336481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6c79dd1-0347-4a3c-8e65-b2522e6b037c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:14.465250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f6c79dd1-0347-4a3c-8e65-b2522e6b037c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:14.473403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f6c79dd1-0347-4a3c-8e65-b2522e6b037c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1371 microversion: 2.1 time: 0.150789 Aug 18 21:57:14.474350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 183/368] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:14.648638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-89ab8708-cd75-499e-836d-82c1679a4ca1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:14.649247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-89ab8708-cd75-499e-836d-82c1679a4ca1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:14.655643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ab8708-cd75-499e-836d-82c1679a4ca1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:14.656120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ab8708-cd75-499e-836d-82c1679a4ca1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:14.656550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ab8708-cd75-499e-836d-82c1679a4ca1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:14.657232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ab8708-cd75-499e-836d-82c1679a4ca1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:14.657704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ab8708-cd75-499e-836d-82c1679a4ca1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:14.658122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ab8708-cd75-499e-836d-82c1679a4ca1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:14.797622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-89ab8708-cd75-499e-836d-82c1679a4ca1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:14.805869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-89ab8708-cd75-499e-836d-82c1679a4ca1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.161039 Aug 18 21:57:14.806785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 186/369] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:15.217397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4d51cff3-c540-459c-b5d0-fe8294980535 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:15.218018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4d51cff3-c540-459c-b5d0-fe8294980535 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:15.223913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d51cff3-c540-459c-b5d0-fe8294980535 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:15.224392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d51cff3-c540-459c-b5d0-fe8294980535 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:15.224864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d51cff3-c540-459c-b5d0-fe8294980535 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:15.225681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d51cff3-c540-459c-b5d0-fe8294980535 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:15.226128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d51cff3-c540-459c-b5d0-fe8294980535 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:15.226549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d51cff3-c540-459c-b5d0-fe8294980535 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:15.365825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4d51cff3-c540-459c-b5d0-fe8294980535 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:15.371883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4d51cff3-c540-459c-b5d0-fe8294980535 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:15.373388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4d51cff3-c540-459c-b5d0-fe8294980535 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:15.374564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4d51cff3-c540-459c-b5d0-fe8294980535 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.161068 Aug 18 21:57:15.375139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 184/370] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:15.494947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e6877f97-8fcd-4f52-adbd-ae35106ee837 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:15.495484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e6877f97-8fcd-4f52-adbd-ae35106ee837 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:15.501632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6877f97-8fcd-4f52-adbd-ae35106ee837 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:15.502134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6877f97-8fcd-4f52-adbd-ae35106ee837 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:15.502586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6877f97-8fcd-4f52-adbd-ae35106ee837 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:15.503286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6877f97-8fcd-4f52-adbd-ae35106ee837 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:15.503775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6877f97-8fcd-4f52-adbd-ae35106ee837 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:15.504204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6877f97-8fcd-4f52-adbd-ae35106ee837 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:15.630868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e6877f97-8fcd-4f52-adbd-ae35106ee837 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:15.638409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e6877f97-8fcd-4f52-adbd-ae35106ee837 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1371 microversion: 2.1 time: 0.147429 Aug 18 21:57:15.638987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 187/371] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:15 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:15.827792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5d2d4207-2c69-4d0b-821c-9c1ae1b78a40 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:15.828407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5d2d4207-2c69-4d0b-821c-9c1ae1b78a40 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:15.834954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d2d4207-2c69-4d0b-821c-9c1ae1b78a40 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:15.835439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d2d4207-2c69-4d0b-821c-9c1ae1b78a40 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:15.835876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d2d4207-2c69-4d0b-821c-9c1ae1b78a40 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:15.836564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d2d4207-2c69-4d0b-821c-9c1ae1b78a40 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:15.837023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d2d4207-2c69-4d0b-821c-9c1ae1b78a40 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:15.837450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d2d4207-2c69-4d0b-821c-9c1ae1b78a40 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:15.964325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5d2d4207-2c69-4d0b-821c-9c1ae1b78a40 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:15.973238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5d2d4207-2c69-4d0b-821c-9c1ae1b78a40 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.149240 Aug 18 21:57:15.973858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 185/372] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:15 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:16.398291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae77e8a9-80b5-45a7-aed7-cbc5a15eba5e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:16.398928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ae77e8a9-80b5-45a7-aed7-cbc5a15eba5e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:16.405886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae77e8a9-80b5-45a7-aed7-cbc5a15eba5e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:16.406445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae77e8a9-80b5-45a7-aed7-cbc5a15eba5e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:16.406812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae77e8a9-80b5-45a7-aed7-cbc5a15eba5e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:16.407508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae77e8a9-80b5-45a7-aed7-cbc5a15eba5e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:16.407958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae77e8a9-80b5-45a7-aed7-cbc5a15eba5e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:16.408387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae77e8a9-80b5-45a7-aed7-cbc5a15eba5e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:16.538021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ae77e8a9-80b5-45a7-aed7-cbc5a15eba5e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:16.547239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ae77e8a9-80b5-45a7-aed7-cbc5a15eba5e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:16.548754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ae77e8a9-80b5-45a7-aed7-cbc5a15eba5e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:16.549944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ae77e8a9-80b5-45a7-aed7-cbc5a15eba5e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1723 microversion: 2.20 time: 0.156596 Aug 18 21:57:16.551003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 188/373] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:16.658931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-932e8b35-96a8-46e4-900c-9c005b66e1a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:16.659485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-932e8b35-96a8-46e4-900c-9c005b66e1a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:16.665502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-932e8b35-96a8-46e4-900c-9c005b66e1a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:16.666025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-932e8b35-96a8-46e4-900c-9c005b66e1a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:16.666468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-932e8b35-96a8-46e4-900c-9c005b66e1a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:16.667167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-932e8b35-96a8-46e4-900c-9c005b66e1a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:16.667881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-932e8b35-96a8-46e4-900c-9c005b66e1a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:16.668312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-932e8b35-96a8-46e4-900c-9c005b66e1a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:16.802202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-932e8b35-96a8-46e4-900c-9c005b66e1a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:16.809899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-932e8b35-96a8-46e4-900c-9c005b66e1a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1371 microversion: 2.1 time: 0.154770 Aug 18 21:57:16.810495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 186/374] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:16 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:16.870833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-736560c2-0dd3-4b27-a320-91bf93bb5f33 req-4fe3f0d8-f419-42ee-a243-f20bb0b971df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3f260fb-84bc-434c-b885-0a8f54494162", "name": "network-vif-plugged", "status": "completed", "tag": "859d4e5f-383d-4366-b08c-f0d6c9520205"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:16.882066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-736560c2-0dd3-4b27-a320-91bf93bb5f33 req-4fe3f0d8-f419-42ee-a243-f20bb0b971df service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:16.882555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-736560c2-0dd3-4b27-a320-91bf93bb5f33 req-4fe3f0d8-f419-42ee-a243-f20bb0b971df service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:16.882988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-736560c2-0dd3-4b27-a320-91bf93bb5f33 req-4fe3f0d8-f419-42ee-a243-f20bb0b971df service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:16.894464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-736560c2-0dd3-4b27-a320-91bf93bb5f33 req-4fe3f0d8-f419-42ee-a243-f20bb0b971df service nova] Creating event network-vif-plugged:859d4e5f-383d-4366-b08c-f0d6c9520205 for instance c3f260fb-84bc-434c-b885-0a8f54494162 on hv-cinder-85367 Aug 18 21:57:16.899351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-736560c2-0dd3-4b27-a320-91bf93bb5f33 req-4fe3f0d8-f419-42ee-a243-f20bb0b971df service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032904 Aug 18 21:57:16.899952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 189/375] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:57:16.995000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d4eb302c-474e-48c6-b0c4-8f1a80d45554 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:16.995615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d4eb302c-474e-48c6-b0c4-8f1a80d45554 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:17.001899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4eb302c-474e-48c6-b0c4-8f1a80d45554 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:17.002687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4eb302c-474e-48c6-b0c4-8f1a80d45554 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:17.003130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4eb302c-474e-48c6-b0c4-8f1a80d45554 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:17.003837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4eb302c-474e-48c6-b0c4-8f1a80d45554 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:17.004302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4eb302c-474e-48c6-b0c4-8f1a80d45554 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:17.004733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4eb302c-474e-48c6-b0c4-8f1a80d45554 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:17.160284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d4eb302c-474e-48c6-b0c4-8f1a80d45554 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:17.168696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d4eb302c-474e-48c6-b0c4-8f1a80d45554 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.177561 Aug 18 21:57:17.169266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 187/376] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:17.570705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:17.574877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-116df93c-0fa6-4b01-b4d9-6b387db36c29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:17.575567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-116df93c-0fa6-4b01-b4d9-6b387db36c29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:17.582355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-116df93c-0fa6-4b01-b4d9-6b387db36c29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:17.582833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-116df93c-0fa6-4b01-b4d9-6b387db36c29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:17.583321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-116df93c-0fa6-4b01-b4d9-6b387db36c29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:17.583949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-116df93c-0fa6-4b01-b4d9-6b387db36c29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:17.584392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-116df93c-0fa6-4b01-b4d9-6b387db36c29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:17.584811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-116df93c-0fa6-4b01-b4d9-6b387db36c29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:17.715081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-116df93c-0fa6-4b01-b4d9-6b387db36c29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:17.723285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-116df93c-0fa6-4b01-b4d9-6b387db36c29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:17.724778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-116df93c-0fa6-4b01-b4d9-6b387db36c29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:17.725943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-116df93c-0fa6-4b01-b4d9-6b387db36c29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1744 microversion: 2.20 time: 0.156669 Aug 18 21:57:17.726495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 190/377] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:17.830447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c19dd11d-c2d4-47ed-b1a2-2bf70f2e9074 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:17.831069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c19dd11d-c2d4-47ed-b1a2-2bf70f2e9074 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:17.834645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:17.840428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c19dd11d-c2d4-47ed-b1a2-2bf70f2e9074 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:17.840920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c19dd11d-c2d4-47ed-b1a2-2bf70f2e9074 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:17.841371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c19dd11d-c2d4-47ed-b1a2-2bf70f2e9074 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:17.842097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c19dd11d-c2d4-47ed-b1a2-2bf70f2e9074 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:17.842553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c19dd11d-c2d4-47ed-b1a2-2bf70f2e9074 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:17.842976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c19dd11d-c2d4-47ed-b1a2-2bf70f2e9074 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:17.970595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c19dd11d-c2d4-47ed-b1a2-2bf70f2e9074 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:17.978305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c19dd11d-c2d4-47ed-b1a2-2bf70f2e9074 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1371 microversion: 2.1 time: 0.151745 Aug 18 21:57:17.978881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 188/378] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:17 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:18.190338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-112c0e59-1d01-49a2-9021-46f602512d89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:18.191602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-112c0e59-1d01-49a2-9021-46f602512d89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:18.197736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-112c0e59-1d01-49a2-9021-46f602512d89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:18.198227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-112c0e59-1d01-49a2-9021-46f602512d89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:18.198675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-112c0e59-1d01-49a2-9021-46f602512d89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:18.199361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-112c0e59-1d01-49a2-9021-46f602512d89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:18.199823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-112c0e59-1d01-49a2-9021-46f602512d89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:18.200253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-112c0e59-1d01-49a2-9021-46f602512d89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:18.330981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-112c0e59-1d01-49a2-9021-46f602512d89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:18.340260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-112c0e59-1d01-49a2-9021-46f602512d89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.153827 Aug 18 21:57:18.341020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 191/379] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:18 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:18.749972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-47cc1c80-75fe-41df-a6a7-5db5141623df tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:18.750502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-47cc1c80-75fe-41df-a6a7-5db5141623df tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:18.752591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:18.758682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47cc1c80-75fe-41df-a6a7-5db5141623df tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:18.758883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47cc1c80-75fe-41df-a6a7-5db5141623df tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:18.759206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47cc1c80-75fe-41df-a6a7-5db5141623df tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:18.759899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47cc1c80-75fe-41df-a6a7-5db5141623df tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:18.760347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47cc1c80-75fe-41df-a6a7-5db5141623df tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:18.760765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47cc1c80-75fe-41df-a6a7-5db5141623df tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:18.889755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-47cc1c80-75fe-41df-a6a7-5db5141623df tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:18.894331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:18.900278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-47cc1c80-75fe-41df-a6a7-5db5141623df tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:18.901886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-47cc1c80-75fe-41df-a6a7-5db5141623df tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:18.903143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-47cc1c80-75fe-41df-a6a7-5db5141623df tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1744 microversion: 2.20 time: 0.157289 Aug 18 21:57:18.903608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 189/380] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:18 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:18.999267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-43253d64-3323-4046-887d-55fd653e3f27 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:18.999893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-43253d64-3323-4046-887d-55fd653e3f27 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:19.006525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43253d64-3323-4046-887d-55fd653e3f27 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:19.007008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43253d64-3323-4046-887d-55fd653e3f27 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:19.007439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43253d64-3323-4046-887d-55fd653e3f27 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:19.008132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43253d64-3323-4046-887d-55fd653e3f27 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:19.008582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43253d64-3323-4046-887d-55fd653e3f27 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:19.009002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43253d64-3323-4046-887d-55fd653e3f27 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:19.146316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-43253d64-3323-4046-887d-55fd653e3f27 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:19.156147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-43253d64-3323-4046-887d-55fd653e3f27 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1371 microversion: 2.1 time: 0.160603 Aug 18 21:57:19.156740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 192/381] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:18 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:19.363557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-de80ce31-d440-4504-aff5-eeb8676e7f03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:19.364444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-de80ce31-d440-4504-aff5-eeb8676e7f03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:19.370885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de80ce31-d440-4504-aff5-eeb8676e7f03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:19.371542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de80ce31-d440-4504-aff5-eeb8676e7f03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:19.372001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de80ce31-d440-4504-aff5-eeb8676e7f03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:19.372889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de80ce31-d440-4504-aff5-eeb8676e7f03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:19.373511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de80ce31-d440-4504-aff5-eeb8676e7f03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:19.373964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de80ce31-d440-4504-aff5-eeb8676e7f03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:19.509085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-de80ce31-d440-4504-aff5-eeb8676e7f03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:19.517218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-de80ce31-d440-4504-aff5-eeb8676e7f03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.159492 Aug 18 21:57:19.517812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 190/382] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:19 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:19.589058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a096ce8a-33d7-40c0-a942-592c0e7c68fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49359745-d205-4b46-9b13-2fd8f9eb1483", "device": "/dev/sdb"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:19.591991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a096ce8a-33d7-40c0-a942-592c0e7c68fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:19.598578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a096ce8a-33d7-40c0-a942-592c0e7c68fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:19.599075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a096ce8a-33d7-40c0-a942-592c0e7c68fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:19.599521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a096ce8a-33d7-40c0-a942-592c0e7c68fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:19.600218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a096ce8a-33d7-40c0-a942-592c0e7c68fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:19.600677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a096ce8a-33d7-40c0-a942-592c0e7c68fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:19.601106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a096ce8a-33d7-40c0-a942-592c0e7c68fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:19.925722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d864fb85-eecf-432d-81d9-53063a4745c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:19.926262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d864fb85-eecf-432d-81d9-53063a4745c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:19.932260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d864fb85-eecf-432d-81d9-53063a4745c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:19.932747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d864fb85-eecf-432d-81d9-53063a4745c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:19.933187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d864fb85-eecf-432d-81d9-53063a4745c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:19.933911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d864fb85-eecf-432d-81d9-53063a4745c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:19.934374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d864fb85-eecf-432d-81d9-53063a4745c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:19.934803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d864fb85-eecf-432d-81d9-53063a4745c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:20.061170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d864fb85-eecf-432d-81d9-53063a4745c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:20.069783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d864fb85-eecf-432d-81d9-53063a4745c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:20.071292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d864fb85-eecf-432d-81d9-53063a4745c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:20.072450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d864fb85-eecf-432d-81d9-53063a4745c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1744 microversion: 2.20 time: 0.150799 Aug 18 21:57:20.073006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 191/383] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:57:20.175950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b3c4f387-1c36-4ab4-9d6d-3c796bf534e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:20.176500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b3c4f387-1c36-4ab4-9d6d-3c796bf534e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:20.182355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3c4f387-1c36-4ab4-9d6d-3c796bf534e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:20.182832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3c4f387-1c36-4ab4-9d6d-3c796bf534e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:20.183268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3c4f387-1c36-4ab4-9d6d-3c796bf534e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:20.183948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3c4f387-1c36-4ab4-9d6d-3c796bf534e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:20.184397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3c4f387-1c36-4ab4-9d6d-3c796bf534e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:20.184819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3c4f387-1c36-4ab4-9d6d-3c796bf534e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:20.317373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b3c4f387-1c36-4ab4-9d6d-3c796bf534e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:20.325434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b3c4f387-1c36-4ab4-9d6d-3c796bf534e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1593 microversion: 2.1 time: 0.153343 Aug 18 21:57:20.326026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 192/384] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:20 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1593 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:20.330278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3ed0a72f-32ed-4631-9c7f-bfed1d3f666e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:20.330881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3ed0a72f-32ed-4631-9c7f-bfed1d3f666e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:20.337259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ed0a72f-32ed-4631-9c7f-bfed1d3f666e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:20.337691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ed0a72f-32ed-4631-9c7f-bfed1d3f666e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:20.338224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ed0a72f-32ed-4631-9c7f-bfed1d3f666e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:20.338784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ed0a72f-32ed-4631-9c7f-bfed1d3f666e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:20.339318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ed0a72f-32ed-4631-9c7f-bfed1d3f666e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:20.339720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ed0a72f-32ed-4631-9c7f-bfed1d3f666e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:20.502955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3ed0a72f-32ed-4631-9c7f-bfed1d3f666e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:20.511940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3ed0a72f-32ed-4631-9c7f-bfed1d3f666e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1371 microversion: 2.1 time: 0.184929 Aug 18 21:57:20.512596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 193/385] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:20.539315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-77255c68-a7d9-4461-9169-a414a80f2f36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:20.540088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-77255c68-a7d9-4461-9169-a414a80f2f36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:20.546926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77255c68-a7d9-4461-9169-a414a80f2f36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:20.547772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77255c68-a7d9-4461-9169-a414a80f2f36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:20.548231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77255c68-a7d9-4461-9169-a414a80f2f36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:20.548999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77255c68-a7d9-4461-9169-a414a80f2f36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:20.549454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77255c68-a7d9-4461-9169-a414a80f2f36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:20.549958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77255c68-a7d9-4461-9169-a414a80f2f36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:20.556011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a096ce8a-33d7-40c0-a942-592c0e7c68fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "POST /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.970655 Aug 18 21:57:20.556778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 193/386] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 21:57:19 2022] POST /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357/os-volume_attachments => generated 194 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:57:20.790573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-77255c68-a7d9-4461-9169-a414a80f2f36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:20.800906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-77255c68-a7d9-4461-9169-a414a80f2f36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.265225 Aug 18 21:57:20.802277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 194/387] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:20 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:20.888983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-1377ac7e-853d-4867-af9c-a7d1e00a8c96 req-4b160bd0-0a7e-4171-89ba-609d7d6de70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0426bb7b-e862-4873-9c1e-7878b89cde47", "name": "network-vif-plugged", "status": "completed", "tag": "a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:20.899418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1377ac7e-853d-4867-af9c-a7d1e00a8c96 req-4b160bd0-0a7e-4171-89ba-609d7d6de70c service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:20.900340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1377ac7e-853d-4867-af9c-a7d1e00a8c96 req-4b160bd0-0a7e-4171-89ba-609d7d6de70c service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:20.900831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1377ac7e-853d-4867-af9c-a7d1e00a8c96 req-4b160bd0-0a7e-4171-89ba-609d7d6de70c service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:20.913257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-1377ac7e-853d-4867-af9c-a7d1e00a8c96 req-4b160bd0-0a7e-4171-89ba-609d7d6de70c service nova] Creating event network-vif-plugged:a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b for instance 0426bb7b-e862-4873-9c1e-7878b89cde47 on hv-cinder-85367 Aug 18 21:57:20.918834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-1377ac7e-853d-4867-af9c-a7d1e00a8c96 req-4b160bd0-0a7e-4171-89ba-609d7d6de70c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034220 Aug 18 21:57:20.920002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 194/388] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:57:21.095703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-94069e4b-3618-4f0e-9253-e74a8090590f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:21.096395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-94069e4b-3618-4f0e-9253-e74a8090590f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:21.105456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94069e4b-3618-4f0e-9253-e74a8090590f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:21.106161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94069e4b-3618-4f0e-9253-e74a8090590f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:21.106686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94069e4b-3618-4f0e-9253-e74a8090590f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:21.107374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94069e4b-3618-4f0e-9253-e74a8090590f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:21.107824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94069e4b-3618-4f0e-9253-e74a8090590f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:21.108248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94069e4b-3618-4f0e-9253-e74a8090590f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:21.342732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-94069e4b-3618-4f0e-9253-e74a8090590f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:21.351563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-94069e4b-3618-4f0e-9253-e74a8090590f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:21.353154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-94069e4b-3618-4f0e-9253-e74a8090590f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:21.354349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-94069e4b-3618-4f0e-9253-e74a8090590f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1744 microversion: 2.20 time: 0.262740 Aug 18 21:57:21.354926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 195/389] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1744 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:21.538634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d512c7ca-1a61-49d0-90b0-62cdfd906657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:21.539983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d512c7ca-1a61-49d0-90b0-62cdfd906657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:21.551494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d512c7ca-1a61-49d0-90b0-62cdfd906657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:21.552049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d512c7ca-1a61-49d0-90b0-62cdfd906657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:21.552780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d512c7ca-1a61-49d0-90b0-62cdfd906657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:21.553801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d512c7ca-1a61-49d0-90b0-62cdfd906657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:21.554559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d512c7ca-1a61-49d0-90b0-62cdfd906657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:21.554987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d512c7ca-1a61-49d0-90b0-62cdfd906657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:21.750378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d512c7ca-1a61-49d0-90b0-62cdfd906657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:21.758895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d512c7ca-1a61-49d0-90b0-62cdfd906657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1566 microversion: 2.1 time: 0.227927 Aug 18 21:57:21.759481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 195/390] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:21.781091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7b2fe245-89fc-435b-8827-69f0a3749ad4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:21.782057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7b2fe245-89fc-435b-8827-69f0a3749ad4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:21.797049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b2fe245-89fc-435b-8827-69f0a3749ad4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:21.797652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b2fe245-89fc-435b-8827-69f0a3749ad4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:21.798273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b2fe245-89fc-435b-8827-69f0a3749ad4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:21.799190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b2fe245-89fc-435b-8827-69f0a3749ad4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:21.800896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b2fe245-89fc-435b-8827-69f0a3749ad4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:21.801488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b2fe245-89fc-435b-8827-69f0a3749ad4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:21.824204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-25a2a7b3-c6ba-4272-a11d-eb2d27c94151 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:21.824853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-25a2a7b3-c6ba-4272-a11d-eb2d27c94151 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:21.832429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25a2a7b3-c6ba-4272-a11d-eb2d27c94151 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:21.833274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25a2a7b3-c6ba-4272-a11d-eb2d27c94151 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:21.833921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25a2a7b3-c6ba-4272-a11d-eb2d27c94151 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:21.834974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25a2a7b3-c6ba-4272-a11d-eb2d27c94151 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:21.835471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25a2a7b3-c6ba-4272-a11d-eb2d27c94151 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:21.835904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25a2a7b3-c6ba-4272-a11d-eb2d27c94151 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:21.936169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7b2fe245-89fc-435b-8827-69f0a3749ad4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.160543 Aug 18 21:57:21.937098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 196/391] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 21:57:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-interface => generated 285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:57:22.098285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-25a2a7b3-c6ba-4272-a11d-eb2d27c94151 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:22.108136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-25a2a7b3-c6ba-4272-a11d-eb2d27c94151 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.287869 Aug 18 21:57:22.129308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 196/392] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:22.379662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f8727408-7dbc-4828-abc1-d0b633566ae5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:22.380378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f8727408-7dbc-4828-abc1-d0b633566ae5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:22.387870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8727408-7dbc-4828-abc1-d0b633566ae5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:22.388362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8727408-7dbc-4828-abc1-d0b633566ae5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:22.388803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8727408-7dbc-4828-abc1-d0b633566ae5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:22.389512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8727408-7dbc-4828-abc1-d0b633566ae5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:22.389991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8727408-7dbc-4828-abc1-d0b633566ae5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:22.390417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8727408-7dbc-4828-abc1-d0b633566ae5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:22.954008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8727408-7dbc-4828-abc1-d0b633566ae5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:22.966653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8727408-7dbc-4828-abc1-d0b633566ae5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:22.968605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8727408-7dbc-4828-abc1-d0b633566ae5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:22.970031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f8727408-7dbc-4828-abc1-d0b633566ae5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1739 microversion: 2.20 time: 0.596911 Aug 18 21:57:22.971113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 197/393] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1739 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:23.085694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-1061d27b-6318-4ecc-91bf-5234d770f810 req-385407d6-64af-49f4-bfa2-e65d86c35401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b11b63-0232-4f27-bacb-2e3872f6ae18", "tag": "98ccabc6-a7d1-4192-af56-2e746060a479"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:23.106953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1061d27b-6318-4ecc-91bf-5234d770f810 req-385407d6-64af-49f4-bfa2-e65d86c35401 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:23.108590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1061d27b-6318-4ecc-91bf-5234d770f810 req-385407d6-64af-49f4-bfa2-e65d86c35401 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:23.109052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1061d27b-6318-4ecc-91bf-5234d770f810 req-385407d6-64af-49f4-bfa2-e65d86c35401 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:23.136628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:23.147050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-1061d27b-6318-4ecc-91bf-5234d770f810 req-385407d6-64af-49f4-bfa2-e65d86c35401 service nova] Creating event network-changed:98ccabc6-a7d1-4192-af56-2e746060a479 for instance e7b11b63-0232-4f27-bacb-2e3872f6ae18 on hv-cinder-85367 Aug 18 21:57:23.147646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5bb9782e-84e1-460d-a2a0-47daec441277 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:23.148833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5bb9782e-84e1-460d-a2a0-47daec441277 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:23.158998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-1061d27b-6318-4ecc-91bf-5234d770f810 req-385407d6-64af-49f4-bfa2-e65d86c35401 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077219 Aug 18 21:57:23.161565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 197/394] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:57:23.166999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bb9782e-84e1-460d-a2a0-47daec441277 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:23.169415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bb9782e-84e1-460d-a2a0-47daec441277 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:23.171489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bb9782e-84e1-460d-a2a0-47daec441277 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:23.173312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bb9782e-84e1-460d-a2a0-47daec441277 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:23.175434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bb9782e-84e1-460d-a2a0-47daec441277 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:23.178757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bb9782e-84e1-460d-a2a0-47daec441277 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:23.507996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5bb9782e-84e1-460d-a2a0-47daec441277 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:23.532217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5bb9782e-84e1-460d-a2a0-47daec441277 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.391299 Aug 18 21:57:23.534018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 198/395] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:23 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:23.536620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-cc8e71d3-5dda-4e41-a7e2-f71ef9705804 req-f83d304c-b444-4902-841d-4a0e1c7d491b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f260fb-84bc-434c-b885-0a8f54494162", "tag": "859d4e5f-383d-4366-b08c-f0d6c9520205"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:23.595882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cc8e71d3-5dda-4e41-a7e2-f71ef9705804 req-f83d304c-b444-4902-841d-4a0e1c7d491b service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:23.599930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cc8e71d3-5dda-4e41-a7e2-f71ef9705804 req-f83d304c-b444-4902-841d-4a0e1c7d491b service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:23.601891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cc8e71d3-5dda-4e41-a7e2-f71ef9705804 req-f83d304c-b444-4902-841d-4a0e1c7d491b service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:23.640968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-cc8e71d3-5dda-4e41-a7e2-f71ef9705804 req-f83d304c-b444-4902-841d-4a0e1c7d491b service nova] Creating event network-changed:859d4e5f-383d-4366-b08c-f0d6c9520205 for instance c3f260fb-84bc-434c-b885-0a8f54494162 on hv-cinder-85367 Aug 18 21:57:23.653529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-cc8e71d3-5dda-4e41-a7e2-f71ef9705804 req-f83d304c-b444-4902-841d-4a0e1c7d491b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124734 Aug 18 21:57:23.654948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 198/396] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:57:23.995324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1bd79d37-8450-4e54-969f-ccf5d04593ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:23.996304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1bd79d37-8450-4e54-969f-ccf5d04593ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:24.011163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bd79d37-8450-4e54-969f-ccf5d04593ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:24.012459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bd79d37-8450-4e54-969f-ccf5d04593ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:24.014902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bd79d37-8450-4e54-969f-ccf5d04593ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:24.016054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bd79d37-8450-4e54-969f-ccf5d04593ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:24.019175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bd79d37-8450-4e54-969f-ccf5d04593ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:24.020245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bd79d37-8450-4e54-969f-ccf5d04593ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:24.553824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1bd79d37-8450-4e54-969f-ccf5d04593ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:24.563472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a48f5399-eee9-44d2-97cb-24aa4bbcf64d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:24.565974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a48f5399-eee9-44d2-97cb-24aa4bbcf64d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:24.571258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1bd79d37-8450-4e54-969f-ccf5d04593ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:24.572890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1bd79d37-8450-4e54-969f-ccf5d04593ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:24.579450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1bd79d37-8450-4e54-969f-ccf5d04593ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1739 microversion: 2.20 time: 0.589325 Aug 18 21:57:24.580083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 199/397] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1739 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:24.580554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a48f5399-eee9-44d2-97cb-24aa4bbcf64d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:24.581776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a48f5399-eee9-44d2-97cb-24aa4bbcf64d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:24.583144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a48f5399-eee9-44d2-97cb-24aa4bbcf64d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:24.584769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a48f5399-eee9-44d2-97cb-24aa4bbcf64d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:24.586632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a48f5399-eee9-44d2-97cb-24aa4bbcf64d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:24.587313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a48f5399-eee9-44d2-97cb-24aa4bbcf64d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:24.874986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a48f5399-eee9-44d2-97cb-24aa4bbcf64d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:24.893101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a48f5399-eee9-44d2-97cb-24aa4bbcf64d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.331368 Aug 18 21:57:24.895912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 199/398] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:25.219739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b9d56cfe-6a98-4b7d-93b6-2ed3d0c0e799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1158796106"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:25.220285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b9d56cfe-6a98-4b7d-93b6-2ed3d0c0e799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:25.239077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9d56cfe-6a98-4b7d-93b6-2ed3d0c0e799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:25.239993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9d56cfe-6a98-4b7d-93b6-2ed3d0c0e799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:25.240134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9d56cfe-6a98-4b7d-93b6-2ed3d0c0e799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:25.240759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9d56cfe-6a98-4b7d-93b6-2ed3d0c0e799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:25.241218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9d56cfe-6a98-4b7d-93b6-2ed3d0c0e799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:25.241690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9d56cfe-6a98-4b7d-93b6-2ed3d0c0e799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:25.436420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.network.security_group_api [None req-b9d56cfe-6a98-4b7d-93b6-2ed3d0c0e799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Adding security group 73c6476e-6681-4a00-9083-a5484af3f64a to port 98ccabc6-a7d1-4192-af56-2e746060a479 Aug 18 21:57:25.604107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9bb9ff32-675f-450f-bb80-4da15fa25135 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:25.604881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9bb9ff32-675f-450f-bb80-4da15fa25135 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:25.612976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bb9ff32-675f-450f-bb80-4da15fa25135 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:25.613710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bb9ff32-675f-450f-bb80-4da15fa25135 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:25.614514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bb9ff32-675f-450f-bb80-4da15fa25135 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:25.615792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bb9ff32-675f-450f-bb80-4da15fa25135 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:25.616485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bb9ff32-675f-450f-bb80-4da15fa25135 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:25.617064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bb9ff32-675f-450f-bb80-4da15fa25135 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:25.790753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9bb9ff32-675f-450f-bb80-4da15fa25135 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:25.800590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9bb9ff32-675f-450f-bb80-4da15fa25135 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:25.802583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9bb9ff32-675f-450f-bb80-4da15fa25135 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:25.802793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b9d56cfe-6a98-4b7d-93b6-2ed3d0c0e799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "POST /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/action" status: 202 len: 0 microversion: 2.1 time: 0.586968 Aug 18 21:57:25.803741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 200/399] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 21:57:25 2022] POST /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:57:25.806729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9bb9ff32-675f-450f-bb80-4da15fa25135 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1739 microversion: 2.20 time: 0.206319 Aug 18 21:57:25.811606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-98e38e25-e614-497c-b857-98930c352832 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:25.812445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-98e38e25-e614-497c-b857-98930c352832 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:25.820328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98e38e25-e614-497c-b857-98930c352832 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:25.821124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98e38e25-e614-497c-b857-98930c352832 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:25.821754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98e38e25-e614-497c-b857-98930c352832 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:25.822636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98e38e25-e614-497c-b857-98930c352832 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:25.822987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 200/400] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:25 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:25.823402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98e38e25-e614-497c-b857-98930c352832 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:25.823978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98e38e25-e614-497c-b857-98930c352832 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:25.838934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-1aa9aea1-1561-4b01-aaa0-8a41fc9e1fd2 req-a708ad3b-6e23-41fa-a6db-79ca1d27f854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b11b63-0232-4f27-bacb-2e3872f6ae18", "tag": "98ccabc6-a7d1-4192-af56-2e746060a479"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:25.866670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1aa9aea1-1561-4b01-aaa0-8a41fc9e1fd2 req-a708ad3b-6e23-41fa-a6db-79ca1d27f854 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:25.869013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1aa9aea1-1561-4b01-aaa0-8a41fc9e1fd2 req-a708ad3b-6e23-41fa-a6db-79ca1d27f854 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:25.875171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1aa9aea1-1561-4b01-aaa0-8a41fc9e1fd2 req-a708ad3b-6e23-41fa-a6db-79ca1d27f854 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:25.894228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-1aa9aea1-1561-4b01-aaa0-8a41fc9e1fd2 req-a708ad3b-6e23-41fa-a6db-79ca1d27f854 service nova] Creating event network-changed:98ccabc6-a7d1-4192-af56-2e746060a479 for instance e7b11b63-0232-4f27-bacb-2e3872f6ae18 on hv-cinder-85367 Aug 18 21:57:25.902104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-1aa9aea1-1561-4b01-aaa0-8a41fc9e1fd2 req-a708ad3b-6e23-41fa-a6db-79ca1d27f854 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077395 Aug 18 21:57:25.903824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 201/401] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:57:25.928383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-830ef4cf-c95a-4b1d-b9ae-fbf2c5b8b58a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:25.929854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-830ef4cf-c95a-4b1d-b9ae-fbf2c5b8b58a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:25.942919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-830ef4cf-c95a-4b1d-b9ae-fbf2c5b8b58a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:25.943420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-830ef4cf-c95a-4b1d-b9ae-fbf2c5b8b58a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:25.944288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-830ef4cf-c95a-4b1d-b9ae-fbf2c5b8b58a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:25.944593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-830ef4cf-c95a-4b1d-b9ae-fbf2c5b8b58a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:25.945620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-830ef4cf-c95a-4b1d-b9ae-fbf2c5b8b58a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:25.946304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-830ef4cf-c95a-4b1d-b9ae-fbf2c5b8b58a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:26.214454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-830ef4cf-c95a-4b1d-b9ae-fbf2c5b8b58a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:26.228287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-830ef4cf-c95a-4b1d-b9ae-fbf2c5b8b58a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.307353 Aug 18 21:57:26.248236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 202/402] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:26.258596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-98e38e25-e614-497c-b857-98930c352832 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:26.276332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-98e38e25-e614-497c-b857-98930c352832 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1759 microversion: 2.1 time: 0.468690 Aug 18 21:57:26.277173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 201/403] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:25 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1759 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:26.844405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b375e6ca-ea5a-4f58-8c36-0093eb398b23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:26.845713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b375e6ca-ea5a-4f58-8c36-0093eb398b23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:26.853268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b375e6ca-ea5a-4f58-8c36-0093eb398b23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:26.853830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b375e6ca-ea5a-4f58-8c36-0093eb398b23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:26.854271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b375e6ca-ea5a-4f58-8c36-0093eb398b23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:26.855168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b375e6ca-ea5a-4f58-8c36-0093eb398b23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:26.855789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b375e6ca-ea5a-4f58-8c36-0093eb398b23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:26.856208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b375e6ca-ea5a-4f58-8c36-0093eb398b23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:27.001814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b375e6ca-ea5a-4f58-8c36-0093eb398b23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:27.015964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b375e6ca-ea5a-4f58-8c36-0093eb398b23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:27.020746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b375e6ca-ea5a-4f58-8c36-0093eb398b23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:27.024088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b375e6ca-ea5a-4f58-8c36-0093eb398b23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1739 microversion: 2.20 time: 0.183685 Aug 18 21:57:27.028377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 203/404] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:26 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:27.254617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-64c2ce42-f80f-4c28-8c36-b420979e4cb6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:27.255245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-64c2ce42-f80f-4c28-8c36-b420979e4cb6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:27.261278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c2ce42-f80f-4c28-8c36-b420979e4cb6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:27.261807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c2ce42-f80f-4c28-8c36-b420979e4cb6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:27.262248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c2ce42-f80f-4c28-8c36-b420979e4cb6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:27.263139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c2ce42-f80f-4c28-8c36-b420979e4cb6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:27.263598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c2ce42-f80f-4c28-8c36-b420979e4cb6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:27.264246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c2ce42-f80f-4c28-8c36-b420979e4cb6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:27.414269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-64c2ce42-f80f-4c28-8c36-b420979e4cb6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:27.427243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-64c2ce42-f80f-4c28-8c36-b420979e4cb6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.176501 Aug 18 21:57:27.428403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 202/405] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:28.048925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ba575a1e-d8a4-4126-a184-a0260a42b674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:28.049713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ba575a1e-d8a4-4126-a184-a0260a42b674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:28.062618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba575a1e-d8a4-4126-a184-a0260a42b674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:28.063181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba575a1e-d8a4-4126-a184-a0260a42b674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:28.063630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba575a1e-d8a4-4126-a184-a0260a42b674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:28.064342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba575a1e-d8a4-4126-a184-a0260a42b674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:28.064804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba575a1e-d8a4-4126-a184-a0260a42b674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:28.065230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba575a1e-d8a4-4126-a184-a0260a42b674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:28.218954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ba575a1e-d8a4-4126-a184-a0260a42b674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:28.229694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ba575a1e-d8a4-4126-a184-a0260a42b674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:28.231683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ba575a1e-d8a4-4126-a184-a0260a42b674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:28.232628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ba575a1e-d8a4-4126-a184-a0260a42b674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1739 microversion: 2.20 time: 0.187899 Aug 18 21:57:28.233520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 204/406] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:28.451226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-70a862f1-649b-4f23-9684-0a6d7b71fe8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:28.452661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-70a862f1-649b-4f23-9684-0a6d7b71fe8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:28.460774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70a862f1-649b-4f23-9684-0a6d7b71fe8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:28.461319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70a862f1-649b-4f23-9684-0a6d7b71fe8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:28.461959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70a862f1-649b-4f23-9684-0a6d7b71fe8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:28.462934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70a862f1-649b-4f23-9684-0a6d7b71fe8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:28.463536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70a862f1-649b-4f23-9684-0a6d7b71fe8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:28.464253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70a862f1-649b-4f23-9684-0a6d7b71fe8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:28.652375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-70a862f1-649b-4f23-9684-0a6d7b71fe8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:28.664718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-70a862f1-649b-4f23-9684-0a6d7b71fe8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.217702 Aug 18 21:57:28.665626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 203/407] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:29.258165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-800f91e9-c5c1-47c3-ba39-fd35655c053d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:29.259456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-800f91e9-c5c1-47c3-ba39-fd35655c053d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:29.266532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-800f91e9-c5c1-47c3-ba39-fd35655c053d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:29.267030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-800f91e9-c5c1-47c3-ba39-fd35655c053d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:29.267468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-800f91e9-c5c1-47c3-ba39-fd35655c053d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:29.268187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-800f91e9-c5c1-47c3-ba39-fd35655c053d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:29.268678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-800f91e9-c5c1-47c3-ba39-fd35655c053d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:29.269139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-800f91e9-c5c1-47c3-ba39-fd35655c053d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:29.420342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-800f91e9-c5c1-47c3-ba39-fd35655c053d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:29.429198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-800f91e9-c5c1-47c3-ba39-fd35655c053d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:29.430762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-800f91e9-c5c1-47c3-ba39-fd35655c053d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:29.431905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-800f91e9-c5c1-47c3-ba39-fd35655c053d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1739 microversion: 2.20 time: 0.177678 Aug 18 21:57:29.432466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 205/408] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:29.686199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ef9122b9-cedd-49a6-b1d1-6f2a7b0cac94 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:29.686813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ef9122b9-cedd-49a6-b1d1-6f2a7b0cac94 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:29.694645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef9122b9-cedd-49a6-b1d1-6f2a7b0cac94 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:29.695367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef9122b9-cedd-49a6-b1d1-6f2a7b0cac94 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:29.696165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef9122b9-cedd-49a6-b1d1-6f2a7b0cac94 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:29.697063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef9122b9-cedd-49a6-b1d1-6f2a7b0cac94 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:29.697528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef9122b9-cedd-49a6-b1d1-6f2a7b0cac94 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:29.697988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef9122b9-cedd-49a6-b1d1-6f2a7b0cac94 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:29.835793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ef9122b9-cedd-49a6-b1d1-6f2a7b0cac94 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:29.844594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ef9122b9-cedd-49a6-b1d1-6f2a7b0cac94 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.162309 Aug 18 21:57:29.845180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 204/409] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:29 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:30.455242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ed7ce386-4bf9-48bb-bfb1-33e4947d8ad1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:30.455845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ed7ce386-4bf9-48bb-bfb1-33e4947d8ad1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:30.462489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7ce386-4bf9-48bb-bfb1-33e4947d8ad1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:30.462981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7ce386-4bf9-48bb-bfb1-33e4947d8ad1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:30.463421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7ce386-4bf9-48bb-bfb1-33e4947d8ad1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:30.464128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7ce386-4bf9-48bb-bfb1-33e4947d8ad1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:30.464587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7ce386-4bf9-48bb-bfb1-33e4947d8ad1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:30.465015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7ce386-4bf9-48bb-bfb1-33e4947d8ad1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:30.615572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ed7ce386-4bf9-48bb-bfb1-33e4947d8ad1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:30.625351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ed7ce386-4bf9-48bb-bfb1-33e4947d8ad1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:30.626972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ed7ce386-4bf9-48bb-bfb1-33e4947d8ad1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:30.628886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ed7ce386-4bf9-48bb-bfb1-33e4947d8ad1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1739 microversion: 2.20 time: 0.176721 Aug 18 21:57:30.629543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 206/410] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:57:30.867026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5f57d403-7719-4dc7-a5df-d85ca1ed9631 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:30.868257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5f57d403-7719-4dc7-a5df-d85ca1ed9631 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:30.874657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f57d403-7719-4dc7-a5df-d85ca1ed9631 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:30.875331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f57d403-7719-4dc7-a5df-d85ca1ed9631 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:30.875926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f57d403-7719-4dc7-a5df-d85ca1ed9631 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:30.876787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f57d403-7719-4dc7-a5df-d85ca1ed9631 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:30.877452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f57d403-7719-4dc7-a5df-d85ca1ed9631 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:30.878099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f57d403-7719-4dc7-a5df-d85ca1ed9631 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:31.033020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5f57d403-7719-4dc7-a5df-d85ca1ed9631 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:31.042125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5f57d403-7719-4dc7-a5df-d85ca1ed9631 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1724 microversion: 2.1 time: 0.178877 Aug 18 21:57:31.043260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 205/411] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:31.656268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-05e74f9c-a451-4460-8b2e-e5dd3f3a7db0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:31.656876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-05e74f9c-a451-4460-8b2e-e5dd3f3a7db0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:31.663610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05e74f9c-a451-4460-8b2e-e5dd3f3a7db0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:31.664042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05e74f9c-a451-4460-8b2e-e5dd3f3a7db0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:31.664476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05e74f9c-a451-4460-8b2e-e5dd3f3a7db0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:31.665178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05e74f9c-a451-4460-8b2e-e5dd3f3a7db0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:31.665637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05e74f9c-a451-4460-8b2e-e5dd3f3a7db0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:31.666055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05e74f9c-a451-4460-8b2e-e5dd3f3a7db0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:31.818841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05e74f9c-a451-4460-8b2e-e5dd3f3a7db0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:31.827821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05e74f9c-a451-4460-8b2e-e5dd3f3a7db0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:31.830680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05e74f9c-a451-4460-8b2e-e5dd3f3a7db0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:31.832138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-05e74f9c-a451-4460-8b2e-e5dd3f3a7db0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1739 microversion: 2.20 time: 0.180226 Aug 18 21:57:31.832725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 207/412] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:31 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:32.064403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ab5bb378-ae8d-46a2-be72-c0506de6ed75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:32.065223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ab5bb378-ae8d-46a2-be72-c0506de6ed75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:32.073101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab5bb378-ae8d-46a2-be72-c0506de6ed75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:32.073940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab5bb378-ae8d-46a2-be72-c0506de6ed75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:32.074386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab5bb378-ae8d-46a2-be72-c0506de6ed75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:32.075115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab5bb378-ae8d-46a2-be72-c0506de6ed75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:32.075578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab5bb378-ae8d-46a2-be72-c0506de6ed75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:32.076005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab5bb378-ae8d-46a2-be72-c0506de6ed75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:32.234496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ab5bb378-ae8d-46a2-be72-c0506de6ed75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:32.250011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ab5bb378-ae8d-46a2-be72-c0506de6ed75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1701 microversion: 2.1 time: 0.189371 Aug 18 21:57:32.250895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 206/413] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1701 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:32.273353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-458254d3-7d57-4c1e-809a-fd871e1384e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:32.278554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-458254d3-7d57-4c1e-809a-fd871e1384e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:32.279043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-458254d3-7d57-4c1e-809a-fd871e1384e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:32.279476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-458254d3-7d57-4c1e-809a-fd871e1384e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:32.304210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-458254d3-7d57-4c1e-809a-fd871e1384e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Going to try to start instance {{(pid=120539) start /opt/stack/nova/nova/compute/api.py:2775}} Aug 18 21:57:32.352671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-458254d3-7d57-4c1e-809a-fd871e1384e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "POST /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/action" status: 202 len: 0 microversion: 2.1 time: 0.084361 Aug 18 21:57:32.353633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 208/414] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 21:57:32 2022] POST /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:57:32.363573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a1e345ea-cfbf-4288-9bef-6af328702ca3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:32.365245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a1e345ea-cfbf-4288-9bef-6af328702ca3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:32.379948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:32.383313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1e345ea-cfbf-4288-9bef-6af328702ca3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:32.384363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1e345ea-cfbf-4288-9bef-6af328702ca3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:32.384829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1e345ea-cfbf-4288-9bef-6af328702ca3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:32.386606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1e345ea-cfbf-4288-9bef-6af328702ca3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:32.387621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1e345ea-cfbf-4288-9bef-6af328702ca3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:32.388070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1e345ea-cfbf-4288-9bef-6af328702ca3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:32.394640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:32.632259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a1e345ea-cfbf-4288-9bef-6af328702ca3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:32.648014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a1e345ea-cfbf-4288-9bef-6af328702ca3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1710 microversion: 2.1 time: 0.290270 Aug 18 21:57:32.649391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 207/415] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1710 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:32.855239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b47cfef8-e37b-449b-984f-81537535d6a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:32.856977 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b47cfef8-e37b-449b-984f-81537535d6a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:32.865481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b47cfef8-e37b-449b-984f-81537535d6a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:32.866195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b47cfef8-e37b-449b-984f-81537535d6a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:32.866666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b47cfef8-e37b-449b-984f-81537535d6a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:32.867371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b47cfef8-e37b-449b-984f-81537535d6a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:32.868109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b47cfef8-e37b-449b-984f-81537535d6a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:32.868498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b47cfef8-e37b-449b-984f-81537535d6a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:33.022907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b47cfef8-e37b-449b-984f-81537535d6a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:33.032320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b47cfef8-e37b-449b-984f-81537535d6a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:33.034383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b47cfef8-e37b-449b-984f-81537535d6a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:33.035533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b47cfef8-e37b-449b-984f-81537535d6a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1739 microversion: 2.20 time: 0.184610 Aug 18 21:57:33.036101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 209/416] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:57:33.670046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-10067c41-d429-492e-9d3b-008390cd49e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:33.670690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-10067c41-d429-492e-9d3b-008390cd49e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:33.677301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10067c41-d429-492e-9d3b-008390cd49e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:33.677820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10067c41-d429-492e-9d3b-008390cd49e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:33.678264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10067c41-d429-492e-9d3b-008390cd49e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:33.678955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10067c41-d429-492e-9d3b-008390cd49e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:33.679412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10067c41-d429-492e-9d3b-008390cd49e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:33.679840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10067c41-d429-492e-9d3b-008390cd49e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:33.809897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-10067c41-d429-492e-9d3b-008390cd49e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:33.818875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-10067c41-d429-492e-9d3b-008390cd49e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1710 microversion: 2.1 time: 0.152907 Aug 18 21:57:33.819491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 208/417] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:34.059277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e38b3a3d-139f-4dcd-b601-cbb6f13229b4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:34.059893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e38b3a3d-139f-4dcd-b601-cbb6f13229b4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:34.066335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e38b3a3d-139f-4dcd-b601-cbb6f13229b4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:34.066818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e38b3a3d-139f-4dcd-b601-cbb6f13229b4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:34.067259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e38b3a3d-139f-4dcd-b601-cbb6f13229b4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:34.067947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e38b3a3d-139f-4dcd-b601-cbb6f13229b4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:34.068397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e38b3a3d-139f-4dcd-b601-cbb6f13229b4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:34.068820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e38b3a3d-139f-4dcd-b601-cbb6f13229b4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:34.422836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e38b3a3d-139f-4dcd-b601-cbb6f13229b4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:34.431074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e38b3a3d-139f-4dcd-b601-cbb6f13229b4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:34.432588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e38b3a3d-139f-4dcd-b601-cbb6f13229b4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:34.433806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e38b3a3d-139f-4dcd-b601-cbb6f13229b4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1739 microversion: 2.20 time: 0.378288 Aug 18 21:57:34.434360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 210/418] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1739 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:34.841568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-19fa2b98-72a7-4b9b-ae99-6143164a3023 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:34.842206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-19fa2b98-72a7-4b9b-ae99-6143164a3023 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:34.848271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19fa2b98-72a7-4b9b-ae99-6143164a3023 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:34.849004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19fa2b98-72a7-4b9b-ae99-6143164a3023 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:34.849517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19fa2b98-72a7-4b9b-ae99-6143164a3023 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:34.850233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19fa2b98-72a7-4b9b-ae99-6143164a3023 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:34.850693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19fa2b98-72a7-4b9b-ae99-6143164a3023 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:34.851118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19fa2b98-72a7-4b9b-ae99-6143164a3023 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:34.977604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-19fa2b98-72a7-4b9b-ae99-6143164a3023 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:34.985844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-19fa2b98-72a7-4b9b-ae99-6143164a3023 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1710 microversion: 2.1 time: 0.149170 Aug 18 21:57:34.986411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 209/419] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1710 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:35.456967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3839750b-63cb-4a60-a9b8-07c1908b9b57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:35.457620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3839750b-63cb-4a60-a9b8-07c1908b9b57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:35.464022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3839750b-63cb-4a60-a9b8-07c1908b9b57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:35.464505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3839750b-63cb-4a60-a9b8-07c1908b9b57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:35.464942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3839750b-63cb-4a60-a9b8-07c1908b9b57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:35.465664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3839750b-63cb-4a60-a9b8-07c1908b9b57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:35.466120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3839750b-63cb-4a60-a9b8-07c1908b9b57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:35.466542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3839750b-63cb-4a60-a9b8-07c1908b9b57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:35.592318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3839750b-63cb-4a60-a9b8-07c1908b9b57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:35.600994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3839750b-63cb-4a60-a9b8-07c1908b9b57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:35.602736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3839750b-63cb-4a60-a9b8-07c1908b9b57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:35.603894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3839750b-63cb-4a60-a9b8-07c1908b9b57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1739 microversion: 2.20 time: 0.151437 Aug 18 21:57:35.604460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 211/420] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:36.008328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-24c20ae8-b94b-4762-90a4-1f76455d3bad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:36.008851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-24c20ae8-b94b-4762-90a4-1f76455d3bad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:36.014819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24c20ae8-b94b-4762-90a4-1f76455d3bad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:36.015296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24c20ae8-b94b-4762-90a4-1f76455d3bad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:36.015728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24c20ae8-b94b-4762-90a4-1f76455d3bad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:36.016407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24c20ae8-b94b-4762-90a4-1f76455d3bad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:36.016855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24c20ae8-b94b-4762-90a4-1f76455d3bad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:36.017273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24c20ae8-b94b-4762-90a4-1f76455d3bad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:36.147855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-24c20ae8-b94b-4762-90a4-1f76455d3bad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:36.156005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-24c20ae8-b94b-4762-90a4-1f76455d3bad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1710 microversion: 2.1 time: 0.151631 Aug 18 21:57:36.156577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 210/421] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:36.626777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fbe3e007-3ec0-4931-92a2-36924ab20e7d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:36.627501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fbe3e007-3ec0-4931-92a2-36924ab20e7d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:36.634516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fbe3e007-3ec0-4931-92a2-36924ab20e7d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:36.635260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fbe3e007-3ec0-4931-92a2-36924ab20e7d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:36.635833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fbe3e007-3ec0-4931-92a2-36924ab20e7d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:36.636834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fbe3e007-3ec0-4931-92a2-36924ab20e7d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:36.637356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fbe3e007-3ec0-4931-92a2-36924ab20e7d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:36.637875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fbe3e007-3ec0-4931-92a2-36924ab20e7d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:36.773975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fbe3e007-3ec0-4931-92a2-36924ab20e7d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:36.782054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fbe3e007-3ec0-4931-92a2-36924ab20e7d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:36.783560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fbe3e007-3ec0-4931-92a2-36924ab20e7d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:36.785230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fbe3e007-3ec0-4931-92a2-36924ab20e7d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1721 microversion: 2.20 time: 0.162576 Aug 18 21:57:36.785826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 212/422] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:37.040272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-2530675b-58ca-4dcc-830a-2955d40ec83b req-00d2f551-dc2a-4fd1-9a27-383e130f6c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0426bb7b-e862-4873-9c1e-7878b89cde47", "name": "network-vif-unplugged", "status": "completed", "tag": "a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:37.050321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2530675b-58ca-4dcc-830a-2955d40ec83b req-00d2f551-dc2a-4fd1-9a27-383e130f6c74 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:37.050779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2530675b-58ca-4dcc-830a-2955d40ec83b req-00d2f551-dc2a-4fd1-9a27-383e130f6c74 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:37.051214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-2530675b-58ca-4dcc-830a-2955d40ec83b req-00d2f551-dc2a-4fd1-9a27-383e130f6c74 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:37.062843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-2530675b-58ca-4dcc-830a-2955d40ec83b req-00d2f551-dc2a-4fd1-9a27-383e130f6c74 service nova] Creating event network-vif-unplugged:a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b for instance 0426bb7b-e862-4873-9c1e-7878b89cde47 on hv-cinder-85367 Aug 18 21:57:37.067997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-2530675b-58ca-4dcc-830a-2955d40ec83b req-00d2f551-dc2a-4fd1-9a27-383e130f6c74 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031127 Aug 18 21:57:37.068365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 211/423] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:57:37.176672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1090d12f-985b-4557-9eb3-734521126592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:37.177555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1090d12f-985b-4557-9eb3-734521126592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:37.183410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1090d12f-985b-4557-9eb3-734521126592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:37.183892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1090d12f-985b-4557-9eb3-734521126592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:37.184319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1090d12f-985b-4557-9eb3-734521126592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:37.185002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1090d12f-985b-4557-9eb3-734521126592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:37.185451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1090d12f-985b-4557-9eb3-734521126592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:37.185897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1090d12f-985b-4557-9eb3-734521126592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:37.329778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1090d12f-985b-4557-9eb3-734521126592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:37.340788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1090d12f-985b-4557-9eb3-734521126592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1714 microversion: 2.1 time: 0.167853 Aug 18 21:57:37.341694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 213/424] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:37 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1714 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:37.810150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-47eac9c0-9414-4b76-8684-8eef498b04b3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:37.810862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-47eac9c0-9414-4b76-8684-8eef498b04b3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:37.817971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47eac9c0-9414-4b76-8684-8eef498b04b3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:37.818464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47eac9c0-9414-4b76-8684-8eef498b04b3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:37.818901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47eac9c0-9414-4b76-8684-8eef498b04b3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:37.819611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47eac9c0-9414-4b76-8684-8eef498b04b3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:37.820065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47eac9c0-9414-4b76-8684-8eef498b04b3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:37.820490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47eac9c0-9414-4b76-8684-8eef498b04b3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:37.995603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-47eac9c0-9414-4b76-8684-8eef498b04b3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:38.003702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-47eac9c0-9414-4b76-8684-8eef498b04b3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:38.005205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-47eac9c0-9414-4b76-8684-8eef498b04b3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:38.006383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-47eac9c0-9414-4b76-8684-8eef498b04b3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1721 microversion: 2.20 time: 0.201183 Aug 18 21:57:38.006946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 212/425] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:39.029036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7c4c1291-6d10-4f4c-a589-a47c6e0744a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:39.029678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7c4c1291-6d10-4f4c-a589-a47c6e0744a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:39.036119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c4c1291-6d10-4f4c-a589-a47c6e0744a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:39.036605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c4c1291-6d10-4f4c-a589-a47c6e0744a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:39.037043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c4c1291-6d10-4f4c-a589-a47c6e0744a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:39.037777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c4c1291-6d10-4f4c-a589-a47c6e0744a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:39.038239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c4c1291-6d10-4f4c-a589-a47c6e0744a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:39.038669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c4c1291-6d10-4f4c-a589-a47c6e0744a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:39.169502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7c4c1291-6d10-4f4c-a589-a47c6e0744a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:39.171854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:39.180507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7c4c1291-6d10-4f4c-a589-a47c6e0744a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:39.182076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7c4c1291-6d10-4f4c-a589-a47c6e0744a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:39.183262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7c4c1291-6d10-4f4c-a589-a47c6e0744a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1721 microversion: 2.20 time: 0.158128 Aug 18 21:57:39.183822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 214/426] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:40.208819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ada955fd-c93f-412e-a6b8-306d12f95b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:40.209428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ada955fd-c93f-412e-a6b8-306d12f95b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:40.215487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ada955fd-c93f-412e-a6b8-306d12f95b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:40.215960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ada955fd-c93f-412e-a6b8-306d12f95b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:40.216391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ada955fd-c93f-412e-a6b8-306d12f95b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:40.217096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ada955fd-c93f-412e-a6b8-306d12f95b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:40.217546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ada955fd-c93f-412e-a6b8-306d12f95b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:40.217988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ada955fd-c93f-412e-a6b8-306d12f95b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:40.346688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ada955fd-c93f-412e-a6b8-306d12f95b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:40.354718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ada955fd-c93f-412e-a6b8-306d12f95b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:40.356216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ada955fd-c93f-412e-a6b8-306d12f95b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:40.357351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ada955fd-c93f-412e-a6b8-306d12f95b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1721 microversion: 2.20 time: 0.153017 Aug 18 21:57:40.357961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 213/427] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:41.380992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8a6cedba-32d4-43ed-b0e7-95e6f4135aba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:41.382153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8a6cedba-32d4-43ed-b0e7-95e6f4135aba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:41.391004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a6cedba-32d4-43ed-b0e7-95e6f4135aba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:41.391500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a6cedba-32d4-43ed-b0e7-95e6f4135aba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:41.391951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a6cedba-32d4-43ed-b0e7-95e6f4135aba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:41.393491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a6cedba-32d4-43ed-b0e7-95e6f4135aba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:41.394119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a6cedba-32d4-43ed-b0e7-95e6f4135aba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:41.394548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a6cedba-32d4-43ed-b0e7-95e6f4135aba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:41.543764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8a6cedba-32d4-43ed-b0e7-95e6f4135aba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:41.552483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8a6cedba-32d4-43ed-b0e7-95e6f4135aba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:41.554023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8a6cedba-32d4-43ed-b0e7-95e6f4135aba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:41.555180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8a6cedba-32d4-43ed-b0e7-95e6f4135aba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1721 microversion: 2.20 time: 0.179445 Aug 18 21:57:41.555734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 215/428] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:42.323612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-026efeb4-9e7a-4e80-bff0-94305094f5eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:42.324160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-026efeb4-9e7a-4e80-bff0-94305094f5eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:42.330003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-026efeb4-9e7a-4e80-bff0-94305094f5eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:42.330481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-026efeb4-9e7a-4e80-bff0-94305094f5eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:42.330913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-026efeb4-9e7a-4e80-bff0-94305094f5eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:42.332089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-026efeb4-9e7a-4e80-bff0-94305094f5eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:42.332584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-026efeb4-9e7a-4e80-bff0-94305094f5eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:42.332998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-026efeb4-9e7a-4e80-bff0-94305094f5eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:42.357194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-026efeb4-9e7a-4e80-bff0-94305094f5eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/ips" status: 200 len: 150 microversion: 2.1 time: 0.037333 Aug 18 21:57:42.357788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 214/429] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 21:57:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:57:42.579145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-336c4ffc-02a2-4504-9e67-9a246d1b5dab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:42.579819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-336c4ffc-02a2-4504-9e67-9a246d1b5dab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:42.589804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-336c4ffc-02a2-4504-9e67-9a246d1b5dab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:42.590305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-336c4ffc-02a2-4504-9e67-9a246d1b5dab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:42.590740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-336c4ffc-02a2-4504-9e67-9a246d1b5dab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:42.591474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-336c4ffc-02a2-4504-9e67-9a246d1b5dab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:42.591935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-336c4ffc-02a2-4504-9e67-9a246d1b5dab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:42.592449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-336c4ffc-02a2-4504-9e67-9a246d1b5dab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:42.750239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-336c4ffc-02a2-4504-9e67-9a246d1b5dab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:42.758899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-336c4ffc-02a2-4504-9e67-9a246d1b5dab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:42.760419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-336c4ffc-02a2-4504-9e67-9a246d1b5dab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:42.761569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-336c4ffc-02a2-4504-9e67-9a246d1b5dab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1664 microversion: 2.20 time: 0.187486 Aug 18 21:57:42.762166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 216/430] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1664 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:42.784609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0f10b4bb-13b6-4aba-8296-9bf08adda3f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6581902e-b904-4837-9f75-cfc3e4ccb534"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:42.787074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0f10b4bb-13b6-4aba-8296-9bf08adda3f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:42.793235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f10b4bb-13b6-4aba-8296-9bf08adda3f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:42.793785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f10b4bb-13b6-4aba-8296-9bf08adda3f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:42.794226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f10b4bb-13b6-4aba-8296-9bf08adda3f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:42.794924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f10b4bb-13b6-4aba-8296-9bf08adda3f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:42.795385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f10b4bb-13b6-4aba-8296-9bf08adda3f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:42.795811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f10b4bb-13b6-4aba-8296-9bf08adda3f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:43.090267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0f10b4bb-13b6-4aba-8296-9bf08adda3f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "POST /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.309482 Aug 18 21:57:43.095266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 215/431] 10.222.0.82 () {62 vars in 1364 bytes} [Thu Aug 18 21:57:42 2022] POST /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:57:43.210973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-871dc6bd-c48b-406c-b918-8e0b76d593f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:43.211567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-871dc6bd-c48b-406c-b918-8e0b76d593f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:43.213381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=66 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:43.218713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871dc6bd-c48b-406c-b918-8e0b76d593f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:43.219196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871dc6bd-c48b-406c-b918-8e0b76d593f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:43.219626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871dc6bd-c48b-406c-b918-8e0b76d593f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:43.220313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871dc6bd-c48b-406c-b918-8e0b76d593f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:43.220768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871dc6bd-c48b-406c-b918-8e0b76d593f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:43.221187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871dc6bd-c48b-406c-b918-8e0b76d593f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:43.263115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-871dc6bd-c48b-406c-b918-8e0b76d593f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120539) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 21:57:43.331006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-871dc6bd-c48b-406c-b918-8e0b76d593f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "POST /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/action" status: 202 len: 0 microversion: 2.20 time: 0.123879 Aug 18 21:57:43.331578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 217/432] 10.222.0.82 () {62 vars in 1319 bytes} [Thu Aug 18 21:57:43 2022] POST /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:57:43.340377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-71ea2e41-51e9-49c6-aa41-2b0e08317c84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:43.341167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-71ea2e41-51e9-49c6-aa41-2b0e08317c84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:43.348691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71ea2e41-51e9-49c6-aa41-2b0e08317c84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:43.349168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71ea2e41-51e9-49c6-aa41-2b0e08317c84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:43.349679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71ea2e41-51e9-49c6-aa41-2b0e08317c84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:43.350495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71ea2e41-51e9-49c6-aa41-2b0e08317c84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:43.350984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71ea2e41-51e9-49c6-aa41-2b0e08317c84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:43.351406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71ea2e41-51e9-49c6-aa41-2b0e08317c84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:43.479149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-71ea2e41-51e9-49c6-aa41-2b0e08317c84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:43.488695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-71ea2e41-51e9-49c6-aa41-2b0e08317c84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:43.490266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-71ea2e41-51e9-49c6-aa41-2b0e08317c84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:43.491438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-71ea2e41-51e9-49c6-aa41-2b0e08317c84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1750 microversion: 2.20 time: 0.155380 Aug 18 21:57:43.492001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 216/433] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:43.737857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-abeef03e-8455-41f3-8eeb-d1de6bc5849f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea4c7704-2bc6-471e-be0a-966efb7bbe13"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:43.742983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-abeef03e-8455-41f3-8eeb-d1de6bc5849f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:43.749839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abeef03e-8455-41f3-8eeb-d1de6bc5849f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:43.750327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abeef03e-8455-41f3-8eeb-d1de6bc5849f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:43.750761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abeef03e-8455-41f3-8eeb-d1de6bc5849f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:43.751461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abeef03e-8455-41f3-8eeb-d1de6bc5849f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:43.751915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abeef03e-8455-41f3-8eeb-d1de6bc5849f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:43.752339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abeef03e-8455-41f3-8eeb-d1de6bc5849f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:44.024347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-abeef03e-8455-41f3-8eeb-d1de6bc5849f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "POST /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290519 Aug 18 21:57:44.030027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 218/434] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 21:57:43 2022] POST /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:57:44.514375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ed68846e-ceeb-4475-956d-65c1baaca153 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:44.514979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ed68846e-ceeb-4475-956d-65c1baaca153 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:44.520927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed68846e-ceeb-4475-956d-65c1baaca153 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:44.521401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed68846e-ceeb-4475-956d-65c1baaca153 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:44.521870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed68846e-ceeb-4475-956d-65c1baaca153 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:44.522554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed68846e-ceeb-4475-956d-65c1baaca153 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:44.523000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed68846e-ceeb-4475-956d-65c1baaca153 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:44.523491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed68846e-ceeb-4475-956d-65c1baaca153 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:44.656243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ed68846e-ceeb-4475-956d-65c1baaca153 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:44.664689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ed68846e-ceeb-4475-956d-65c1baaca153 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:44.666731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ed68846e-ceeb-4475-956d-65c1baaca153 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:44.668106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ed68846e-ceeb-4475-956d-65c1baaca153 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1752 microversion: 2.20 time: 0.158155 Aug 18 21:57:44.668671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 217/435] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:44.847603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-28582e5b-fd03-47b2-9fc4-50290fc5a0e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:44.848188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-28582e5b-fd03-47b2-9fc4-50290fc5a0e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:44.854245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28582e5b-fd03-47b2-9fc4-50290fc5a0e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:44.854725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28582e5b-fd03-47b2-9fc4-50290fc5a0e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:44.855157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28582e5b-fd03-47b2-9fc4-50290fc5a0e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:44.855844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28582e5b-fd03-47b2-9fc4-50290fc5a0e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:44.856297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28582e5b-fd03-47b2-9fc4-50290fc5a0e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:44.856721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28582e5b-fd03-47b2-9fc4-50290fc5a0e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:44.982844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-28582e5b-fd03-47b2-9fc4-50290fc5a0e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lazy-loading 'services' on Instance uuid 0aa5355b-48a3-4342-998a-e31be1538357 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:57:45.100325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-28582e5b-fd03-47b2-9fc4-50290fc5a0e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357/os-volume_attachments/49359745-d205-4b46-9b13-2fd8f9eb1483" status: 202 len: 0 microversion: 2.1 time: 0.257769 Aug 18 21:57:45.100876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 219/436] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 21:57:44 2022] DELETE /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357/os-volume_attachments/49359745-d205-4b46-9b13-2fd8f9eb1483 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:57:45.691594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f8947d5b-937c-485c-bcc4-3347e77ad77f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:45.692215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f8947d5b-937c-485c-bcc4-3347e77ad77f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:45.698304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8947d5b-937c-485c-bcc4-3347e77ad77f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:45.698791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8947d5b-937c-485c-bcc4-3347e77ad77f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:45.699562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8947d5b-937c-485c-bcc4-3347e77ad77f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:45.700273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8947d5b-937c-485c-bcc4-3347e77ad77f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:45.700731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8947d5b-937c-485c-bcc4-3347e77ad77f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:45.701161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8947d5b-937c-485c-bcc4-3347e77ad77f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:45.828151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8947d5b-937c-485c-bcc4-3347e77ad77f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:45.836667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8947d5b-937c-485c-bcc4-3347e77ad77f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:45.838206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8947d5b-937c-485c-bcc4-3347e77ad77f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:45.839380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f8947d5b-937c-485c-bcc4-3347e77ad77f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1752 microversion: 2.20 time: 0.152199 Aug 18 21:57:45.839939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 218/437] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:45 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:46.863464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a2fc30d2-d91d-482f-8379-a7d19b03a3d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:46.864419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a2fc30d2-d91d-482f-8379-a7d19b03a3d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:46.871082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2fc30d2-d91d-482f-8379-a7d19b03a3d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:46.871570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2fc30d2-d91d-482f-8379-a7d19b03a3d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:46.872009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2fc30d2-d91d-482f-8379-a7d19b03a3d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:46.872710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2fc30d2-d91d-482f-8379-a7d19b03a3d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:46.873168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2fc30d2-d91d-482f-8379-a7d19b03a3d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:46.873612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2fc30d2-d91d-482f-8379-a7d19b03a3d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:47.003565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a2fc30d2-d91d-482f-8379-a7d19b03a3d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:47.012548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a2fc30d2-d91d-482f-8379-a7d19b03a3d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:47.014057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a2fc30d2-d91d-482f-8379-a7d19b03a3d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:47.015230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a2fc30d2-d91d-482f-8379-a7d19b03a3d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1752 microversion: 2.20 time: 0.156729 Aug 18 21:57:47.015790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 220/438] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:46 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:48.038579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-413651c1-3a54-4e06-ba49-659dfa49a45f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:48.039202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-413651c1-3a54-4e06-ba49-659dfa49a45f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:48.045791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-413651c1-3a54-4e06-ba49-659dfa49a45f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:48.046275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-413651c1-3a54-4e06-ba49-659dfa49a45f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:48.046715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-413651c1-3a54-4e06-ba49-659dfa49a45f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:48.047410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-413651c1-3a54-4e06-ba49-659dfa49a45f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:48.047873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-413651c1-3a54-4e06-ba49-659dfa49a45f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:48.048300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-413651c1-3a54-4e06-ba49-659dfa49a45f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:48.177812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-413651c1-3a54-4e06-ba49-659dfa49a45f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:48.186304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-413651c1-3a54-4e06-ba49-659dfa49a45f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:48.187807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-413651c1-3a54-4e06-ba49-659dfa49a45f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:48.188955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-413651c1-3a54-4e06-ba49-659dfa49a45f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1752 microversion: 2.20 time: 0.154872 Aug 18 21:57:48.189568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 219/439] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:49.211491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-785c6d47-da47-42e5-9579-4e8de4466345 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:49.212104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-785c6d47-da47-42e5-9579-4e8de4466345 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:49.218537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-785c6d47-da47-42e5-9579-4e8de4466345 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:49.219021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-785c6d47-da47-42e5-9579-4e8de4466345 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:49.219464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-785c6d47-da47-42e5-9579-4e8de4466345 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:49.220152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-785c6d47-da47-42e5-9579-4e8de4466345 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:49.220603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-785c6d47-da47-42e5-9579-4e8de4466345 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:49.221022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-785c6d47-da47-42e5-9579-4e8de4466345 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:49.355272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-785c6d47-da47-42e5-9579-4e8de4466345 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:49.366500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-785c6d47-da47-42e5-9579-4e8de4466345 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:49.368615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-785c6d47-da47-42e5-9579-4e8de4466345 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:49.370162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-785c6d47-da47-42e5-9579-4e8de4466345 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1752 microversion: 2.20 time: 0.162513 Aug 18 21:57:49.371056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 221/440] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:50.392767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ddaaab5c-9afb-4c0d-9954-253383d52788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:50.393390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ddaaab5c-9afb-4c0d-9954-253383d52788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:50.399498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddaaab5c-9afb-4c0d-9954-253383d52788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:50.399986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddaaab5c-9afb-4c0d-9954-253383d52788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:50.400431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddaaab5c-9afb-4c0d-9954-253383d52788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:50.401128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddaaab5c-9afb-4c0d-9954-253383d52788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:50.401590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddaaab5c-9afb-4c0d-9954-253383d52788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:50.402050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddaaab5c-9afb-4c0d-9954-253383d52788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:50.537678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ddaaab5c-9afb-4c0d-9954-253383d52788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:50.546528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ddaaab5c-9afb-4c0d-9954-253383d52788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:50.548028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ddaaab5c-9afb-4c0d-9954-253383d52788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:50.549172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ddaaab5c-9afb-4c0d-9954-253383d52788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1752 microversion: 2.20 time: 0.160552 Aug 18 21:57:50.549866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 220/441] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:51.571933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6fa7a8f4-c4b9-4907-a35d-e5dec5512a14 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Action: 'create', calling method: .version_select at 0x7fd88964e1f0>, body: {"keypair": {"name": "tempest-keypair-482574890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFFKEU3o2BB4G49WmlLr0se9xkneOZR7118bbfad98af85zUOigDR8HU5mKlw83+glcptWK2PldFcTG/Mpu+jWGYIxWuadZYa9DLWmR0cNuUEbqJZ/7JWvcnrkJaAQu9jw=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:51.572563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c22dbfa2-86d1-409b-b746-bb628c90c041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:51.573169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c22dbfa2-86d1-409b-b746-bb628c90c041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:51.579257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c22dbfa2-86d1-409b-b746-bb628c90c041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:51.579736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c22dbfa2-86d1-409b-b746-bb628c90c041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:51.580168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c22dbfa2-86d1-409b-b746-bb628c90c041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:51.580851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c22dbfa2-86d1-409b-b746-bb628c90c041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:51.581297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c22dbfa2-86d1-409b-b746-bb628c90c041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:51.581754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c22dbfa2-86d1-409b-b746-bb628c90c041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:51.588372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-6fa7a8f4-c4b9-4907-a35d-e5dec5512a14 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for project aa6929ebd282417cb6ba149f50281240. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:57:51.592178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-6fa7a8f4-c4b9-4907-a35d-e5dec5512a14 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for user 7790a2ef47644d62863aafc890d03249 and project aa6929ebd282417cb6ba149f50281240. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:57:51.614086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6fa7a8f4-c4b9-4907-a35d-e5dec5512a14 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046653 Aug 18 21:57:51.614714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 222/442] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 21:57:51 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:57:51.719605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c22dbfa2-86d1-409b-b746-bb628c90c041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:51.728863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c22dbfa2-86d1-409b-b746-bb628c90c041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:51.730664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c22dbfa2-86d1-409b-b746-bb628c90c041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:51.731894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c22dbfa2-86d1-409b-b746-bb628c90c041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1752 microversion: 2.20 time: 0.163137 Aug 18 21:57:51.732526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 221/443] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:51 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:52.600021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-004de858-8017-451f-9f7b-7e3d7c80f9ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:52.600537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-004de858-8017-451f-9f7b-7e3d7c80f9ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:52.607269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-004de858-8017-451f-9f7b-7e3d7c80f9ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:52.607949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-004de858-8017-451f-9f7b-7e3d7c80f9ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:52.608577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-004de858-8017-451f-9f7b-7e3d7c80f9ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:52.609283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-004de858-8017-451f-9f7b-7e3d7c80f9ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:52.609785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-004de858-8017-451f-9f7b-7e3d7c80f9ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:52.610393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-004de858-8017-451f-9f7b-7e3d7c80f9ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:52.648050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-004de858-8017-451f-9f7b-7e3d7c80f9ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:57:52.739715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-004de858-8017-451f-9f7b-7e3d7c80f9ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 204 len: 0 microversion: 2.1 time: 0.144741 Aug 18 21:57:52.740744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 223/444] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 21:57:52 2022] DELETE /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:57:52.750797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-21d4cc61-e934-4bd1-b59e-701546fb838c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:52.752194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-21d4cc61-e934-4bd1-b59e-701546fb838c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:52.757921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-11bc0894-261b-4b46-bf8c-f87346979f3a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:52.758823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-11bc0894-261b-4b46-bf8c-f87346979f3a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:52.759325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d4cc61-e934-4bd1-b59e-701546fb838c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:52.760479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d4cc61-e934-4bd1-b59e-701546fb838c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:52.761511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d4cc61-e934-4bd1-b59e-701546fb838c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:52.762721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d4cc61-e934-4bd1-b59e-701546fb838c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:52.764121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d4cc61-e934-4bd1-b59e-701546fb838c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:52.764735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d4cc61-e934-4bd1-b59e-701546fb838c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:52.766717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11bc0894-261b-4b46-bf8c-f87346979f3a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:52.767206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11bc0894-261b-4b46-bf8c-f87346979f3a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:52.767712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11bc0894-261b-4b46-bf8c-f87346979f3a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:52.768721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11bc0894-261b-4b46-bf8c-f87346979f3a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:52.769178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11bc0894-261b-4b46-bf8c-f87346979f3a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:52.769625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11bc0894-261b-4b46-bf8c-f87346979f3a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:52.771106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:52.924737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-21d4cc61-e934-4bd1-b59e-701546fb838c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:52.929056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-11bc0894-261b-4b46-bf8c-f87346979f3a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:52.932549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-21d4cc61-e934-4bd1-b59e-701546fb838c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1514 microversion: 2.1 time: 0.187689 Aug 18 21:57:52.933165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 222/445] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:52 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:52.937820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-11bc0894-261b-4b46-bf8c-f87346979f3a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:52.939324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-11bc0894-261b-4b46-bf8c-f87346979f3a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:52.940470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-11bc0894-261b-4b46-bf8c-f87346979f3a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.188421 Aug 18 21:57:52.941014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 224/446] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:52 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:57:52.950410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-186893327", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4f28e51-196b-4c42-8717-0b4dbb184c81"}], "security_groups": [{"name": "tempest-securitygroup--396208850"}], "key_name": "tempest-keypair-482574890", "user_data": "}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:53.052623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] validate_networks() for [('b4f28e51-196b-4c42-8717-0b4dbb184c81', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:57:53.424959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:57:53.425377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:57:53.425901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:57:53.426309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:57:53.427199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:57:53.435749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:53.436222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:53.436648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:53.437359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:53.437835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:53.438257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:53.455073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for project aa6929ebd282417cb6ba149f50281240. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:57:53.458993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for user 7790a2ef47644d62863aafc890d03249 and project aa6929ebd282417cb6ba149f50281240. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:57:53.469686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:57:53.471985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:57:53.518422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cbf9a998-9261-4684-8765-5a0dcc0381fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.572176 Aug 18 21:57:53.519062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 223/447] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 21:57:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:57:53.529987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-84756f6b-6ed2-45a8-8ff3-798ce3f58d83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:53.530604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-84756f6b-6ed2-45a8-8ff3-798ce3f58d83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:53.583789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-84756f6b-6ed2-45a8-8ff3-798ce3f58d83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:53.590508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-84756f6b-6ed2-45a8-8ff3-798ce3f58d83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1240 microversion: 2.1 time: 0.064413 Aug 18 21:57:53.591073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 225/448] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:53 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:53.953935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-db6aee2c-5c32-46fc-bbcd-b6f4ec8ff57e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:53.954584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-db6aee2c-5c32-46fc-bbcd-b6f4ec8ff57e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:53.961206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db6aee2c-5c32-46fc-bbcd-b6f4ec8ff57e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:53.961723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db6aee2c-5c32-46fc-bbcd-b6f4ec8ff57e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:53.962165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db6aee2c-5c32-46fc-bbcd-b6f4ec8ff57e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:53.962870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db6aee2c-5c32-46fc-bbcd-b6f4ec8ff57e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:53.963240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-05bef156-d276-4f45-a9da-5777a0a2643f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:53.963660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db6aee2c-5c32-46fc-bbcd-b6f4ec8ff57e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:53.963767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db6aee2c-5c32-46fc-bbcd-b6f4ec8ff57e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:53.963995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-05bef156-d276-4f45-a9da-5777a0a2643f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:53.970522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05bef156-d276-4f45-a9da-5777a0a2643f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:53.971008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05bef156-d276-4f45-a9da-5777a0a2643f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:53.971443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05bef156-d276-4f45-a9da-5777a0a2643f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:53.972135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05bef156-d276-4f45-a9da-5777a0a2643f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:53.972590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05bef156-d276-4f45-a9da-5777a0a2643f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:53.973020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05bef156-d276-4f45-a9da-5777a0a2643f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:54.100330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-db6aee2c-5c32-46fc-bbcd-b6f4ec8ff57e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:54.102667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05bef156-d276-4f45-a9da-5777a0a2643f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:54.108052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-db6aee2c-5c32-46fc-bbcd-b6f4ec8ff57e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1514 microversion: 2.1 time: 0.158044 Aug 18 21:57:54.108633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 224/449] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:53 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:54.111505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05bef156-d276-4f45-a9da-5777a0a2643f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:54.113055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05bef156-d276-4f45-a9da-5777a0a2643f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:54.114561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-05bef156-d276-4f45-a9da-5777a0a2643f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.155168 Aug 18 21:57:54.121987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 226/450] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:53 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:57:54.610684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-866ea5c4-ffaa-4e38-b039-234931c5d55e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:54.611315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-866ea5c4-ffaa-4e38-b039-234931c5d55e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:54.617647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-866ea5c4-ffaa-4e38-b039-234931c5d55e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:54.618130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-866ea5c4-ffaa-4e38-b039-234931c5d55e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:54.618560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-866ea5c4-ffaa-4e38-b039-234931c5d55e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:54.619271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-866ea5c4-ffaa-4e38-b039-234931c5d55e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:54.619724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-866ea5c4-ffaa-4e38-b039-234931c5d55e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:54.620146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-866ea5c4-ffaa-4e38-b039-234931c5d55e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:54.684330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-866ea5c4-ffaa-4e38-b039-234931c5d55e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:54.700137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-866ea5c4-ffaa-4e38-b039-234931c5d55e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1236 microversion: 2.1 time: 0.093132 Aug 18 21:57:54.700910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 225/451] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:54 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:55.129562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ccca50f2-89a0-4aff-884a-b815899662b1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:55.130759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ccca50f2-89a0-4aff-884a-b815899662b1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:55.136610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c39bd686-8cc4-43e1-8795-efb7be3c372a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:55.137262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c39bd686-8cc4-43e1-8795-efb7be3c372a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:55.137388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccca50f2-89a0-4aff-884a-b815899662b1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:55.137776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccca50f2-89a0-4aff-884a-b815899662b1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:55.138214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccca50f2-89a0-4aff-884a-b815899662b1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:55.138907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccca50f2-89a0-4aff-884a-b815899662b1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:55.139354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccca50f2-89a0-4aff-884a-b815899662b1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:55.139769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccca50f2-89a0-4aff-884a-b815899662b1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:55.143167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c39bd686-8cc4-43e1-8795-efb7be3c372a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:55.143709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c39bd686-8cc4-43e1-8795-efb7be3c372a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:55.144151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c39bd686-8cc4-43e1-8795-efb7be3c372a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:55.144846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c39bd686-8cc4-43e1-8795-efb7be3c372a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:55.145297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c39bd686-8cc4-43e1-8795-efb7be3c372a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:55.145834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c39bd686-8cc4-43e1-8795-efb7be3c372a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:55.274822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ccca50f2-89a0-4aff-884a-b815899662b1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:55.282605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ccca50f2-89a0-4aff-884a-b815899662b1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1514 microversion: 2.1 time: 0.156808 Aug 18 21:57:55.283178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 227/452] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:55 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:55.318242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c39bd686-8cc4-43e1-8795-efb7be3c372a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:55.327804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c39bd686-8cc4-43e1-8795-efb7be3c372a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:55.329301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c39bd686-8cc4-43e1-8795-efb7be3c372a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:55.330693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c39bd686-8cc4-43e1-8795-efb7be3c372a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.197897 Aug 18 21:57:55.331260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 226/453] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:57:55.722345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7bb1cce4-d636-4bdc-bd03-80e3c64524de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:55.728734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-72139516-51b9-42c9-8ea5-920cc0964006 req-77b1f8ac-f16e-4f01-8994-bebe418d75f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa5355b-48a3-4342-998a-e31be1538357", "name": "network-vif-deleted", "tag": "742008d4-bf3b-476e-8e19-c9e9c780f008"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:57:55.730760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7bb1cce4-d636-4bdc-bd03-80e3c64524de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:55.742364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7bb1cce4-d636-4bdc-bd03-80e3c64524de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:55.745440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-72139516-51b9-42c9-8ea5-920cc0964006 req-77b1f8ac-f16e-4f01-8994-bebe418d75f6 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:55.746195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7bb1cce4-d636-4bdc-bd03-80e3c64524de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:55.746848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7bb1cce4-d636-4bdc-bd03-80e3c64524de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:55.747760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7bb1cce4-d636-4bdc-bd03-80e3c64524de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:55.748405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7bb1cce4-d636-4bdc-bd03-80e3c64524de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:55.749038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7bb1cce4-d636-4bdc-bd03-80e3c64524de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:55.749767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-72139516-51b9-42c9-8ea5-920cc0964006 req-77b1f8ac-f16e-4f01-8994-bebe418d75f6 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:55.754951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-72139516-51b9-42c9-8ea5-920cc0964006 req-77b1f8ac-f16e-4f01-8994-bebe418d75f6 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:55.781205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-72139516-51b9-42c9-8ea5-920cc0964006 req-77b1f8ac-f16e-4f01-8994-bebe418d75f6 service nova] Creating event network-vif-deleted:742008d4-bf3b-476e-8e19-c9e9c780f008 for instance 0aa5355b-48a3-4342-998a-e31be1538357 on hv-cinder-85367 Aug 18 21:57:55.787930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-72139516-51b9-42c9-8ea5-920cc0964006 req-77b1f8ac-f16e-4f01-8994-bebe418d75f6 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061575 Aug 18 21:57:55.794599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 227/454] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:57:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:57:55.836097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7bb1cce4-d636-4bdc-bd03-80e3c64524de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:55.838577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:57:55.845572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7bb1cce4-d636-4bdc-bd03-80e3c64524de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1292 microversion: 2.1 time: 0.127856 Aug 18 21:57:55.846552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 228/455] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:55 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1292 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:56.305505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fb11dfb1-4506-476b-8357-17b46fb2a6d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:56.306262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fb11dfb1-4506-476b-8357-17b46fb2a6d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:56.312802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb11dfb1-4506-476b-8357-17b46fb2a6d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:56.313287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb11dfb1-4506-476b-8357-17b46fb2a6d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:56.313745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb11dfb1-4506-476b-8357-17b46fb2a6d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:56.314438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb11dfb1-4506-476b-8357-17b46fb2a6d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:56.314887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb11dfb1-4506-476b-8357-17b46fb2a6d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:56.315305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb11dfb1-4506-476b-8357-17b46fb2a6d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:56.355835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2d3e808c-2575-4122-a996-c3f3e3df4d09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:56.356702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2d3e808c-2575-4122-a996-c3f3e3df4d09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:56.365041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d3e808c-2575-4122-a996-c3f3e3df4d09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:56.365524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d3e808c-2575-4122-a996-c3f3e3df4d09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:56.366008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d3e808c-2575-4122-a996-c3f3e3df4d09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:56.366746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d3e808c-2575-4122-a996-c3f3e3df4d09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:56.367195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d3e808c-2575-4122-a996-c3f3e3df4d09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:56.367618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d3e808c-2575-4122-a996-c3f3e3df4d09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:56.390421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fb11dfb1-4506-476b-8357-17b46fb2a6d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:56.398518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fb11dfb1-4506-476b-8357-17b46fb2a6d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1472 microversion: 2.1 time: 0.097888 Aug 18 21:57:56.399305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 228/456] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:56 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1472 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:56.501516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2d3e808c-2575-4122-a996-c3f3e3df4d09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:56.510943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2d3e808c-2575-4122-a996-c3f3e3df4d09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:56.512472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2d3e808c-2575-4122-a996-c3f3e3df4d09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:56.513656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2d3e808c-2575-4122-a996-c3f3e3df4d09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.162253 Aug 18 21:57:56.514221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 229/457] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:57:56.867587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9bd106b4-2c69-4cf6-b4cc-d6304790d090 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:56.868208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9bd106b4-2c69-4cf6-b4cc-d6304790d090 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:56.874570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd106b4-2c69-4cf6-b4cc-d6304790d090 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:56.875063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd106b4-2c69-4cf6-b4cc-d6304790d090 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:56.875690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd106b4-2c69-4cf6-b4cc-d6304790d090 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:56.876591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd106b4-2c69-4cf6-b4cc-d6304790d090 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:56.877052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd106b4-2c69-4cf6-b4cc-d6304790d090 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:56.877484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd106b4-2c69-4cf6-b4cc-d6304790d090 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:56.942687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9bd106b4-2c69-4cf6-b4cc-d6304790d090 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:56.950429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9bd106b4-2c69-4cf6-b4cc-d6304790d090 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1292 microversion: 2.1 time: 0.087159 Aug 18 21:57:56.951008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 229/458] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:56 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:57.420711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-98f91c74-beb4-478c-bc48-cf4afc4c5176 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:57.421319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-98f91c74-beb4-478c-bc48-cf4afc4c5176 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:57.428297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98f91c74-beb4-478c-bc48-cf4afc4c5176 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:57.428777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98f91c74-beb4-478c-bc48-cf4afc4c5176 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:57.429203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98f91c74-beb4-478c-bc48-cf4afc4c5176 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:57.429928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98f91c74-beb4-478c-bc48-cf4afc4c5176 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:57.430376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98f91c74-beb4-478c-bc48-cf4afc4c5176 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:57.430794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98f91c74-beb4-478c-bc48-cf4afc4c5176 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:57.497360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-98f91c74-beb4-478c-bc48-cf4afc4c5176 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:57.506084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-98f91c74-beb4-478c-bc48-cf4afc4c5176 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1472 microversion: 2.1 time: 0.089854 Aug 18 21:57:57.506662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 230/459] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:57 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1472 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:57.536736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-99e47775-751b-4092-83f8-e14b75e82c0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:57.537463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-99e47775-751b-4092-83f8-e14b75e82c0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:57.544309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99e47775-751b-4092-83f8-e14b75e82c0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:57.544923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99e47775-751b-4092-83f8-e14b75e82c0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:57.545737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99e47775-751b-4092-83f8-e14b75e82c0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:57.546494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99e47775-751b-4092-83f8-e14b75e82c0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:57.547012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99e47775-751b-4092-83f8-e14b75e82c0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:57.547514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99e47775-751b-4092-83f8-e14b75e82c0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:57.685432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-99e47775-751b-4092-83f8-e14b75e82c0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:57.695406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-99e47775-751b-4092-83f8-e14b75e82c0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:57.696914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-99e47775-751b-4092-83f8-e14b75e82c0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:57.698119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-99e47775-751b-4092-83f8-e14b75e82c0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.165736 Aug 18 21:57:57.698686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 230/460] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:57.971514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bc1c1a30-da2d-4a0d-a59c-047c0a6d1c68 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:57.972217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bc1c1a30-da2d-4a0d-a59c-047c0a6d1c68 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:57.978316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc1c1a30-da2d-4a0d-a59c-047c0a6d1c68 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:57.978900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc1c1a30-da2d-4a0d-a59c-047c0a6d1c68 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:57.979347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc1c1a30-da2d-4a0d-a59c-047c0a6d1c68 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:57.980057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc1c1a30-da2d-4a0d-a59c-047c0a6d1c68 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:57.980520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc1c1a30-da2d-4a0d-a59c-047c0a6d1c68 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:57.980947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc1c1a30-da2d-4a0d-a59c-047c0a6d1c68 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:58.044432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bc1c1a30-da2d-4a0d-a59c-047c0a6d1c68 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:58.052812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bc1c1a30-da2d-4a0d-a59c-047c0a6d1c68 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1292 microversion: 2.1 time: 0.085225 Aug 18 21:57:58.053499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 231/461] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:57 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:57:58.528741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c3fed2c3-1fec-40df-a961-f33e7fb6026e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:58.529361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c3fed2c3-1fec-40df-a961-f33e7fb6026e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:58.535761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3fed2c3-1fec-40df-a961-f33e7fb6026e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:58.536296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3fed2c3-1fec-40df-a961-f33e7fb6026e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:58.536920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3fed2c3-1fec-40df-a961-f33e7fb6026e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:58.537689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3fed2c3-1fec-40df-a961-f33e7fb6026e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:58.538121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3fed2c3-1fec-40df-a961-f33e7fb6026e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:58.538534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3fed2c3-1fec-40df-a961-f33e7fb6026e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:58.603501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c3fed2c3-1fec-40df-a961-f33e7fb6026e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:58.612224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c3fed2c3-1fec-40df-a961-f33e7fb6026e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1472 microversion: 2.1 time: 0.087200 Aug 18 21:57:58.612806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 231/462] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:58 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1472 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:58.720594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-138fce79-9a2a-472c-b6d5-eb927249eb4f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:58.721642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-138fce79-9a2a-472c-b6d5-eb927249eb4f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:58.728925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-138fce79-9a2a-472c-b6d5-eb927249eb4f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:58.729440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-138fce79-9a2a-472c-b6d5-eb927249eb4f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:58.729924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-138fce79-9a2a-472c-b6d5-eb927249eb4f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:58.730623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-138fce79-9a2a-472c-b6d5-eb927249eb4f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:58.731075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-138fce79-9a2a-472c-b6d5-eb927249eb4f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:58.731557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-138fce79-9a2a-472c-b6d5-eb927249eb4f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:58.875034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-138fce79-9a2a-472c-b6d5-eb927249eb4f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:58.885112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-138fce79-9a2a-472c-b6d5-eb927249eb4f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:58.886655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-138fce79-9a2a-472c-b6d5-eb927249eb4f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:58.887828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-138fce79-9a2a-472c-b6d5-eb927249eb4f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.171475 Aug 18 21:57:58.888388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 232/463] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:57:59.074538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9d01fe67-d6f3-4060-a5d5-0dd713545f36 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:59.075169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9d01fe67-d6f3-4060-a5d5-0dd713545f36 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:59.082452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d01fe67-d6f3-4060-a5d5-0dd713545f36 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:59.083228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d01fe67-d6f3-4060-a5d5-0dd713545f36 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:59.083925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d01fe67-d6f3-4060-a5d5-0dd713545f36 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:59.084708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d01fe67-d6f3-4060-a5d5-0dd713545f36 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:59.085242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d01fe67-d6f3-4060-a5d5-0dd713545f36 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:59.085764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d01fe67-d6f3-4060-a5d5-0dd713545f36 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:59.152425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9d01fe67-d6f3-4060-a5d5-0dd713545f36 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:59.160621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9d01fe67-d6f3-4060-a5d5-0dd713545f36 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1292 microversion: 2.1 time: 0.090573 Aug 18 21:57:59.161312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 232/464] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:59 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:59.632432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f318a3d4-dea8-4bac-884f-42705085fa16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:59.633048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f318a3d4-dea8-4bac-884f-42705085fa16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:59.639646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f318a3d4-dea8-4bac-884f-42705085fa16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:59.640140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f318a3d4-dea8-4bac-884f-42705085fa16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:59.640580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f318a3d4-dea8-4bac-884f-42705085fa16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:59.641284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f318a3d4-dea8-4bac-884f-42705085fa16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:59.641771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f318a3d4-dea8-4bac-884f-42705085fa16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:59.642203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f318a3d4-dea8-4bac-884f-42705085fa16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:59.705506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f318a3d4-dea8-4bac-884f-42705085fa16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:57:59.713725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f318a3d4-dea8-4bac-884f-42705085fa16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1472 microversion: 2.1 time: 0.085052 Aug 18 21:57:59.714350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 233/465] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:57:59 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1472 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:57:59.911194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8845f4ab-4f5d-454f-82d0-3ccce4853ff1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:57:59.911767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8845f4ab-4f5d-454f-82d0-3ccce4853ff1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:57:59.919101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8845f4ab-4f5d-454f-82d0-3ccce4853ff1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:59.919591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8845f4ab-4f5d-454f-82d0-3ccce4853ff1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:59.920020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8845f4ab-4f5d-454f-82d0-3ccce4853ff1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:57:59.920711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8845f4ab-4f5d-454f-82d0-3ccce4853ff1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:57:59.921329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8845f4ab-4f5d-454f-82d0-3ccce4853ff1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:57:59.921796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8845f4ab-4f5d-454f-82d0-3ccce4853ff1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:00.069166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8845f4ab-4f5d-454f-82d0-3ccce4853ff1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:00.078346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8845f4ab-4f5d-454f-82d0-3ccce4853ff1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:00.079875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8845f4ab-4f5d-454f-82d0-3ccce4853ff1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:00.081030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8845f4ab-4f5d-454f-82d0-3ccce4853ff1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.173825 Aug 18 21:58:00.081590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 233/466] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:57:59 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:00.182072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b3ecfe3e-ced2-4789-9fa8-9cdd9684b8e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:00.183636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b3ecfe3e-ced2-4789-9fa8-9cdd9684b8e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:00.189312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3ecfe3e-ced2-4789-9fa8-9cdd9684b8e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:00.189842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3ecfe3e-ced2-4789-9fa8-9cdd9684b8e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:00.191126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3ecfe3e-ced2-4789-9fa8-9cdd9684b8e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:00.191126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3ecfe3e-ced2-4789-9fa8-9cdd9684b8e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:00.191998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3ecfe3e-ced2-4789-9fa8-9cdd9684b8e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:00.191998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3ecfe3e-ced2-4789-9fa8-9cdd9684b8e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:00.264427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b3ecfe3e-ced2-4789-9fa8-9cdd9684b8e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:00.273513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b3ecfe3e-ced2-4789-9fa8-9cdd9684b8e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1292 microversion: 2.1 time: 0.095409 Aug 18 21:58:00.274775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 234/467] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:00 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:00.736244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-493dea4c-e97c-4fad-8e22-b32a1f3c8d54 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:00.737005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-493dea4c-e97c-4fad-8e22-b32a1f3c8d54 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:00.744477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-493dea4c-e97c-4fad-8e22-b32a1f3c8d54 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:00.745342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-493dea4c-e97c-4fad-8e22-b32a1f3c8d54 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:00.745863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-493dea4c-e97c-4fad-8e22-b32a1f3c8d54 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:00.746573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-493dea4c-e97c-4fad-8e22-b32a1f3c8d54 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:00.747031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-493dea4c-e97c-4fad-8e22-b32a1f3c8d54 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:00.747456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-493dea4c-e97c-4fad-8e22-b32a1f3c8d54 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:00.810884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-493dea4c-e97c-4fad-8e22-b32a1f3c8d54 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:00.818750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-493dea4c-e97c-4fad-8e22-b32a1f3c8d54 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1472 microversion: 2.1 time: 0.086330 Aug 18 21:58:00.819573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 234/468] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:00 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1472 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:01.105058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-928ebaaf-8139-455c-9002-ad9d6a51ee11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:01.105731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-928ebaaf-8139-455c-9002-ad9d6a51ee11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:01.112096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-928ebaaf-8139-455c-9002-ad9d6a51ee11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:01.112579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-928ebaaf-8139-455c-9002-ad9d6a51ee11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:01.113067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-928ebaaf-8139-455c-9002-ad9d6a51ee11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:01.113963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-928ebaaf-8139-455c-9002-ad9d6a51ee11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:01.114257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-928ebaaf-8139-455c-9002-ad9d6a51ee11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:01.114679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-928ebaaf-8139-455c-9002-ad9d6a51ee11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:01.251140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-928ebaaf-8139-455c-9002-ad9d6a51ee11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:01.260109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-928ebaaf-8139-455c-9002-ad9d6a51ee11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:01.261849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-928ebaaf-8139-455c-9002-ad9d6a51ee11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:01.263020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-928ebaaf-8139-455c-9002-ad9d6a51ee11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.162409 Aug 18 21:58:01.263583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 235/469] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:01.295832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bfa3f398-f596-4475-bdae-c6316c4366d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:01.296605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bfa3f398-f596-4475-bdae-c6316c4366d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:01.303048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfa3f398-f596-4475-bdae-c6316c4366d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:01.303537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfa3f398-f596-4475-bdae-c6316c4366d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:01.303968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfa3f398-f596-4475-bdae-c6316c4366d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:01.304665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfa3f398-f596-4475-bdae-c6316c4366d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:01.305692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfa3f398-f596-4475-bdae-c6316c4366d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:01.306121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfa3f398-f596-4475-bdae-c6316c4366d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:01.375351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bfa3f398-f596-4475-bdae-c6316c4366d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:01.383317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bfa3f398-f596-4475-bdae-c6316c4366d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1292 microversion: 2.1 time: 0.091519 Aug 18 21:58:01.392159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 235/470] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:01 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:01.842248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bb500116-da1c-40b7-94d9-2b160c241357 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:01.844541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bb500116-da1c-40b7-94d9-2b160c241357 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:01.853416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb500116-da1c-40b7-94d9-2b160c241357 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:01.854038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb500116-da1c-40b7-94d9-2b160c241357 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:01.854502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb500116-da1c-40b7-94d9-2b160c241357 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:01.855389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb500116-da1c-40b7-94d9-2b160c241357 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:01.855849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb500116-da1c-40b7-94d9-2b160c241357 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:01.856269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb500116-da1c-40b7-94d9-2b160c241357 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:01.920808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bb500116-da1c-40b7-94d9-2b160c241357 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:01.929619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bb500116-da1c-40b7-94d9-2b160c241357 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1472 microversion: 2.1 time: 0.092918 Aug 18 21:58:01.930401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 236/471] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:01 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:02.286220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-09de803f-7aad-4715-8b02-55f5a59f073c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:02.286884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-09de803f-7aad-4715-8b02-55f5a59f073c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:02.293547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09de803f-7aad-4715-8b02-55f5a59f073c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:02.294193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09de803f-7aad-4715-8b02-55f5a59f073c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:02.294705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09de803f-7aad-4715-8b02-55f5a59f073c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:02.295422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09de803f-7aad-4715-8b02-55f5a59f073c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:02.295880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09de803f-7aad-4715-8b02-55f5a59f073c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:02.296308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09de803f-7aad-4715-8b02-55f5a59f073c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:02.404604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e3c9c6ed-fc2b-4d68-8596-2721f7dd6c2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:02.406037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e3c9c6ed-fc2b-4d68-8596-2721f7dd6c2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:02.413625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3c9c6ed-fc2b-4d68-8596-2721f7dd6c2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:02.414121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3c9c6ed-fc2b-4d68-8596-2721f7dd6c2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:02.414598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3c9c6ed-fc2b-4d68-8596-2721f7dd6c2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:02.415301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3c9c6ed-fc2b-4d68-8596-2721f7dd6c2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:02.415747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3c9c6ed-fc2b-4d68-8596-2721f7dd6c2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:02.416310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3c9c6ed-fc2b-4d68-8596-2721f7dd6c2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:02.439848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-09de803f-7aad-4715-8b02-55f5a59f073c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:02.453218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-09de803f-7aad-4715-8b02-55f5a59f073c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:02.454845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-09de803f-7aad-4715-8b02-55f5a59f073c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:02.456024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-09de803f-7aad-4715-8b02-55f5a59f073c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.174167 Aug 18 21:58:02.459384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 236/472] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:02.494632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e3c9c6ed-fc2b-4d68-8596-2721f7dd6c2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:02.502550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e3c9c6ed-fc2b-4d68-8596-2721f7dd6c2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1292 microversion: 2.1 time: 0.101673 Aug 18 21:58:02.503056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 237/473] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:02 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1292 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:02.950381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7cec82c6-43b0-45f8-a603-dce362639c10 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:02.950997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7cec82c6-43b0-45f8-a603-dce362639c10 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:02.953258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:02.959837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cec82c6-43b0-45f8-a603-dce362639c10 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:02.960414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cec82c6-43b0-45f8-a603-dce362639c10 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:02.960879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cec82c6-43b0-45f8-a603-dce362639c10 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:02.962139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cec82c6-43b0-45f8-a603-dce362639c10 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:02.962598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cec82c6-43b0-45f8-a603-dce362639c10 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:02.963014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cec82c6-43b0-45f8-a603-dce362639c10 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:03.025322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7cec82c6-43b0-45f8-a603-dce362639c10 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:03.033372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7cec82c6-43b0-45f8-a603-dce362639c10 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1472 microversion: 2.1 time: 0.086796 Aug 18 21:58:03.033975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 237/474] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:02 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1472 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:03.479426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ff06ee2b-2b4f-48c3-9c78-6557ce510377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:03.480115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ff06ee2b-2b4f-48c3-9c78-6557ce510377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:03.486566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff06ee2b-2b4f-48c3-9c78-6557ce510377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:03.487056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff06ee2b-2b4f-48c3-9c78-6557ce510377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:03.487496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff06ee2b-2b4f-48c3-9c78-6557ce510377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:03.488203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff06ee2b-2b4f-48c3-9c78-6557ce510377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:03.488666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff06ee2b-2b4f-48c3-9c78-6557ce510377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:03.489147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff06ee2b-2b4f-48c3-9c78-6557ce510377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:03.524992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-14a11f5a-5ad4-473c-9d84-570bc20f6d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:03.525928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-14a11f5a-5ad4-473c-9d84-570bc20f6d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:03.528227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:03.529163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:03.535494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14a11f5a-5ad4-473c-9d84-570bc20f6d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:03.536076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14a11f5a-5ad4-473c-9d84-570bc20f6d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:03.536613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14a11f5a-5ad4-473c-9d84-570bc20f6d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:03.537401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14a11f5a-5ad4-473c-9d84-570bc20f6d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:03.538093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14a11f5a-5ad4-473c-9d84-570bc20f6d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:03.538605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14a11f5a-5ad4-473c-9d84-570bc20f6d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:03.588274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:03.607716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-14a11f5a-5ad4-473c-9d84-570bc20f6d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:03.617126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-14a11f5a-5ad4-473c-9d84-570bc20f6d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1292 microversion: 2.1 time: 0.096395 Aug 18 21:58:03.618102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 238/475] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:03 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:03.629780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ff06ee2b-2b4f-48c3-9c78-6557ce510377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:03.647537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ff06ee2b-2b4f-48c3-9c78-6557ce510377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:03.649581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ff06ee2b-2b4f-48c3-9c78-6557ce510377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:03.650769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ff06ee2b-2b4f-48c3-9c78-6557ce510377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.175478 Aug 18 21:58:03.651333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 238/476] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:04.054816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4d1c48f5-eca0-4d57-b880-0490f9109bee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:04.056268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4d1c48f5-eca0-4d57-b880-0490f9109bee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:04.062512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d1c48f5-eca0-4d57-b880-0490f9109bee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:04.063080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d1c48f5-eca0-4d57-b880-0490f9109bee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:04.063596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d1c48f5-eca0-4d57-b880-0490f9109bee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:04.064397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d1c48f5-eca0-4d57-b880-0490f9109bee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:04.064932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d1c48f5-eca0-4d57-b880-0490f9109bee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:04.065434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d1c48f5-eca0-4d57-b880-0490f9109bee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:04.131867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4d1c48f5-eca0-4d57-b880-0490f9109bee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:04.140124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4d1c48f5-eca0-4d57-b880-0490f9109bee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1472 microversion: 2.1 time: 0.089187 Aug 18 21:58:04.141068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 239/477] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:04 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1472 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:04.638202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dd31b86e-7662-415d-809b-f185c271d18f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:04.638832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dd31b86e-7662-415d-809b-f185c271d18f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:04.645682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd31b86e-7662-415d-809b-f185c271d18f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:04.646175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd31b86e-7662-415d-809b-f185c271d18f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:04.646623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd31b86e-7662-415d-809b-f185c271d18f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:04.647328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd31b86e-7662-415d-809b-f185c271d18f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:04.647780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd31b86e-7662-415d-809b-f185c271d18f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:04.648204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd31b86e-7662-415d-809b-f185c271d18f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:04.674288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-52ce2f1c-e9f2-4129-a8a2-3d19073b8934 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:04.675467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-52ce2f1c-e9f2-4129-a8a2-3d19073b8934 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:04.682971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52ce2f1c-e9f2-4129-a8a2-3d19073b8934 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:04.683473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52ce2f1c-e9f2-4129-a8a2-3d19073b8934 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:04.684063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52ce2f1c-e9f2-4129-a8a2-3d19073b8934 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:04.684783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52ce2f1c-e9f2-4129-a8a2-3d19073b8934 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:04.685263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52ce2f1c-e9f2-4129-a8a2-3d19073b8934 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:04.685934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52ce2f1c-e9f2-4129-a8a2-3d19073b8934 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:04.696432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:04.715535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dd31b86e-7662-415d-809b-f185c271d18f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:04.726199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dd31b86e-7662-415d-809b-f185c271d18f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1292 microversion: 2.1 time: 0.091582 Aug 18 21:58:04.727620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 239/478] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:04 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1292 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:04.837898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-52ce2f1c-e9f2-4129-a8a2-3d19073b8934 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:04.848966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-52ce2f1c-e9f2-4129-a8a2-3d19073b8934 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:04.850492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-52ce2f1c-e9f2-4129-a8a2-3d19073b8934 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:04.851661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-52ce2f1c-e9f2-4129-a8a2-3d19073b8934 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.181546 Aug 18 21:58:04.852252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 240/479] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:05.163302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6fd936bb-3a93-43a5-8043-e5ef716ebd6d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:05.163929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6fd936bb-3a93-43a5-8043-e5ef716ebd6d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:05.171191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd936bb-3a93-43a5-8043-e5ef716ebd6d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:05.171692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd936bb-3a93-43a5-8043-e5ef716ebd6d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:05.172131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd936bb-3a93-43a5-8043-e5ef716ebd6d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:05.172845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd936bb-3a93-43a5-8043-e5ef716ebd6d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:05.173306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd936bb-3a93-43a5-8043-e5ef716ebd6d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:05.173764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd936bb-3a93-43a5-8043-e5ef716ebd6d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:05.238925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6fd936bb-3a93-43a5-8043-e5ef716ebd6d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:05.247568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6fd936bb-3a93-43a5-8043-e5ef716ebd6d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1472 microversion: 2.1 time: 0.089214 Aug 18 21:58:05.248386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 240/480] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:05 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1472 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:05.749817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-015006db-cefc-4a34-8a37-47d96609853f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:05.750464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-015006db-cefc-4a34-8a37-47d96609853f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:05.756693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-015006db-cefc-4a34-8a37-47d96609853f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:05.757187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-015006db-cefc-4a34-8a37-47d96609853f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:05.757654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-015006db-cefc-4a34-8a37-47d96609853f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:05.758362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-015006db-cefc-4a34-8a37-47d96609853f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:05.758820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-015006db-cefc-4a34-8a37-47d96609853f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:05.759307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-015006db-cefc-4a34-8a37-47d96609853f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:05.823503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-015006db-cefc-4a34-8a37-47d96609853f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:05.831124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-015006db-cefc-4a34-8a37-47d96609853f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1292 microversion: 2.1 time: 0.085216 Aug 18 21:58:05.831697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 241/481] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:05 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:05.875480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-91daafb1-bf29-4be5-bd3d-f66ca219b137 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:05.876252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-91daafb1-bf29-4be5-bd3d-f66ca219b137 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:05.882590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91daafb1-bf29-4be5-bd3d-f66ca219b137 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:05.883072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91daafb1-bf29-4be5-bd3d-f66ca219b137 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:05.883741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91daafb1-bf29-4be5-bd3d-f66ca219b137 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:05.884608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91daafb1-bf29-4be5-bd3d-f66ca219b137 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:05.885063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91daafb1-bf29-4be5-bd3d-f66ca219b137 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:05.885486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91daafb1-bf29-4be5-bd3d-f66ca219b137 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:06.021867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-91daafb1-bf29-4be5-bd3d-f66ca219b137 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:06.031791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-91daafb1-bf29-4be5-bd3d-f66ca219b137 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:06.033324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-91daafb1-bf29-4be5-bd3d-f66ca219b137 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:06.034503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-91daafb1-bf29-4be5-bd3d-f66ca219b137 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.162940 Aug 18 21:58:06.035060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 241/482] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:06.269989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6f2741db-e3f6-4040-99c6-5381ca0cc9c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:06.270563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6f2741db-e3f6-4040-99c6-5381ca0cc9c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:06.277264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f2741db-e3f6-4040-99c6-5381ca0cc9c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:06.277787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f2741db-e3f6-4040-99c6-5381ca0cc9c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:06.278233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f2741db-e3f6-4040-99c6-5381ca0cc9c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:06.278924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f2741db-e3f6-4040-99c6-5381ca0cc9c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:06.279381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f2741db-e3f6-4040-99c6-5381ca0cc9c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:06.279807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f2741db-e3f6-4040-99c6-5381ca0cc9c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:06.339141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6f2741db-e3f6-4040-99c6-5381ca0cc9c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:06.348332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6f2741db-e3f6-4040-99c6-5381ca0cc9c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1472 microversion: 2.1 time: 0.082326 Aug 18 21:58:06.348912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 242/483] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:06 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1472 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:06.853818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ef5a837e-6ce4-4df8-bf0f-716ec64ef94e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:06.854434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ef5a837e-6ce4-4df8-bf0f-716ec64ef94e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:06.860426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef5a837e-6ce4-4df8-bf0f-716ec64ef94e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:06.860910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef5a837e-6ce4-4df8-bf0f-716ec64ef94e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:06.861344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef5a837e-6ce4-4df8-bf0f-716ec64ef94e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:06.862070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef5a837e-6ce4-4df8-bf0f-716ec64ef94e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:06.862521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef5a837e-6ce4-4df8-bf0f-716ec64ef94e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:06.862944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef5a837e-6ce4-4df8-bf0f-716ec64ef94e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:06.925640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ef5a837e-6ce4-4df8-bf0f-716ec64ef94e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:06.934008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ef5a837e-6ce4-4df8-bf0f-716ec64ef94e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1300 microversion: 2.1 time: 0.085559 Aug 18 21:58:06.934570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 242/484] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:06 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1300 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:07.057576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dc7e6d42-6486-4084-9a38-9d9dc6706412 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:07.058213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dc7e6d42-6486-4084-9a38-9d9dc6706412 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:07.064215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc7e6d42-6486-4084-9a38-9d9dc6706412 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:07.064704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc7e6d42-6486-4084-9a38-9d9dc6706412 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:07.065147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc7e6d42-6486-4084-9a38-9d9dc6706412 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:07.065870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc7e6d42-6486-4084-9a38-9d9dc6706412 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:07.066333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc7e6d42-6486-4084-9a38-9d9dc6706412 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:07.066768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc7e6d42-6486-4084-9a38-9d9dc6706412 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:07.216981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dc7e6d42-6486-4084-9a38-9d9dc6706412 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:07.226550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dc7e6d42-6486-4084-9a38-9d9dc6706412 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:07.228902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dc7e6d42-6486-4084-9a38-9d9dc6706412 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:07.230180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dc7e6d42-6486-4084-9a38-9d9dc6706412 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.177111 Aug 18 21:58:07.231201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 243/485] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:07.370581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:07.371477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:07.380203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:07.380740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:07.381192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:07.381983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:07.382382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:07.382815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:07.417223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:07.417755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:07.418195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:07.418899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lazy-loading 'fault' on Instance uuid 0aa5355b-48a3-4342-998a-e31be1538357 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:58:07.464599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:07.472316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9e177adc-5042-499d-98d3-f2378b074d51 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 200 len: 1309 microversion: 2.1 time: 0.107897 Aug 18 21:58:07.472890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 243/486] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:07 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 1309 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:07.955333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-22a0cecc-5c4b-4676-bcdc-26a60e2adb00 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:07.955984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-22a0cecc-5c4b-4676-bcdc-26a60e2adb00 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:07.962619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22a0cecc-5c4b-4676-bcdc-26a60e2adb00 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:07.963377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22a0cecc-5c4b-4676-bcdc-26a60e2adb00 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:07.964164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22a0cecc-5c4b-4676-bcdc-26a60e2adb00 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:07.965148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22a0cecc-5c4b-4676-bcdc-26a60e2adb00 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:07.965745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22a0cecc-5c4b-4676-bcdc-26a60e2adb00 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:07.966271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22a0cecc-5c4b-4676-bcdc-26a60e2adb00 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:08.059823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-22a0cecc-5c4b-4676-bcdc-26a60e2adb00 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:08.067565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-22a0cecc-5c4b-4676-bcdc-26a60e2adb00 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1298 microversion: 2.1 time: 0.115975 Aug 18 21:58:08.068147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 244/487] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:07 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1298 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:08.253947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-178501aa-d5b3-4a01-b82b-17bd17c5df00 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:08.254596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-178501aa-d5b3-4a01-b82b-17bd17c5df00 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:08.261004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-178501aa-d5b3-4a01-b82b-17bd17c5df00 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:08.261484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-178501aa-d5b3-4a01-b82b-17bd17c5df00 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:08.261951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-178501aa-d5b3-4a01-b82b-17bd17c5df00 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:08.262645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-178501aa-d5b3-4a01-b82b-17bd17c5df00 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:08.263094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-178501aa-d5b3-4a01-b82b-17bd17c5df00 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:08.263512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-178501aa-d5b3-4a01-b82b-17bd17c5df00 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:08.402443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-178501aa-d5b3-4a01-b82b-17bd17c5df00 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:08.411057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-178501aa-d5b3-4a01-b82b-17bd17c5df00 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:08.412547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-178501aa-d5b3-4a01-b82b-17bd17c5df00 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:08.413720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-178501aa-d5b3-4a01-b82b-17bd17c5df00 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.163841 Aug 18 21:58:08.414282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 244/488] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:08.493956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a8f8200e-dc20-4a70-bf6b-ca3db6f70560 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:08.494692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a8f8200e-dc20-4a70-bf6b-ca3db6f70560 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 0aa5355b-48a3-4342-998a-e31be1538357] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:08.500622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8f8200e-dc20-4a70-bf6b-ca3db6f70560 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:08.501181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8f8200e-dc20-4a70-bf6b-ca3db6f70560 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:08.501730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8f8200e-dc20-4a70-bf6b-ca3db6f70560 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:08.502486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8f8200e-dc20-4a70-bf6b-ca3db6f70560 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:08.502938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8f8200e-dc20-4a70-bf6b-ca3db6f70560 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:08.503355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8f8200e-dc20-4a70-bf6b-ca3db6f70560 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:08.517285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-a8f8200e-dc20-4a70-bf6b-ca3db6f70560 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] HTTP exception thrown: Instance 0aa5355b-48a3-4342-998a-e31be1538357 could not be found. Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a8f8200e-dc20-4a70-bf6b-ca3db6f70560 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Request method failure captured: Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 HTTP/1.1 Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rWLGT-rMp_xUNyaeCwfTlaqlDdAv2OMxhl0zafo_7EZJzAgHq_yko-ssacj1HgUc8wDYiZor_5oW7Bha2k2hUdTs2XqXvIAG0WOFPXPH5gzHHIU42ZwnIf-NXdTquCLar3rSbyOxOGLN-WGReA1nN_GdN-Cv3YNlicjI16oaX4e7pw Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 3b157ed00f1548f1af769106e03cf9b5 Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesSnapshotTestJSON-273656140 Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 21:58:08.518944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 21:58:08.520337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_3b157ed00f1548f1af769106e03cf9b5", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/3b157ed00f1548f1af769106e03cf9b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/3b157ed00f1548f1af769106e03cf9b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/3b157ed00f1548f1af769106e03cf9b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:58:08.520337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesSnapshotTestJSON-273656140 Aug 18 21:58:08.520337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 3b157ed00f1548f1af769106e03cf9b5 Aug 18 21:58:08.520337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-273656140 Aug 18 21:58:08.520337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesSnapshotTestJSON-273656140-project Aug 18 21:58:08.520337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 21:58:08.520337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 21:58:08.520337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 6a40fd568da34b26bd93b8ff0ea92812 Aug 18 21:58:08.520337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesSnapshotTestJSON-273656140-project Aug 18 21:58:08.520337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 21:58:08.520337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance 0aa5355b-48a3-4342-998a-e31be1538357 could not be found. Aug 18 21:58:08.520337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': '0aa5355b-48a3-4342-998a-e31be1538357'} Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa5355b-48a3-4342-998a-e31be1538357 could not be found. Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:58:08.521223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa5355b-48a3-4342-998a-e31be1538357 could not be found. Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa5355b-48a3-4342-998a-e31be1538357 could not be found. Aug 18 21:58:08.522624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:58:08.523673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a8f8200e-dc20-4a70-bf6b-ca3db6f70560 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Returning 404 to user: Instance 0aa5355b-48a3-4342-998a-e31be1538357 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:58:08.523673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a8f8200e-dc20-4a70-bf6b-ca3db6f70560 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357" status: 404 len: 111 microversion: 2.1 time: 0.030349 Aug 18 21:58:08.524539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 245/489] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:08 2022] GET /compute/v2.1/servers/0aa5355b-48a3-4342-998a-e31be1538357 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:58:08.845942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cca8854f-31e9-42ac-a2c4-3425ba1ede8b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:08.848150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cca8854f-31e9-42ac-a2c4-3425ba1ede8b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:08.856717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cca8854f-31e9-42ac-a2c4-3425ba1ede8b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:08.857447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cca8854f-31e9-42ac-a2c4-3425ba1ede8b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:08.857932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cca8854f-31e9-42ac-a2c4-3425ba1ede8b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:08.858712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cca8854f-31e9-42ac-a2c4-3425ba1ede8b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:08.859343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cca8854f-31e9-42ac-a2c4-3425ba1ede8b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:08.859774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cca8854f-31e9-42ac-a2c4-3425ba1ede8b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:08.864414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:08.937680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cca8854f-31e9-42ac-a2c4-3425ba1ede8b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "POST /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/action" status: 202 len: 0 microversion: 2.1 time: 0.095372 Aug 18 21:58:08.938635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 245/490] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 21:58:08 2022] POST /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:58:08.947771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8d3165cd-826f-43e1-b120-0f33c334d062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:08.948554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8d3165cd-826f-43e1-b120-0f33c334d062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:08.955341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d3165cd-826f-43e1-b120-0f33c334d062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:08.956107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d3165cd-826f-43e1-b120-0f33c334d062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:08.956497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d3165cd-826f-43e1-b120-0f33c334d062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:08.957539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d3165cd-826f-43e1-b120-0f33c334d062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:08.957981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d3165cd-826f-43e1-b120-0f33c334d062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:08.958712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d3165cd-826f-43e1-b120-0f33c334d062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:09.089038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-991e50d9-7710-42af-99d3-c9db16610339 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:09.089782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-991e50d9-7710-42af-99d3-c9db16610339 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:09.096247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991e50d9-7710-42af-99d3-c9db16610339 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:09.096735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991e50d9-7710-42af-99d3-c9db16610339 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:09.097173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991e50d9-7710-42af-99d3-c9db16610339 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:09.097903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991e50d9-7710-42af-99d3-c9db16610339 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:09.098809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991e50d9-7710-42af-99d3-c9db16610339 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:09.098809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-991e50d9-7710-42af-99d3-c9db16610339 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:09.238020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-991e50d9-7710-42af-99d3-c9db16610339 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:09.246527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-991e50d9-7710-42af-99d3-c9db16610339 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.161757 Aug 18 21:58:09.247114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 246/491] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:09 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:09.324793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8d3165cd-826f-43e1-b120-0f33c334d062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:09.332968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8d3165cd-826f-43e1-b120-0f33c334d062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1751 microversion: 2.1 time: 0.389724 Aug 18 21:58:09.333547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 246/492] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:08 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1751 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:09.436918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-872134d1-1908-48d4-a91e-9a962e9772a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:09.437527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-872134d1-1908-48d4-a91e-9a962e9772a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:09.444099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-872134d1-1908-48d4-a91e-9a962e9772a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:09.444585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-872134d1-1908-48d4-a91e-9a962e9772a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:09.445019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-872134d1-1908-48d4-a91e-9a962e9772a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:09.445941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-872134d1-1908-48d4-a91e-9a962e9772a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:09.446395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-872134d1-1908-48d4-a91e-9a962e9772a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:09.446870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-872134d1-1908-48d4-a91e-9a962e9772a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:09.553332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-b558be91-e9aa-479b-8079-d93a39054f41 req-19952c18-0e6e-4c98-bc3f-2bc4baceafba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7625a2b9-485b-4313-ba1b-b8f88221a6fb", "tag": "0ff91d4b-4a96-4c19-83e6-3d9507cf9389"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:09.564020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b558be91-e9aa-479b-8079-d93a39054f41 req-19952c18-0e6e-4c98-bc3f-2bc4baceafba service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:09.564221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b558be91-e9aa-479b-8079-d93a39054f41 req-19952c18-0e6e-4c98-bc3f-2bc4baceafba service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:09.564695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b558be91-e9aa-479b-8079-d93a39054f41 req-19952c18-0e6e-4c98-bc3f-2bc4baceafba service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:09.575873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-b558be91-e9aa-479b-8079-d93a39054f41 req-19952c18-0e6e-4c98-bc3f-2bc4baceafba service nova] Creating event network-changed:0ff91d4b-4a96-4c19-83e6-3d9507cf9389 for instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb on hv-cinder-85367 Aug 18 21:58:09.581466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-872134d1-1908-48d4-a91e-9a962e9772a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:09.587514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-b558be91-e9aa-479b-8079-d93a39054f41 req-19952c18-0e6e-4c98-bc3f-2bc4baceafba service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037978 Aug 18 21:58:09.588412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 247/493] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:58:09.591485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-872134d1-1908-48d4-a91e-9a962e9772a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:09.593383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-872134d1-1908-48d4-a91e-9a962e9772a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:09.594627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-872134d1-1908-48d4-a91e-9a962e9772a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.161652 Aug 18 21:58:09.595233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 247/494] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:10.269066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d290043b-cb9b-45eb-95e5-8f5a2ab9d2a2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:10.269804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d290043b-cb9b-45eb-95e5-8f5a2ab9d2a2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:10.275877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d290043b-cb9b-45eb-95e5-8f5a2ab9d2a2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:10.276357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d290043b-cb9b-45eb-95e5-8f5a2ab9d2a2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:10.276795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d290043b-cb9b-45eb-95e5-8f5a2ab9d2a2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:10.277490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d290043b-cb9b-45eb-95e5-8f5a2ab9d2a2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:10.277980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d290043b-cb9b-45eb-95e5-8f5a2ab9d2a2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:10.278415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d290043b-cb9b-45eb-95e5-8f5a2ab9d2a2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:10.356858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9e58f2ec-45cf-475d-9945-aa4fb66328dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:10.357437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9e58f2ec-45cf-475d-9945-aa4fb66328dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:10.363374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e58f2ec-45cf-475d-9945-aa4fb66328dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:10.363982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e58f2ec-45cf-475d-9945-aa4fb66328dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:10.364289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e58f2ec-45cf-475d-9945-aa4fb66328dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:10.364981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e58f2ec-45cf-475d-9945-aa4fb66328dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:10.365427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e58f2ec-45cf-475d-9945-aa4fb66328dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:10.365881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e58f2ec-45cf-475d-9945-aa4fb66328dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:10.406973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d290043b-cb9b-45eb-95e5-8f5a2ab9d2a2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:10.414611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d290043b-cb9b-45eb-95e5-8f5a2ab9d2a2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.149789 Aug 18 21:58:10.415184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 248/495] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:10 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:10.505212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e58f2ec-45cf-475d-9945-aa4fb66328dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:10.513705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9e58f2ec-45cf-475d-9945-aa4fb66328dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1751 microversion: 2.1 time: 0.161186 Aug 18 21:58:10.514272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 248/496] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:10 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:10.618020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-51c61bbb-0ce2-43a4-9fb9-a84a122ee965 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:10.618683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-51c61bbb-0ce2-43a4-9fb9-a84a122ee965 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:10.624530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51c61bbb-0ce2-43a4-9fb9-a84a122ee965 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:10.625010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51c61bbb-0ce2-43a4-9fb9-a84a122ee965 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:10.625443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51c61bbb-0ce2-43a4-9fb9-a84a122ee965 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:10.626163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51c61bbb-0ce2-43a4-9fb9-a84a122ee965 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:10.626616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51c61bbb-0ce2-43a4-9fb9-a84a122ee965 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:10.627038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51c61bbb-0ce2-43a4-9fb9-a84a122ee965 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:10.759698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-51c61bbb-0ce2-43a4-9fb9-a84a122ee965 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:10.768793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-51c61bbb-0ce2-43a4-9fb9-a84a122ee965 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:10.770343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-51c61bbb-0ce2-43a4-9fb9-a84a122ee965 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:10.771512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-51c61bbb-0ce2-43a4-9fb9-a84a122ee965 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.157834 Aug 18 21:58:10.772231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 249/497] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:11.437082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-df980a1e-71ad-44f5-815c-328f45bfd8de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:11.437715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-df980a1e-71ad-44f5-815c-328f45bfd8de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:11.444321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df980a1e-71ad-44f5-815c-328f45bfd8de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:11.444801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df980a1e-71ad-44f5-815c-328f45bfd8de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:11.445232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df980a1e-71ad-44f5-815c-328f45bfd8de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:11.446107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df980a1e-71ad-44f5-815c-328f45bfd8de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:11.446563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df980a1e-71ad-44f5-815c-328f45bfd8de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:11.447643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df980a1e-71ad-44f5-815c-328f45bfd8de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:11.534949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-72e23881-352a-4d3a-8ce1-437dc1efe4e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:11.535566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-72e23881-352a-4d3a-8ce1-437dc1efe4e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:11.542046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72e23881-352a-4d3a-8ce1-437dc1efe4e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:11.542541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72e23881-352a-4d3a-8ce1-437dc1efe4e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:11.542981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72e23881-352a-4d3a-8ce1-437dc1efe4e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:11.543949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72e23881-352a-4d3a-8ce1-437dc1efe4e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:11.544409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72e23881-352a-4d3a-8ce1-437dc1efe4e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:11.544838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72e23881-352a-4d3a-8ce1-437dc1efe4e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:11.582636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-df980a1e-71ad-44f5-815c-328f45bfd8de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:11.593544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-df980a1e-71ad-44f5-815c-328f45bfd8de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.160194 Aug 18 21:58:11.594166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 249/498] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:11 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:11.796251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-081308ff-6998-44db-b6cd-dd71b17bd8ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:11.797045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-081308ff-6998-44db-b6cd-dd71b17bd8ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:11.807267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-081308ff-6998-44db-b6cd-dd71b17bd8ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:11.807755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-081308ff-6998-44db-b6cd-dd71b17bd8ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:11.808183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-081308ff-6998-44db-b6cd-dd71b17bd8ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:11.808880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-081308ff-6998-44db-b6cd-dd71b17bd8ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:11.809329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-081308ff-6998-44db-b6cd-dd71b17bd8ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:11.809782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-081308ff-6998-44db-b6cd-dd71b17bd8ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:11.883791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-72e23881-352a-4d3a-8ce1-437dc1efe4e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:11.892808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-72e23881-352a-4d3a-8ce1-437dc1efe4e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1751 microversion: 2.1 time: 0.361622 Aug 18 21:58:11.893683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 250/499] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1751 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:11.984404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-081308ff-6998-44db-b6cd-dd71b17bd8ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:11.994366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-081308ff-6998-44db-b6cd-dd71b17bd8ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:11.995867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-081308ff-6998-44db-b6cd-dd71b17bd8ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:11.997247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-081308ff-6998-44db-b6cd-dd71b17bd8ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.205775 Aug 18 21:58:12.001644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 250/500] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:58:12.614651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e5dbed65-3c01-4d26-b4a6-6c7dc68e222e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:12.615324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e5dbed65-3c01-4d26-b4a6-6c7dc68e222e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:12.621952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e5dbed65-3c01-4d26-b4a6-6c7dc68e222e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:12.622428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e5dbed65-3c01-4d26-b4a6-6c7dc68e222e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:12.622856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e5dbed65-3c01-4d26-b4a6-6c7dc68e222e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:12.623538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e5dbed65-3c01-4d26-b4a6-6c7dc68e222e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:12.623986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e5dbed65-3c01-4d26-b4a6-6c7dc68e222e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:12.624402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e5dbed65-3c01-4d26-b4a6-6c7dc68e222e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:12.752397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e5dbed65-3c01-4d26-b4a6-6c7dc68e222e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:12.760011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e5dbed65-3c01-4d26-b4a6-6c7dc68e222e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.149205 Aug 18 21:58:12.760578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 251/501] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:12 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:12.915441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a3bead92-b2c4-4e29-b2fd-3a7b3c28a2a1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:12.916712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a3bead92-b2c4-4e29-b2fd-3a7b3c28a2a1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:12.923529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3bead92-b2c4-4e29-b2fd-3a7b3c28a2a1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:12.924019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3bead92-b2c4-4e29-b2fd-3a7b3c28a2a1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:12.924458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3bead92-b2c4-4e29-b2fd-3a7b3c28a2a1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:12.925165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3bead92-b2c4-4e29-b2fd-3a7b3c28a2a1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:12.925638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3bead92-b2c4-4e29-b2fd-3a7b3c28a2a1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:12.926072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3bead92-b2c4-4e29-b2fd-3a7b3c28a2a1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:13.020132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8c4c0b53-1ca7-4a0d-9dee-9fc704e51a2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:13.020778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8c4c0b53-1ca7-4a0d-9dee-9fc704e51a2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:13.026641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c4c0b53-1ca7-4a0d-9dee-9fc704e51a2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:13.027135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c4c0b53-1ca7-4a0d-9dee-9fc704e51a2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:13.027588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c4c0b53-1ca7-4a0d-9dee-9fc704e51a2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:13.028295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c4c0b53-1ca7-4a0d-9dee-9fc704e51a2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:13.028758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c4c0b53-1ca7-4a0d-9dee-9fc704e51a2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:13.029186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c4c0b53-1ca7-4a0d-9dee-9fc704e51a2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:13.068310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a3bead92-b2c4-4e29-b2fd-3a7b3c28a2a1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:13.076980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a3bead92-b2c4-4e29-b2fd-3a7b3c28a2a1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1751 microversion: 2.1 time: 0.165382 Aug 18 21:58:13.077668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 251/502] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:12 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:13.281889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8c4c0b53-1ca7-4a0d-9dee-9fc704e51a2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:13.290823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8c4c0b53-1ca7-4a0d-9dee-9fc704e51a2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:13.292350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8c4c0b53-1ca7-4a0d-9dee-9fc704e51a2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:13.293805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8c4c0b53-1ca7-4a0d-9dee-9fc704e51a2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.277251 Aug 18 21:58:13.294374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 252/503] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:13 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:58:13.780550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7711422a-7f09-4999-b6c9-89e432d0991e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:13.781170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7711422a-7f09-4999-b6c9-89e432d0991e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:13.783270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:13.788743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7711422a-7f09-4999-b6c9-89e432d0991e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:13.789230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7711422a-7f09-4999-b6c9-89e432d0991e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:13.789707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7711422a-7f09-4999-b6c9-89e432d0991e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:13.790903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7711422a-7f09-4999-b6c9-89e432d0991e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:13.791363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7711422a-7f09-4999-b6c9-89e432d0991e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:13.791792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7711422a-7f09-4999-b6c9-89e432d0991e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:13.923405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7711422a-7f09-4999-b6c9-89e432d0991e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:13.931824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7711422a-7f09-4999-b6c9-89e432d0991e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.154588 Aug 18 21:58:13.932448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 252/504] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:13 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:14.104336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-58daae62-45f4-4923-bed5-4c409abf8570 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:14.104885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-58daae62-45f4-4923-bed5-4c409abf8570 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:14.111317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58daae62-45f4-4923-bed5-4c409abf8570 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:14.111804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58daae62-45f4-4923-bed5-4c409abf8570 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:14.112247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58daae62-45f4-4923-bed5-4c409abf8570 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:14.112943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58daae62-45f4-4923-bed5-4c409abf8570 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:14.113406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58daae62-45f4-4923-bed5-4c409abf8570 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:14.113861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58daae62-45f4-4923-bed5-4c409abf8570 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:14.257096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-58daae62-45f4-4923-bed5-4c409abf8570 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:14.265349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-58daae62-45f4-4923-bed5-4c409abf8570 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.165419 Aug 18 21:58:14.265956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 253/505] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:14.316668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7dc38373-71fd-47fe-b865-20a79a38c2ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:14.317547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7dc38373-71fd-47fe-b865-20a79a38c2ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:14.323176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dc38373-71fd-47fe-b865-20a79a38c2ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:14.323653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dc38373-71fd-47fe-b865-20a79a38c2ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:14.324080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dc38373-71fd-47fe-b865-20a79a38c2ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:14.324766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dc38373-71fd-47fe-b865-20a79a38c2ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:14.325214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dc38373-71fd-47fe-b865-20a79a38c2ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:14.325658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dc38373-71fd-47fe-b865-20a79a38c2ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:14.452545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7dc38373-71fd-47fe-b865-20a79a38c2ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:14.461205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7dc38373-71fd-47fe-b865-20a79a38c2ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:14.463340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7dc38373-71fd-47fe-b865-20a79a38c2ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:14.464517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7dc38373-71fd-47fe-b865-20a79a38c2ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.151984 Aug 18 21:58:14.465126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 253/506] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:14.953506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bab82042-55f5-4b43-b2ac-249dfef6eeb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:14.954067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bab82042-55f5-4b43-b2ac-249dfef6eeb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:14.959897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bab82042-55f5-4b43-b2ac-249dfef6eeb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:14.960381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bab82042-55f5-4b43-b2ac-249dfef6eeb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:14.960809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bab82042-55f5-4b43-b2ac-249dfef6eeb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:14.961483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bab82042-55f5-4b43-b2ac-249dfef6eeb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:14.961957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bab82042-55f5-4b43-b2ac-249dfef6eeb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:14.962375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bab82042-55f5-4b43-b2ac-249dfef6eeb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:15.086965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bab82042-55f5-4b43-b2ac-249dfef6eeb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:15.094625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bab82042-55f5-4b43-b2ac-249dfef6eeb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.145001 Aug 18 21:58:15.095192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 254/507] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:14 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:15.286803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c33b0cfb-27dc-4ff2-bcc2-1cb0ab0cc799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:15.287433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c33b0cfb-27dc-4ff2-bcc2-1cb0ab0cc799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:15.294265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c33b0cfb-27dc-4ff2-bcc2-1cb0ab0cc799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:15.294754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c33b0cfb-27dc-4ff2-bcc2-1cb0ab0cc799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:15.295193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c33b0cfb-27dc-4ff2-bcc2-1cb0ab0cc799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:15.295890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c33b0cfb-27dc-4ff2-bcc2-1cb0ab0cc799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:15.296350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c33b0cfb-27dc-4ff2-bcc2-1cb0ab0cc799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:15.296776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c33b0cfb-27dc-4ff2-bcc2-1cb0ab0cc799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:15.439509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c33b0cfb-27dc-4ff2-bcc2-1cb0ab0cc799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:15.447717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c33b0cfb-27dc-4ff2-bcc2-1cb0ab0cc799 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.165165 Aug 18 21:58:15.448288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 254/508] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:15 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:15.487966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6c2a9f7a-2b75-471d-81ca-41f3b7a085d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:15.488614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6c2a9f7a-2b75-471d-81ca-41f3b7a085d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:15.495175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c2a9f7a-2b75-471d-81ca-41f3b7a085d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:15.495661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c2a9f7a-2b75-471d-81ca-41f3b7a085d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:15.496100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c2a9f7a-2b75-471d-81ca-41f3b7a085d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:15.496793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c2a9f7a-2b75-471d-81ca-41f3b7a085d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:15.497255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c2a9f7a-2b75-471d-81ca-41f3b7a085d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:15.497732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c2a9f7a-2b75-471d-81ca-41f3b7a085d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:15.622766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6c2a9f7a-2b75-471d-81ca-41f3b7a085d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:15.631431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6c2a9f7a-2b75-471d-81ca-41f3b7a085d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:15.632956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6c2a9f7a-2b75-471d-81ca-41f3b7a085d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:15.634142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6c2a9f7a-2b75-471d-81ca-41f3b7a085d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.150046 Aug 18 21:58:15.634707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 255/509] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:16.116072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-11667b03-ae3d-4eb7-8a3d-849005a4a2f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:16.116711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-11667b03-ae3d-4eb7-8a3d-849005a4a2f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:16.122974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11667b03-ae3d-4eb7-8a3d-849005a4a2f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:16.123453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11667b03-ae3d-4eb7-8a3d-849005a4a2f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:16.123887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11667b03-ae3d-4eb7-8a3d-849005a4a2f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:16.124584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11667b03-ae3d-4eb7-8a3d-849005a4a2f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:16.125038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11667b03-ae3d-4eb7-8a3d-849005a4a2f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:16.125462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11667b03-ae3d-4eb7-8a3d-849005a4a2f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:16.258255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-11667b03-ae3d-4eb7-8a3d-849005a4a2f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:16.266534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-11667b03-ae3d-4eb7-8a3d-849005a4a2f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.154394 Aug 18 21:58:16.267102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 255/510] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:16 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:16.428859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2131135144", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "networks": [{"uuid": "82a02ec9-f25d-4d9e-a8f8-b419af8b8326"}]}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:16.468386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52eb8609-c61c-4819-9e49-7320d9f63894 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:16.469007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-52eb8609-c61c-4819-9e49-7320d9f63894 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:16.475657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52eb8609-c61c-4819-9e49-7320d9f63894 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:16.476237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52eb8609-c61c-4819-9e49-7320d9f63894 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:16.476677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52eb8609-c61c-4819-9e49-7320d9f63894 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:16.477533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52eb8609-c61c-4819-9e49-7320d9f63894 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:16.478084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52eb8609-c61c-4819-9e49-7320d9f63894 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:16.478514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52eb8609-c61c-4819-9e49-7320d9f63894 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:16.480928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] validate_networks() for [('82a02ec9-f25d-4d9e-a8f8-b419af8b8326', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 21:58:16.627634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-52eb8609-c61c-4819-9e49-7320d9f63894 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:16.636560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-52eb8609-c61c-4819-9e49-7320d9f63894 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.172090 Aug 18 21:58:16.637161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 256/511] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:16.656804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-67bc6713-c936-45cb-a301-43708605fbd3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:16.657736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-67bc6713-c936-45cb-a301-43708605fbd3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:16.664983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67bc6713-c936-45cb-a301-43708605fbd3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:16.666119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67bc6713-c936-45cb-a301-43708605fbd3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:16.666631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67bc6713-c936-45cb-a301-43708605fbd3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:16.667631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67bc6713-c936-45cb-a301-43708605fbd3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:16.668203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67bc6713-c936-45cb-a301-43708605fbd3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:16.668939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67bc6713-c936-45cb-a301-43708605fbd3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:16.816511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-67bc6713-c936-45cb-a301-43708605fbd3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:16.825667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-67bc6713-c936-45cb-a301-43708605fbd3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:16.827164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-67bc6713-c936-45cb-a301-43708605fbd3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:16.828311 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-67bc6713-c936-45cb-a301-43708605fbd3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.175431 Aug 18 21:58:16.828881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 257/512] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:16.866172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 21:58:16.866695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 21:58:16.867098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 21:58:16.867513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 21:58:16.867930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 21:58:16.876718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:16.877200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:16.877669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:16.878429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:16.878884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:16.879314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:16.897223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Getting quotas for project 3b157ed00f1548f1af769106e03cf9b5. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 21:58:16.901970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Getting quotas for user 6a40fd568da34b26bd93b8ff0ea92812 and project 3b157ed00f1548f1af769106e03cf9b5. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 21:58:16.912863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 21:58:16.915187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 21:58:16.962014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d44a311f-39c8-409f-bc24-c1e3aaa116e2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536924 Aug 18 21:58:16.962754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 256/513] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 21:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 21:58:16.974429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f68fa7c3-17fc-45bd-a246-d7ce5be44767 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:16.975044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f68fa7c3-17fc-45bd-a246-d7ce5be44767 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:17.030036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f68fa7c3-17fc-45bd-a246-d7ce5be44767 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:17.036850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f68fa7c3-17fc-45bd-a246-d7ce5be44767 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1219 microversion: 2.1 time: 0.066388 Aug 18 21:58:17.037410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 258/514] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:16 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:17.288034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-72a41964-afc9-452b-8cd8-8f565d45f161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:17.288677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-72a41964-afc9-452b-8cd8-8f565d45f161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:17.294853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72a41964-afc9-452b-8cd8-8f565d45f161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:17.295329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72a41964-afc9-452b-8cd8-8f565d45f161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:17.295762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72a41964-afc9-452b-8cd8-8f565d45f161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:17.296445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72a41964-afc9-452b-8cd8-8f565d45f161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:17.296895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72a41964-afc9-452b-8cd8-8f565d45f161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:17.297313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72a41964-afc9-452b-8cd8-8f565d45f161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:17.435781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-72a41964-afc9-452b-8cd8-8f565d45f161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:17.443818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-72a41964-afc9-452b-8cd8-8f565d45f161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.159676 Aug 18 21:58:17.444419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 257/515] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:17 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:17.661104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ac4fbde8-420e-4a08-93a9-cd18708acd7f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:17.661631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ac4fbde8-420e-4a08-93a9-cd18708acd7f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:17.665150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-74106219-4d43-45a5-af44-00a03c3de735 req-8afa3fb9-6c03-4e45-9d65-92478e3e76ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0426bb7b-e862-4873-9c1e-7878b89cde47", "name": "network-vif-plugged", "status": "completed", "tag": "a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:17.669625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac4fbde8-420e-4a08-93a9-cd18708acd7f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:17.670002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac4fbde8-420e-4a08-93a9-cd18708acd7f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:17.670648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac4fbde8-420e-4a08-93a9-cd18708acd7f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:17.671428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac4fbde8-420e-4a08-93a9-cd18708acd7f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:17.671950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac4fbde8-420e-4a08-93a9-cd18708acd7f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:17.672680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac4fbde8-420e-4a08-93a9-cd18708acd7f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:17.677002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-74106219-4d43-45a5-af44-00a03c3de735 req-8afa3fb9-6c03-4e45-9d65-92478e3e76ee service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:17.677943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-74106219-4d43-45a5-af44-00a03c3de735 req-8afa3fb9-6c03-4e45-9d65-92478e3e76ee service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:17.678392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-74106219-4d43-45a5-af44-00a03c3de735 req-8afa3fb9-6c03-4e45-9d65-92478e3e76ee service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:17.697429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-74106219-4d43-45a5-af44-00a03c3de735 req-8afa3fb9-6c03-4e45-9d65-92478e3e76ee service nova] Creating event network-vif-plugged:a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b for instance 0426bb7b-e862-4873-9c1e-7878b89cde47 on hv-cinder-85367 Aug 18 21:58:17.703669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-74106219-4d43-45a5-af44-00a03c3de735 req-8afa3fb9-6c03-4e45-9d65-92478e3e76ee service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042198 Aug 18 21:58:17.704671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 258/516] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:58:17.816702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ac4fbde8-420e-4a08-93a9-cd18708acd7f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:17.824915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ac4fbde8-420e-4a08-93a9-cd18708acd7f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.168090 Aug 18 21:58:17.825494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 259/517] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:17.852054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fc109ada-c2bb-4cb6-a980-9718d0116d0f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:17.853277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fc109ada-c2bb-4cb6-a980-9718d0116d0f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:17.859460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc109ada-c2bb-4cb6-a980-9718d0116d0f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:17.859944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc109ada-c2bb-4cb6-a980-9718d0116d0f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:17.860380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc109ada-c2bb-4cb6-a980-9718d0116d0f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:17.861065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc109ada-c2bb-4cb6-a980-9718d0116d0f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:17.861518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc109ada-c2bb-4cb6-a980-9718d0116d0f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:17.861969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc109ada-c2bb-4cb6-a980-9718d0116d0f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:17.879731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:17.995857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fc109ada-c2bb-4cb6-a980-9718d0116d0f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:18.004499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fc109ada-c2bb-4cb6-a980-9718d0116d0f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:18.006026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fc109ada-c2bb-4cb6-a980-9718d0116d0f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:18.007181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fc109ada-c2bb-4cb6-a980-9718d0116d0f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.159360 Aug 18 21:58:18.007743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 259/518] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:18.057424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5dca629f-070f-42de-b801-c9d1741ad927 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:18.058073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5dca629f-070f-42de-b801-c9d1741ad927 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:18.063956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5dca629f-070f-42de-b801-c9d1741ad927 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:18.064489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5dca629f-070f-42de-b801-c9d1741ad927 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:18.064881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5dca629f-070f-42de-b801-c9d1741ad927 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:18.065572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5dca629f-070f-42de-b801-c9d1741ad927 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:18.066053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5dca629f-070f-42de-b801-c9d1741ad927 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:18.066483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5dca629f-070f-42de-b801-c9d1741ad927 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:18.129863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5dca629f-070f-42de-b801-c9d1741ad927 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:18.137405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5dca629f-070f-42de-b801-c9d1741ad927 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1279 microversion: 2.1 time: 0.083876 Aug 18 21:58:18.138021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 260/519] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:18 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1279 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:18.465451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aecbf284-11cc-4d26-b480-86d1f7dc88b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:18.466226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-aecbf284-11cc-4d26-b480-86d1f7dc88b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:18.474626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aecbf284-11cc-4d26-b480-86d1f7dc88b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:18.475206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aecbf284-11cc-4d26-b480-86d1f7dc88b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:18.475722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aecbf284-11cc-4d26-b480-86d1f7dc88b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:18.476504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aecbf284-11cc-4d26-b480-86d1f7dc88b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:18.477057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aecbf284-11cc-4d26-b480-86d1f7dc88b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:18.477560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aecbf284-11cc-4d26-b480-86d1f7dc88b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:18.692868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aecbf284-11cc-4d26-b480-86d1f7dc88b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:18.701690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aecbf284-11cc-4d26-b480-86d1f7dc88b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.240782 Aug 18 21:58:18.702278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 260/520] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:18 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:18.846458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5d3fafdb-2856-4099-84d5-2fba9ebd1af6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:18.847068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5d3fafdb-2856-4099-84d5-2fba9ebd1af6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:18.853965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d3fafdb-2856-4099-84d5-2fba9ebd1af6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:18.854459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d3fafdb-2856-4099-84d5-2fba9ebd1af6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:18.854891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d3fafdb-2856-4099-84d5-2fba9ebd1af6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:18.855620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d3fafdb-2856-4099-84d5-2fba9ebd1af6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:18.856069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d3fafdb-2856-4099-84d5-2fba9ebd1af6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:18.856487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d3fafdb-2856-4099-84d5-2fba9ebd1af6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:19.002196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5d3fafdb-2856-4099-84d5-2fba9ebd1af6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:19.004444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:19.012235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5d3fafdb-2856-4099-84d5-2fba9ebd1af6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.169704 Aug 18 21:58:19.012815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 261/521] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:19.030940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-444443ad-6ee3-4f37-a58d-19000ff7c1e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:19.031669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-444443ad-6ee3-4f37-a58d-19000ff7c1e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:19.038161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-444443ad-6ee3-4f37-a58d-19000ff7c1e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:19.038650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-444443ad-6ee3-4f37-a58d-19000ff7c1e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:19.039092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-444443ad-6ee3-4f37-a58d-19000ff7c1e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:19.039791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-444443ad-6ee3-4f37-a58d-19000ff7c1e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:19.040820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-444443ad-6ee3-4f37-a58d-19000ff7c1e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:19.041424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-444443ad-6ee3-4f37-a58d-19000ff7c1e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:19.159294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-41b15982-e1df-4731-a46c-46cb7e233ccb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:19.160025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-41b15982-e1df-4731-a46c-46cb7e233ccb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:19.166559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41b15982-e1df-4731-a46c-46cb7e233ccb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:19.167152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41b15982-e1df-4731-a46c-46cb7e233ccb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:19.167717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41b15982-e1df-4731-a46c-46cb7e233ccb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:19.168745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41b15982-e1df-4731-a46c-46cb7e233ccb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:19.169331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41b15982-e1df-4731-a46c-46cb7e233ccb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:19.169857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41b15982-e1df-4731-a46c-46cb7e233ccb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:19.236286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-41b15982-e1df-4731-a46c-46cb7e233ccb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:19.244462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-41b15982-e1df-4731-a46c-46cb7e233ccb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1277 microversion: 2.1 time: 0.089449 Aug 18 21:58:19.245050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 262/522] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:19 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:19.279021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-444443ad-6ee3-4f37-a58d-19000ff7c1e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:19.287977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-444443ad-6ee3-4f37-a58d-19000ff7c1e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:19.290112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-444443ad-6ee3-4f37-a58d-19000ff7c1e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:19.291519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-444443ad-6ee3-4f37-a58d-19000ff7c1e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.265137 Aug 18 21:58:19.292099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 261/523] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:19.692036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-080cd7a0-19e5-45c9-9fe9-bf360152de7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77ca1fdd-7c40-445d-ab22-9f784df4ce01"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:19.694522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-080cd7a0-19e5-45c9-9fe9-bf360152de7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:19.705645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-080cd7a0-19e5-45c9-9fe9-bf360152de7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:19.706085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-080cd7a0-19e5-45c9-9fe9-bf360152de7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:19.706521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-080cd7a0-19e5-45c9-9fe9-bf360152de7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:19.707238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-080cd7a0-19e5-45c9-9fe9-bf360152de7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:19.707845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-080cd7a0-19e5-45c9-9fe9-bf360152de7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:19.708779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-080cd7a0-19e5-45c9-9fe9-bf360152de7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:19.723379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dc9f8feb-f139-4fae-902b-ed461b526c16 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:19.724277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dc9f8feb-f139-4fae-902b-ed461b526c16 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:19.731449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc9f8feb-f139-4fae-902b-ed461b526c16 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:19.732831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc9f8feb-f139-4fae-902b-ed461b526c16 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:19.733451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc9f8feb-f139-4fae-902b-ed461b526c16 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:19.734344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc9f8feb-f139-4fae-902b-ed461b526c16 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:19.734963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc9f8feb-f139-4fae-902b-ed461b526c16 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:19.735551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc9f8feb-f139-4fae-902b-ed461b526c16 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:20.013735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dc9f8feb-f139-4fae-902b-ed461b526c16 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:20.022830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dc9f8feb-f139-4fae-902b-ed461b526c16 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.303082 Aug 18 21:58:20.023557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 262/524] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:19 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:20.029206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-080cd7a0-19e5-45c9-9fe9-bf360152de7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "POST /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340989 Aug 18 21:58:20.030190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 263/525] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 21:58:19 2022] POST /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:58:20.039684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fb72078f-41a9-467c-a75f-1eb03ae8d118 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:20.040328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fb72078f-41a9-467c-a75f-1eb03ae8d118 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:20.046727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb72078f-41a9-467c-a75f-1eb03ae8d118 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:20.047061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb72078f-41a9-467c-a75f-1eb03ae8d118 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:20.047526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb72078f-41a9-467c-a75f-1eb03ae8d118 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:20.048188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb72078f-41a9-467c-a75f-1eb03ae8d118 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:20.048792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb72078f-41a9-467c-a75f-1eb03ae8d118 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:20.049362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb72078f-41a9-467c-a75f-1eb03ae8d118 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:20.271118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f01d55fe-e384-4d24-b68c-de604c28c592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:20.272066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f01d55fe-e384-4d24-b68c-de604c28c592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:20.279695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f01d55fe-e384-4d24-b68c-de604c28c592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:20.280398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f01d55fe-e384-4d24-b68c-de604c28c592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:20.280976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f01d55fe-e384-4d24-b68c-de604c28c592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:20.281997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f01d55fe-e384-4d24-b68c-de604c28c592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:20.282604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f01d55fe-e384-4d24-b68c-de604c28c592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:20.283209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f01d55fe-e384-4d24-b68c-de604c28c592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:20.297932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fb72078f-41a9-467c-a75f-1eb03ae8d118 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:20.309841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fb72078f-41a9-467c-a75f-1eb03ae8d118 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.272192 Aug 18 21:58:20.311511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 263/526] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:20 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:20.316769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cef00253-6437-4f7e-a3c8-7aa2b782fd63 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:20.317512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cef00253-6437-4f7e-a3c8-7aa2b782fd63 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:20.324310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cef00253-6437-4f7e-a3c8-7aa2b782fd63 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:20.324918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cef00253-6437-4f7e-a3c8-7aa2b782fd63 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:20.325457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cef00253-6437-4f7e-a3c8-7aa2b782fd63 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:20.326277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cef00253-6437-4f7e-a3c8-7aa2b782fd63 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:20.326993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cef00253-6437-4f7e-a3c8-7aa2b782fd63 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:20.327632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cef00253-6437-4f7e-a3c8-7aa2b782fd63 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:20.436843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f01d55fe-e384-4d24-b68c-de604c28c592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:20.444716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f01d55fe-e384-4d24-b68c-de604c28c592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1319 microversion: 2.1 time: 0.178191 Aug 18 21:58:20.445312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 264/527] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:20 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:20.486235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-67e8994f-1fa1-45c3-bf91-bb0a1395ed1a req-16325499-1e91-4fdd-9b7f-1cd9c6c5e723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f0b7a98-3ba3-4739-8b60-3c7946107c6e", "tag": "b3adcd12-7019-4150-9399-0b0bcc04b72b"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:20.501327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-67e8994f-1fa1-45c3-bf91-bb0a1395ed1a req-16325499-1e91-4fdd-9b7f-1cd9c6c5e723 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:20.501837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-67e8994f-1fa1-45c3-bf91-bb0a1395ed1a req-16325499-1e91-4fdd-9b7f-1cd9c6c5e723 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:20.502262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-67e8994f-1fa1-45c3-bf91-bb0a1395ed1a req-16325499-1e91-4fdd-9b7f-1cd9c6c5e723 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:20.514903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-67e8994f-1fa1-45c3-bf91-bb0a1395ed1a req-16325499-1e91-4fdd-9b7f-1cd9c6c5e723 service nova] Creating event network-changed:b3adcd12-7019-4150-9399-0b0bcc04b72b for instance 3f0b7a98-3ba3-4739-8b60-3c7946107c6e on hv-cinder-85367 Aug 18 21:58:20.521819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-67e8994f-1fa1-45c3-bf91-bb0a1395ed1a req-16325499-1e91-4fdd-9b7f-1cd9c6c5e723 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038733 Aug 18 21:58:20.522408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 265/528] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:58:20.537725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cef00253-6437-4f7e-a3c8-7aa2b782fd63 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:20.548061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cef00253-6437-4f7e-a3c8-7aa2b782fd63 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:20.549583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cef00253-6437-4f7e-a3c8-7aa2b782fd63 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:20.550750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cef00253-6437-4f7e-a3c8-7aa2b782fd63 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.237995 Aug 18 21:58:20.551322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 264/529] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:20 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 21:58:21.046803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f59f7f93-bbcc-4571-8b72-4f179f32fa96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:21.048106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f59f7f93-bbcc-4571-8b72-4f179f32fa96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:21.054203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f59f7f93-bbcc-4571-8b72-4f179f32fa96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:21.054688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f59f7f93-bbcc-4571-8b72-4f179f32fa96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:21.055299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f59f7f93-bbcc-4571-8b72-4f179f32fa96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:21.056104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f59f7f93-bbcc-4571-8b72-4f179f32fa96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:21.056720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f59f7f93-bbcc-4571-8b72-4f179f32fa96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:21.057158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f59f7f93-bbcc-4571-8b72-4f179f32fa96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:21.199697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f59f7f93-bbcc-4571-8b72-4f179f32fa96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:21.208160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f59f7f93-bbcc-4571-8b72-4f179f32fa96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.165895 Aug 18 21:58:21.208366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 266/530] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:21 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:21.337113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-66832f77-339a-4abf-820d-ef2e733b40c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:21.337760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-66832f77-339a-4abf-820d-ef2e733b40c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:21.343740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66832f77-339a-4abf-820d-ef2e733b40c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:21.344259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66832f77-339a-4abf-820d-ef2e733b40c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:21.344693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66832f77-339a-4abf-820d-ef2e733b40c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:21.345378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66832f77-339a-4abf-820d-ef2e733b40c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:21.345862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66832f77-339a-4abf-820d-ef2e733b40c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:21.346282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66832f77-339a-4abf-820d-ef2e733b40c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:21.465030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8e0b2830-dd4b-45c2-954a-8737c19bec9c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:21.465702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8e0b2830-dd4b-45c2-954a-8737c19bec9c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:21.471846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e0b2830-dd4b-45c2-954a-8737c19bec9c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:21.472276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e0b2830-dd4b-45c2-954a-8737c19bec9c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:21.472728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e0b2830-dd4b-45c2-954a-8737c19bec9c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:21.473503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e0b2830-dd4b-45c2-954a-8737c19bec9c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:21.473987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e0b2830-dd4b-45c2-954a-8737c19bec9c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:21.474411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e0b2830-dd4b-45c2-954a-8737c19bec9c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:21.487955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-66832f77-339a-4abf-820d-ef2e733b40c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:21.496884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-66832f77-339a-4abf-820d-ef2e733b40c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.163676 Aug 18 21:58:21.497478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 265/531] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:21 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:21.574516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-544b2d1f-39e3-4b55-a81f-0e4bd783730a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:21.575310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-544b2d1f-39e3-4b55-a81f-0e4bd783730a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:21.582122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-544b2d1f-39e3-4b55-a81f-0e4bd783730a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:21.582706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-544b2d1f-39e3-4b55-a81f-0e4bd783730a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:21.583368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-544b2d1f-39e3-4b55-a81f-0e4bd783730a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:21.584333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-544b2d1f-39e3-4b55-a81f-0e4bd783730a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:21.584865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-544b2d1f-39e3-4b55-a81f-0e4bd783730a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:21.585297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-544b2d1f-39e3-4b55-a81f-0e4bd783730a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:21.619194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8e0b2830-dd4b-45c2-954a-8737c19bec9c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:21.630839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8e0b2830-dd4b-45c2-954a-8737c19bec9c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1319 microversion: 2.1 time: 0.169696 Aug 18 21:58:21.643702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 267/532] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:21 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:21.669862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-11511e6b-8999-4010-a051-34431b772b3d req-69422286-e9f8-46de-860a-a99d0294d816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7625a2b9-485b-4313-ba1b-b8f88221a6fb", "name": "network-vif-plugged", "status": "completed", "tag": "0ff91d4b-4a96-4c19-83e6-3d9507cf9389"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:21.679840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-11511e6b-8999-4010-a051-34431b772b3d req-69422286-e9f8-46de-860a-a99d0294d816 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:21.680402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-11511e6b-8999-4010-a051-34431b772b3d req-69422286-e9f8-46de-860a-a99d0294d816 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:21.680937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-11511e6b-8999-4010-a051-34431b772b3d req-69422286-e9f8-46de-860a-a99d0294d816 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:21.692909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-11511e6b-8999-4010-a051-34431b772b3d req-69422286-e9f8-46de-860a-a99d0294d816 service nova] Creating event network-vif-plugged:0ff91d4b-4a96-4c19-83e6-3d9507cf9389 for instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb on hv-cinder-85367 Aug 18 21:58:21.698113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-11511e6b-8999-4010-a051-34431b772b3d req-69422286-e9f8-46de-860a-a99d0294d816 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034723 Aug 18 21:58:21.698951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 268/533] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:58:21.737832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-544b2d1f-39e3-4b55-a81f-0e4bd783730a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:21.747043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-544b2d1f-39e3-4b55-a81f-0e4bd783730a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:21.748552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-544b2d1f-39e3-4b55-a81f-0e4bd783730a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:21.749754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-544b2d1f-39e3-4b55-a81f-0e4bd783730a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1808 microversion: 2.20 time: 0.179456 Aug 18 21:58:21.750313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 266/534] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:58:22.229375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4aa214cf-3407-4e0b-a480-9d53c7111d6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:22.230113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4aa214cf-3407-4e0b-a480-9d53c7111d6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:22.236336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa214cf-3407-4e0b-a480-9d53c7111d6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:22.236861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa214cf-3407-4e0b-a480-9d53c7111d6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:22.237309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa214cf-3407-4e0b-a480-9d53c7111d6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:22.238072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa214cf-3407-4e0b-a480-9d53c7111d6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:22.238570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa214cf-3407-4e0b-a480-9d53c7111d6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:22.239184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa214cf-3407-4e0b-a480-9d53c7111d6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:22.403212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4aa214cf-3407-4e0b-a480-9d53c7111d6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:22.411995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4aa214cf-3407-4e0b-a480-9d53c7111d6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.186773 Aug 18 21:58:22.412690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 269/535] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:22 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:22.517612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-80486993-4550-443d-bc70-dde27213ee33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:22.518233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-80486993-4550-443d-bc70-dde27213ee33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:22.524144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80486993-4550-443d-bc70-dde27213ee33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:22.524629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80486993-4550-443d-bc70-dde27213ee33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:22.525074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80486993-4550-443d-bc70-dde27213ee33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:22.525788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80486993-4550-443d-bc70-dde27213ee33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:22.526240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80486993-4550-443d-bc70-dde27213ee33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:22.526668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80486993-4550-443d-bc70-dde27213ee33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:22.651474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2945b481-dc6d-4e74-acb8-36b4d366bd0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:22.652298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2945b481-dc6d-4e74-acb8-36b4d366bd0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:22.659248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2945b481-dc6d-4e74-acb8-36b4d366bd0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:22.659813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2945b481-dc6d-4e74-acb8-36b4d366bd0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:22.660366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2945b481-dc6d-4e74-acb8-36b4d366bd0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:22.661109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2945b481-dc6d-4e74-acb8-36b4d366bd0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:22.661666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2945b481-dc6d-4e74-acb8-36b4d366bd0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:22.662174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2945b481-dc6d-4e74-acb8-36b4d366bd0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:22.714156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-80486993-4550-443d-bc70-dde27213ee33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:22.722436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-80486993-4550-443d-bc70-dde27213ee33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.208615 Aug 18 21:58:22.723401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 267/536] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:22 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:22.772190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-efe9c3db-20c2-47df-90f7-d2bfbc7a156a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:22.772813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-efe9c3db-20c2-47df-90f7-d2bfbc7a156a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:22.778842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efe9c3db-20c2-47df-90f7-d2bfbc7a156a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:22.779329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efe9c3db-20c2-47df-90f7-d2bfbc7a156a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:22.779771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efe9c3db-20c2-47df-90f7-d2bfbc7a156a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:22.780471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efe9c3db-20c2-47df-90f7-d2bfbc7a156a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:22.780931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efe9c3db-20c2-47df-90f7-d2bfbc7a156a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:22.781361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efe9c3db-20c2-47df-90f7-d2bfbc7a156a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:22.791944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2945b481-dc6d-4e74-acb8-36b4d366bd0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:22.800589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2945b481-dc6d-4e74-acb8-36b4d366bd0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1319 microversion: 2.1 time: 0.153300 Aug 18 21:58:22.801172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 270/537] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:22 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:22.991962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-efe9c3db-20c2-47df-90f7-d2bfbc7a156a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:23.001307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-efe9c3db-20c2-47df-90f7-d2bfbc7a156a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:23.002986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-efe9c3db-20c2-47df-90f7-d2bfbc7a156a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:23.004332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-efe9c3db-20c2-47df-90f7-d2bfbc7a156a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1795 microversion: 2.20 time: 0.235924 Aug 18 21:58:23.004907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 268/538] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 21:58:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1795 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 21:58:23.433251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a4da189-2440-4c88-ac99-42a34882171f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:23.433926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0a4da189-2440-4c88-ac99-42a34882171f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:23.439939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a4da189-2440-4c88-ac99-42a34882171f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:23.440422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a4da189-2440-4c88-ac99-42a34882171f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:23.440860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a4da189-2440-4c88-ac99-42a34882171f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:23.441552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a4da189-2440-4c88-ac99-42a34882171f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:23.442037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a4da189-2440-4c88-ac99-42a34882171f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:23.442464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a4da189-2440-4c88-ac99-42a34882171f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:23.574755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0a4da189-2440-4c88-ac99-42a34882171f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:23.583025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a4da189-2440-4c88-ac99-42a34882171f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1365 microversion: 2.1 time: 0.153633 Aug 18 21:58:23.583630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 271/539] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:23 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:23.744312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d28d64a1-1dc6-467e-b9e9-66ce5849d314 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:23.744938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d28d64a1-1dc6-467e-b9e9-66ce5849d314 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:23.752365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d28d64a1-1dc6-467e-b9e9-66ce5849d314 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:23.752365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d28d64a1-1dc6-467e-b9e9-66ce5849d314 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:23.752728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d28d64a1-1dc6-467e-b9e9-66ce5849d314 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:23.753430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d28d64a1-1dc6-467e-b9e9-66ce5849d314 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:23.753920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d28d64a1-1dc6-467e-b9e9-66ce5849d314 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:23.754355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d28d64a1-1dc6-467e-b9e9-66ce5849d314 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:23.822114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1e38d9bf-0ac5-4f86-92f2-9a2f36bea373 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:23.822844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1e38d9bf-0ac5-4f86-92f2-9a2f36bea373 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:23.829214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e38d9bf-0ac5-4f86-92f2-9a2f36bea373 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:23.829824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e38d9bf-0ac5-4f86-92f2-9a2f36bea373 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:23.830332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e38d9bf-0ac5-4f86-92f2-9a2f36bea373 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:23.831128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e38d9bf-0ac5-4f86-92f2-9a2f36bea373 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:23.831649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e38d9bf-0ac5-4f86-92f2-9a2f36bea373 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:23.832143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e38d9bf-0ac5-4f86-92f2-9a2f36bea373 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:23.904437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d28d64a1-1dc6-467e-b9e9-66ce5849d314 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:23.912689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d28d64a1-1dc6-467e-b9e9-66ce5849d314 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.172216 Aug 18 21:58:23.913264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 269/540] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:23 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:23.964147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1e38d9bf-0ac5-4f86-92f2-9a2f36bea373 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:23.971721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1e38d9bf-0ac5-4f86-92f2-9a2f36bea373 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1319 microversion: 2.1 time: 0.153989 Aug 18 21:58:23.972293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 272/541] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:23 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:24.605444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b4d72f45-f930-45c0-9df6-59a72b449f43 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:24.606014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b4d72f45-f930-45c0-9df6-59a72b449f43 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:24.612041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4d72f45-f930-45c0-9df6-59a72b449f43 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:24.612527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4d72f45-f930-45c0-9df6-59a72b449f43 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:24.612966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4d72f45-f930-45c0-9df6-59a72b449f43 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:24.613682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4d72f45-f930-45c0-9df6-59a72b449f43 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:24.614145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4d72f45-f930-45c0-9df6-59a72b449f43 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:24.614574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4d72f45-f930-45c0-9df6-59a72b449f43 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:24.745669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b4d72f45-f930-45c0-9df6-59a72b449f43 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:24.753367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b4d72f45-f930-45c0-9df6-59a72b449f43 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1556 microversion: 2.1 time: 0.152517 Aug 18 21:58:24.754032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 270/542] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:24 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:24.773397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7a84941c-b51e-4c8d-84ca-8c0d906ca5dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:24.773954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7a84941c-b51e-4c8d-84ca-8c0d906ca5dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:24.780364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a84941c-b51e-4c8d-84ca-8c0d906ca5dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:24.780842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a84941c-b51e-4c8d-84ca-8c0d906ca5dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:24.781273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a84941c-b51e-4c8d-84ca-8c0d906ca5dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:24.782018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a84941c-b51e-4c8d-84ca-8c0d906ca5dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:24.782468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a84941c-b51e-4c8d-84ca-8c0d906ca5dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:24.782890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a84941c-b51e-4c8d-84ca-8c0d906ca5dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:24.862250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7a84941c-b51e-4c8d-84ca-8c0d906ca5dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092639 Aug 18 21:58:24.862849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 273/543] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 21:58:24 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:58:24.933973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a74d25e5-1721-49f7-99c1-1a725b10628d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:24.934592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a74d25e5-1721-49f7-99c1-1a725b10628d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:24.940523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a74d25e5-1721-49f7-99c1-1a725b10628d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:24.940992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a74d25e5-1721-49f7-99c1-1a725b10628d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:24.941477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a74d25e5-1721-49f7-99c1-1a725b10628d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:24.942854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a74d25e5-1721-49f7-99c1-1a725b10628d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:24.943168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a74d25e5-1721-49f7-99c1-1a725b10628d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:24.943624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a74d25e5-1721-49f7-99c1-1a725b10628d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:24.992351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-45f5867b-ff77-45a7-8922-f0dc439989e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:24.992960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-45f5867b-ff77-45a7-8922-f0dc439989e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:24.999049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45f5867b-ff77-45a7-8922-f0dc439989e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:24.999550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45f5867b-ff77-45a7-8922-f0dc439989e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:24.999985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45f5867b-ff77-45a7-8922-f0dc439989e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:25.000677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45f5867b-ff77-45a7-8922-f0dc439989e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:25.001124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45f5867b-ff77-45a7-8922-f0dc439989e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:25.001545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45f5867b-ff77-45a7-8922-f0dc439989e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:25.089736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a74d25e5-1721-49f7-99c1-1a725b10628d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:25.098011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a74d25e5-1721-49f7-99c1-1a725b10628d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.167882 Aug 18 21:58:25.098583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 271/544] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:25.269211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-45f5867b-ff77-45a7-8922-f0dc439989e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:25.277470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-45f5867b-ff77-45a7-8922-f0dc439989e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1319 microversion: 2.1 time: 0.289005 Aug 18 21:58:25.278079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 274/545] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:24 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:25.697076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-3e394765-29fd-4399-9f2f-fc9bb82d2fb2 req-891228cd-58d2-4377-b829-e5ee10657d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f0b7a98-3ba3-4739-8b60-3c7946107c6e", "name": "network-vif-plugged", "status": "completed", "tag": "b3adcd12-7019-4150-9399-0b0bcc04b72b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:25.706780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-3e394765-29fd-4399-9f2f-fc9bb82d2fb2 req-891228cd-58d2-4377-b829-e5ee10657d22 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:25.707274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-3e394765-29fd-4399-9f2f-fc9bb82d2fb2 req-891228cd-58d2-4377-b829-e5ee10657d22 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:25.707775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-3e394765-29fd-4399-9f2f-fc9bb82d2fb2 req-891228cd-58d2-4377-b829-e5ee10657d22 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:25.720302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-3e394765-29fd-4399-9f2f-fc9bb82d2fb2 req-891228cd-58d2-4377-b829-e5ee10657d22 service nova] Creating event network-vif-plugged:b3adcd12-7019-4150-9399-0b0bcc04b72b for instance 3f0b7a98-3ba3-4739-8b60-3c7946107c6e on hv-cinder-85367 Aug 18 21:58:25.724804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-3e394765-29fd-4399-9f2f-fc9bb82d2fb2 req-891228cd-58d2-4377-b829-e5ee10657d22 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031856 Aug 18 21:58:25.725623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 272/546] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:58:26.113016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-743e3d4a-d19b-4faa-bad9-702b809d4e34 req-0df97746-c47f-4f81-a30f-846220b5bd70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7625a2b9-485b-4313-ba1b-b8f88221a6fb", "tag": "0ff91d4b-4a96-4c19-83e6-3d9507cf9389"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:26.120086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-df5e66e7-476c-485e-b483-5197e58e891c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:26.121099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-df5e66e7-476c-485e-b483-5197e58e891c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:26.125244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-743e3d4a-d19b-4faa-bad9-702b809d4e34 req-0df97746-c47f-4f81-a30f-846220b5bd70 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:26.125774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-743e3d4a-d19b-4faa-bad9-702b809d4e34 req-0df97746-c47f-4f81-a30f-846220b5bd70 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:26.126205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-743e3d4a-d19b-4faa-bad9-702b809d4e34 req-0df97746-c47f-4f81-a30f-846220b5bd70 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:26.127442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df5e66e7-476c-485e-b483-5197e58e891c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:26.127983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df5e66e7-476c-485e-b483-5197e58e891c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:26.128480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df5e66e7-476c-485e-b483-5197e58e891c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:26.129395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df5e66e7-476c-485e-b483-5197e58e891c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:26.130775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df5e66e7-476c-485e-b483-5197e58e891c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:26.131283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df5e66e7-476c-485e-b483-5197e58e891c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:26.140635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-743e3d4a-d19b-4faa-bad9-702b809d4e34 req-0df97746-c47f-4f81-a30f-846220b5bd70 service nova] Creating event network-changed:0ff91d4b-4a96-4c19-83e6-3d9507cf9389 for instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb on hv-cinder-85367 Aug 18 21:58:26.145993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-743e3d4a-d19b-4faa-bad9-702b809d4e34 req-0df97746-c47f-4f81-a30f-846220b5bd70 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036594 Aug 18 21:58:26.147907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 275/547] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:58:26.278641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-df5e66e7-476c-485e-b483-5197e58e891c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:26.287109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-df5e66e7-476c-485e-b483-5197e58e891c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.171824 Aug 18 21:58:26.287702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 273/548] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:26 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:26.307241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-68d2b709-f8ea-4713-b35a-0a8e3ddef493 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:26.307949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-68d2b709-f8ea-4713-b35a-0a8e3ddef493 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:26.314393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68d2b709-f8ea-4713-b35a-0a8e3ddef493 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:26.314873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68d2b709-f8ea-4713-b35a-0a8e3ddef493 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:26.315311 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68d2b709-f8ea-4713-b35a-0a8e3ddef493 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:26.316004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68d2b709-f8ea-4713-b35a-0a8e3ddef493 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:26.316460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68d2b709-f8ea-4713-b35a-0a8e3ddef493 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:26.316887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68d2b709-f8ea-4713-b35a-0a8e3ddef493 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:26.464603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-68d2b709-f8ea-4713-b35a-0a8e3ddef493 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:26.473891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-68d2b709-f8ea-4713-b35a-0a8e3ddef493 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1319 microversion: 2.1 time: 0.170780 Aug 18 21:58:26.474641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 276/549] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:26 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:27.309543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b2c9501f-ca6c-4943-b4fd-2813be4b894d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:27.310180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b2c9501f-ca6c-4943-b4fd-2813be4b894d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:27.312147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:27.312854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:27.319173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2c9501f-ca6c-4943-b4fd-2813be4b894d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:27.319657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2c9501f-ca6c-4943-b4fd-2813be4b894d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:27.320093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2c9501f-ca6c-4943-b4fd-2813be4b894d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:27.320975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2c9501f-ca6c-4943-b4fd-2813be4b894d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:27.321479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2c9501f-ca6c-4943-b4fd-2813be4b894d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:27.321929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2c9501f-ca6c-4943-b4fd-2813be4b894d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:27.470569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b2c9501f-ca6c-4943-b4fd-2813be4b894d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:27.481422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b2c9501f-ca6c-4943-b4fd-2813be4b894d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.176222 Aug 18 21:58:27.482062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 274/550] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:27 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:27.496184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e805b8d3-f11b-4667-97f6-73d0f64d3db8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:27.497393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e805b8d3-f11b-4667-97f6-73d0f64d3db8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:27.499605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:27.505947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e805b8d3-f11b-4667-97f6-73d0f64d3db8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:27.506521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e805b8d3-f11b-4667-97f6-73d0f64d3db8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:27.507037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e805b8d3-f11b-4667-97f6-73d0f64d3db8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:27.507739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e805b8d3-f11b-4667-97f6-73d0f64d3db8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:27.508225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e805b8d3-f11b-4667-97f6-73d0f64d3db8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:27.508668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e805b8d3-f11b-4667-97f6-73d0f64d3db8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:27.637885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e805b8d3-f11b-4667-97f6-73d0f64d3db8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:27.645470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e805b8d3-f11b-4667-97f6-73d0f64d3db8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1508 microversion: 2.1 time: 0.154220 Aug 18 21:58:27.646078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 277/551] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:27 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:27.666736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bfb2760c-0ab9-43e7-8a3d-490559ad38b7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8c02a59-adcf-48a4-8a38-e38dbbbb00f8", "device": "/dev/sdb"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:27.669998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bfb2760c-0ab9-43e7-8a3d-490559ad38b7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:27.675939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfb2760c-0ab9-43e7-8a3d-490559ad38b7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:27.676432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfb2760c-0ab9-43e7-8a3d-490559ad38b7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:27.676861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfb2760c-0ab9-43e7-8a3d-490559ad38b7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:27.677554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfb2760c-0ab9-43e7-8a3d-490559ad38b7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:27.678034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfb2760c-0ab9-43e7-8a3d-490559ad38b7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:27.678458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfb2760c-0ab9-43e7-8a3d-490559ad38b7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:28.504067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-55a893f0-f130-40a5-82d7-b2b270aeea65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:28.504714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-55a893f0-f130-40a5-82d7-b2b270aeea65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:28.511156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55a893f0-f130-40a5-82d7-b2b270aeea65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:28.511634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55a893f0-f130-40a5-82d7-b2b270aeea65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:28.512070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55a893f0-f130-40a5-82d7-b2b270aeea65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:28.512757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55a893f0-f130-40a5-82d7-b2b270aeea65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:28.513212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55a893f0-f130-40a5-82d7-b2b270aeea65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:28.513657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55a893f0-f130-40a5-82d7-b2b270aeea65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:28.662249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-55a893f0-f130-40a5-82d7-b2b270aeea65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:28.674062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-55a893f0-f130-40a5-82d7-b2b270aeea65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.173849 Aug 18 21:58:28.674943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 278/552] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:28 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:28.771137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:28.788783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bfb2760c-0ab9-43e7-8a3d-490559ad38b7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "POST /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.126879 Aug 18 21:58:28.789552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 275/553] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 21:58:27 2022] POST /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e/os-volume_attachments => generated 194 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:58:29.040154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-efb69b78-a01a-4368-be2f-94e05ee8d771 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:29.040843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-efb69b78-a01a-4368-be2f-94e05ee8d771 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:29.047075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efb69b78-a01a-4368-be2f-94e05ee8d771 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:29.047557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efb69b78-a01a-4368-be2f-94e05ee8d771 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:29.047991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efb69b78-a01a-4368-be2f-94e05ee8d771 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:29.048680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efb69b78-a01a-4368-be2f-94e05ee8d771 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:29.049131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efb69b78-a01a-4368-be2f-94e05ee8d771 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:29.049554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efb69b78-a01a-4368-be2f-94e05ee8d771 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:29.063936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:29.136182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-efb69b78-a01a-4368-be2f-94e05ee8d771 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lazy-loading 'services' on Instance uuid b3851c11-f4ba-40cd-946e-d113ddb6e3b3 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:58:29.285869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-efb69b78-a01a-4368-be2f-94e05ee8d771 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "DELETE /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments/f2fcff3e-034c-44f8-aa7f-0d16bd20fc26" status: 202 len: 0 microversion: 2.1 time: 0.249264 Aug 18 21:58:29.286493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 279/554] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 21:58:29 2022] DELETE /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments/f2fcff3e-034c-44f8-aa7f-0d16bd20fc26 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:58:29.697035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-351e3ddc-a6dd-4cdc-8044-74797f01d02d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:29.697788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-351e3ddc-a6dd-4cdc-8044-74797f01d02d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:29.704618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-351e3ddc-a6dd-4cdc-8044-74797f01d02d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:29.705114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-351e3ddc-a6dd-4cdc-8044-74797f01d02d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:29.705605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-351e3ddc-a6dd-4cdc-8044-74797f01d02d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:29.706336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-351e3ddc-a6dd-4cdc-8044-74797f01d02d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:29.706806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-351e3ddc-a6dd-4cdc-8044-74797f01d02d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:29.707244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-351e3ddc-a6dd-4cdc-8044-74797f01d02d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:29.730213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae9b1edc-40a2-4eb2-bb30-e756bc4a5fdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:29.732859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ae9b1edc-40a2-4eb2-bb30-e756bc4a5fdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:29.739150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae9b1edc-40a2-4eb2-bb30-e756bc4a5fdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:29.739636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae9b1edc-40a2-4eb2-bb30-e756bc4a5fdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:29.740073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae9b1edc-40a2-4eb2-bb30-e756bc4a5fdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:29.740801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae9b1edc-40a2-4eb2-bb30-e756bc4a5fdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:29.741258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae9b1edc-40a2-4eb2-bb30-e756bc4a5fdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:29.741728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae9b1edc-40a2-4eb2-bb30-e756bc4a5fdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:29.765510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-ae9b1edc-40a2-4eb2-bb30-e756bc4a5fdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lazy-loading 'flavor' on Instance uuid c3f260fb-84bc-434c-b885-0a8f54494162 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:58:29.857626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-351e3ddc-a6dd-4cdc-8044-74797f01d02d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:29.866294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-351e3ddc-a6dd-4cdc-8044-74797f01d02d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.174312 Aug 18 21:58:29.866866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 276/555] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:29 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:29.903035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ae9b1edc-40a2-4eb2-bb30-e756bc4a5fdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "POST /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/action" status: 200 len: 32 microversion: 2.1 time: 0.178462 Aug 18 21:58:29.903535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 280/556] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 21:58:29 2022] POST /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 21:58:29.912868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-31621d24-eeb7-4979-9e88-08833acb87ad tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:29.913489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-31621d24-eeb7-4979-9e88-08833acb87ad tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:29.920632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31621d24-eeb7-4979-9e88-08833acb87ad tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:29.921126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31621d24-eeb7-4979-9e88-08833acb87ad tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:29.921569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31621d24-eeb7-4979-9e88-08833acb87ad tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:29.922304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31621d24-eeb7-4979-9e88-08833acb87ad tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:29.923104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31621d24-eeb7-4979-9e88-08833acb87ad tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:29.923539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31621d24-eeb7-4979-9e88-08833acb87ad tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:30.134372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-31621d24-eeb7-4979-9e88-08833acb87ad tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:30.142535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-31621d24-eeb7-4979-9e88-08833acb87ad tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.233562 Aug 18 21:58:30.143119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 277/557] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:29 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:30.889513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a3bc2b4a-22ac-4822-bffd-8e5e58e5abf4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:30.890243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a3bc2b4a-22ac-4822-bffd-8e5e58e5abf4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:30.896490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3bc2b4a-22ac-4822-bffd-8e5e58e5abf4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:30.896973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3bc2b4a-22ac-4822-bffd-8e5e58e5abf4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:30.897413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3bc2b4a-22ac-4822-bffd-8e5e58e5abf4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:30.898128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3bc2b4a-22ac-4822-bffd-8e5e58e5abf4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:30.898580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3bc2b4a-22ac-4822-bffd-8e5e58e5abf4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:30.899003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3bc2b4a-22ac-4822-bffd-8e5e58e5abf4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:31.046470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a3bc2b4a-22ac-4822-bffd-8e5e58e5abf4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:31.054687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a3bc2b4a-22ac-4822-bffd-8e5e58e5abf4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.170547 Aug 18 21:58:31.055267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 281/558] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:31.164032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3c7ea8fd-da0d-4127-94c3-c6bb90d148b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:31.164637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3c7ea8fd-da0d-4127-94c3-c6bb90d148b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:31.171808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c7ea8fd-da0d-4127-94c3-c6bb90d148b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:31.172225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c7ea8fd-da0d-4127-94c3-c6bb90d148b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:31.172654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c7ea8fd-da0d-4127-94c3-c6bb90d148b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:31.173340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c7ea8fd-da0d-4127-94c3-c6bb90d148b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:31.173830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c7ea8fd-da0d-4127-94c3-c6bb90d148b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:31.174256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c7ea8fd-da0d-4127-94c3-c6bb90d148b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:31.306541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3c7ea8fd-da0d-4127-94c3-c6bb90d148b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:31.314801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3c7ea8fd-da0d-4127-94c3-c6bb90d148b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154596 Aug 18 21:58:31.315374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 278/559] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:32.076683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e2c6a04b-59c4-4530-8cb2-d92d6c299fb8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:32.077300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e2c6a04b-59c4-4530-8cb2-d92d6c299fb8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:32.083800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c6a04b-59c4-4530-8cb2-d92d6c299fb8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:32.084283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c6a04b-59c4-4530-8cb2-d92d6c299fb8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:32.084719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c6a04b-59c4-4530-8cb2-d92d6c299fb8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:32.085410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c6a04b-59c4-4530-8cb2-d92d6c299fb8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:32.085901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c6a04b-59c4-4530-8cb2-d92d6c299fb8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:32.086328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c6a04b-59c4-4530-8cb2-d92d6c299fb8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:32.224628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e2c6a04b-59c4-4530-8cb2-d92d6c299fb8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:32.232817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e2c6a04b-59c4-4530-8cb2-d92d6c299fb8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1756 microversion: 2.1 time: 0.159911 Aug 18 21:58:32.233333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 282/560] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:32.336126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a855015c-8004-4c5b-a991-8584d289c316 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:32.336737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a855015c-8004-4c5b-a991-8584d289c316 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:32.343624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a855015c-8004-4c5b-a991-8584d289c316 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:32.344268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a855015c-8004-4c5b-a991-8584d289c316 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:32.344708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a855015c-8004-4c5b-a991-8584d289c316 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:32.345408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a855015c-8004-4c5b-a991-8584d289c316 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:32.345931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a855015c-8004-4c5b-a991-8584d289c316 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:32.346361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a855015c-8004-4c5b-a991-8584d289c316 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:32.476643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a855015c-8004-4c5b-a991-8584d289c316 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:32.484959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a855015c-8004-4c5b-a991-8584d289c316 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152659 Aug 18 21:58:32.485662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 279/561] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:32 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:33.254421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-39956362-a7d3-4c0e-8e8c-33a6cee9e9d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:33.255017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-39956362-a7d3-4c0e-8e8c-33a6cee9e9d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:33.261984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39956362-a7d3-4c0e-8e8c-33a6cee9e9d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:33.262468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39956362-a7d3-4c0e-8e8c-33a6cee9e9d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:33.262903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39956362-a7d3-4c0e-8e8c-33a6cee9e9d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:33.263603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39956362-a7d3-4c0e-8e8c-33a6cee9e9d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:33.264055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39956362-a7d3-4c0e-8e8c-33a6cee9e9d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:33.264478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39956362-a7d3-4c0e-8e8c-33a6cee9e9d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:33.411819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-39956362-a7d3-4c0e-8e8c-33a6cee9e9d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:33.420244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-39956362-a7d3-4c0e-8e8c-33a6cee9e9d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1759 microversion: 2.1 time: 0.169734 Aug 18 21:58:33.420818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 283/562] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:33 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:33.506954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-112b3f64-f2b4-4388-aa10-8d13a6e5bdf8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:33.507602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-112b3f64-f2b4-4388-aa10-8d13a6e5bdf8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:33.510599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:33.515466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-112b3f64-f2b4-4388-aa10-8d13a6e5bdf8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:33.516007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-112b3f64-f2b4-4388-aa10-8d13a6e5bdf8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:33.516555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-112b3f64-f2b4-4388-aa10-8d13a6e5bdf8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:33.517292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-112b3f64-f2b4-4388-aa10-8d13a6e5bdf8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:33.517784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-112b3f64-f2b4-4388-aa10-8d13a6e5bdf8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:33.518218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-112b3f64-f2b4-4388-aa10-8d13a6e5bdf8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:33.652082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-112b3f64-f2b4-4388-aa10-8d13a6e5bdf8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:33.660586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-112b3f64-f2b4-4388-aa10-8d13a6e5bdf8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.157560 Aug 18 21:58:33.661163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 280/563] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:34.682054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-53ee2b2c-1e20-487e-99a2-e9e4c5066b5d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:34.682673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-53ee2b2c-1e20-487e-99a2-e9e4c5066b5d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:34.689052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ee2b2c-1e20-487e-99a2-e9e4c5066b5d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:34.689544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ee2b2c-1e20-487e-99a2-e9e4c5066b5d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:34.690078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ee2b2c-1e20-487e-99a2-e9e4c5066b5d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:34.690780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ee2b2c-1e20-487e-99a2-e9e4c5066b5d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:34.691240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ee2b2c-1e20-487e-99a2-e9e4c5066b5d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:34.691680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ee2b2c-1e20-487e-99a2-e9e4c5066b5d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:34.819607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-53ee2b2c-1e20-487e-99a2-e9e4c5066b5d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:34.828252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-53ee2b2c-1e20-487e-99a2-e9e4c5066b5d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150026 Aug 18 21:58:34.828830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 284/564] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:35.849903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e41f2550-30fe-4b7e-b781-c1a6bd152483 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:35.850525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e41f2550-30fe-4b7e-b781-c1a6bd152483 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:35.857822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e41f2550-30fe-4b7e-b781-c1a6bd152483 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:35.858311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e41f2550-30fe-4b7e-b781-c1a6bd152483 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:35.858750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e41f2550-30fe-4b7e-b781-c1a6bd152483 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:35.859444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e41f2550-30fe-4b7e-b781-c1a6bd152483 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:35.859897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e41f2550-30fe-4b7e-b781-c1a6bd152483 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:35.860324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e41f2550-30fe-4b7e-b781-c1a6bd152483 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:35.990182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e41f2550-30fe-4b7e-b781-c1a6bd152483 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:35.998838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e41f2550-30fe-4b7e-b781-c1a6bd152483 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152848 Aug 18 21:58:35.999429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 281/565] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:35 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:37.020066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e31edcf4-ba69-423c-aba3-f9f68d1e3347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:37.020771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e31edcf4-ba69-423c-aba3-f9f68d1e3347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:37.027231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e31edcf4-ba69-423c-aba3-f9f68d1e3347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:37.027706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e31edcf4-ba69-423c-aba3-f9f68d1e3347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:37.028138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e31edcf4-ba69-423c-aba3-f9f68d1e3347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:37.028829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e31edcf4-ba69-423c-aba3-f9f68d1e3347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:37.029262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e31edcf4-ba69-423c-aba3-f9f68d1e3347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:37.029701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e31edcf4-ba69-423c-aba3-f9f68d1e3347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:37.155200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e31edcf4-ba69-423c-aba3-f9f68d1e3347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:37.163397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e31edcf4-ba69-423c-aba3-f9f68d1e3347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.147154 Aug 18 21:58:37.163967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 285/566] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:37 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:38.185686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ad46566f-ea73-4b6c-81dc-03cbc6324ed4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:38.186297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ad46566f-ea73-4b6c-81dc-03cbc6324ed4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:38.192738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad46566f-ea73-4b6c-81dc-03cbc6324ed4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:38.193215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad46566f-ea73-4b6c-81dc-03cbc6324ed4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:38.193677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad46566f-ea73-4b6c-81dc-03cbc6324ed4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:38.194377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad46566f-ea73-4b6c-81dc-03cbc6324ed4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:38.194830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad46566f-ea73-4b6c-81dc-03cbc6324ed4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:38.195249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad46566f-ea73-4b6c-81dc-03cbc6324ed4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:38.324735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ad46566f-ea73-4b6c-81dc-03cbc6324ed4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:38.332884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ad46566f-ea73-4b6c-81dc-03cbc6324ed4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151011 Aug 18 21:58:38.333543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 282/567] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:38 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:39.353680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b78bbdaa-b3a0-4b50-941e-70a409474b01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:39.354294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b78bbdaa-b3a0-4b50-941e-70a409474b01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:39.360798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b78bbdaa-b3a0-4b50-941e-70a409474b01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:39.361278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b78bbdaa-b3a0-4b50-941e-70a409474b01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:39.361738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b78bbdaa-b3a0-4b50-941e-70a409474b01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:39.362430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b78bbdaa-b3a0-4b50-941e-70a409474b01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:39.362887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b78bbdaa-b3a0-4b50-941e-70a409474b01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:39.363312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b78bbdaa-b3a0-4b50-941e-70a409474b01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:39.501842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b78bbdaa-b3a0-4b50-941e-70a409474b01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:39.510605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b78bbdaa-b3a0-4b50-941e-70a409474b01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.160755 Aug 18 21:58:39.511166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 286/568] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:39 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:40.531518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8b79218c-4e1c-4adb-9877-5e05e7cae313 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:40.532134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8b79218c-4e1c-4adb-9877-5e05e7cae313 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:40.538788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b79218c-4e1c-4adb-9877-5e05e7cae313 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:40.539274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b79218c-4e1c-4adb-9877-5e05e7cae313 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:40.539710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b79218c-4e1c-4adb-9877-5e05e7cae313 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:40.541038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b79218c-4e1c-4adb-9877-5e05e7cae313 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:40.541500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b79218c-4e1c-4adb-9877-5e05e7cae313 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:40.541952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b79218c-4e1c-4adb-9877-5e05e7cae313 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:40.668214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8b79218c-4e1c-4adb-9877-5e05e7cae313 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:40.677620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8b79218c-4e1c-4adb-9877-5e05e7cae313 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149792 Aug 18 21:58:40.678222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 283/569] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:41.698961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2e3ca812-1167-46c9-8e9d-72cb511f763c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:41.699572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2e3ca812-1167-46c9-8e9d-72cb511f763c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:41.705971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e3ca812-1167-46c9-8e9d-72cb511f763c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:41.706449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e3ca812-1167-46c9-8e9d-72cb511f763c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:41.706887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e3ca812-1167-46c9-8e9d-72cb511f763c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:41.707769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e3ca812-1167-46c9-8e9d-72cb511f763c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:41.708225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e3ca812-1167-46c9-8e9d-72cb511f763c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:41.708652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e3ca812-1167-46c9-8e9d-72cb511f763c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:41.834957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2e3ca812-1167-46c9-8e9d-72cb511f763c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:41.843086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2e3ca812-1167-46c9-8e9d-72cb511f763c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148022 Aug 18 21:58:41.843654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 287/570] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:42.864393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7504475a-ea65-4824-9c74-9a681ce414c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:42.864929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7504475a-ea65-4824-9c74-9a681ce414c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:42.871917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7504475a-ea65-4824-9c74-9a681ce414c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:42.872398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7504475a-ea65-4824-9c74-9a681ce414c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:42.872828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7504475a-ea65-4824-9c74-9a681ce414c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:42.873514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7504475a-ea65-4824-9c74-9a681ce414c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:42.873988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7504475a-ea65-4824-9c74-9a681ce414c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:42.874409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7504475a-ea65-4824-9c74-9a681ce414c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:43.000380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7504475a-ea65-4824-9c74-9a681ce414c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:43.008726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7504475a-ea65-4824-9c74-9a681ce414c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148285 Aug 18 21:58:43.009906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 284/571] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:42 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:44.031314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0f5e33e2-96cc-45ce-8763-994906943e25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:44.031931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0f5e33e2-96cc-45ce-8763-994906943e25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:44.034420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=74 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:44.039922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f5e33e2-96cc-45ce-8763-994906943e25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:44.040413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f5e33e2-96cc-45ce-8763-994906943e25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:44.040855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f5e33e2-96cc-45ce-8763-994906943e25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:44.041552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f5e33e2-96cc-45ce-8763-994906943e25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:44.042047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f5e33e2-96cc-45ce-8763-994906943e25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:44.042475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f5e33e2-96cc-45ce-8763-994906943e25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:44.173391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0f5e33e2-96cc-45ce-8763-994906943e25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:44.181997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0f5e33e2-96cc-45ce-8763-994906943e25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154496 Aug 18 21:58:44.182560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 288/572] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:44 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:45.203046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-31e6f9f4-0319-41cf-8da0-52a888b05866 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:45.203672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-31e6f9f4-0319-41cf-8da0-52a888b05866 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:45.210228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31e6f9f4-0319-41cf-8da0-52a888b05866 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:45.210727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31e6f9f4-0319-41cf-8da0-52a888b05866 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:45.211174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31e6f9f4-0319-41cf-8da0-52a888b05866 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:45.211881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31e6f9f4-0319-41cf-8da0-52a888b05866 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:45.212839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31e6f9f4-0319-41cf-8da0-52a888b05866 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:45.213276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-31e6f9f4-0319-41cf-8da0-52a888b05866 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:45.342106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-31e6f9f4-0319-41cf-8da0-52a888b05866 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:45.350711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-31e6f9f4-0319-41cf-8da0-52a888b05866 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151422 Aug 18 21:58:45.351278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 285/573] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:45 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:46.372534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5a7934ac-8720-45ea-9b19-edb1e249f438 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:46.373137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5a7934ac-8720-45ea-9b19-edb1e249f438 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:46.379564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a7934ac-8720-45ea-9b19-edb1e249f438 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:46.380038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a7934ac-8720-45ea-9b19-edb1e249f438 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:46.380466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a7934ac-8720-45ea-9b19-edb1e249f438 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:46.381145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a7934ac-8720-45ea-9b19-edb1e249f438 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:46.381591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a7934ac-8720-45ea-9b19-edb1e249f438 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:46.382033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a7934ac-8720-45ea-9b19-edb1e249f438 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:46.510961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5a7934ac-8720-45ea-9b19-edb1e249f438 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:46.519232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5a7934ac-8720-45ea-9b19-edb1e249f438 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151195 Aug 18 21:58:46.519807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 289/574] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:47.540137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7369e849-a675-4f11-8830-7f10ac7b752d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:47.540779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7369e849-a675-4f11-8830-7f10ac7b752d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:47.547347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7369e849-a675-4f11-8830-7f10ac7b752d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:47.547832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7369e849-a675-4f11-8830-7f10ac7b752d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:47.548271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7369e849-a675-4f11-8830-7f10ac7b752d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:47.548968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7369e849-a675-4f11-8830-7f10ac7b752d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:47.549425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7369e849-a675-4f11-8830-7f10ac7b752d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:47.549882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7369e849-a675-4f11-8830-7f10ac7b752d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:47.676592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7369e849-a675-4f11-8830-7f10ac7b752d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:47.684510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7369e849-a675-4f11-8830-7f10ac7b752d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148315 Aug 18 21:58:47.685094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 286/575] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:48.706987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7f7e637c-92af-41bc-9f42-a4c5793e8cea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:48.707624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7f7e637c-92af-41bc-9f42-a4c5793e8cea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:48.714666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f7e637c-92af-41bc-9f42-a4c5793e8cea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:48.715152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f7e637c-92af-41bc-9f42-a4c5793e8cea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:48.715591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f7e637c-92af-41bc-9f42-a4c5793e8cea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:48.716303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f7e637c-92af-41bc-9f42-a4c5793e8cea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:48.716758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f7e637c-92af-41bc-9f42-a4c5793e8cea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:48.717187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f7e637c-92af-41bc-9f42-a4c5793e8cea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:48.843591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7f7e637c-92af-41bc-9f42-a4c5793e8cea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:48.851780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7f7e637c-92af-41bc-9f42-a4c5793e8cea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148718 Aug 18 21:58:48.852356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 290/576] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:48 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:49.874253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3edf7939-2598-419f-855f-93783ada3566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:49.874806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3edf7939-2598-419f-855f-93783ada3566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:49.881251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3edf7939-2598-419f-855f-93783ada3566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:49.881784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3edf7939-2598-419f-855f-93783ada3566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:49.882220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3edf7939-2598-419f-855f-93783ada3566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:49.882910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3edf7939-2598-419f-855f-93783ada3566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:49.883365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3edf7939-2598-419f-855f-93783ada3566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:49.883790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3edf7939-2598-419f-855f-93783ada3566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:50.012785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3edf7939-2598-419f-855f-93783ada3566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:50.020927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3edf7939-2598-419f-855f-93783ada3566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150499 Aug 18 21:58:50.021638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 287/577] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:49 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:51.042163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9b692525-343c-4058-92e3-475c6b3c739b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:51.042779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9b692525-343c-4058-92e3-475c6b3c739b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:51.049509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b692525-343c-4058-92e3-475c6b3c739b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:51.050023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b692525-343c-4058-92e3-475c6b3c739b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:51.050458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b692525-343c-4058-92e3-475c6b3c739b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:51.051551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b692525-343c-4058-92e3-475c6b3c739b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:51.051675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b692525-343c-4058-92e3-475c6b3c739b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:51.052020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b692525-343c-4058-92e3-475c6b3c739b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:51.181929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9b692525-343c-4058-92e3-475c6b3c739b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:51.190131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9b692525-343c-4058-92e3-475c6b3c739b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151819 Aug 18 21:58:51.190706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 291/578] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:51 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:52.212890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ca0f220d-c550-44ad-86ee-a2c634e061e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:52.213525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ca0f220d-c550-44ad-86ee-a2c634e061e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:52.219916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca0f220d-c550-44ad-86ee-a2c634e061e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:52.220397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca0f220d-c550-44ad-86ee-a2c634e061e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:52.220833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca0f220d-c550-44ad-86ee-a2c634e061e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:52.221522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca0f220d-c550-44ad-86ee-a2c634e061e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:52.221998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca0f220d-c550-44ad-86ee-a2c634e061e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:52.222425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca0f220d-c550-44ad-86ee-a2c634e061e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:52.355733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ca0f220d-c550-44ad-86ee-a2c634e061e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:52.364393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ca0f220d-c550-44ad-86ee-a2c634e061e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155823 Aug 18 21:58:52.364996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 288/579] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:53.386229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-76c6311c-aead-4a00-8cc2-64fc49ddca26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:53.386760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-76c6311c-aead-4a00-8cc2-64fc49ddca26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:53.393287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76c6311c-aead-4a00-8cc2-64fc49ddca26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:53.393817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76c6311c-aead-4a00-8cc2-64fc49ddca26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:53.394264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76c6311c-aead-4a00-8cc2-64fc49ddca26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:53.394956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76c6311c-aead-4a00-8cc2-64fc49ddca26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:53.395415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76c6311c-aead-4a00-8cc2-64fc49ddca26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:53.395844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76c6311c-aead-4a00-8cc2-64fc49ddca26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:53.522241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-76c6311c-aead-4a00-8cc2-64fc49ddca26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:53.531113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-76c6311c-aead-4a00-8cc2-64fc49ddca26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148792 Aug 18 21:58:53.531697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 292/580] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:54.552782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e87396d3-e50c-4a59-9912-fb62bed04464 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:54.553399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e87396d3-e50c-4a59-9912-fb62bed04464 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:54.560568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87396d3-e50c-4a59-9912-fb62bed04464 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:54.561051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87396d3-e50c-4a59-9912-fb62bed04464 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:54.561490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87396d3-e50c-4a59-9912-fb62bed04464 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:54.562210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87396d3-e50c-4a59-9912-fb62bed04464 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:54.562666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87396d3-e50c-4a59-9912-fb62bed04464 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:54.563094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87396d3-e50c-4a59-9912-fb62bed04464 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:54.708688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e87396d3-e50c-4a59-9912-fb62bed04464 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:54.718580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e87396d3-e50c-4a59-9912-fb62bed04464 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1717 microversion: 2.1 time: 0.169725 Aug 18 21:58:54.719336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 289/581] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1717 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:54.781151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5c452d78-89c3-4d2e-9d51-8d41f61ef3b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:54.781680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5c452d78-89c3-4d2e-9d51-8d41f61ef3b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:54.788129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c452d78-89c3-4d2e-9d51-8d41f61ef3b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:54.788615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c452d78-89c3-4d2e-9d51-8d41f61ef3b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:54.789054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c452d78-89c3-4d2e-9d51-8d41f61ef3b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:54.789794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c452d78-89c3-4d2e-9d51-8d41f61ef3b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:54.790909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c452d78-89c3-4d2e-9d51-8d41f61ef3b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:54.791339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c452d78-89c3-4d2e-9d51-8d41f61ef3b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:54.806300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:54.874707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-5c452d78-89c3-4d2e-9d51-8d41f61ef3b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] HTTP exception thrown: Cannot 'detach_volume' instance c3f260fb-84bc-434c-b885-0a8f54494162 while it is in vm_state rescued Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5c452d78-89c3-4d2e-9d51-8d41f61ef3b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Request method failure captured: Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments/77ca1fdd-7c40-445d-ab22-9f784df4ce01 HTTP/1.1 Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rUzAZHR_MTPG4eJ3KFYVTA565onzDKJxO1xSy-9It6A9DtmJ6F300Tyn7MqouaxuXCF3bBRuEPysbl4Qlry_Z0Mjpi9pocsEF0UrU9WWgJizF4d5s1BWfgp-r109oWhu2RDYnEoBMuaK1MUk3rKA7u7FJnLkZ8ikFqp1sSliWh_1qU Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 9894625c04a341e3a82584481410cd35 Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1925617752 Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 21:58:54.876333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 21:58:54.877954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9894625c04a341e3a82584481410cd35", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9894625c04a341e3a82584481410cd35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9894625c04a341e3a82584481410cd35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9894625c04a341e3a82584481410cd35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:58:54.877954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1925617752 Aug 18 21:58:54.877954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 9894625c04a341e3a82584481410cd35 Aug 18 21:58:54.877954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1925617752 Aug 18 21:58:54.877954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-ServerRescueNegativeTestJSON-1925617752-project Aug 18 21:58:54.877954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 21:58:54.877954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 21:58:54.877954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 42072422001c4f1684f68baa25517a9e Aug 18 21:58:54.877954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1925617752-project Aug 18 21:58:54.877954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 21:58:54.877954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Cannot 'detach_volume' instance c3f260fb-84bc-434c-b885-0a8f54494162 while it is in vm_state rescued Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'server_id': 'c3f260fb-84bc-434c-b885-0a8f54494162', 'id': '77ca1fdd-7c40-445d-ab22-9f784df4ce01'} Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3f260fb-84bc-434c-b885-0a8f54494162 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:58:54.878809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c3f260fb-84bc-434c-b885-0a8f54494162 while it is in vm_state rescued Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c3f260fb-84bc-434c-b885-0a8f54494162 while it is in vm_state rescued Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 21:58:54.880361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5c452d78-89c3-4d2e-9d51-8d41f61ef3b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Returning 409 to user: Cannot 'detach_volume' instance c3f260fb-84bc-434c-b885-0a8f54494162 while it is in vm_state rescued {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:58:54.881755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5c452d78-89c3-4d2e-9d51-8d41f61ef3b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments/77ca1fdd-7c40-445d-ab22-9f784df4ce01" status: 409 len: 152 microversion: 2.1 time: 0.100584 Aug 18 21:58:54.881755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 293/582] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 21:58:54 2022] DELETE /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments/77ca1fdd-7c40-445d-ab22-9f784df4ce01 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 21:58:54.887061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3e60c02c-aff7-4e54-8600-b9a816af864f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:54.887607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3e60c02c-aff7-4e54-8600-b9a816af864f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:54.894355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e60c02c-aff7-4e54-8600-b9a816af864f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:54.894849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e60c02c-aff7-4e54-8600-b9a816af864f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:54.895288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e60c02c-aff7-4e54-8600-b9a816af864f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:54.895997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e60c02c-aff7-4e54-8600-b9a816af864f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:54.896451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e60c02c-aff7-4e54-8600-b9a816af864f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:54.896876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e60c02c-aff7-4e54-8600-b9a816af864f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:54.962453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3e60c02c-aff7-4e54-8600-b9a816af864f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "POST /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/action" status: 202 len: 0 microversion: 2.1 time: 0.078631 Aug 18 21:58:54.963086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 290/583] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 21:58:54 2022] POST /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:58:54.971060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4d932220-3765-4fa7-a430-54488f05614c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:54.971669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4d932220-3765-4fa7-a430-54488f05614c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:54.978969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d932220-3765-4fa7-a430-54488f05614c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:54.979108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d932220-3765-4fa7-a430-54488f05614c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:54.979426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d932220-3765-4fa7-a430-54488f05614c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:54.980113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d932220-3765-4fa7-a430-54488f05614c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:54.980560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d932220-3765-4fa7-a430-54488f05614c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:54.980982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d932220-3765-4fa7-a430-54488f05614c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:55.112879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4d932220-3765-4fa7-a430-54488f05614c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:55.121247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4d932220-3765-4fa7-a430-54488f05614c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1725 microversion: 2.1 time: 0.153903 Aug 18 21:58:55.122193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 294/584] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 21:58:56.144015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1f222ae8-8680-4aa0-a772-e517ba074ddf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:56.144708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1f222ae8-8680-4aa0-a772-e517ba074ddf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:56.151612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f222ae8-8680-4aa0-a772-e517ba074ddf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:56.152088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f222ae8-8680-4aa0-a772-e517ba074ddf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:56.152522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f222ae8-8680-4aa0-a772-e517ba074ddf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:56.153204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f222ae8-8680-4aa0-a772-e517ba074ddf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:56.153687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f222ae8-8680-4aa0-a772-e517ba074ddf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:56.154125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f222ae8-8680-4aa0-a772-e517ba074ddf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:56.158202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:58:56.289587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1f222ae8-8680-4aa0-a772-e517ba074ddf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:56.298609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1f222ae8-8680-4aa0-a772-e517ba074ddf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1725 microversion: 2.1 time: 0.159353 Aug 18 21:58:56.299177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 291/585] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:56 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:57.319582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8e25d2ff-8bb0-4722-942a-b9d538fc5f9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:57.320196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8e25d2ff-8bb0-4722-942a-b9d538fc5f9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:57.326859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e25d2ff-8bb0-4722-942a-b9d538fc5f9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:57.327334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e25d2ff-8bb0-4722-942a-b9d538fc5f9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:57.327764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e25d2ff-8bb0-4722-942a-b9d538fc5f9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:57.328462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e25d2ff-8bb0-4722-942a-b9d538fc5f9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:57.328913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e25d2ff-8bb0-4722-942a-b9d538fc5f9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:57.329332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e25d2ff-8bb0-4722-942a-b9d538fc5f9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:57.469570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8e25d2ff-8bb0-4722-942a-b9d538fc5f9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:57.478504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8e25d2ff-8bb0-4722-942a-b9d538fc5f9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1725 microversion: 2.1 time: 0.162121 Aug 18 21:58:57.478944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 295/586] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:57 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:58.500393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-beea9ae7-cf53-4598-8813-f1ed0b4889f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:58.501015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-beea9ae7-cf53-4598-8813-f1ed0b4889f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:58.507020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-beea9ae7-cf53-4598-8813-f1ed0b4889f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:58.507505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-beea9ae7-cf53-4598-8813-f1ed0b4889f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:58.507943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-beea9ae7-cf53-4598-8813-f1ed0b4889f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:58.508641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-beea9ae7-cf53-4598-8813-f1ed0b4889f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:58.509785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-beea9ae7-cf53-4598-8813-f1ed0b4889f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:58.510326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-beea9ae7-cf53-4598-8813-f1ed0b4889f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:58.720555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-beea9ae7-cf53-4598-8813-f1ed0b4889f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:58:58.731341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-beea9ae7-cf53-4598-8813-f1ed0b4889f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1731 microversion: 2.1 time: 0.234845 Aug 18 21:58:58.731932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 292/587] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:58:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:58:58.752859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-996dc6d6-e2fa-4664-aa40-3ad59f171fcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:58:58.753405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-996dc6d6-e2fa-4664-aa40-3ad59f171fcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:58:58.760497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-996dc6d6-e2fa-4664-aa40-3ad59f171fcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:58.760976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-996dc6d6-e2fa-4664-aa40-3ad59f171fcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:58.761422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-996dc6d6-e2fa-4664-aa40-3ad59f171fcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:58.762151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-996dc6d6-e2fa-4664-aa40-3ad59f171fcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:58.762690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-996dc6d6-e2fa-4664-aa40-3ad59f171fcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:58.763122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-996dc6d6-e2fa-4664-aa40-3ad59f171fcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:58.838433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-996dc6d6-e2fa-4664-aa40-3ad59f171fcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089424 Aug 18 21:58:58.839061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 296/588] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 21:58:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:58:59.699813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-65eaef95-e7c3-4f5e-bfeb-d9d7ef000de1 req-0d5989f2-b938-4c6a-9112-0d6f8c909afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f260fb-84bc-434c-b885-0a8f54494162", "tag": "859d4e5f-383d-4366-b08c-f0d6c9520205"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:58:59.711346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-65eaef95-e7c3-4f5e-bfeb-d9d7ef000de1 req-0d5989f2-b938-4c6a-9112-0d6f8c909afb service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:58:59.711835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-65eaef95-e7c3-4f5e-bfeb-d9d7ef000de1 req-0d5989f2-b938-4c6a-9112-0d6f8c909afb service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:58:59.712730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-65eaef95-e7c3-4f5e-bfeb-d9d7ef000de1 req-0d5989f2-b938-4c6a-9112-0d6f8c909afb service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:58:59.730111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-65eaef95-e7c3-4f5e-bfeb-d9d7ef000de1 req-0d5989f2-b938-4c6a-9112-0d6f8c909afb service nova] Creating event network-changed:859d4e5f-383d-4366-b08c-f0d6c9520205 for instance c3f260fb-84bc-434c-b885-0a8f54494162 on hv-cinder-85367 Aug 18 21:58:59.735248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-65eaef95-e7c3-4f5e-bfeb-d9d7ef000de1 req-0d5989f2-b938-4c6a-9112-0d6f8c909afb service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040599 Aug 18 21:58:59.736015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 293/589] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:01.750484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-632e1938-33cd-42df-8d57-d57463bd1f4d req-363b9754-7985-4f03-9d11-573a88430c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f260fb-84bc-434c-b885-0a8f54494162", "tag": "859d4e5f-383d-4366-b08c-f0d6c9520205"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:59:01.759918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-632e1938-33cd-42df-8d57-d57463bd1f4d req-363b9754-7985-4f03-9d11-573a88430c8d service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:01.760450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-632e1938-33cd-42df-8d57-d57463bd1f4d req-363b9754-7985-4f03-9d11-573a88430c8d service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:01.760943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-632e1938-33cd-42df-8d57-d57463bd1f4d req-363b9754-7985-4f03-9d11-573a88430c8d service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:01.772041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-632e1938-33cd-42df-8d57-d57463bd1f4d req-363b9754-7985-4f03-9d11-573a88430c8d service nova] Creating event network-changed:859d4e5f-383d-4366-b08c-f0d6c9520205 for instance c3f260fb-84bc-434c-b885-0a8f54494162 on hv-cinder-85367 Aug 18 21:59:01.777005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-632e1938-33cd-42df-8d57-d57463bd1f4d req-363b9754-7985-4f03-9d11-573a88430c8d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030833 Aug 18 21:59:01.777612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 297/590] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:05.367252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-235bad66-451e-491b-a7db-1daa46c2bff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:05.367821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-235bad66-451e-491b-a7db-1daa46c2bff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:05.369725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=28 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:05.374857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-235bad66-451e-491b-a7db-1daa46c2bff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:05.375339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-235bad66-451e-491b-a7db-1daa46c2bff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:05.375774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-235bad66-451e-491b-a7db-1daa46c2bff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:05.376453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-235bad66-451e-491b-a7db-1daa46c2bff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:05.376900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-235bad66-451e-491b-a7db-1daa46c2bff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:05.377322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-235bad66-451e-491b-a7db-1daa46c2bff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:05.407994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-235bad66-451e-491b-a7db-1daa46c2bff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments/6581902e-b904-4837-9f75-cfc3e4ccb534" status: 200 len: 194 microversion: 2.20 time: 0.045724 Aug 18 21:59:05.408566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 294/591] 10.222.0.82 () {60 vars in 1454 bytes} [Thu Aug 18 21:59:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments/6581902e-b904-4837-9f75-cfc3e4ccb534 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:05.476292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69e3fa55-dfe4-4e3c-8ec1-898a9dadac93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:05.476878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-69e3fa55-dfe4-4e3c-8ec1-898a9dadac93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:05.482937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69e3fa55-dfe4-4e3c-8ec1-898a9dadac93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:05.483415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69e3fa55-dfe4-4e3c-8ec1-898a9dadac93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:05.483849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69e3fa55-dfe4-4e3c-8ec1-898a9dadac93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:05.484535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69e3fa55-dfe4-4e3c-8ec1-898a9dadac93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:05.484987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69e3fa55-dfe4-4e3c-8ec1-898a9dadac93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:05.485417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69e3fa55-dfe4-4e3c-8ec1-898a9dadac93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:05.565737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-69e3fa55-dfe4-4e3c-8ec1-898a9dadac93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lazy-loading 'services' on Instance uuid 0426bb7b-e862-4873-9c1e-7878b89cde47 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:59:05.635649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-69e3fa55-dfe4-4e3c-8ec1-898a9dadac93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments/6581902e-b904-4837-9f75-cfc3e4ccb534" status: 202 len: 0 microversion: 2.20 time: 0.163978 Aug 18 21:59:05.637221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 298/592] 10.222.0.82 () {60 vars in 1457 bytes} [Thu Aug 18 21:59:05 2022] DELETE /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments/6581902e-b904-4837-9f75-cfc3e4ccb534 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:59:05.645740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d9fe0020-5a34-48ab-a350-281f56d8adcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:05.647963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d9fe0020-5a34-48ab-a350-281f56d8adcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:05.655170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9fe0020-5a34-48ab-a350-281f56d8adcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:05.655711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9fe0020-5a34-48ab-a350-281f56d8adcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:05.656156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9fe0020-5a34-48ab-a350-281f56d8adcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:05.656907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9fe0020-5a34-48ab-a350-281f56d8adcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:05.657369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9fe0020-5a34-48ab-a350-281f56d8adcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:05.657833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9fe0020-5a34-48ab-a350-281f56d8adcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:05.688905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d9fe0020-5a34-48ab-a350-281f56d8adcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047061 Aug 18 21:59:05.689633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 295/593] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:06.702245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a724e21a-0955-4332-8df3-d756d2577e6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:06.704506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a724e21a-0955-4332-8df3-d756d2577e6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:06.711262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a724e21a-0955-4332-8df3-d756d2577e6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:06.711742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a724e21a-0955-4332-8df3-d756d2577e6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:06.712178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a724e21a-0955-4332-8df3-d756d2577e6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:06.712883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a724e21a-0955-4332-8df3-d756d2577e6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:06.713337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a724e21a-0955-4332-8df3-d756d2577e6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:06.714281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a724e21a-0955-4332-8df3-d756d2577e6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:06.744232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a724e21a-0955-4332-8df3-d756d2577e6d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046330 Aug 18 21:59:06.744786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 299/594] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:06 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 21:59:07.756377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b14486ea-c1b5-4cfe-bd3e-763ebab838c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:07.758504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b14486ea-c1b5-4cfe-bd3e-763ebab838c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:07.764862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b14486ea-c1b5-4cfe-bd3e-763ebab838c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:07.765342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b14486ea-c1b5-4cfe-bd3e-763ebab838c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:07.765822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b14486ea-c1b5-4cfe-bd3e-763ebab838c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:07.766513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b14486ea-c1b5-4cfe-bd3e-763ebab838c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:07.766966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b14486ea-c1b5-4cfe-bd3e-763ebab838c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:07.767392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b14486ea-c1b5-4cfe-bd3e-763ebab838c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:07.797104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b14486ea-c1b5-4cfe-bd3e-763ebab838c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044621 Aug 18 21:59:07.797694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 296/595] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:08.809444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-578c55cb-9b9f-4131-8ecb-22727315e765 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:08.811594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-578c55cb-9b9f-4131-8ecb-22727315e765 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:08.818119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-578c55cb-9b9f-4131-8ecb-22727315e765 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:08.818592 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-578c55cb-9b9f-4131-8ecb-22727315e765 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:08.819018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-578c55cb-9b9f-4131-8ecb-22727315e765 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:08.819703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-578c55cb-9b9f-4131-8ecb-22727315e765 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:08.820151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-578c55cb-9b9f-4131-8ecb-22727315e765 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:08.820570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-578c55cb-9b9f-4131-8ecb-22727315e765 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:08.849989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-578c55cb-9b9f-4131-8ecb-22727315e765 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044500 Aug 18 21:59:08.850541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 300/596] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:09.861947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4b294ed6-00b4-4352-b23d-54997e8939f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:09.864100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4b294ed6-00b4-4352-b23d-54997e8939f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:09.870896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b294ed6-00b4-4352-b23d-54997e8939f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:09.871378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b294ed6-00b4-4352-b23d-54997e8939f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:09.871815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b294ed6-00b4-4352-b23d-54997e8939f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:09.872513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b294ed6-00b4-4352-b23d-54997e8939f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:09.872974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b294ed6-00b4-4352-b23d-54997e8939f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:09.873422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b294ed6-00b4-4352-b23d-54997e8939f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:09.904909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4b294ed6-00b4-4352-b23d-54997e8939f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046853 Aug 18 21:59:09.905472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 297/597] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:10.916846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1600fedc-64ef-4b80-8654-ce90c1ad0c8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:10.919676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1600fedc-64ef-4b80-8654-ce90c1ad0c8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:10.926105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1600fedc-64ef-4b80-8654-ce90c1ad0c8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:10.926583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1600fedc-64ef-4b80-8654-ce90c1ad0c8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:10.927021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1600fedc-64ef-4b80-8654-ce90c1ad0c8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:10.927715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1600fedc-64ef-4b80-8654-ce90c1ad0c8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:10.928170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1600fedc-64ef-4b80-8654-ce90c1ad0c8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:10.928596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1600fedc-64ef-4b80-8654-ce90c1ad0c8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:10.958843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1600fedc-64ef-4b80-8654-ce90c1ad0c8a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046001 Aug 18 21:59:10.959639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 301/598] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:11.971646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4656f8a6-c0d6-4503-8edc-8fddbff69e82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:11.973731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4656f8a6-c0d6-4503-8edc-8fddbff69e82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:11.980104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4656f8a6-c0d6-4503-8edc-8fddbff69e82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:11.980590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4656f8a6-c0d6-4503-8edc-8fddbff69e82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:11.981028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4656f8a6-c0d6-4503-8edc-8fddbff69e82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:11.981783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4656f8a6-c0d6-4503-8edc-8fddbff69e82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:11.982246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4656f8a6-c0d6-4503-8edc-8fddbff69e82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:11.982678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4656f8a6-c0d6-4503-8edc-8fddbff69e82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:12.012142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4656f8a6-c0d6-4503-8edc-8fddbff69e82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044518 Aug 18 21:59:12.012699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 298/599] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:12.573500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1e736724-b59b-4d22-ab3f-2bac4582c2a1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:12.574050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1e736724-b59b-4d22-ab3f-2bac4582c2a1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:12.580378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e736724-b59b-4d22-ab3f-2bac4582c2a1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:12.580858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e736724-b59b-4d22-ab3f-2bac4582c2a1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:12.581294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e736724-b59b-4d22-ab3f-2bac4582c2a1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:12.582042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e736724-b59b-4d22-ab3f-2bac4582c2a1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:12.582486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e736724-b59b-4d22-ab3f-2bac4582c2a1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:12.582907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e736724-b59b-4d22-ab3f-2bac4582c2a1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:12.606166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1e736724-b59b-4d22-ab3f-2bac4582c2a1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb/ips" status: 200 len: 150 microversion: 2.1 time: 0.036621 Aug 18 21:59:12.606722 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 302/600] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 21:59:12 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:12.617860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-86d72e97-982a-4dea-99de-b7aee7042a27 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea4c7704-2bc6-471e-be0a-966efb7bbe13"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:59:12.620195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-86d72e97-982a-4dea-99de-b7aee7042a27 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:12.626061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86d72e97-982a-4dea-99de-b7aee7042a27 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:12.626536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86d72e97-982a-4dea-99de-b7aee7042a27 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:12.626970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86d72e97-982a-4dea-99de-b7aee7042a27 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:12.627648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86d72e97-982a-4dea-99de-b7aee7042a27 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:12.628097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86d72e97-982a-4dea-99de-b7aee7042a27 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:12.628511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86d72e97-982a-4dea-99de-b7aee7042a27 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:12.719020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-86d72e97-982a-4dea-99de-b7aee7042a27 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] HTTP exception thrown: Invalid volume: volume ea4c7704-2bc6-471e-be0a-966efb7bbe13 is already attached to instances: ca6f2dae-a492-46e5-ab40-5884ff13d01e Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-86d72e97-982a-4dea-99de-b7aee7042a27 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Request method failure captured: Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: POST /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb/os-volume_attachments HTTP/1.1 Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 74 Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rWBIsfITIm8B5aAadYoYtda0awBoPJQ3oDuqOGHktq7_2BFfV86yckT-Pvy_DdsU84CbBgXzQDDx-uKH3hBO1dZNixUXGb6LhK0N9LZHsMdm_6JnJoe2wAQi1un1nAf2qs4VMjOEM8E7JksAIf_9lzrYLB1p3BpYyJ_ip384PM_XwU Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 21:59:12.721260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 21:59:12.722912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_aa6929ebd282417cb6ba149f50281240", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:59:12.722912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-10339268 Aug 18 21:59:12.722912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 21:59:12.722912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 21:59:12.722912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 21:59:12.722912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 21:59:12.722912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 21:59:12.722912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 7790a2ef47644d62863aafc890d03249 Aug 18 21:59:12.722912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 21:59:12.722912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Aug 18 21:59:12.722912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {"volumeAttachment": {"volumeId": "ea4c7704-2bc6-471e-be0a-966efb7bbe13"}} Aug 18 21:59:12.722912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Invalid volume: volume ea4c7704-2bc6-471e-be0a-966efb7bbe13 is already attached to instances: ca6f2dae-a492-46e5-ab40-5884ff13d01e Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'server_id': '7625a2b9-485b-4313-ba1b-b8f88221a6fb', 'body': {'volumeAttachment': {'volumeId': 'ea4c7704-2bc6-471e-be0a-966efb7bbe13'}}} Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5122, in attach_volume Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4962, in _check_volume_already_attached Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ea4c7704-2bc6-471e-be0a-966efb7bbe13 is already attached to instances: ca6f2dae-a492-46e5-ab40-5884ff13d01e Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:59:12.723761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ea4c7704-2bc6-471e-be0a-966efb7bbe13 is already attached to instances: ca6f2dae-a492-46e5-ab40-5884ff13d01e Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:59:12.725177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:59:12.726597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:59:12.726597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:59:12.726597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:59:12.726597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ea4c7704-2bc6-471e-be0a-966efb7bbe13 is already attached to instances: ca6f2dae-a492-46e5-ab40-5884ff13d01e Aug 18 21:59:12.726597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:59:12.726597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-86d72e97-982a-4dea-99de-b7aee7042a27 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Returning 400 to user: Invalid volume: volume ea4c7704-2bc6-471e-be0a-966efb7bbe13 is already attached to instances: ca6f2dae-a492-46e5-ab40-5884ff13d01e {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:59:12.726597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-86d72e97-982a-4dea-99de-b7aee7042a27 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "POST /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108870 Aug 18 21:59:12.726597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 299/601] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 21:59:12 2022] POST /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 21:59:12.732088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3d2f0be8-5796-40c4-9b0a-711133b6df69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:12.732591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3d2f0be8-5796-40c4-9b0a-711133b6df69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:12.738594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d2f0be8-5796-40c4-9b0a-711133b6df69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:12.739078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d2f0be8-5796-40c4-9b0a-711133b6df69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:12.739517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d2f0be8-5796-40c4-9b0a-711133b6df69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:12.740211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d2f0be8-5796-40c4-9b0a-711133b6df69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:12.740669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d2f0be8-5796-40c4-9b0a-711133b6df69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:12.741117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d2f0be8-5796-40c4-9b0a-711133b6df69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:12.764916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3d2f0be8-5796-40c4-9b0a-711133b6df69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 21:59:12.839621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3d2f0be8-5796-40c4-9b0a-711133b6df69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 204 len: 0 microversion: 2.1 time: 0.111110 Aug 18 21:59:12.840235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 303/602] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 21:59:12 2022] DELETE /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 21:59:12.848786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f3034351-21d1-47f6-a1af-8bd9e4976fa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:12.849406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f3034351-21d1-47f6-a1af-8bd9e4976fa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:12.856753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3034351-21d1-47f6-a1af-8bd9e4976fa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:12.857238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3034351-21d1-47f6-a1af-8bd9e4976fa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:12.857707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3034351-21d1-47f6-a1af-8bd9e4976fa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:12.858396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3034351-21d1-47f6-a1af-8bd9e4976fa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:12.858851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3034351-21d1-47f6-a1af-8bd9e4976fa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:12.859278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3034351-21d1-47f6-a1af-8bd9e4976fa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:12.988057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f3034351-21d1-47f6-a1af-8bd9e4976fa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:59:12.995847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f3034351-21d1-47f6-a1af-8bd9e4976fa7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1680 microversion: 2.1 time: 0.150934 Aug 18 21:59:12.996409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 300/603] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:59:12 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:59:13.025206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fee38374-030b-40fc-b636-0688b4f14cc0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:13.028120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fee38374-030b-40fc-b636-0688b4f14cc0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:13.034344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fee38374-030b-40fc-b636-0688b4f14cc0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:13.034636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fee38374-030b-40fc-b636-0688b4f14cc0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:13.035069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fee38374-030b-40fc-b636-0688b4f14cc0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:13.035771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fee38374-030b-40fc-b636-0688b4f14cc0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:13.036223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fee38374-030b-40fc-b636-0688b4f14cc0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:13.036643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fee38374-030b-40fc-b636-0688b4f14cc0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:13.067473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fee38374-030b-40fc-b636-0688b4f14cc0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046651 Aug 18 21:59:13.068032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 304/604] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:13 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:14.016990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ce794841-68e9-4bc4-a6a2-5dade0357450 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:14.017566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ce794841-68e9-4bc4-a6a2-5dade0357450 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:14.024090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce794841-68e9-4bc4-a6a2-5dade0357450 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:14.024578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce794841-68e9-4bc4-a6a2-5dade0357450 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:14.025022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce794841-68e9-4bc4-a6a2-5dade0357450 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:14.025755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce794841-68e9-4bc4-a6a2-5dade0357450 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:14.026220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce794841-68e9-4bc4-a6a2-5dade0357450 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:14.026650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce794841-68e9-4bc4-a6a2-5dade0357450 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:14.079727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e3bbc6bd-9336-41ee-8ac8-d12d59e37b99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:14.082110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e3bbc6bd-9336-41ee-8ac8-d12d59e37b99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:14.084597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:14.090541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3bbc6bd-9336-41ee-8ac8-d12d59e37b99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:14.091022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3bbc6bd-9336-41ee-8ac8-d12d59e37b99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:14.091464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3bbc6bd-9336-41ee-8ac8-d12d59e37b99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:14.092168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3bbc6bd-9336-41ee-8ac8-d12d59e37b99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:14.092624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3bbc6bd-9336-41ee-8ac8-d12d59e37b99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:14.093046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3bbc6bd-9336-41ee-8ac8-d12d59e37b99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:14.123905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e3bbc6bd-9336-41ee-8ac8-d12d59e37b99 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048053 Aug 18 21:59:14.124476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 305/605] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 21:59:14.160573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ce794841-68e9-4bc4-a6a2-5dade0357450 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:59:14.168771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ce794841-68e9-4bc4-a6a2-5dade0357450 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1680 microversion: 2.1 time: 0.155738 Aug 18 21:59:14.169335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 301/606] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:59:14 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:59:15.136641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ceb1f62b-55f3-4770-b125-5a149f51ede9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:15.139750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ceb1f62b-55f3-4770-b125-5a149f51ede9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:15.145867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ceb1f62b-55f3-4770-b125-5a149f51ede9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:15.146492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ceb1f62b-55f3-4770-b125-5a149f51ede9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:15.147001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ceb1f62b-55f3-4770-b125-5a149f51ede9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:15.147772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ceb1f62b-55f3-4770-b125-5a149f51ede9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:15.148300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ceb1f62b-55f3-4770-b125-5a149f51ede9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:15.148858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ceb1f62b-55f3-4770-b125-5a149f51ede9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:15.179631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ceb1f62b-55f3-4770-b125-5a149f51ede9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047723 Aug 18 21:59:15.180215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 306/607] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:15.191280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d05f6c9b-35e8-4a35-9251-8af40ac4d7bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:15.191890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d05f6c9b-35e8-4a35-9251-8af40ac4d7bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:15.198899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d05f6c9b-35e8-4a35-9251-8af40ac4d7bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:15.199419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d05f6c9b-35e8-4a35-9251-8af40ac4d7bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:15.199863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d05f6c9b-35e8-4a35-9251-8af40ac4d7bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:15.200566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d05f6c9b-35e8-4a35-9251-8af40ac4d7bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:15.201020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d05f6c9b-35e8-4a35-9251-8af40ac4d7bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:15.201444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d05f6c9b-35e8-4a35-9251-8af40ac4d7bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:15.283762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d05f6c9b-35e8-4a35-9251-8af40ac4d7bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 21:59:15.292755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d05f6c9b-35e8-4a35-9251-8af40ac4d7bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 200 len: 1613 microversion: 2.1 time: 0.104698 Aug 18 21:59:15.293332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 302/608] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:59:15 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 1613 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 21:59:15.355790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-362691d3-f46e-4e30-b286-ebc9200acc98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1158796106"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:59:15.356370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-362691d3-f46e-4e30-b286-ebc9200acc98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:15.363161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-362691d3-f46e-4e30-b286-ebc9200acc98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:15.363896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-362691d3-f46e-4e30-b286-ebc9200acc98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:15.364512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-362691d3-f46e-4e30-b286-ebc9200acc98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:15.365804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-362691d3-f46e-4e30-b286-ebc9200acc98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:15.366351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-66d9c48b-8ef2-4d0f-bca3-7e7a84dd32f0 req-48c1cf43-2626-432c-a69e-5cc5f7aa924b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7625a2b9-485b-4313-ba1b-b8f88221a6fb", "name": "network-vif-deleted", "tag": "0ff91d4b-4a96-4c19-83e6-3d9507cf9389"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:59:15.366622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-362691d3-f46e-4e30-b286-ebc9200acc98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:15.367196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-362691d3-f46e-4e30-b286-ebc9200acc98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:15.387729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-66d9c48b-8ef2-4d0f-bca3-7e7a84dd32f0 req-48c1cf43-2626-432c-a69e-5cc5f7aa924b service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:15.388703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-66d9c48b-8ef2-4d0f-bca3-7e7a84dd32f0 req-48c1cf43-2626-432c-a69e-5cc5f7aa924b service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:15.389714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-66d9c48b-8ef2-4d0f-bca3-7e7a84dd32f0 req-48c1cf43-2626-432c-a69e-5cc5f7aa924b service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:15.403504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-66d9c48b-8ef2-4d0f-bca3-7e7a84dd32f0 req-48c1cf43-2626-432c-a69e-5cc5f7aa924b service nova] Creating event network-vif-deleted:0ff91d4b-4a96-4c19-83e6-3d9507cf9389 for instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb on hv-cinder-85367 Aug 18 21:59:15.409765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-66d9c48b-8ef2-4d0f-bca3-7e7a84dd32f0 req-48c1cf43-2626-432c-a69e-5cc5f7aa924b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052010 Aug 18 21:59:15.410775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 303/609] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:15.510142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.network.security_group_api [None req-362691d3-f46e-4e30-b286-ebc9200acc98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Removing security group 73c6476e-6681-4a00-9083-a5484af3f64a from port 98ccabc6-a7d1-4192-af56-2e746060a479 Aug 18 21:59:15.929912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-362691d3-f46e-4e30-b286-ebc9200acc98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "POST /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/action" status: 202 len: 0 microversion: 2.1 time: 0.581290 Aug 18 21:59:15.930807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 307/610] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 21:59:15 2022] POST /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:59:15.947604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-ee2c4a4a-0417-4951-ac11-751f0d491471 req-732b59eb-e25c-4f73-90ce-bd4233baeda7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b11b63-0232-4f27-bacb-2e3872f6ae18", "tag": "98ccabc6-a7d1-4192-af56-2e746060a479"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:59:15.958652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-ee2c4a4a-0417-4951-ac11-751f0d491471 req-732b59eb-e25c-4f73-90ce-bd4233baeda7 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:15.959390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-ee2c4a4a-0417-4951-ac11-751f0d491471 req-732b59eb-e25c-4f73-90ce-bd4233baeda7 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:15.960136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-ee2c4a4a-0417-4951-ac11-751f0d491471 req-732b59eb-e25c-4f73-90ce-bd4233baeda7 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:15.985301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-ee2c4a4a-0417-4951-ac11-751f0d491471 req-732b59eb-e25c-4f73-90ce-bd4233baeda7 service nova] Creating event network-changed:98ccabc6-a7d1-4192-af56-2e746060a479 for instance e7b11b63-0232-4f27-bacb-2e3872f6ae18 on hv-cinder-85367 Aug 18 21:59:15.990697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-ee2c4a4a-0417-4951-ac11-751f0d491471 req-732b59eb-e25c-4f73-90ce-bd4233baeda7 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046841 Aug 18 21:59:15.994851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 304/611] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:16.194107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0f2cabd2-91c1-4b0b-98ac-aad3e87d6a3b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:16.197175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0f2cabd2-91c1-4b0b-98ac-aad3e87d6a3b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:16.204520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f2cabd2-91c1-4b0b-98ac-aad3e87d6a3b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:16.205304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f2cabd2-91c1-4b0b-98ac-aad3e87d6a3b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:16.205978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f2cabd2-91c1-4b0b-98ac-aad3e87d6a3b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:16.206919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f2cabd2-91c1-4b0b-98ac-aad3e87d6a3b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:16.207593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f2cabd2-91c1-4b0b-98ac-aad3e87d6a3b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:16.208224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f2cabd2-91c1-4b0b-98ac-aad3e87d6a3b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:16.239705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0f2cabd2-91c1-4b0b-98ac-aad3e87d6a3b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049550 Aug 18 21:59:16.240977 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 308/612] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:16.315145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0bb5bf79-7971-4571-8400-ec20b6797969 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:16.318766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0bb5bf79-7971-4571-8400-ec20b6797969 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:16.326187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bb5bf79-7971-4571-8400-ec20b6797969 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:16.327108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bb5bf79-7971-4571-8400-ec20b6797969 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:16.327985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bb5bf79-7971-4571-8400-ec20b6797969 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:16.328918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bb5bf79-7971-4571-8400-ec20b6797969 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:16.329571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bb5bf79-7971-4571-8400-ec20b6797969 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:16.330214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bb5bf79-7971-4571-8400-ec20b6797969 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:16.345985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-0bb5bf79-7971-4571-8400-ec20b6797969 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] HTTP exception thrown: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0bb5bf79-7971-4571-8400-ec20b6797969 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Request method failure captured: Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb HTTP/1.1 Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rWBIsfITIm8B5aAadYoYtda0awBoPJQ3oDuqOGHktq7_2BFfV86yckT-Pvy_DdsU84CbBgXzQDDx-uKH3hBO1dZNixUXGb6LhK0N9LZHsMdm_6JnJoe2wAQi1un1nAf2qs4VMjOEM8E7JksAIf_9lzrYLB1p3BpYyJ_ip384PM_XwU Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 21:59:16.348212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 21:59:16.349751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_aa6929ebd282417cb6ba149f50281240", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 21:59:16.349751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-10339268 Aug 18 21:59:16.349751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 21:59:16.349751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 21:59:16.349751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 21:59:16.349751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 21:59:16.349751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 21:59:16.349751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 7790a2ef47644d62863aafc890d03249 Aug 18 21:59:16.349751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 21:59:16.349751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 21:59:16.349751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 21:59:16.349751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': '7625a2b9-485b-4313-ba1b-b8f88221a6fb'} Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 21:59:16.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 21:59:16.352003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 21:59:16.357953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0bb5bf79-7971-4571-8400-ec20b6797969 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Returning 404 to user: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 21:59:16.359547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0bb5bf79-7971-4571-8400-ec20b6797969 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 404 len: 111 microversion: 2.1 time: 0.048747 Aug 18 21:59:16.360893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 305/613] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 21:59:16 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 21:59:16.369733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a0fedd56-b40b-4f3d-a22c-e2494282081d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '.version_select at 0x7fd889633430>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:16.398628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a0fedd56-b40b-4f3d-a22c-e2494282081d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-482574890" status: 202 len: 0 microversion: 2.1 time: 0.033207 Aug 18 21:59:16.403906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 309/614] 10.222.0.82 () {58 vars in 1218 bytes} [Thu Aug 18 21:59:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-482574890 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:59:17.252022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0d381cc7-9dda-4c17-9235-6587584e6f93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:17.254276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0d381cc7-9dda-4c17-9235-6587584e6f93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:17.260860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d381cc7-9dda-4c17-9235-6587584e6f93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:17.261752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d381cc7-9dda-4c17-9235-6587584e6f93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:17.262410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d381cc7-9dda-4c17-9235-6587584e6f93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:17.263382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d381cc7-9dda-4c17-9235-6587584e6f93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:17.264062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d381cc7-9dda-4c17-9235-6587584e6f93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:17.264751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d381cc7-9dda-4c17-9235-6587584e6f93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:17.302113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0d381cc7-9dda-4c17-9235-6587584e6f93 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053973 Aug 18 21:59:17.303167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 306/615] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:17.330355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4a1f0ff1-3c5e-4588-8a06-4c132e96f77b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:17.331617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4a1f0ff1-3c5e-4588-8a06-4c132e96f77b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:17.340913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a1f0ff1-3c5e-4588-8a06-4c132e96f77b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:17.342583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a1f0ff1-3c5e-4588-8a06-4c132e96f77b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:17.343283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a1f0ff1-3c5e-4588-8a06-4c132e96f77b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:17.345045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a1f0ff1-3c5e-4588-8a06-4c132e96f77b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:17.345802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a1f0ff1-3c5e-4588-8a06-4c132e96f77b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:17.347922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a1f0ff1-3c5e-4588-8a06-4c132e96f77b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:17.374490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:17.455545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-4a1f0ff1-3c5e-4588-8a06-4c132e96f77b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lazy-loading 'services' on Instance uuid e7b11b63-0232-4f27-bacb-2e3872f6ae18 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:59:17.561452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4a1f0ff1-3c5e-4588-8a06-4c132e96f77b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "DELETE /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments/a9793aeb-8666-4b6c-9f30-e26675b395f9" status: 202 len: 0 microversion: 2.1 time: 0.232259 Aug 18 21:59:17.562363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 310/616] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 21:59:17 2022] DELETE /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments/a9793aeb-8666-4b6c-9f30-e26675b395f9 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:59:17.575683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5cda97c7-35b1-4566-921c-3aaeb05fdf5f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:17.578270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5cda97c7-35b1-4566-921c-3aaeb05fdf5f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:17.602748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cda97c7-35b1-4566-921c-3aaeb05fdf5f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:17.604793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cda97c7-35b1-4566-921c-3aaeb05fdf5f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:17.605505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cda97c7-35b1-4566-921c-3aaeb05fdf5f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:17.608948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cda97c7-35b1-4566-921c-3aaeb05fdf5f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:17.609547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cda97c7-35b1-4566-921c-3aaeb05fdf5f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:17.610060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cda97c7-35b1-4566-921c-3aaeb05fdf5f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:17.654696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5cda97c7-35b1-4566-921c-3aaeb05fdf5f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086794 Aug 18 21:59:17.656545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 307/617] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:17.748417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d4b69487-e1b2-4842-a72a-9367ccad4206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:17.749006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d4b69487-e1b2-4842-a72a-9367ccad4206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:17.755259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4b69487-e1b2-4842-a72a-9367ccad4206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:17.755944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4b69487-e1b2-4842-a72a-9367ccad4206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:17.756541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4b69487-e1b2-4842-a72a-9367ccad4206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:17.757401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4b69487-e1b2-4842-a72a-9367ccad4206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:17.758093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4b69487-e1b2-4842-a72a-9367ccad4206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:17.758707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4b69487-e1b2-4842-a72a-9367ccad4206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:17.859089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-d4b69487-e1b2-4842-a72a-9367ccad4206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lazy-loading 'services' on Instance uuid ca6f2dae-a492-46e5-ab40-5884ff13d01e {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:59:17.948028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d4b69487-e1b2-4842-a72a-9367ccad4206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments/ea4c7704-2bc6-471e-be0a-966efb7bbe13" status: 202 len: 0 microversion: 2.1 time: 0.203680 Aug 18 21:59:17.949311 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 311/618] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 21:59:17 2022] DELETE /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments/ea4c7704-2bc6-471e-be0a-966efb7bbe13 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:59:17.958831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6e852378-96f3-4f4e-9b0a-a15930f6e917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:17.960999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6e852378-96f3-4f4e-9b0a-a15930f6e917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:17.971202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e852378-96f3-4f4e-9b0a-a15930f6e917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:17.972111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e852378-96f3-4f4e-9b0a-a15930f6e917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:17.975101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e852378-96f3-4f4e-9b0a-a15930f6e917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:17.976026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e852378-96f3-4f4e-9b0a-a15930f6e917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:17.976499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e852378-96f3-4f4e-9b0a-a15930f6e917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:17.976931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e852378-96f3-4f4e-9b0a-a15930f6e917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:18.013307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6e852378-96f3-4f4e-9b0a-a15930f6e917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058758 Aug 18 21:59:18.014115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-dc3a5684-29b3-4b11-98b4-647ddd9f36fa req-11f0a85a-5100-471a-a0e1-010823e9226f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b11b63-0232-4f27-bacb-2e3872f6ae18", "tag": "98ccabc6-a7d1-4192-af56-2e746060a479"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 21:59:18.015235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 308/619] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:17 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:18.032450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-dc3a5684-29b3-4b11-98b4-647ddd9f36fa req-11f0a85a-5100-471a-a0e1-010823e9226f service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:18.033168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-dc3a5684-29b3-4b11-98b4-647ddd9f36fa req-11f0a85a-5100-471a-a0e1-010823e9226f service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:18.033633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-dc3a5684-29b3-4b11-98b4-647ddd9f36fa req-11f0a85a-5100-471a-a0e1-010823e9226f service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:18.046879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-dc3a5684-29b3-4b11-98b4-647ddd9f36fa req-11f0a85a-5100-471a-a0e1-010823e9226f service nova] Creating event network-changed:98ccabc6-a7d1-4192-af56-2e746060a479 for instance e7b11b63-0232-4f27-bacb-2e3872f6ae18 on hv-cinder-85367 Aug 18 21:59:18.052790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-dc3a5684-29b3-4b11-98b4-647ddd9f36fa req-11f0a85a-5100-471a-a0e1-010823e9226f service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044392 Aug 18 21:59:18.053796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 312/620] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 21:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:18.314580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-01ba177e-06f5-4c0e-bbdc-8f767746f0dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:18.316860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-01ba177e-06f5-4c0e-bbdc-8f767746f0dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:18.323743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01ba177e-06f5-4c0e-bbdc-8f767746f0dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:18.324506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01ba177e-06f5-4c0e-bbdc-8f767746f0dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:18.325213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01ba177e-06f5-4c0e-bbdc-8f767746f0dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:18.326154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01ba177e-06f5-4c0e-bbdc-8f767746f0dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:18.326784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01ba177e-06f5-4c0e-bbdc-8f767746f0dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:18.327221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01ba177e-06f5-4c0e-bbdc-8f767746f0dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:18.360271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-01ba177e-06f5-4c0e-bbdc-8f767746f0dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049591 Aug 18 21:59:18.361252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 309/621] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:18 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 21:59:18.668884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0f553175-7756-4980-a451-580c5d508a65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:18.671419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0f553175-7756-4980-a451-580c5d508a65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:18.677705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f553175-7756-4980-a451-580c5d508a65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:18.678208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f553175-7756-4980-a451-580c5d508a65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:18.678644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f553175-7756-4980-a451-580c5d508a65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:18.679346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f553175-7756-4980-a451-580c5d508a65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:18.679806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f553175-7756-4980-a451-580c5d508a65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:18.680238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f553175-7756-4980-a451-580c5d508a65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:18.710129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0f553175-7756-4980-a451-580c5d508a65 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045901 Aug 18 21:59:18.710692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 313/622] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:19.027425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-50e67ee3-1036-4613-95a3-b109b972d224 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:19.029591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-50e67ee3-1036-4613-95a3-b109b972d224 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:19.036076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50e67ee3-1036-4613-95a3-b109b972d224 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:19.036554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50e67ee3-1036-4613-95a3-b109b972d224 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:19.036994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50e67ee3-1036-4613-95a3-b109b972d224 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:19.037714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50e67ee3-1036-4613-95a3-b109b972d224 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:19.038175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50e67ee3-1036-4613-95a3-b109b972d224 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:19.038603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50e67ee3-1036-4613-95a3-b109b972d224 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:19.055532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:19.070129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-50e67ee3-1036-4613-95a3-b109b972d224 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046681 Aug 18 21:59:19.070692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 310/623] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:19 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:19.372649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52e3267e-6966-4d4c-8148-1454c042a914 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:19.374770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-52e3267e-6966-4d4c-8148-1454c042a914 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:19.380660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52e3267e-6966-4d4c-8148-1454c042a914 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:19.381133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52e3267e-6966-4d4c-8148-1454c042a914 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:19.381561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52e3267e-6966-4d4c-8148-1454c042a914 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:19.382269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52e3267e-6966-4d4c-8148-1454c042a914 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:19.382718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52e3267e-6966-4d4c-8148-1454c042a914 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:19.383136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52e3267e-6966-4d4c-8148-1454c042a914 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:19.412502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-52e3267e-6966-4d4c-8148-1454c042a914 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043988 Aug 18 21:59:19.413054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 314/624] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:19.722452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-def70ba3-05ba-4836-b2ae-80026364a275 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:19.724564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-def70ba3-05ba-4836-b2ae-80026364a275 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:19.730614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-def70ba3-05ba-4836-b2ae-80026364a275 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:19.731105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-def70ba3-05ba-4836-b2ae-80026364a275 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:19.731541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-def70ba3-05ba-4836-b2ae-80026364a275 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:19.732224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-def70ba3-05ba-4836-b2ae-80026364a275 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:19.732683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-def70ba3-05ba-4836-b2ae-80026364a275 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:19.733108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-def70ba3-05ba-4836-b2ae-80026364a275 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:19.761418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-def70ba3-05ba-4836-b2ae-80026364a275 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042379 Aug 18 21:59:19.761986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 311/625] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:19 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:20.082556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fe36e888-0456-4c3c-a489-032397bc15a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:20.084711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fe36e888-0456-4c3c-a489-032397bc15a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:20.091792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe36e888-0456-4c3c-a489-032397bc15a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:20.092263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe36e888-0456-4c3c-a489-032397bc15a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:20.092693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe36e888-0456-4c3c-a489-032397bc15a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:20.093376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe36e888-0456-4c3c-a489-032397bc15a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:20.093858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe36e888-0456-4c3c-a489-032397bc15a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:20.094281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe36e888-0456-4c3c-a489-032397bc15a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:20.123913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fe36e888-0456-4c3c-a489-032397bc15a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045336 Aug 18 21:59:20.124463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 315/626] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:20 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:20.425395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9d8e344c-a2ca-4856-9080-29761a43dbb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:20.427414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9d8e344c-a2ca-4856-9080-29761a43dbb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:20.434272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d8e344c-a2ca-4856-9080-29761a43dbb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:20.434754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d8e344c-a2ca-4856-9080-29761a43dbb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:20.435185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d8e344c-a2ca-4856-9080-29761a43dbb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:20.435868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d8e344c-a2ca-4856-9080-29761a43dbb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:20.436317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d8e344c-a2ca-4856-9080-29761a43dbb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:20.436735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d8e344c-a2ca-4856-9080-29761a43dbb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:20.465175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9d8e344c-a2ca-4856-9080-29761a43dbb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043804 Aug 18 21:59:20.465750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 312/627] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:20 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:20.773615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ed9861ab-c868-4893-b294-5b8e6819889b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:20.776046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ed9861ab-c868-4893-b294-5b8e6819889b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:20.782291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed9861ab-c868-4893-b294-5b8e6819889b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:20.782781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed9861ab-c868-4893-b294-5b8e6819889b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:20.783253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed9861ab-c868-4893-b294-5b8e6819889b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:20.783954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed9861ab-c868-4893-b294-5b8e6819889b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:20.784413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed9861ab-c868-4893-b294-5b8e6819889b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:20.784848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed9861ab-c868-4893-b294-5b8e6819889b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:20.814394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ed9861ab-c868-4893-b294-5b8e6819889b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Aug 18 21:59:20.814957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 316/628] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:20 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:21.135858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-faa07ab8-e7e8-4e68-a03c-fab6426e945e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:21.138026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-faa07ab8-e7e8-4e68-a03c-fab6426e945e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:21.144012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa07ab8-e7e8-4e68-a03c-fab6426e945e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:21.144499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa07ab8-e7e8-4e68-a03c-fab6426e945e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:21.144945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa07ab8-e7e8-4e68-a03c-fab6426e945e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:21.145659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa07ab8-e7e8-4e68-a03c-fab6426e945e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:21.146121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa07ab8-e7e8-4e68-a03c-fab6426e945e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:21.146552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa07ab8-e7e8-4e68-a03c-fab6426e945e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:21.176531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-faa07ab8-e7e8-4e68-a03c-fab6426e945e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Aug 18 21:59:21.177086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 313/629] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:21 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:21.477522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b1712aae-b389-427e-a3e8-bbb6fd2e4074 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:21.479614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b1712aae-b389-427e-a3e8-bbb6fd2e4074 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:21.485982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1712aae-b389-427e-a3e8-bbb6fd2e4074 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:21.486461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1712aae-b389-427e-a3e8-bbb6fd2e4074 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:21.486896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1712aae-b389-427e-a3e8-bbb6fd2e4074 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:21.487588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1712aae-b389-427e-a3e8-bbb6fd2e4074 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:21.488047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1712aae-b389-427e-a3e8-bbb6fd2e4074 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:21.488475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1712aae-b389-427e-a3e8-bbb6fd2e4074 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:21.517040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b1712aae-b389-427e-a3e8-bbb6fd2e4074 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043661 Aug 18 21:59:21.517618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 317/630] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:21.827091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-790a068f-64b8-41ef-9300-82d6db09d200 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:21.829247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-790a068f-64b8-41ef-9300-82d6db09d200 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:21.835627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-790a068f-64b8-41ef-9300-82d6db09d200 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:21.836125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-790a068f-64b8-41ef-9300-82d6db09d200 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:21.836566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-790a068f-64b8-41ef-9300-82d6db09d200 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:21.837268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-790a068f-64b8-41ef-9300-82d6db09d200 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:21.837762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-790a068f-64b8-41ef-9300-82d6db09d200 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:21.838197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-790a068f-64b8-41ef-9300-82d6db09d200 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:21.866137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-790a068f-64b8-41ef-9300-82d6db09d200 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043611 Aug 18 21:59:21.866686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 314/631] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:21 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:22.189363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-12980ec3-9fcf-42f7-978a-e6e364b32147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:22.191463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-12980ec3-9fcf-42f7-978a-e6e364b32147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:22.197356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12980ec3-9fcf-42f7-978a-e6e364b32147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:22.197951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12980ec3-9fcf-42f7-978a-e6e364b32147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:22.198387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12980ec3-9fcf-42f7-978a-e6e364b32147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:22.199076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12980ec3-9fcf-42f7-978a-e6e364b32147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:22.199530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12980ec3-9fcf-42f7-978a-e6e364b32147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:22.200023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12980ec3-9fcf-42f7-978a-e6e364b32147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:22.228259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-12980ec3-9fcf-42f7-978a-e6e364b32147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043137 Aug 18 21:59:22.228813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 318/632] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:22.529497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7e784bc7-bad6-4228-8277-98c22fb97dbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:22.531676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7e784bc7-bad6-4228-8277-98c22fb97dbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:22.537923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e784bc7-bad6-4228-8277-98c22fb97dbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:22.538409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e784bc7-bad6-4228-8277-98c22fb97dbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:22.538846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e784bc7-bad6-4228-8277-98c22fb97dbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:22.539537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e784bc7-bad6-4228-8277-98c22fb97dbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:22.539990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e784bc7-bad6-4228-8277-98c22fb97dbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:22.540425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e784bc7-bad6-4228-8277-98c22fb97dbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:22.569157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7e784bc7-bad6-4228-8277-98c22fb97dbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043686 Aug 18 21:59:22.569726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 315/633] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:22.878848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-347b0cb3-f52e-4cae-aad1-4c9bc47c4409 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:22.880943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-347b0cb3-f52e-4cae-aad1-4c9bc47c4409 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:22.887420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-347b0cb3-f52e-4cae-aad1-4c9bc47c4409 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:22.887916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-347b0cb3-f52e-4cae-aad1-4c9bc47c4409 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:22.888347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-347b0cb3-f52e-4cae-aad1-4c9bc47c4409 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:22.889046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-347b0cb3-f52e-4cae-aad1-4c9bc47c4409 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:22.889504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-347b0cb3-f52e-4cae-aad1-4c9bc47c4409 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:22.889958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-347b0cb3-f52e-4cae-aad1-4c9bc47c4409 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:22.918174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-347b0cb3-f52e-4cae-aad1-4c9bc47c4409 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043367 Aug 18 21:59:22.918728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 319/634] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:22 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:23.240783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-584fad5f-8527-41f1-ad25-3363dd48cabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:23.242824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-584fad5f-8527-41f1-ad25-3363dd48cabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:23.249669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-584fad5f-8527-41f1-ad25-3363dd48cabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:23.250142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-584fad5f-8527-41f1-ad25-3363dd48cabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:23.250568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-584fad5f-8527-41f1-ad25-3363dd48cabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:23.251247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-584fad5f-8527-41f1-ad25-3363dd48cabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:23.251696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-584fad5f-8527-41f1-ad25-3363dd48cabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:23.252117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-584fad5f-8527-41f1-ad25-3363dd48cabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:23.280770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-584fad5f-8527-41f1-ad25-3363dd48cabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Aug 18 21:59:23.281314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 316/635] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:23 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:23.582945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-95974870-0663-430e-bd4b-3ba263e90537 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:23.585100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-95974870-0663-430e-bd4b-3ba263e90537 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:23.591161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95974870-0663-430e-bd4b-3ba263e90537 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:23.591655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95974870-0663-430e-bd4b-3ba263e90537 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:23.592092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95974870-0663-430e-bd4b-3ba263e90537 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:23.592786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95974870-0663-430e-bd4b-3ba263e90537 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:23.593243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95974870-0663-430e-bd4b-3ba263e90537 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:23.593700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95974870-0663-430e-bd4b-3ba263e90537 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:23.624397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-95974870-0663-430e-bd4b-3ba263e90537 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045586 Aug 18 21:59:23.624972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 320/636] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:23.930790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3ad18ea5-1c10-4790-8dd3-bc8e5236b3a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:23.932894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3ad18ea5-1c10-4790-8dd3-bc8e5236b3a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:23.938885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ad18ea5-1c10-4790-8dd3-bc8e5236b3a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:23.939368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ad18ea5-1c10-4790-8dd3-bc8e5236b3a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:23.939810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ad18ea5-1c10-4790-8dd3-bc8e5236b3a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:23.940499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ad18ea5-1c10-4790-8dd3-bc8e5236b3a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:23.941159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ad18ea5-1c10-4790-8dd3-bc8e5236b3a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:23.941934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ad18ea5-1c10-4790-8dd3-bc8e5236b3a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:23.970532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3ad18ea5-1c10-4790-8dd3-bc8e5236b3a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043790 Aug 18 21:59:23.971115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 317/637] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:23 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:24.292957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1232fea9-4427-49ba-97cd-8d0f8b501140 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:24.295421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1232fea9-4427-49ba-97cd-8d0f8b501140 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:24.301866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1232fea9-4427-49ba-97cd-8d0f8b501140 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:24.302348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1232fea9-4427-49ba-97cd-8d0f8b501140 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:24.302782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1232fea9-4427-49ba-97cd-8d0f8b501140 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:24.303469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1232fea9-4427-49ba-97cd-8d0f8b501140 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:24.303925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1232fea9-4427-49ba-97cd-8d0f8b501140 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:24.304350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1232fea9-4427-49ba-97cd-8d0f8b501140 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:24.333057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1232fea9-4427-49ba-97cd-8d0f8b501140 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044072 Aug 18 21:59:24.333621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 321/638] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:24 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:24.637285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-891198a5-df0d-4472-895a-917dd60a27bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:24.639461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-891198a5-df0d-4472-895a-917dd60a27bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:24.645849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-891198a5-df0d-4472-895a-917dd60a27bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:24.646325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-891198a5-df0d-4472-895a-917dd60a27bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:24.646755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-891198a5-df0d-4472-895a-917dd60a27bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:24.647444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-891198a5-df0d-4472-895a-917dd60a27bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:24.647894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-891198a5-df0d-4472-895a-917dd60a27bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:24.648315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-891198a5-df0d-4472-895a-917dd60a27bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:24.676917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-891198a5-df0d-4472-895a-917dd60a27bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044174 Aug 18 21:59:24.677465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 318/639] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:24 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:24.983554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d54c5b2-63a6-47f4-ba4e-4d069a8144e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:24.985752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1d54c5b2-63a6-47f4-ba4e-4d069a8144e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:24.991637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d54c5b2-63a6-47f4-ba4e-4d069a8144e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:24.992122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d54c5b2-63a6-47f4-ba4e-4d069a8144e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:24.992565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d54c5b2-63a6-47f4-ba4e-4d069a8144e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:24.993258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d54c5b2-63a6-47f4-ba4e-4d069a8144e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:24.993751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d54c5b2-63a6-47f4-ba4e-4d069a8144e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:24.994185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d54c5b2-63a6-47f4-ba4e-4d069a8144e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:25.023878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1d54c5b2-63a6-47f4-ba4e-4d069a8144e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Aug 18 21:59:25.024446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 322/640] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:25.346358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-efce4964-2ef5-408b-8980-018eb8c4cd9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:25.348740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-efce4964-2ef5-408b-8980-018eb8c4cd9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:25.355309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efce4964-2ef5-408b-8980-018eb8c4cd9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:25.355789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efce4964-2ef5-408b-8980-018eb8c4cd9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:25.356222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efce4964-2ef5-408b-8980-018eb8c4cd9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:25.356917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efce4964-2ef5-408b-8980-018eb8c4cd9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:25.357372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efce4964-2ef5-408b-8980-018eb8c4cd9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:25.357816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efce4964-2ef5-408b-8980-018eb8c4cd9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:25.386354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-efce4964-2ef5-408b-8980-018eb8c4cd9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 Aug 18 21:59:25.386909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 319/641] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:25.688740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-de846b57-6864-4936-b0df-7f751425f7d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:25.691028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-de846b57-6864-4936-b0df-7f751425f7d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:25.697495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de846b57-6864-4936-b0df-7f751425f7d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:25.698017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de846b57-6864-4936-b0df-7f751425f7d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:25.698940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de846b57-6864-4936-b0df-7f751425f7d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:25.699643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de846b57-6864-4936-b0df-7f751425f7d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:25.700103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de846b57-6864-4936-b0df-7f751425f7d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:25.700534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de846b57-6864-4936-b0df-7f751425f7d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:25.732391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-de846b57-6864-4936-b0df-7f751425f7d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047603 Aug 18 21:59:25.732955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 323/642] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:25 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:26.036771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-35c7c96a-d443-4614-beb6-87e5a8e2af10 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:26.038978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-35c7c96a-d443-4614-beb6-87e5a8e2af10 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:26.045674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35c7c96a-d443-4614-beb6-87e5a8e2af10 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:26.046156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35c7c96a-d443-4614-beb6-87e5a8e2af10 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:26.046589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35c7c96a-d443-4614-beb6-87e5a8e2af10 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:26.047278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35c7c96a-d443-4614-beb6-87e5a8e2af10 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:26.047737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35c7c96a-d443-4614-beb6-87e5a8e2af10 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:26.048163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35c7c96a-d443-4614-beb6-87e5a8e2af10 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:26.076685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-35c7c96a-d443-4614-beb6-87e5a8e2af10 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043972 Aug 18 21:59:26.077243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 320/643] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:26 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:26.397755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3481cc99-3208-4695-8328-4ded5f02c00e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:26.399927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3481cc99-3208-4695-8328-4ded5f02c00e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:26.406420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3481cc99-3208-4695-8328-4ded5f02c00e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:26.406908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3481cc99-3208-4695-8328-4ded5f02c00e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:26.407351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3481cc99-3208-4695-8328-4ded5f02c00e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:26.408043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3481cc99-3208-4695-8328-4ded5f02c00e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:26.408503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3481cc99-3208-4695-8328-4ded5f02c00e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:26.408933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3481cc99-3208-4695-8328-4ded5f02c00e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:26.438306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3481cc99-3208-4695-8328-4ded5f02c00e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044473 Aug 18 21:59:26.438905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 324/644] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:26 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:26.744594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a5ace12c-2a38-4f24-a288-830122b4a01a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:26.747367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a5ace12c-2a38-4f24-a288-830122b4a01a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:26.753385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5ace12c-2a38-4f24-a288-830122b4a01a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:26.753909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5ace12c-2a38-4f24-a288-830122b4a01a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:26.754350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5ace12c-2a38-4f24-a288-830122b4a01a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:26.755039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5ace12c-2a38-4f24-a288-830122b4a01a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:26.755495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5ace12c-2a38-4f24-a288-830122b4a01a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:26.755920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5ace12c-2a38-4f24-a288-830122b4a01a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:26.784659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a5ace12c-2a38-4f24-a288-830122b4a01a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044156 Aug 18 21:59:26.785244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 321/645] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:26 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:27.088527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ffb732dc-fccc-4b97-9153-6314a238d577 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:27.091239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ffb732dc-fccc-4b97-9153-6314a238d577 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:27.097742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb732dc-fccc-4b97-9153-6314a238d577 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:27.098163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb732dc-fccc-4b97-9153-6314a238d577 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:27.098602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb732dc-fccc-4b97-9153-6314a238d577 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:27.099305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb732dc-fccc-4b97-9153-6314a238d577 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:27.099773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb732dc-fccc-4b97-9153-6314a238d577 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:27.100204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffb732dc-fccc-4b97-9153-6314a238d577 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:27.129018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ffb732dc-fccc-4b97-9153-6314a238d577 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Aug 18 21:59:27.129631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 325/646] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:27 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:27.451066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fb5345b4-0cc4-42e9-be34-9a3004034469 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:27.452994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fb5345b4-0cc4-42e9-be34-9a3004034469 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:27.460326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb5345b4-0cc4-42e9-be34-9a3004034469 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:27.461576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb5345b4-0cc4-42e9-be34-9a3004034469 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:27.462039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb5345b4-0cc4-42e9-be34-9a3004034469 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:27.463082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb5345b4-0cc4-42e9-be34-9a3004034469 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:27.463613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb5345b4-0cc4-42e9-be34-9a3004034469 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:27.464087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb5345b4-0cc4-42e9-be34-9a3004034469 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:27.493761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fb5345b4-0cc4-42e9-be34-9a3004034469 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046974 Aug 18 21:59:27.494318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 322/647] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:27.797363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9509c6a5-5d50-4a75-b7cf-003df8b0b580 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:27.799656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9509c6a5-5d50-4a75-b7cf-003df8b0b580 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:27.805583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9509c6a5-5d50-4a75-b7cf-003df8b0b580 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:27.806097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9509c6a5-5d50-4a75-b7cf-003df8b0b580 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:27.806565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9509c6a5-5d50-4a75-b7cf-003df8b0b580 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:27.807256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9509c6a5-5d50-4a75-b7cf-003df8b0b580 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:27.807710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9509c6a5-5d50-4a75-b7cf-003df8b0b580 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:27.808135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9509c6a5-5d50-4a75-b7cf-003df8b0b580 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:27.822128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:27.839496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9509c6a5-5d50-4a75-b7cf-003df8b0b580 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045952 Aug 18 21:59:27.840056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 326/648] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:27 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:28.140903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-219ef4c1-8d68-4f1f-b39a-0f441819b9e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:28.143068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-219ef4c1-8d68-4f1f-b39a-0f441819b9e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:28.149149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-219ef4c1-8d68-4f1f-b39a-0f441819b9e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:28.149732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-219ef4c1-8d68-4f1f-b39a-0f441819b9e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:28.150180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-219ef4c1-8d68-4f1f-b39a-0f441819b9e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:28.150873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-219ef4c1-8d68-4f1f-b39a-0f441819b9e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:28.151983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-219ef4c1-8d68-4f1f-b39a-0f441819b9e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:28.152429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-219ef4c1-8d68-4f1f-b39a-0f441819b9e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:28.180561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-219ef4c1-8d68-4f1f-b39a-0f441819b9e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043585 Aug 18 21:59:28.181121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 323/649] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:28 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:28.507096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-454f1a26-af24-421d-817d-d45eea4f7374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:28.509188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-454f1a26-af24-421d-817d-d45eea4f7374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:28.516171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-454f1a26-af24-421d-817d-d45eea4f7374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:28.516659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-454f1a26-af24-421d-817d-d45eea4f7374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:28.517101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-454f1a26-af24-421d-817d-d45eea4f7374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:28.517825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-454f1a26-af24-421d-817d-d45eea4f7374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:28.518285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-454f1a26-af24-421d-817d-d45eea4f7374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:28.518715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-454f1a26-af24-421d-817d-d45eea4f7374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:28.547266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-454f1a26-af24-421d-817d-d45eea4f7374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Aug 18 21:59:28.547821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 327/650] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:28.851993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-56506084-18cf-4a9c-95f9-d252efb2dff3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:28.854220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-56506084-18cf-4a9c-95f9-d252efb2dff3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:28.860628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56506084-18cf-4a9c-95f9-d252efb2dff3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:28.861119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56506084-18cf-4a9c-95f9-d252efb2dff3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:28.861563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56506084-18cf-4a9c-95f9-d252efb2dff3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:28.862297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56506084-18cf-4a9c-95f9-d252efb2dff3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:28.862857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56506084-18cf-4a9c-95f9-d252efb2dff3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:28.863291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56506084-18cf-4a9c-95f9-d252efb2dff3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:28.892424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-56506084-18cf-4a9c-95f9-d252efb2dff3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044408 Aug 18 21:59:28.892985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 324/651] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:29.192384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a023e1a6-299c-4c4a-8c36-baa561b42ff3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:29.194527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a023e1a6-299c-4c4a-8c36-baa561b42ff3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:29.201020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a023e1a6-299c-4c4a-8c36-baa561b42ff3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:29.201516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a023e1a6-299c-4c4a-8c36-baa561b42ff3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:29.202086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a023e1a6-299c-4c4a-8c36-baa561b42ff3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:29.202878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a023e1a6-299c-4c4a-8c36-baa561b42ff3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:29.203558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a023e1a6-299c-4c4a-8c36-baa561b42ff3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:29.203959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a023e1a6-299c-4c4a-8c36-baa561b42ff3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:29.234189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a023e1a6-299c-4c4a-8c36-baa561b42ff3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045849 Aug 18 21:59:29.234752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 328/652] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:29 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:29.559763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c0555c38-c771-4347-950b-e642cd81bf76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:29.561923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c0555c38-c771-4347-950b-e642cd81bf76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:29.568380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0555c38-c771-4347-950b-e642cd81bf76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:29.568865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0555c38-c771-4347-950b-e642cd81bf76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:29.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0555c38-c771-4347-950b-e642cd81bf76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:29.570029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0555c38-c771-4347-950b-e642cd81bf76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:29.570492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0555c38-c771-4347-950b-e642cd81bf76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:29.570923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0555c38-c771-4347-950b-e642cd81bf76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:29.600510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c0555c38-c771-4347-950b-e642cd81bf76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Aug 18 21:59:29.601104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 325/653] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:29 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:29.904521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-341d2234-4a9f-467c-b520-3654f8147311 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:29.906625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-341d2234-4a9f-467c-b520-3654f8147311 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:29.913127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-341d2234-4a9f-467c-b520-3654f8147311 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:29.913624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-341d2234-4a9f-467c-b520-3654f8147311 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:29.914076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-341d2234-4a9f-467c-b520-3654f8147311 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:29.914777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-341d2234-4a9f-467c-b520-3654f8147311 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:29.915238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-341d2234-4a9f-467c-b520-3654f8147311 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:29.915669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-341d2234-4a9f-467c-b520-3654f8147311 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:29.947548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-341d2234-4a9f-467c-b520-3654f8147311 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046980 Aug 18 21:59:29.948967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 329/654] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 21:59:30.247091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-634d4cfe-8f38-49a6-80aa-95be36d2f37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:30.249127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-634d4cfe-8f38-49a6-80aa-95be36d2f37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:30.255035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-634d4cfe-8f38-49a6-80aa-95be36d2f37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:30.255512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-634d4cfe-8f38-49a6-80aa-95be36d2f37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:30.255956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-634d4cfe-8f38-49a6-80aa-95be36d2f37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:30.256640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-634d4cfe-8f38-49a6-80aa-95be36d2f37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:30.257095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-634d4cfe-8f38-49a6-80aa-95be36d2f37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:30.257521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-634d4cfe-8f38-49a6-80aa-95be36d2f37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:30.285102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-634d4cfe-8f38-49a6-80aa-95be36d2f37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042621 Aug 18 21:59:30.285678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 326/655] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:30.612830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-abd38d12-547e-4217-8829-e2d6f25aa571 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:30.615241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-abd38d12-547e-4217-8829-e2d6f25aa571 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:30.621243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abd38d12-547e-4217-8829-e2d6f25aa571 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:30.621759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abd38d12-547e-4217-8829-e2d6f25aa571 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:30.622194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abd38d12-547e-4217-8829-e2d6f25aa571 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:30.622886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abd38d12-547e-4217-8829-e2d6f25aa571 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:30.623337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abd38d12-547e-4217-8829-e2d6f25aa571 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:30.623760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abd38d12-547e-4217-8829-e2d6f25aa571 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:30.652605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-abd38d12-547e-4217-8829-e2d6f25aa571 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043778 Aug 18 21:59:30.653157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 330/656] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:30 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:30.960358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-084ae3ee-f68d-4205-a7a9-4425cb25f246 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:30.962805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-084ae3ee-f68d-4205-a7a9-4425cb25f246 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:30.969828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-084ae3ee-f68d-4205-a7a9-4425cb25f246 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:30.970346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-084ae3ee-f68d-4205-a7a9-4425cb25f246 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:30.970785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-084ae3ee-f68d-4205-a7a9-4425cb25f246 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:30.971487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-084ae3ee-f68d-4205-a7a9-4425cb25f246 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:30.971947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-084ae3ee-f68d-4205-a7a9-4425cb25f246 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:30.972407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-084ae3ee-f68d-4205-a7a9-4425cb25f246 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:30.976161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:31.001714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-084ae3ee-f68d-4205-a7a9-4425cb25f246 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045359 Aug 18 21:59:31.002276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 327/657] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:31.297005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e8b11ea4-8a67-42e5-947a-43bdd78370cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:31.299230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e8b11ea4-8a67-42e5-947a-43bdd78370cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:31.305609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8b11ea4-8a67-42e5-947a-43bdd78370cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:31.306101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8b11ea4-8a67-42e5-947a-43bdd78370cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:31.306536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8b11ea4-8a67-42e5-947a-43bdd78370cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:31.307234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8b11ea4-8a67-42e5-947a-43bdd78370cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:31.307695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8b11ea4-8a67-42e5-947a-43bdd78370cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:31.308126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8b11ea4-8a67-42e5-947a-43bdd78370cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:31.336444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e8b11ea4-8a67-42e5-947a-43bdd78370cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043767 Aug 18 21:59:31.336999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 331/658] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:31 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:31.664921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-045ada5b-10a4-414f-840a-493aa0fb639c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:31.667032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-045ada5b-10a4-414f-840a-493aa0fb639c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:31.673167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-045ada5b-10a4-414f-840a-493aa0fb639c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:31.673689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-045ada5b-10a4-414f-840a-493aa0fb639c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:31.674130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-045ada5b-10a4-414f-840a-493aa0fb639c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:31.674821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-045ada5b-10a4-414f-840a-493aa0fb639c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:31.675274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-045ada5b-10a4-414f-840a-493aa0fb639c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:31.675699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-045ada5b-10a4-414f-840a-493aa0fb639c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:31.705542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-045ada5b-10a4-414f-840a-493aa0fb639c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044635 Aug 18 21:59:31.706128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 328/659] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:31 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:32.013623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a86cc5fe-adcd-4610-9b7c-2a2e3d5c02c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:32.015823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a86cc5fe-adcd-4610-9b7c-2a2e3d5c02c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:32.021749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a86cc5fe-adcd-4610-9b7c-2a2e3d5c02c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:32.022230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a86cc5fe-adcd-4610-9b7c-2a2e3d5c02c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:32.022664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a86cc5fe-adcd-4610-9b7c-2a2e3d5c02c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:32.023353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a86cc5fe-adcd-4610-9b7c-2a2e3d5c02c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:32.023800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a86cc5fe-adcd-4610-9b7c-2a2e3d5c02c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:32.024221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a86cc5fe-adcd-4610-9b7c-2a2e3d5c02c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:32.054041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a86cc5fe-adcd-4610-9b7c-2a2e3d5c02c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044227 Aug 18 21:59:32.054632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 332/660] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:32.060649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-464449b4-754d-43f2-83b1-102b642b7263 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:32.061145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-464449b4-754d-43f2-83b1-102b642b7263 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:32.067420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-464449b4-754d-43f2-83b1-102b642b7263 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:32.067893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-464449b4-754d-43f2-83b1-102b642b7263 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:32.068322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-464449b4-754d-43f2-83b1-102b642b7263 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:32.069002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-464449b4-754d-43f2-83b1-102b642b7263 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:32.069450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-464449b4-754d-43f2-83b1-102b642b7263 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:32.069901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-464449b4-754d-43f2-83b1-102b642b7263 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:32.191304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-464449b4-754d-43f2-83b1-102b642b7263 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lazy-loading 'services' on Instance uuid c3f260fb-84bc-434c-b885-0a8f54494162 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 21:59:32.301745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-464449b4-754d-43f2-83b1-102b642b7263 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments/77ca1fdd-7c40-445d-ab22-9f784df4ce01" status: 202 len: 0 microversion: 2.1 time: 0.245278 Aug 18 21:59:32.302331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 329/661] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 21:59:32 2022] DELETE /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments/77ca1fdd-7c40-445d-ab22-9f784df4ce01 => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 21:59:32.310811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-126e0b6d-1e38-460f-ac7b-9a0361e7906b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:32.312969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-126e0b6d-1e38-460f-ac7b-9a0361e7906b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:32.319466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-126e0b6d-1e38-460f-ac7b-9a0361e7906b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:32.319944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-126e0b6d-1e38-460f-ac7b-9a0361e7906b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:32.320374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-126e0b6d-1e38-460f-ac7b-9a0361e7906b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:32.321057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-126e0b6d-1e38-460f-ac7b-9a0361e7906b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:32.321507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-126e0b6d-1e38-460f-ac7b-9a0361e7906b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:32.321960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-126e0b6d-1e38-460f-ac7b-9a0361e7906b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:32.349562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5cff75fb-cc0f-41f7-9f24-393fc10dbb83 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:32.351608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-126e0b6d-1e38-460f-ac7b-9a0361e7906b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044812 Aug 18 21:59:32.351902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5cff75fb-cc0f-41f7-9f24-393fc10dbb83 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:32.352182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 333/662] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:32 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:32.358861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cff75fb-cc0f-41f7-9f24-393fc10dbb83 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:32.359348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cff75fb-cc0f-41f7-9f24-393fc10dbb83 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:32.359789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cff75fb-cc0f-41f7-9f24-393fc10dbb83 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:32.360493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cff75fb-cc0f-41f7-9f24-393fc10dbb83 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:32.360951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cff75fb-cc0f-41f7-9f24-393fc10dbb83 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:32.361379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cff75fb-cc0f-41f7-9f24-393fc10dbb83 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:32.389300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5cff75fb-cc0f-41f7-9f24-393fc10dbb83 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044322 Aug 18 21:59:32.389890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 330/663] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:32.718124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8a37301a-d701-42f7-a98e-679322cab808 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:32.720318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8a37301a-d701-42f7-a98e-679322cab808 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:32.726255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a37301a-d701-42f7-a98e-679322cab808 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:32.726741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a37301a-d701-42f7-a98e-679322cab808 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:32.727179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a37301a-d701-42f7-a98e-679322cab808 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:32.727871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a37301a-d701-42f7-a98e-679322cab808 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:32.728327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a37301a-d701-42f7-a98e-679322cab808 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:32.728752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a37301a-d701-42f7-a98e-679322cab808 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:32.757079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8a37301a-d701-42f7-a98e-679322cab808 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043539 Aug 18 21:59:32.757714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 334/664] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:32 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:33.066838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4bb7435a-4360-4229-8b60-0cdeaabf34c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:33.068933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4bb7435a-4360-4229-8b60-0cdeaabf34c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:33.075991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bb7435a-4360-4229-8b60-0cdeaabf34c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:33.076476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bb7435a-4360-4229-8b60-0cdeaabf34c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:33.076917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bb7435a-4360-4229-8b60-0cdeaabf34c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:33.077620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bb7435a-4360-4229-8b60-0cdeaabf34c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:33.078098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bb7435a-4360-4229-8b60-0cdeaabf34c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:33.078527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bb7435a-4360-4229-8b60-0cdeaabf34c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:33.107007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4bb7435a-4360-4229-8b60-0cdeaabf34c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044131 Aug 18 21:59:33.107570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 331/665] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:33 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:33.364778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-23f5000a-04f3-4227-95d3-8f729d62d920 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:33.366962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-23f5000a-04f3-4227-95d3-8f729d62d920 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:33.373884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23f5000a-04f3-4227-95d3-8f729d62d920 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:33.374371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23f5000a-04f3-4227-95d3-8f729d62d920 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:33.374844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23f5000a-04f3-4227-95d3-8f729d62d920 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:33.375542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23f5000a-04f3-4227-95d3-8f729d62d920 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:33.376001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23f5000a-04f3-4227-95d3-8f729d62d920 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:33.376432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23f5000a-04f3-4227-95d3-8f729d62d920 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:33.401579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eecfc148-f1fb-47c8-93c1-79d0a64cbd77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:33.403782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eecfc148-f1fb-47c8-93c1-79d0a64cbd77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:33.405277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-23f5000a-04f3-4227-95d3-8f729d62d920 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Aug 18 21:59:33.405891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 335/666] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:33.410027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eecfc148-f1fb-47c8-93c1-79d0a64cbd77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:33.410529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eecfc148-f1fb-47c8-93c1-79d0a64cbd77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:33.410972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eecfc148-f1fb-47c8-93c1-79d0a64cbd77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:33.411689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eecfc148-f1fb-47c8-93c1-79d0a64cbd77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:33.412146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eecfc148-f1fb-47c8-93c1-79d0a64cbd77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:33.412576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eecfc148-f1fb-47c8-93c1-79d0a64cbd77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:33.442523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eecfc148-f1fb-47c8-93c1-79d0a64cbd77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044869 Aug 18 21:59:33.443088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 332/667] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:33 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:33.769832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f12e9c1a-941c-4936-ab9f-aae4908a80e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:33.771997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f12e9c1a-941c-4936-ab9f-aae4908a80e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:33.778433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f12e9c1a-941c-4936-ab9f-aae4908a80e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:33.778911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f12e9c1a-941c-4936-ab9f-aae4908a80e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:33.779341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f12e9c1a-941c-4936-ab9f-aae4908a80e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:33.780029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f12e9c1a-941c-4936-ab9f-aae4908a80e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:33.780479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f12e9c1a-941c-4936-ab9f-aae4908a80e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:33.780902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f12e9c1a-941c-4936-ab9f-aae4908a80e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:33.810516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f12e9c1a-941c-4936-ab9f-aae4908a80e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Aug 18 21:59:33.811074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 336/668] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:33 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:34.119344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-20c01cc6-1166-4d32-8c54-136f16dd65c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:34.122041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-20c01cc6-1166-4d32-8c54-136f16dd65c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:34.128299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20c01cc6-1166-4d32-8c54-136f16dd65c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:34.128768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20c01cc6-1166-4d32-8c54-136f16dd65c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:34.129197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20c01cc6-1166-4d32-8c54-136f16dd65c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:34.129907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20c01cc6-1166-4d32-8c54-136f16dd65c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:34.130476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20c01cc6-1166-4d32-8c54-136f16dd65c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:34.130901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20c01cc6-1166-4d32-8c54-136f16dd65c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:34.159897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-20c01cc6-1166-4d32-8c54-136f16dd65c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044527 Aug 18 21:59:34.160443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 333/669] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:34.417064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1dec9ec5-b961-4548-bba0-5b96163e8153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:34.419183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1dec9ec5-b961-4548-bba0-5b96163e8153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:34.425782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1dec9ec5-b961-4548-bba0-5b96163e8153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:34.426267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1dec9ec5-b961-4548-bba0-5b96163e8153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:34.426704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1dec9ec5-b961-4548-bba0-5b96163e8153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:34.427396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1dec9ec5-b961-4548-bba0-5b96163e8153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:34.427852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1dec9ec5-b961-4548-bba0-5b96163e8153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:34.428278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1dec9ec5-b961-4548-bba0-5b96163e8153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:34.455460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-33e220e9-794b-492a-b987-64e17b1c8bcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:34.458979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-33e220e9-794b-492a-b987-64e17b1c8bcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:34.461969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1dec9ec5-b961-4548-bba0-5b96163e8153 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048835 Aug 18 21:59:34.462547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 337/670] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:34.466187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33e220e9-794b-492a-b987-64e17b1c8bcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:34.466738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33e220e9-794b-492a-b987-64e17b1c8bcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:34.467174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33e220e9-794b-492a-b987-64e17b1c8bcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:34.467875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33e220e9-794b-492a-b987-64e17b1c8bcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:34.468323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33e220e9-794b-492a-b987-64e17b1c8bcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:34.468744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33e220e9-794b-492a-b987-64e17b1c8bcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:34.497663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-33e220e9-794b-492a-b987-64e17b1c8bcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046228 Aug 18 21:59:34.498228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 334/671] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:34 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:34.822355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0abf996b-87c5-42ba-8a8d-85619491c176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:34.824526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0abf996b-87c5-42ba-8a8d-85619491c176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:34.830387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0abf996b-87c5-42ba-8a8d-85619491c176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:34.830869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0abf996b-87c5-42ba-8a8d-85619491c176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:34.831407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0abf996b-87c5-42ba-8a8d-85619491c176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:34.832109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0abf996b-87c5-42ba-8a8d-85619491c176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:34.832563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0abf996b-87c5-42ba-8a8d-85619491c176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:34.832986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0abf996b-87c5-42ba-8a8d-85619491c176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:34.862255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0abf996b-87c5-42ba-8a8d-85619491c176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Aug 18 21:59:34.862916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 338/672] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:34 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:35.172324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-45d1145f-5505-4052-bfc9-eccd63486bc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:35.174476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-45d1145f-5505-4052-bfc9-eccd63486bc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:35.180711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45d1145f-5505-4052-bfc9-eccd63486bc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:35.181197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45d1145f-5505-4052-bfc9-eccd63486bc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:35.181652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45d1145f-5505-4052-bfc9-eccd63486bc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:35.182344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45d1145f-5505-4052-bfc9-eccd63486bc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:35.183288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45d1145f-5505-4052-bfc9-eccd63486bc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:35.183768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45d1145f-5505-4052-bfc9-eccd63486bc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:35.213722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-45d1145f-5505-4052-bfc9-eccd63486bc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045423 Aug 18 21:59:35.214341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 335/673] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:35.474454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-35b1980f-8127-477a-9bf7-e20f139275d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:35.476531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-35b1980f-8127-477a-9bf7-e20f139275d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:35.483420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35b1980f-8127-477a-9bf7-e20f139275d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:35.483904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35b1980f-8127-477a-9bf7-e20f139275d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:35.484342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35b1980f-8127-477a-9bf7-e20f139275d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:35.485044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35b1980f-8127-477a-9bf7-e20f139275d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:35.485506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35b1980f-8127-477a-9bf7-e20f139275d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:35.485960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35b1980f-8127-477a-9bf7-e20f139275d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:35.510276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f3638084-7bbf-4c3e-b733-602b8130dd9e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:35.512399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f3638084-7bbf-4c3e-b733-602b8130dd9e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:35.514545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=84 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:35.515400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-35b1980f-8127-477a-9bf7-e20f139275d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044987 Aug 18 21:59:35.516238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 339/674] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:35 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:35.520415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3638084-7bbf-4c3e-b733-602b8130dd9e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:35.520902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3638084-7bbf-4c3e-b733-602b8130dd9e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:35.521342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3638084-7bbf-4c3e-b733-602b8130dd9e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:35.522076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3638084-7bbf-4c3e-b733-602b8130dd9e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:35.522535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3638084-7bbf-4c3e-b733-602b8130dd9e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:35.522963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3638084-7bbf-4c3e-b733-602b8130dd9e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:35.553708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f3638084-7bbf-4c3e-b733-602b8130dd9e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047402 Aug 18 21:59:35.554263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 336/675] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:35 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:35.873989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ea741d5c-59b4-4e30-9f49-8eed0ec013e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:35.876112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ea741d5c-59b4-4e30-9f49-8eed0ec013e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:35.882030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea741d5c-59b4-4e30-9f49-8eed0ec013e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:35.882509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea741d5c-59b4-4e30-9f49-8eed0ec013e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:35.882942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea741d5c-59b4-4e30-9f49-8eed0ec013e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:35.883635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea741d5c-59b4-4e30-9f49-8eed0ec013e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:35.884087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea741d5c-59b4-4e30-9f49-8eed0ec013e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:35.884512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea741d5c-59b4-4e30-9f49-8eed0ec013e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:35.913232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea741d5c-59b4-4e30-9f49-8eed0ec013e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043196 Aug 18 21:59:35.913822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 340/676] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:36.225589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-87c259e7-ebb1-4d1b-bef4-0159e8b6266f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:36.227713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-87c259e7-ebb1-4d1b-bef4-0159e8b6266f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:36.234215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-87c259e7-ebb1-4d1b-bef4-0159e8b6266f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:36.234703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-87c259e7-ebb1-4d1b-bef4-0159e8b6266f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:36.235144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-87c259e7-ebb1-4d1b-bef4-0159e8b6266f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:36.235842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-87c259e7-ebb1-4d1b-bef4-0159e8b6266f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:36.236302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-87c259e7-ebb1-4d1b-bef4-0159e8b6266f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:36.236732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-87c259e7-ebb1-4d1b-bef4-0159e8b6266f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:36.265558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-87c259e7-ebb1-4d1b-bef4-0159e8b6266f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043933 Aug 18 21:59:36.266142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 337/677] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:36.528596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-84f2c008-dd9e-4a67-abd9-7e174b295e6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:36.530787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-84f2c008-dd9e-4a67-abd9-7e174b295e6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:36.537198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84f2c008-dd9e-4a67-abd9-7e174b295e6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:36.537713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84f2c008-dd9e-4a67-abd9-7e174b295e6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:36.538151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84f2c008-dd9e-4a67-abd9-7e174b295e6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:36.538846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84f2c008-dd9e-4a67-abd9-7e174b295e6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:36.539303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84f2c008-dd9e-4a67-abd9-7e174b295e6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:36.539731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84f2c008-dd9e-4a67-abd9-7e174b295e6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:36.566641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e72af0f9-88ef-45e7-a863-ff2fa8ca7f9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:36.568438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-84f2c008-dd9e-4a67-abd9-7e174b295e6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Aug 18 21:59:36.568752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e72af0f9-88ef-45e7-a863-ff2fa8ca7f9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:36.569009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 341/678] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:36 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:36.575268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e72af0f9-88ef-45e7-a863-ff2fa8ca7f9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:36.575755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e72af0f9-88ef-45e7-a863-ff2fa8ca7f9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:36.576196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e72af0f9-88ef-45e7-a863-ff2fa8ca7f9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:36.576897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e72af0f9-88ef-45e7-a863-ff2fa8ca7f9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:36.577357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e72af0f9-88ef-45e7-a863-ff2fa8ca7f9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:36.577839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e72af0f9-88ef-45e7-a863-ff2fa8ca7f9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:36.606798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e72af0f9-88ef-45e7-a863-ff2fa8ca7f9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044134 Aug 18 21:59:36.607355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 338/679] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:36 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:36.926528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d6221f06-e31d-4692-a1b1-6080e1bdcac5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:36.928687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d6221f06-e31d-4692-a1b1-6080e1bdcac5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:36.935075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6221f06-e31d-4692-a1b1-6080e1bdcac5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:36.935560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6221f06-e31d-4692-a1b1-6080e1bdcac5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:36.936001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6221f06-e31d-4692-a1b1-6080e1bdcac5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:36.936693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6221f06-e31d-4692-a1b1-6080e1bdcac5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:36.937152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6221f06-e31d-4692-a1b1-6080e1bdcac5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:36.937576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6221f06-e31d-4692-a1b1-6080e1bdcac5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:36.966513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d6221f06-e31d-4692-a1b1-6080e1bdcac5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044124 Aug 18 21:59:36.967075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 342/680] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:36 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:37.277522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-08d072f1-8994-4dfc-9892-048a17400114 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:37.279709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-08d072f1-8994-4dfc-9892-048a17400114 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:37.286278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08d072f1-8994-4dfc-9892-048a17400114 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:37.286755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08d072f1-8994-4dfc-9892-048a17400114 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:37.287196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08d072f1-8994-4dfc-9892-048a17400114 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:37.287915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08d072f1-8994-4dfc-9892-048a17400114 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:37.288369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08d072f1-8994-4dfc-9892-048a17400114 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:37.288795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08d072f1-8994-4dfc-9892-048a17400114 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:37.318749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-08d072f1-8994-4dfc-9892-048a17400114 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045161 Aug 18 21:59:37.319312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 339/681] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:37.580371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3202983e-ef3b-428c-8561-2e1d3f291c7d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:37.582499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3202983e-ef3b-428c-8561-2e1d3f291c7d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:37.589471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3202983e-ef3b-428c-8561-2e1d3f291c7d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:37.589986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3202983e-ef3b-428c-8561-2e1d3f291c7d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:37.590423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3202983e-ef3b-428c-8561-2e1d3f291c7d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:37.591121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3202983e-ef3b-428c-8561-2e1d3f291c7d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:37.591575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3202983e-ef3b-428c-8561-2e1d3f291c7d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:37.592005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3202983e-ef3b-428c-8561-2e1d3f291c7d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:37.594381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:37.619087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9d12f75c-1b03-4c12-8c30-74ad40ee0662 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:37.621309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9d12f75c-1b03-4c12-8c30-74ad40ee0662 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:37.622180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3202983e-ef3b-428c-8561-2e1d3f291c7d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045660 Aug 18 21:59:37.622744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 343/682] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:37 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:37.627201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d12f75c-1b03-4c12-8c30-74ad40ee0662 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:37.627679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d12f75c-1b03-4c12-8c30-74ad40ee0662 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:37.628114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d12f75c-1b03-4c12-8c30-74ad40ee0662 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:37.628900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d12f75c-1b03-4c12-8c30-74ad40ee0662 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:37.629255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d12f75c-1b03-4c12-8c30-74ad40ee0662 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:37.629704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d12f75c-1b03-4c12-8c30-74ad40ee0662 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:37.658240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9d12f75c-1b03-4c12-8c30-74ad40ee0662 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043081 Aug 18 21:59:37.658801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 340/683] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:37 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:37.978833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7f9651a6-b919-4e14-a114-a89348d9891c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:37.980921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7f9651a6-b919-4e14-a114-a89348d9891c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:37.986825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f9651a6-b919-4e14-a114-a89348d9891c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:37.987307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f9651a6-b919-4e14-a114-a89348d9891c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:37.987735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f9651a6-b919-4e14-a114-a89348d9891c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:37.988423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f9651a6-b919-4e14-a114-a89348d9891c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:37.988868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f9651a6-b919-4e14-a114-a89348d9891c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:37.989287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f9651a6-b919-4e14-a114-a89348d9891c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:38.018165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7f9651a6-b919-4e14-a114-a89348d9891c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043384 Aug 18 21:59:38.018728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 344/684] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:37 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:38.331136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f469ea44-904e-428f-bd15-de98061d6a73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:38.333508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f469ea44-904e-428f-bd15-de98061d6a73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:38.340371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f469ea44-904e-428f-bd15-de98061d6a73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:38.340851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f469ea44-904e-428f-bd15-de98061d6a73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:38.341286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f469ea44-904e-428f-bd15-de98061d6a73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:38.342000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f469ea44-904e-428f-bd15-de98061d6a73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:38.342457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f469ea44-904e-428f-bd15-de98061d6a73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:38.342877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f469ea44-904e-428f-bd15-de98061d6a73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:38.372702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f469ea44-904e-428f-bd15-de98061d6a73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045579 Aug 18 21:59:38.373251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 341/685] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:38 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:38.634637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-512a2332-387c-4852-8c1d-11c4baae4979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:38.637209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-512a2332-387c-4852-8c1d-11c4baae4979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:38.643669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-512a2332-387c-4852-8c1d-11c4baae4979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:38.644151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-512a2332-387c-4852-8c1d-11c4baae4979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:38.644615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-512a2332-387c-4852-8c1d-11c4baae4979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:38.645310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-512a2332-387c-4852-8c1d-11c4baae4979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:38.645796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-512a2332-387c-4852-8c1d-11c4baae4979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:38.646223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-512a2332-387c-4852-8c1d-11c4baae4979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:38.670553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-482aedd0-dd86-4e70-b9f5-3fe8066aceda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:38.672646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-482aedd0-dd86-4e70-b9f5-3fe8066aceda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:38.677670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-512a2332-387c-4852-8c1d-11c4baae4979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047025 Aug 18 21:59:38.678237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 345/686] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:38 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:38.678857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-482aedd0-dd86-4e70-b9f5-3fe8066aceda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:38.679413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-482aedd0-dd86-4e70-b9f5-3fe8066aceda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:38.679850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-482aedd0-dd86-4e70-b9f5-3fe8066aceda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:38.680615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-482aedd0-dd86-4e70-b9f5-3fe8066aceda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:38.681065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-482aedd0-dd86-4e70-b9f5-3fe8066aceda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:38.681512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-482aedd0-dd86-4e70-b9f5-3fe8066aceda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:38.711192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-482aedd0-dd86-4e70-b9f5-3fe8066aceda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044691 Aug 18 21:59:38.711759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 342/687] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:38 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:39.030454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-04900a8e-4df2-421b-b2c6-297802a295c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:39.032575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-04900a8e-4df2-421b-b2c6-297802a295c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:39.038419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04900a8e-4df2-421b-b2c6-297802a295c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:39.038888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04900a8e-4df2-421b-b2c6-297802a295c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:39.039316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04900a8e-4df2-421b-b2c6-297802a295c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:39.040000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04900a8e-4df2-421b-b2c6-297802a295c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:39.040445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04900a8e-4df2-421b-b2c6-297802a295c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:39.040865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04900a8e-4df2-421b-b2c6-297802a295c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:39.069414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-04900a8e-4df2-421b-b2c6-297802a295c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042921 Aug 18 21:59:39.070001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 346/688] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:39.385264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f563b645-58db-4b69-9f9e-7e92cf8e51fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:39.387798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f563b645-58db-4b69-9f9e-7e92cf8e51fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:39.394125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f563b645-58db-4b69-9f9e-7e92cf8e51fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:39.394609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f563b645-58db-4b69-9f9e-7e92cf8e51fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:39.395042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f563b645-58db-4b69-9f9e-7e92cf8e51fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:39.395732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f563b645-58db-4b69-9f9e-7e92cf8e51fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:39.396186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f563b645-58db-4b69-9f9e-7e92cf8e51fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:39.396613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f563b645-58db-4b69-9f9e-7e92cf8e51fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:39.400149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:39.426667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f563b645-58db-4b69-9f9e-7e92cf8e51fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045589 Aug 18 21:59:39.427227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 343/689] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:39.690082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-234e2021-a829-4a7a-bd52-760f4e7773c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:39.692135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-234e2021-a829-4a7a-bd52-760f4e7773c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:39.699241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-234e2021-a829-4a7a-bd52-760f4e7773c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:39.699717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-234e2021-a829-4a7a-bd52-760f4e7773c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:39.700632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-234e2021-a829-4a7a-bd52-760f4e7773c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:39.700821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-234e2021-a829-4a7a-bd52-760f4e7773c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:39.701269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-234e2021-a829-4a7a-bd52-760f4e7773c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:39.701732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-234e2021-a829-4a7a-bd52-760f4e7773c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:39.724155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e7070405-671f-4959-8d5b-fef09a636503 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:39.726295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e7070405-671f-4959-8d5b-fef09a636503 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:39.731985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-234e2021-a829-4a7a-bd52-760f4e7773c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045989 Aug 18 21:59:39.732557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 347/690] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:39 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:39.733201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7070405-671f-4959-8d5b-fef09a636503 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:39.733819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7070405-671f-4959-8d5b-fef09a636503 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:39.734263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7070405-671f-4959-8d5b-fef09a636503 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:39.734977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7070405-671f-4959-8d5b-fef09a636503 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:39.735439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7070405-671f-4959-8d5b-fef09a636503 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:39.735869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7070405-671f-4959-8d5b-fef09a636503 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:39.766096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e7070405-671f-4959-8d5b-fef09a636503 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045881 Aug 18 21:59:39.766674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 344/691] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:39 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:40.082405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aced8e32-e138-4084-b7bf-260792f6e94f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:40.084616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aced8e32-e138-4084-b7bf-260792f6e94f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:40.090759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aced8e32-e138-4084-b7bf-260792f6e94f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:40.091246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aced8e32-e138-4084-b7bf-260792f6e94f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:40.091682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aced8e32-e138-4084-b7bf-260792f6e94f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:40.092383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aced8e32-e138-4084-b7bf-260792f6e94f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:40.092844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aced8e32-e138-4084-b7bf-260792f6e94f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:40.093277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aced8e32-e138-4084-b7bf-260792f6e94f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:40.123347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aced8e32-e138-4084-b7bf-260792f6e94f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044904 Aug 18 21:59:40.123919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 348/692] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:40 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:40.439102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b866c21b-3055-4304-b15d-476f60fe027f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:40.441180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b866c21b-3055-4304-b15d-476f60fe027f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:40.447539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b866c21b-3055-4304-b15d-476f60fe027f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:40.448019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b866c21b-3055-4304-b15d-476f60fe027f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:40.448456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b866c21b-3055-4304-b15d-476f60fe027f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:40.449153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b866c21b-3055-4304-b15d-476f60fe027f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:40.449636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b866c21b-3055-4304-b15d-476f60fe027f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:40.450073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b866c21b-3055-4304-b15d-476f60fe027f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:40.478835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b866c21b-3055-4304-b15d-476f60fe027f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043761 Aug 18 21:59:40.480084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 345/693] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:40.744131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-50fb145c-9f2a-427e-ba62-749196ec1880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:40.746330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-50fb145c-9f2a-427e-ba62-749196ec1880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:40.752823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50fb145c-9f2a-427e-ba62-749196ec1880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:40.753314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50fb145c-9f2a-427e-ba62-749196ec1880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:40.753772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50fb145c-9f2a-427e-ba62-749196ec1880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:40.754477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50fb145c-9f2a-427e-ba62-749196ec1880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:40.754935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50fb145c-9f2a-427e-ba62-749196ec1880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:40.755362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50fb145c-9f2a-427e-ba62-749196ec1880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:40.778698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f8beaf1e-0fab-478d-87d7-0c5cecda705c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:40.780838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f8beaf1e-0fab-478d-87d7-0c5cecda705c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:40.785800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-50fb145c-9f2a-427e-ba62-749196ec1880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045591 Aug 18 21:59:40.786370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 349/694] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:40.786678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8beaf1e-0fab-478d-87d7-0c5cecda705c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:40.787161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8beaf1e-0fab-478d-87d7-0c5cecda705c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:40.787587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8beaf1e-0fab-478d-87d7-0c5cecda705c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:40.788278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8beaf1e-0fab-478d-87d7-0c5cecda705c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:40.788727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8beaf1e-0fab-478d-87d7-0c5cecda705c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:40.789145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8beaf1e-0fab-478d-87d7-0c5cecda705c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:40.817422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f8beaf1e-0fab-478d-87d7-0c5cecda705c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043240 Aug 18 21:59:40.817993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 346/695] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:40 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:41.136294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-09b3cf6f-6298-47be-a36c-42e17d8592dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:41.138439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-09b3cf6f-6298-47be-a36c-42e17d8592dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:41.144215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09b3cf6f-6298-47be-a36c-42e17d8592dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:41.144681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09b3cf6f-6298-47be-a36c-42e17d8592dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:41.145110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09b3cf6f-6298-47be-a36c-42e17d8592dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:41.145833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09b3cf6f-6298-47be-a36c-42e17d8592dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:41.146280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09b3cf6f-6298-47be-a36c-42e17d8592dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:41.146701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09b3cf6f-6298-47be-a36c-42e17d8592dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:41.175592 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-09b3cf6f-6298-47be-a36c-42e17d8592dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 Aug 18 21:59:41.176138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 350/696] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:41 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:41.491744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c0fda1cc-1d79-4f89-ba92-7492a36bb15e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:41.493888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c0fda1cc-1d79-4f89-ba92-7492a36bb15e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:41.500860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fda1cc-1d79-4f89-ba92-7492a36bb15e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:41.501348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fda1cc-1d79-4f89-ba92-7492a36bb15e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:41.501833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fda1cc-1d79-4f89-ba92-7492a36bb15e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:41.502533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fda1cc-1d79-4f89-ba92-7492a36bb15e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:41.502993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fda1cc-1d79-4f89-ba92-7492a36bb15e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:41.503422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fda1cc-1d79-4f89-ba92-7492a36bb15e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:41.532374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c0fda1cc-1d79-4f89-ba92-7492a36bb15e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044634 Aug 18 21:59:41.532928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 347/697] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:41.799165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-33f6fdbb-9887-4adc-9e17-577b0ca71d30 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:41.801309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-33f6fdbb-9887-4adc-9e17-577b0ca71d30 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:41.808345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33f6fdbb-9887-4adc-9e17-577b0ca71d30 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:41.808837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33f6fdbb-9887-4adc-9e17-577b0ca71d30 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:41.809278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33f6fdbb-9887-4adc-9e17-577b0ca71d30 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:41.809997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33f6fdbb-9887-4adc-9e17-577b0ca71d30 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:41.810460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33f6fdbb-9887-4adc-9e17-577b0ca71d30 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:41.810888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33f6fdbb-9887-4adc-9e17-577b0ca71d30 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:41.829539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-66b92e3b-8c87-4310-87a8-3b013da4f2c1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:41.831862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-66b92e3b-8c87-4310-87a8-3b013da4f2c1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:41.837771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66b92e3b-8c87-4310-87a8-3b013da4f2c1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:41.838261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66b92e3b-8c87-4310-87a8-3b013da4f2c1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:41.839189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66b92e3b-8c87-4310-87a8-3b013da4f2c1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:41.839892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66b92e3b-8c87-4310-87a8-3b013da4f2c1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:41.840362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66b92e3b-8c87-4310-87a8-3b013da4f2c1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:41.840793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66b92e3b-8c87-4310-87a8-3b013da4f2c1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:41.840976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-33f6fdbb-9887-4adc-9e17-577b0ca71d30 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046151 Aug 18 21:59:41.841545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 351/698] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:41.870834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-66b92e3b-8c87-4310-87a8-3b013da4f2c1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045148 Aug 18 21:59:41.871396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 348/699] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:41 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:42.188448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2b249345-bc6d-4794-9a5b-568c2110dabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:42.190570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2b249345-bc6d-4794-9a5b-568c2110dabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:42.196456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b249345-bc6d-4794-9a5b-568c2110dabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:42.196943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b249345-bc6d-4794-9a5b-568c2110dabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:42.197378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b249345-bc6d-4794-9a5b-568c2110dabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:42.198757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b249345-bc6d-4794-9a5b-568c2110dabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:42.199221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b249345-bc6d-4794-9a5b-568c2110dabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:42.199651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b249345-bc6d-4794-9a5b-568c2110dabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:42.227677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2b249345-bc6d-4794-9a5b-568c2110dabb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043235 Aug 18 21:59:42.228241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 352/700] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:42.545439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-baff456c-1551-45d1-a93f-2c49a17222d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:42.547590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-baff456c-1551-45d1-a93f-2c49a17222d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:42.553966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baff456c-1551-45d1-a93f-2c49a17222d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:42.554447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baff456c-1551-45d1-a93f-2c49a17222d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:42.554884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baff456c-1551-45d1-a93f-2c49a17222d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:42.555587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baff456c-1551-45d1-a93f-2c49a17222d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:42.556032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baff456c-1551-45d1-a93f-2c49a17222d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:42.556456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baff456c-1551-45d1-a93f-2c49a17222d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:42.585004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-baff456c-1551-45d1-a93f-2c49a17222d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044375 Aug 18 21:59:42.585541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 349/701] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:42.852492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-be170592-2757-4766-a458-151326290f42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:42.855241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-be170592-2757-4766-a458-151326290f42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:42.861688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be170592-2757-4766-a458-151326290f42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:42.862170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be170592-2757-4766-a458-151326290f42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:42.862608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be170592-2757-4766-a458-151326290f42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:42.863303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be170592-2757-4766-a458-151326290f42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:42.863763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be170592-2757-4766-a458-151326290f42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:42.864188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be170592-2757-4766-a458-151326290f42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:42.882818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-68bda000-0eb4-4483-b8c9-781393dd6e9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:42.884934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-68bda000-0eb4-4483-b8c9-781393dd6e9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:42.890815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68bda000-0eb4-4483-b8c9-781393dd6e9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:42.891297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68bda000-0eb4-4483-b8c9-781393dd6e9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:42.891724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68bda000-0eb4-4483-b8c9-781393dd6e9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:42.892410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68bda000-0eb4-4483-b8c9-781393dd6e9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:42.892861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68bda000-0eb4-4483-b8c9-781393dd6e9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:42.893281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68bda000-0eb4-4483-b8c9-781393dd6e9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:42.893387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-be170592-2757-4766-a458-151326290f42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044738 Aug 18 21:59:42.893911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 353/702] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:42 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:42.922858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-68bda000-0eb4-4483-b8c9-781393dd6e9b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043876 Aug 18 21:59:42.923407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 350/703] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:42 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:43.240432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-165c6e1a-93b1-4408-8f2c-ae555382a71c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:43.242616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-165c6e1a-93b1-4408-8f2c-ae555382a71c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:43.244429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:43.250239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-165c6e1a-93b1-4408-8f2c-ae555382a71c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:43.250721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-165c6e1a-93b1-4408-8f2c-ae555382a71c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:43.251150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-165c6e1a-93b1-4408-8f2c-ae555382a71c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:43.251842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-165c6e1a-93b1-4408-8f2c-ae555382a71c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:43.252293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-165c6e1a-93b1-4408-8f2c-ae555382a71c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:43.252712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-165c6e1a-93b1-4408-8f2c-ae555382a71c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:43.281688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-165c6e1a-93b1-4408-8f2c-ae555382a71c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Aug 18 21:59:43.282246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 354/704] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:43 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:43.598184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a4c3585f-4a67-40d0-8515-ce313aafb276 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:43.600273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a4c3585f-4a67-40d0-8515-ce313aafb276 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:43.607528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4c3585f-4a67-40d0-8515-ce313aafb276 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:43.608011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4c3585f-4a67-40d0-8515-ce313aafb276 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:43.608447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4c3585f-4a67-40d0-8515-ce313aafb276 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:43.609139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4c3585f-4a67-40d0-8515-ce313aafb276 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:43.609591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4c3585f-4a67-40d0-8515-ce313aafb276 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:43.610038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4c3585f-4a67-40d0-8515-ce313aafb276 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:43.638435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a4c3585f-4a67-40d0-8515-ce313aafb276 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044209 Aug 18 21:59:43.638996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 351/705] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:43.906337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1bca7b4f-5900-4bda-ba22-ed132db8c279 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:43.908482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1bca7b4f-5900-4bda-ba22-ed132db8c279 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:43.915020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bca7b4f-5900-4bda-ba22-ed132db8c279 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:43.915507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bca7b4f-5900-4bda-ba22-ed132db8c279 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:43.915948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bca7b4f-5900-4bda-ba22-ed132db8c279 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:43.916647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bca7b4f-5900-4bda-ba22-ed132db8c279 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:43.917106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bca7b4f-5900-4bda-ba22-ed132db8c279 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:43.917539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1bca7b4f-5900-4bda-ba22-ed132db8c279 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:43.934359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2f3dedc7-42c4-41aa-ab23-4277a1ea1eda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:43.936574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2f3dedc7-42c4-41aa-ab23-4277a1ea1eda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:43.942575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f3dedc7-42c4-41aa-ab23-4277a1ea1eda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:43.943061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f3dedc7-42c4-41aa-ab23-4277a1ea1eda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:43.943498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f3dedc7-42c4-41aa-ab23-4277a1ea1eda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:43.944204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f3dedc7-42c4-41aa-ab23-4277a1ea1eda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:43.944658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f3dedc7-42c4-41aa-ab23-4277a1ea1eda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:43.945084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f3dedc7-42c4-41aa-ab23-4277a1ea1eda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:43.949628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1bca7b4f-5900-4bda-ba22-ed132db8c279 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047194 Aug 18 21:59:43.950224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 355/706] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:43 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:43.975302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2f3dedc7-42c4-41aa-ab23-4277a1ea1eda tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044726 Aug 18 21:59:43.975799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 352/707] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:43 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:44.294498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb32684d-02ee-4b30-bd10-7b7fed73f6dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:44.296940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fb32684d-02ee-4b30-bd10-7b7fed73f6dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:44.302845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb32684d-02ee-4b30-bd10-7b7fed73f6dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:44.303351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb32684d-02ee-4b30-bd10-7b7fed73f6dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:44.303785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb32684d-02ee-4b30-bd10-7b7fed73f6dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:44.304474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb32684d-02ee-4b30-bd10-7b7fed73f6dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:44.304930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb32684d-02ee-4b30-bd10-7b7fed73f6dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:44.305352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb32684d-02ee-4b30-bd10-7b7fed73f6dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:44.334151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fb32684d-02ee-4b30-bd10-7b7fed73f6dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 Aug 18 21:59:44.334705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 356/708] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:44 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:44.650855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d7538af5-5a4e-468a-96d4-a76ad3ef58d3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:44.653536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d7538af5-5a4e-468a-96d4-a76ad3ef58d3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:44.659900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7538af5-5a4e-468a-96d4-a76ad3ef58d3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:44.660385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7538af5-5a4e-468a-96d4-a76ad3ef58d3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:44.660819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7538af5-5a4e-468a-96d4-a76ad3ef58d3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:44.661506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7538af5-5a4e-468a-96d4-a76ad3ef58d3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:44.661990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7538af5-5a4e-468a-96d4-a76ad3ef58d3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:44.662417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7538af5-5a4e-468a-96d4-a76ad3ef58d3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:44.690746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d7538af5-5a4e-468a-96d4-a76ad3ef58d3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043934 Aug 18 21:59:44.691313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 353/709] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 21:59:44.961868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e932fd65-c8b3-4998-9dd2-a772b3f18deb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:44.963963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e932fd65-c8b3-4998-9dd2-a772b3f18deb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:44.970430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e932fd65-c8b3-4998-9dd2-a772b3f18deb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:44.970909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e932fd65-c8b3-4998-9dd2-a772b3f18deb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:44.971345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e932fd65-c8b3-4998-9dd2-a772b3f18deb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:44.972041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e932fd65-c8b3-4998-9dd2-a772b3f18deb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:44.972493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e932fd65-c8b3-4998-9dd2-a772b3f18deb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:44.972918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e932fd65-c8b3-4998-9dd2-a772b3f18deb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:44.987297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c239fae7-787f-41fc-8244-2b46654b9d45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:44.989382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c239fae7-787f-41fc-8244-2b46654b9d45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:44.995846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c239fae7-787f-41fc-8244-2b46654b9d45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:44.996323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c239fae7-787f-41fc-8244-2b46654b9d45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:44.996754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c239fae7-787f-41fc-8244-2b46654b9d45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:44.997444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c239fae7-787f-41fc-8244-2b46654b9d45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:44.997928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c239fae7-787f-41fc-8244-2b46654b9d45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:44.998351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c239fae7-787f-41fc-8244-2b46654b9d45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:45.002463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e932fd65-c8b3-4998-9dd2-a772b3f18deb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044684 Aug 18 21:59:45.003042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 357/710] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:44 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:45.026823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c239fae7-787f-41fc-8244-2b46654b9d45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043420 Aug 18 21:59:45.027366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 354/711] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:45.346539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8086ec64-f3ab-4773-a91d-e56961a75004 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:45.348975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8086ec64-f3ab-4773-a91d-e56961a75004 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:45.355344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8086ec64-f3ab-4773-a91d-e56961a75004 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:45.355828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8086ec64-f3ab-4773-a91d-e56961a75004 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:45.356267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8086ec64-f3ab-4773-a91d-e56961a75004 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:45.356963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8086ec64-f3ab-4773-a91d-e56961a75004 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:45.357421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8086ec64-f3ab-4773-a91d-e56961a75004 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:45.357871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8086ec64-f3ab-4773-a91d-e56961a75004 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:45.386627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8086ec64-f3ab-4773-a91d-e56961a75004 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044189 Aug 18 21:59:45.387187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 358/712] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:45 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:45.703207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-32a5799f-4f82-4bd0-b270-8e7c25e68507 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:45.705249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-32a5799f-4f82-4bd0-b270-8e7c25e68507 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:45.711832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32a5799f-4f82-4bd0-b270-8e7c25e68507 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:45.712319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32a5799f-4f82-4bd0-b270-8e7c25e68507 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:45.712759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32a5799f-4f82-4bd0-b270-8e7c25e68507 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:45.713448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32a5799f-4f82-4bd0-b270-8e7c25e68507 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:45.714417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32a5799f-4f82-4bd0-b270-8e7c25e68507 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:45.714842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32a5799f-4f82-4bd0-b270-8e7c25e68507 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:45.743899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-32a5799f-4f82-4bd0-b270-8e7c25e68507 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044765 Aug 18 21:59:45.744453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 355/713] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:45 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:46.015409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-31cd9a41-00bb-4d1d-994a-7284a9833cf5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:46.017515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-31cd9a41-00bb-4d1d-994a-7284a9833cf5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:46.023475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31cd9a41-00bb-4d1d-994a-7284a9833cf5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:46.023966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31cd9a41-00bb-4d1d-994a-7284a9833cf5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:46.024416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31cd9a41-00bb-4d1d-994a-7284a9833cf5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:46.025116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31cd9a41-00bb-4d1d-994a-7284a9833cf5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:46.025577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31cd9a41-00bb-4d1d-994a-7284a9833cf5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:46.026675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31cd9a41-00bb-4d1d-994a-7284a9833cf5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:46.038998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c6ab3a5a-be23-4774-bc0a-98aa7554528a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:46.041114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c6ab3a5a-be23-4774-bc0a-98aa7554528a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:46.047280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6ab3a5a-be23-4774-bc0a-98aa7554528a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:46.047765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6ab3a5a-be23-4774-bc0a-98aa7554528a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:46.048211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6ab3a5a-be23-4774-bc0a-98aa7554528a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:46.048916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6ab3a5a-be23-4774-bc0a-98aa7554528a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:46.049377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6ab3a5a-be23-4774-bc0a-98aa7554528a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:46.049838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6ab3a5a-be23-4774-bc0a-98aa7554528a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:46.050888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:46.057519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-31cd9a41-00bb-4d1d-994a-7284a9833cf5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046741 Aug 18 21:59:46.058127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 359/714] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:46.079183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c6ab3a5a-be23-4774-bc0a-98aa7554528a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Aug 18 21:59:46.079747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 356/715] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:46 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:46.399303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6e2d22da-97c2-4640-8a33-98eb6ab097cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:46.402023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6e2d22da-97c2-4640-8a33-98eb6ab097cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:46.408438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e2d22da-97c2-4640-8a33-98eb6ab097cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:46.408925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e2d22da-97c2-4640-8a33-98eb6ab097cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:46.409365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e2d22da-97c2-4640-8a33-98eb6ab097cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:46.410080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e2d22da-97c2-4640-8a33-98eb6ab097cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:46.410528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e2d22da-97c2-4640-8a33-98eb6ab097cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:46.410950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e2d22da-97c2-4640-8a33-98eb6ab097cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:46.439919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6e2d22da-97c2-4640-8a33-98eb6ab097cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044603 Aug 18 21:59:46.440470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 360/716] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:46 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:46.756303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-83cd9f00-8d24-4c37-a1bf-3fcd3bd98990 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:46.758440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-83cd9f00-8d24-4c37-a1bf-3fcd3bd98990 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:46.765391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83cd9f00-8d24-4c37-a1bf-3fcd3bd98990 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:46.765911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83cd9f00-8d24-4c37-a1bf-3fcd3bd98990 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:46.766352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83cd9f00-8d24-4c37-a1bf-3fcd3bd98990 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:46.767042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83cd9f00-8d24-4c37-a1bf-3fcd3bd98990 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:46.767533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83cd9f00-8d24-4c37-a1bf-3fcd3bd98990 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:46.767958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83cd9f00-8d24-4c37-a1bf-3fcd3bd98990 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:46.797276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-83cd9f00-8d24-4c37-a1bf-3fcd3bd98990 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045012 Aug 18 21:59:46.797865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 357/717] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:46 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:47.069074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-02c8577d-aa55-4df6-bd3b-84c054b76c9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:47.071228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-02c8577d-aa55-4df6-bd3b-84c054b76c9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:47.077563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02c8577d-aa55-4df6-bd3b-84c054b76c9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:47.078073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02c8577d-aa55-4df6-bd3b-84c054b76c9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:47.078507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02c8577d-aa55-4df6-bd3b-84c054b76c9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:47.079198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02c8577d-aa55-4df6-bd3b-84c054b76c9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:47.079649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02c8577d-aa55-4df6-bd3b-84c054b76c9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:47.080073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02c8577d-aa55-4df6-bd3b-84c054b76c9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:47.091735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a19ca285-6cae-488a-b9a4-193bf832bfaf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:47.093903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a19ca285-6cae-488a-b9a4-193bf832bfaf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:47.099694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a19ca285-6cae-488a-b9a4-193bf832bfaf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:47.100182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a19ca285-6cae-488a-b9a4-193bf832bfaf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:47.100626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a19ca285-6cae-488a-b9a4-193bf832bfaf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:47.101353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a19ca285-6cae-488a-b9a4-193bf832bfaf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:47.101835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a19ca285-6cae-488a-b9a4-193bf832bfaf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:47.102265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a19ca285-6cae-488a-b9a4-193bf832bfaf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:47.109631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-02c8577d-aa55-4df6-bd3b-84c054b76c9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Aug 18 21:59:47.110193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 361/718] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:47.131116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a19ca285-6cae-488a-b9a4-193bf832bfaf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Aug 18 21:59:47.131667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 358/719] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:47 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:47.452817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-95906421-fe84-4322-a8f8-0c5fb2638c5c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:47.455320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-95906421-fe84-4322-a8f8-0c5fb2638c5c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:47.462118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95906421-fe84-4322-a8f8-0c5fb2638c5c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:47.462608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95906421-fe84-4322-a8f8-0c5fb2638c5c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:47.463054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95906421-fe84-4322-a8f8-0c5fb2638c5c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:47.463765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95906421-fe84-4322-a8f8-0c5fb2638c5c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:47.464224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95906421-fe84-4322-a8f8-0c5fb2638c5c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:47.464652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95906421-fe84-4322-a8f8-0c5fb2638c5c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:47.494120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-95906421-fe84-4322-a8f8-0c5fb2638c5c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045805 Aug 18 21:59:47.494698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 362/720] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:47 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:47.810356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-91698d82-2af1-4cfd-9320-cd50156579ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:47.812487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-91698d82-2af1-4cfd-9320-cd50156579ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:47.818904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91698d82-2af1-4cfd-9320-cd50156579ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:47.819388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91698d82-2af1-4cfd-9320-cd50156579ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:47.819824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91698d82-2af1-4cfd-9320-cd50156579ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:47.820515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91698d82-2af1-4cfd-9320-cd50156579ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:47.820970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91698d82-2af1-4cfd-9320-cd50156579ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:47.821393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91698d82-2af1-4cfd-9320-cd50156579ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:47.846026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:47.851097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-91698d82-2af1-4cfd-9320-cd50156579ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045383 Aug 18 21:59:47.851650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 359/721] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:47 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:48.122072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-192c5711-d555-4947-a05f-02937806b587 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:48.124214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-192c5711-d555-4947-a05f-02937806b587 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:48.130197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-192c5711-d555-4947-a05f-02937806b587 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:48.130680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-192c5711-d555-4947-a05f-02937806b587 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:48.131117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-192c5711-d555-4947-a05f-02937806b587 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:48.131807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-192c5711-d555-4947-a05f-02937806b587 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:48.132263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-192c5711-d555-4947-a05f-02937806b587 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:48.132689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-192c5711-d555-4947-a05f-02937806b587 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:48.143275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e7330b22-fe1c-446b-a641-9d05ec96aace tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:48.145350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e7330b22-fe1c-446b-a641-9d05ec96aace tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:48.151694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7330b22-fe1c-446b-a641-9d05ec96aace tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:48.152175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7330b22-fe1c-446b-a641-9d05ec96aace tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:48.152611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7330b22-fe1c-446b-a641-9d05ec96aace tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:48.153308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7330b22-fe1c-446b-a641-9d05ec96aace tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:48.153793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7330b22-fe1c-446b-a641-9d05ec96aace tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:48.154219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7330b22-fe1c-446b-a641-9d05ec96aace tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:48.166287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-192c5711-d555-4947-a05f-02937806b587 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048212 Aug 18 21:59:48.172194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 363/722] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:48 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:48.184291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e7330b22-fe1c-446b-a641-9d05ec96aace tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Aug 18 21:59:48.184851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 360/723] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:48 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:48.506965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-31699f38-6017-49c2-b77f-48fafedc4325 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:48.509085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-31699f38-6017-49c2-b77f-48fafedc4325 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:48.515477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31699f38-6017-49c2-b77f-48fafedc4325 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:48.515953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31699f38-6017-49c2-b77f-48fafedc4325 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:48.516391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31699f38-6017-49c2-b77f-48fafedc4325 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:48.517081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31699f38-6017-49c2-b77f-48fafedc4325 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:48.517533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31699f38-6017-49c2-b77f-48fafedc4325 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:48.517987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31699f38-6017-49c2-b77f-48fafedc4325 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:48.547012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-31699f38-6017-49c2-b77f-48fafedc4325 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044042 Aug 18 21:59:48.547571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 364/724] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:48 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:48.863552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-85924289-c946-4f85-b83b-7d1eda40b71e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:48.865773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-85924289-c946-4f85-b83b-7d1eda40b71e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:48.872286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85924289-c946-4f85-b83b-7d1eda40b71e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:48.872772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85924289-c946-4f85-b83b-7d1eda40b71e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:48.873210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85924289-c946-4f85-b83b-7d1eda40b71e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:48.873928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85924289-c946-4f85-b83b-7d1eda40b71e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:48.874388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85924289-c946-4f85-b83b-7d1eda40b71e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:48.874819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85924289-c946-4f85-b83b-7d1eda40b71e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:48.904172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-85924289-c946-4f85-b83b-7d1eda40b71e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044548 Aug 18 21:59:48.904734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 361/725] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:49.179579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-10bb24e4-ad29-4c49-8193-ec7050420b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:49.181764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-10bb24e4-ad29-4c49-8193-ec7050420b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:49.187604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10bb24e4-ad29-4c49-8193-ec7050420b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:49.188085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10bb24e4-ad29-4c49-8193-ec7050420b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:49.188520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10bb24e4-ad29-4c49-8193-ec7050420b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:49.189201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10bb24e4-ad29-4c49-8193-ec7050420b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:49.189681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10bb24e4-ad29-4c49-8193-ec7050420b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:49.190104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10bb24e4-ad29-4c49-8193-ec7050420b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:49.196380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-152a98c7-5914-46df-928b-967e8f69f07e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:49.199172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-152a98c7-5914-46df-928b-967e8f69f07e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:49.205676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-152a98c7-5914-46df-928b-967e8f69f07e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:49.206008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-152a98c7-5914-46df-928b-967e8f69f07e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:49.206689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-152a98c7-5914-46df-928b-967e8f69f07e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:49.207500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-152a98c7-5914-46df-928b-967e8f69f07e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:49.208166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-152a98c7-5914-46df-928b-967e8f69f07e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:49.208655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-152a98c7-5914-46df-928b-967e8f69f07e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:49.221147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-10bb24e4-ad29-4c49-8193-ec7050420b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045445 Aug 18 21:59:49.221737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 365/726] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:49 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:49.238306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-152a98c7-5914-46df-928b-967e8f69f07e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045761 Aug 18 21:59:49.239075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 362/727] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:49 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:49.559733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-37d11357-2d81-4b7e-be42-3d3ef4f57aa2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:49.561939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-37d11357-2d81-4b7e-be42-3d3ef4f57aa2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:49.568296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-37d11357-2d81-4b7e-be42-3d3ef4f57aa2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:49.568782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-37d11357-2d81-4b7e-be42-3d3ef4f57aa2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:49.569207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-37d11357-2d81-4b7e-be42-3d3ef4f57aa2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:49.569932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-37d11357-2d81-4b7e-be42-3d3ef4f57aa2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:49.570388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-37d11357-2d81-4b7e-be42-3d3ef4f57aa2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:49.570808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-37d11357-2d81-4b7e-be42-3d3ef4f57aa2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:49.599860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-37d11357-2d81-4b7e-be42-3d3ef4f57aa2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044548 Aug 18 21:59:49.600425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 366/728] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:49 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:49.918650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6a104405-dd30-4323-94dd-cb8ce357eb69 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:49.921057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6a104405-dd30-4323-94dd-cb8ce357eb69 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:49.927589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a104405-dd30-4323-94dd-cb8ce357eb69 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:49.928073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a104405-dd30-4323-94dd-cb8ce357eb69 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:49.928515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a104405-dd30-4323-94dd-cb8ce357eb69 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:49.929213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a104405-dd30-4323-94dd-cb8ce357eb69 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:49.929700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a104405-dd30-4323-94dd-cb8ce357eb69 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:49.930131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a104405-dd30-4323-94dd-cb8ce357eb69 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:49.959108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6a104405-dd30-4323-94dd-cb8ce357eb69 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044897 Aug 18 21:59:49.959662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 363/729] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:50.234477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-00ceab2f-0e07-4441-9080-b7340e6381e5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:50.236539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-00ceab2f-0e07-4441-9080-b7340e6381e5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:50.242552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00ceab2f-0e07-4441-9080-b7340e6381e5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:50.243038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00ceab2f-0e07-4441-9080-b7340e6381e5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:50.243483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00ceab2f-0e07-4441-9080-b7340e6381e5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:50.244178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00ceab2f-0e07-4441-9080-b7340e6381e5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:50.244717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00ceab2f-0e07-4441-9080-b7340e6381e5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:50.245409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00ceab2f-0e07-4441-9080-b7340e6381e5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:50.249900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-605be0d8-3f1a-4666-96f9-55014363ab76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:50.252151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-605be0d8-3f1a-4666-96f9-55014363ab76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:50.257979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-605be0d8-3f1a-4666-96f9-55014363ab76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:50.258461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-605be0d8-3f1a-4666-96f9-55014363ab76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:50.258896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-605be0d8-3f1a-4666-96f9-55014363ab76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:50.259592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-605be0d8-3f1a-4666-96f9-55014363ab76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:50.260049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-605be0d8-3f1a-4666-96f9-55014363ab76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:50.260525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-605be0d8-3f1a-4666-96f9-55014363ab76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:50.275076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-00ceab2f-0e07-4441-9080-b7340e6381e5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Aug 18 21:59:50.275652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 367/730] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:50 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:50.289168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-605be0d8-3f1a-4666-96f9-55014363ab76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Aug 18 21:59:50.289739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 364/731] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:50.612086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7aa4f163-32e0-417f-b758-df299d972392 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:50.614280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7aa4f163-32e0-417f-b758-df299d972392 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:50.621272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7aa4f163-32e0-417f-b758-df299d972392 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:50.621793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7aa4f163-32e0-417f-b758-df299d972392 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:50.622234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7aa4f163-32e0-417f-b758-df299d972392 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:50.622931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7aa4f163-32e0-417f-b758-df299d972392 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:50.623391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7aa4f163-32e0-417f-b758-df299d972392 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:50.623818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7aa4f163-32e0-417f-b758-df299d972392 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:50.652309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7aa4f163-32e0-417f-b758-df299d972392 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Aug 18 21:59:50.652868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 368/732] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:50 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:50.971707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07b8350a-54e2-406e-8abb-1bc66739cc32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:50.973845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07b8350a-54e2-406e-8abb-1bc66739cc32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:50.980849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07b8350a-54e2-406e-8abb-1bc66739cc32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:50.981332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07b8350a-54e2-406e-8abb-1bc66739cc32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:50.981817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07b8350a-54e2-406e-8abb-1bc66739cc32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:50.982508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07b8350a-54e2-406e-8abb-1bc66739cc32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:50.982966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07b8350a-54e2-406e-8abb-1bc66739cc32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:50.983390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07b8350a-54e2-406e-8abb-1bc66739cc32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:51.013661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07b8350a-54e2-406e-8abb-1bc66739cc32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046001 Aug 18 21:59:51.014226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 365/733] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:51.288102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9ddb3ef7-1beb-4a9c-a9d2-f4379d7f28db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:51.290272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9ddb3ef7-1beb-4a9c-a9d2-f4379d7f28db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:51.297870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ddb3ef7-1beb-4a9c-a9d2-f4379d7f28db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:51.298363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ddb3ef7-1beb-4a9c-a9d2-f4379d7f28db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:51.298801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ddb3ef7-1beb-4a9c-a9d2-f4379d7f28db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:51.299523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ddb3ef7-1beb-4a9c-a9d2-f4379d7f28db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:51.299984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ddb3ef7-1beb-4a9c-a9d2-f4379d7f28db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:51.300396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ddb3ef7-1beb-4a9c-a9d2-f4379d7f28db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:51.301912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c531a18a-c12f-43f9-9bd8-04a327f2e697 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:51.304048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c531a18a-c12f-43f9-9bd8-04a327f2e697 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:51.309886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c531a18a-c12f-43f9-9bd8-04a327f2e697 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:51.310376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c531a18a-c12f-43f9-9bd8-04a327f2e697 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:51.310813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c531a18a-c12f-43f9-9bd8-04a327f2e697 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:51.311512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c531a18a-c12f-43f9-9bd8-04a327f2e697 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:51.311982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c531a18a-c12f-43f9-9bd8-04a327f2e697 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:51.312399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c531a18a-c12f-43f9-9bd8-04a327f2e697 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:51.331249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9ddb3ef7-1beb-4a9c-a9d2-f4379d7f28db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047073 Aug 18 21:59:51.331826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 369/734] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:51 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:51.342779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c531a18a-c12f-43f9-9bd8-04a327f2e697 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044732 Aug 18 21:59:51.343342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 366/735] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:51.664298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f1b6834e-83bf-4e7d-bc06-05c280881adb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:51.666468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f1b6834e-83bf-4e7d-bc06-05c280881adb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:51.673103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b6834e-83bf-4e7d-bc06-05c280881adb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:51.673581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b6834e-83bf-4e7d-bc06-05c280881adb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:51.674063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b6834e-83bf-4e7d-bc06-05c280881adb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:51.674759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b6834e-83bf-4e7d-bc06-05c280881adb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:51.675221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b6834e-83bf-4e7d-bc06-05c280881adb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:51.675647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b6834e-83bf-4e7d-bc06-05c280881adb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:51.705508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f1b6834e-83bf-4e7d-bc06-05c280881adb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Aug 18 21:59:51.706114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 370/736] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:51 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:52.025988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-00a32044-52f2-4265-8277-0752a2e14636 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:52.028109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-00a32044-52f2-4265-8277-0752a2e14636 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:52.034441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00a32044-52f2-4265-8277-0752a2e14636 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:52.034930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00a32044-52f2-4265-8277-0752a2e14636 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:52.035370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00a32044-52f2-4265-8277-0752a2e14636 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:52.036069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00a32044-52f2-4265-8277-0752a2e14636 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:52.036529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00a32044-52f2-4265-8277-0752a2e14636 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:52.036966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00a32044-52f2-4265-8277-0752a2e14636 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:52.066612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-00a32044-52f2-4265-8277-0752a2e14636 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044670 Aug 18 21:59:52.067169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 367/737] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:52 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:52.344249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2bd5e60f-9586-41fe-bda2-fcd3bb5e7396 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:52.346454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2bd5e60f-9586-41fe-bda2-fcd3bb5e7396 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:52.353810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bd5e60f-9586-41fe-bda2-fcd3bb5e7396 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:52.354958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bd5e60f-9586-41fe-bda2-fcd3bb5e7396 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:52.355543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bd5e60f-9586-41fe-bda2-fcd3bb5e7396 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:52.355685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3825040c-d3ce-4e98-8e3b-82b2be4ea3c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:52.356101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bd5e60f-9586-41fe-bda2-fcd3bb5e7396 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:52.356559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bd5e60f-9586-41fe-bda2-fcd3bb5e7396 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:52.356988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bd5e60f-9586-41fe-bda2-fcd3bb5e7396 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:52.357759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3825040c-d3ce-4e98-8e3b-82b2be4ea3c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:52.363693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3825040c-d3ce-4e98-8e3b-82b2be4ea3c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:52.364176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3825040c-d3ce-4e98-8e3b-82b2be4ea3c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:52.364612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3825040c-d3ce-4e98-8e3b-82b2be4ea3c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:52.365303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3825040c-d3ce-4e98-8e3b-82b2be4ea3c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:52.365795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3825040c-d3ce-4e98-8e3b-82b2be4ea3c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:52.366257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3825040c-d3ce-4e98-8e3b-82b2be4ea3c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:52.385816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2bd5e60f-9586-41fe-bda2-fcd3bb5e7396 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Aug 18 21:59:52.386387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 371/738] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:52.394730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3825040c-d3ce-4e98-8e3b-82b2be4ea3c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Aug 18 21:59:52.395786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 368/739] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:52.718431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9b9a142c-6991-4fcf-8121-bdbdb2e31da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:52.720543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9b9a142c-6991-4fcf-8121-bdbdb2e31da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:52.727028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b9a142c-6991-4fcf-8121-bdbdb2e31da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:52.727501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b9a142c-6991-4fcf-8121-bdbdb2e31da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:52.727931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b9a142c-6991-4fcf-8121-bdbdb2e31da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:52.728617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b9a142c-6991-4fcf-8121-bdbdb2e31da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:52.729111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b9a142c-6991-4fcf-8121-bdbdb2e31da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:52.729531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b9a142c-6991-4fcf-8121-bdbdb2e31da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:52.757337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9b9a142c-6991-4fcf-8121-bdbdb2e31da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043518 Aug 18 21:59:52.757916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 372/740] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:52 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:53.080459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a5011e6f-d8a3-4f80-b8dc-889024e686b0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:53.082749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a5011e6f-d8a3-4f80-b8dc-889024e686b0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:53.089728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5011e6f-d8a3-4f80-b8dc-889024e686b0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:53.090217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5011e6f-d8a3-4f80-b8dc-889024e686b0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:53.090658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5011e6f-d8a3-4f80-b8dc-889024e686b0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:53.091355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5011e6f-d8a3-4f80-b8dc-889024e686b0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:53.091812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5011e6f-d8a3-4f80-b8dc-889024e686b0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:53.092243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5011e6f-d8a3-4f80-b8dc-889024e686b0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:53.121376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a5011e6f-d8a3-4f80-b8dc-889024e686b0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045739 Aug 18 21:59:53.121972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 369/741] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:53 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:53.399608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-40e4781e-2e11-4565-b91c-2c8ec25ccb02 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:53.401865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-40e4781e-2e11-4565-b91c-2c8ec25ccb02 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:53.407234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e4b29944-511f-4445-b12e-2d43bf3c282d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:53.408065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40e4781e-2e11-4565-b91c-2c8ec25ccb02 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:53.408545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40e4781e-2e11-4565-b91c-2c8ec25ccb02 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:53.408977 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40e4781e-2e11-4565-b91c-2c8ec25ccb02 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:53.409355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e4b29944-511f-4445-b12e-2d43bf3c282d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:53.409690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40e4781e-2e11-4565-b91c-2c8ec25ccb02 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:53.410143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40e4781e-2e11-4565-b91c-2c8ec25ccb02 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:53.410564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40e4781e-2e11-4565-b91c-2c8ec25ccb02 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:53.415149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4b29944-511f-4445-b12e-2d43bf3c282d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:53.415631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4b29944-511f-4445-b12e-2d43bf3c282d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:53.416071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4b29944-511f-4445-b12e-2d43bf3c282d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:53.416773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4b29944-511f-4445-b12e-2d43bf3c282d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:53.417231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4b29944-511f-4445-b12e-2d43bf3c282d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:53.417684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4b29944-511f-4445-b12e-2d43bf3c282d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:53.445689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-40e4781e-2e11-4565-b91c-2c8ec25ccb02 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051316 Aug 18 21:59:53.446260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 373/742] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:53.447047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e4b29944-511f-4445-b12e-2d43bf3c282d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043617 Aug 18 21:59:53.447617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 370/743] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:53 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:53.769817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0100d158-c108-417e-a54f-127d04c7389e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:53.771940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0100d158-c108-417e-a54f-127d04c7389e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:53.778387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0100d158-c108-417e-a54f-127d04c7389e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:53.778869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0100d158-c108-417e-a54f-127d04c7389e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:53.779306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0100d158-c108-417e-a54f-127d04c7389e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:53.780000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0100d158-c108-417e-a54f-127d04c7389e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:53.780464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0100d158-c108-417e-a54f-127d04c7389e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:53.780889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0100d158-c108-417e-a54f-127d04c7389e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:53.811544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0100d158-c108-417e-a54f-127d04c7389e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045635 Aug 18 21:59:53.812107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 374/744] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:53 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:54.132885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-79d14780-0c6d-46df-9192-323a89a8b8e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:54.135067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-79d14780-0c6d-46df-9192-323a89a8b8e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:54.142118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79d14780-0c6d-46df-9192-323a89a8b8e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:54.142601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79d14780-0c6d-46df-9192-323a89a8b8e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:54.143034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79d14780-0c6d-46df-9192-323a89a8b8e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:54.143723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79d14780-0c6d-46df-9192-323a89a8b8e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:54.144173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79d14780-0c6d-46df-9192-323a89a8b8e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:54.144595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79d14780-0c6d-46df-9192-323a89a8b8e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:54.173161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-79d14780-0c6d-46df-9192-323a89a8b8e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044258 Aug 18 21:59:54.173743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 371/745] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:54 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:54.459230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-31d65dbc-21d6-4f9d-b0e7-51a81611b833 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:54.459830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e4b3f19c-2822-46fc-a531-86448f27d011 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:54.461393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-31d65dbc-21d6-4f9d-b0e7-51a81611b833 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:54.461539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e4b3f19c-2822-46fc-a531-86448f27d011 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:54.467401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4b3f19c-2822-46fc-a531-86448f27d011 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:54.467555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31d65dbc-21d6-4f9d-b0e7-51a81611b833 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:54.467884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4b3f19c-2822-46fc-a531-86448f27d011 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:54.468001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31d65dbc-21d6-4f9d-b0e7-51a81611b833 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:54.468313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4b3f19c-2822-46fc-a531-86448f27d011 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:54.468414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31d65dbc-21d6-4f9d-b0e7-51a81611b833 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:54.469001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4b3f19c-2822-46fc-a531-86448f27d011 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:54.469101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31d65dbc-21d6-4f9d-b0e7-51a81611b833 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:54.469448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4b3f19c-2822-46fc-a531-86448f27d011 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:54.469568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31d65dbc-21d6-4f9d-b0e7-51a81611b833 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:54.469895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4b3f19c-2822-46fc-a531-86448f27d011 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:54.470002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31d65dbc-21d6-4f9d-b0e7-51a81611b833 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:54.499738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e4b3f19c-2822-46fc-a531-86448f27d011 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044083 Aug 18 21:59:54.500019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-31d65dbc-21d6-4f9d-b0e7-51a81611b833 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044773 Aug 18 21:59:54.500320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 372/746] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:54 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:54.500495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 375/747] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:54.823946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-67b2e162-278f-47ba-9a6d-ffb3a086f56b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:54.826090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-67b2e162-278f-47ba-9a6d-ffb3a086f56b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:54.832127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67b2e162-278f-47ba-9a6d-ffb3a086f56b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:54.832613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67b2e162-278f-47ba-9a6d-ffb3a086f56b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:54.833061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67b2e162-278f-47ba-9a6d-ffb3a086f56b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:54.833796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67b2e162-278f-47ba-9a6d-ffb3a086f56b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:54.834256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67b2e162-278f-47ba-9a6d-ffb3a086f56b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:54.834685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67b2e162-278f-47ba-9a6d-ffb3a086f56b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:54.864576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-67b2e162-278f-47ba-9a6d-ffb3a086f56b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044599 Aug 18 21:59:54.865158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 373/748] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:54 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:55.185038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b7647036-f4d6-419f-978b-dd7c64a41c82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:55.187196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b7647036-f4d6-419f-978b-dd7c64a41c82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:55.193831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7647036-f4d6-419f-978b-dd7c64a41c82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:55.194315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7647036-f4d6-419f-978b-dd7c64a41c82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:55.194745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7647036-f4d6-419f-978b-dd7c64a41c82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:55.195432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7647036-f4d6-419f-978b-dd7c64a41c82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:55.195884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7647036-f4d6-419f-978b-dd7c64a41c82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:55.196301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7647036-f4d6-419f-978b-dd7c64a41c82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:55.209714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:55.225246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b7647036-f4d6-419f-978b-dd7c64a41c82 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044783 Aug 18 21:59:55.225839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 376/749] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:55.512620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eef1b5e1-7ce9-433d-9258-bf57c7f9314b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:55.513231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-50b1a9f8-51d5-4b67-b244-4a3c67af9238 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:55.514752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eef1b5e1-7ce9-433d-9258-bf57c7f9314b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:55.514880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-50b1a9f8-51d5-4b67-b244-4a3c67af9238 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:55.521112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50b1a9f8-51d5-4b67-b244-4a3c67af9238 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:55.521275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eef1b5e1-7ce9-433d-9258-bf57c7f9314b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:55.521612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50b1a9f8-51d5-4b67-b244-4a3c67af9238 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:55.521744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eef1b5e1-7ce9-433d-9258-bf57c7f9314b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:55.522051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50b1a9f8-51d5-4b67-b244-4a3c67af9238 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:55.522153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eef1b5e1-7ce9-433d-9258-bf57c7f9314b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:55.522742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50b1a9f8-51d5-4b67-b244-4a3c67af9238 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:55.522852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eef1b5e1-7ce9-433d-9258-bf57c7f9314b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:55.523189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50b1a9f8-51d5-4b67-b244-4a3c67af9238 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:55.523287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eef1b5e1-7ce9-433d-9258-bf57c7f9314b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:55.523607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50b1a9f8-51d5-4b67-b244-4a3c67af9238 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:55.523701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eef1b5e1-7ce9-433d-9258-bf57c7f9314b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:55.552357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-50b1a9f8-51d5-4b67-b244-4a3c67af9238 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044262 Aug 18 21:59:55.552729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eef1b5e1-7ce9-433d-9258-bf57c7f9314b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044579 Aug 18 21:59:55.553522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 374/750] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:55 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:55.553691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 377/751] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:55 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:55.876970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f3594315-82e2-4cb3-9d1a-dc53d73abd23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:55.879142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f3594315-82e2-4cb3-9d1a-dc53d73abd23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:55.885119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3594315-82e2-4cb3-9d1a-dc53d73abd23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:55.885613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3594315-82e2-4cb3-9d1a-dc53d73abd23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:55.886049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3594315-82e2-4cb3-9d1a-dc53d73abd23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:55.886731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3594315-82e2-4cb3-9d1a-dc53d73abd23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:55.887179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3594315-82e2-4cb3-9d1a-dc53d73abd23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:55.887598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3594315-82e2-4cb3-9d1a-dc53d73abd23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:55.915854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f3594315-82e2-4cb3-9d1a-dc53d73abd23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042612 Aug 18 21:59:55.916424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 375/752] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:55 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:56.238292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5881d6e7-7af5-4902-a5ce-9ae7e4e11bc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:56.240323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5881d6e7-7af5-4902-a5ce-9ae7e4e11bc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:56.246784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5881d6e7-7af5-4902-a5ce-9ae7e4e11bc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:56.247258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5881d6e7-7af5-4902-a5ce-9ae7e4e11bc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:56.247689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5881d6e7-7af5-4902-a5ce-9ae7e4e11bc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:56.248364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5881d6e7-7af5-4902-a5ce-9ae7e4e11bc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:56.248828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5881d6e7-7af5-4902-a5ce-9ae7e4e11bc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:56.249272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5881d6e7-7af5-4902-a5ce-9ae7e4e11bc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:56.280547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5881d6e7-7af5-4902-a5ce-9ae7e4e11bc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046248 Aug 18 21:59:56.281124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 378/753] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:56.564488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f4969f1d-3e64-4f26-8f8c-978a1485aa3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:56.565325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3f9000a9-14ca-44e7-a5ae-13b43b8b878e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:56.566684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f4969f1d-3e64-4f26-8f8c-978a1485aa3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:56.567443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3f9000a9-14ca-44e7-a5ae-13b43b8b878e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:56.574126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4969f1d-3e64-4f26-8f8c-978a1485aa3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:56.574298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f9000a9-14ca-44e7-a5ae-13b43b8b878e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:56.574542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f9000a9-14ca-44e7-a5ae-13b43b8b878e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:56.574677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4969f1d-3e64-4f26-8f8c-978a1485aa3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:56.574979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f9000a9-14ca-44e7-a5ae-13b43b8b878e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:56.575091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4969f1d-3e64-4f26-8f8c-978a1485aa3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:56.575682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f9000a9-14ca-44e7-a5ae-13b43b8b878e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:56.575780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4969f1d-3e64-4f26-8f8c-978a1485aa3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:56.576141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4969f1d-3e64-4f26-8f8c-978a1485aa3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:56.576261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f9000a9-14ca-44e7-a5ae-13b43b8b878e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:56.576567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4969f1d-3e64-4f26-8f8c-978a1485aa3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:56.576665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f9000a9-14ca-44e7-a5ae-13b43b8b878e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:56.593902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:59:56.606989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f4969f1d-3e64-4f26-8f8c-978a1485aa3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046468 Aug 18 21:59:56.607215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3f9000a9-14ca-44e7-a5ae-13b43b8b878e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045623 Aug 18 21:59:56.607558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 376/754] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:56 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:56.607948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 379/755] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:56 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:56.928974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4f7af947-9fff-4f49-b788-d45d7299f706 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:56.931134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4f7af947-9fff-4f49-b788-d45d7299f706 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:56.937558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f7af947-9fff-4f49-b788-d45d7299f706 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:56.938074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f7af947-9fff-4f49-b788-d45d7299f706 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:56.938499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f7af947-9fff-4f49-b788-d45d7299f706 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:56.939177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f7af947-9fff-4f49-b788-d45d7299f706 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:56.939625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f7af947-9fff-4f49-b788-d45d7299f706 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:56.940044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f7af947-9fff-4f49-b788-d45d7299f706 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:56.968713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4f7af947-9fff-4f49-b788-d45d7299f706 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044188 Aug 18 21:59:56.969261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 377/756] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:56 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:57.406756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-abac2538-69ed-44cd-b570-0a73c86ca9cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:57.409001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-abac2538-69ed-44cd-b570-0a73c86ca9cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:57.415124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abac2538-69ed-44cd-b570-0a73c86ca9cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:57.415607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abac2538-69ed-44cd-b570-0a73c86ca9cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:57.416201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abac2538-69ed-44cd-b570-0a73c86ca9cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:57.417455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abac2538-69ed-44cd-b570-0a73c86ca9cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:57.417984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abac2538-69ed-44cd-b570-0a73c86ca9cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:57.418419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abac2538-69ed-44cd-b570-0a73c86ca9cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:57.423465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 21:59:57.423672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 21:59:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 21:59:57.450435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-abac2538-69ed-44cd-b570-0a73c86ca9cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.161909 Aug 18 21:59:57.451242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 380/757] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:57.618803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6580805c-bc7c-49f5-b0e4-0457723c2244 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:57.619345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f6b00fd7-579f-498a-9e4b-2e34694f2b7a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:57.621622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6580805c-bc7c-49f5-b0e4-0457723c2244 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:57.622006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f6b00fd7-579f-498a-9e4b-2e34694f2b7a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:57.628639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6b00fd7-579f-498a-9e4b-2e34694f2b7a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:57.628821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6580805c-bc7c-49f5-b0e4-0457723c2244 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:57.628950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6b00fd7-579f-498a-9e4b-2e34694f2b7a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:57.629159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6b00fd7-579f-498a-9e4b-2e34694f2b7a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:57.629263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6580805c-bc7c-49f5-b0e4-0457723c2244 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:57.629546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6580805c-bc7c-49f5-b0e4-0457723c2244 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:57.629819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6b00fd7-579f-498a-9e4b-2e34694f2b7a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:57.630270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6580805c-bc7c-49f5-b0e4-0457723c2244 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:57.630378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6b00fd7-579f-498a-9e4b-2e34694f2b7a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:57.630697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6b00fd7-579f-498a-9e4b-2e34694f2b7a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:57.630799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6580805c-bc7c-49f5-b0e4-0457723c2244 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:57.631142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6580805c-bc7c-49f5-b0e4-0457723c2244 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:57.661907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f6b00fd7-579f-498a-9e4b-2e34694f2b7a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046423 Aug 18 21:59:57.662679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 381/758] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:57.662960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6580805c-bc7c-49f5-b0e4-0457723c2244 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048022 Aug 18 21:59:57.663599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 378/759] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:57 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:57.982686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b8ff023e-d3e3-4e33-852c-36196142b92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:57.984865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b8ff023e-d3e3-4e33-852c-36196142b92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:57.990905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8ff023e-d3e3-4e33-852c-36196142b92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:57.991375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8ff023e-d3e3-4e33-852c-36196142b92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:57.991803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8ff023e-d3e3-4e33-852c-36196142b92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:57.992484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8ff023e-d3e3-4e33-852c-36196142b92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:57.992935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8ff023e-d3e3-4e33-852c-36196142b92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:57.993352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8ff023e-d3e3-4e33-852c-36196142b92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:58.021955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b8ff023e-d3e3-4e33-852c-36196142b92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043692 Aug 18 21:59:58.022500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 382/760] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:57 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:58.462640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3c8b6032-0379-4485-98ef-d0a51887e2cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:58.464858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3c8b6032-0379-4485-98ef-d0a51887e2cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:58.470948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c8b6032-0379-4485-98ef-d0a51887e2cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:58.471436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c8b6032-0379-4485-98ef-d0a51887e2cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:58.471865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c8b6032-0379-4485-98ef-d0a51887e2cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:58.472553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c8b6032-0379-4485-98ef-d0a51887e2cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:58.473006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c8b6032-0379-4485-98ef-d0a51887e2cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:58.473431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c8b6032-0379-4485-98ef-d0a51887e2cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:58.501960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3c8b6032-0379-4485-98ef-d0a51887e2cc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043276 Aug 18 21:59:58.502505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 379/761] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:58.674449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-55f5714b-b170-49e7-8122-b9ebfe8bb4a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:58.675212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-568a816d-d4e4-4137-a793-09f51dd12c17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:58.676861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-55f5714b-b170-49e7-8122-b9ebfe8bb4a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:58.677282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-568a816d-d4e4-4137-a793-09f51dd12c17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:58.683823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55f5714b-b170-49e7-8122-b9ebfe8bb4a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:58.683970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-568a816d-d4e4-4137-a793-09f51dd12c17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:58.684234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55f5714b-b170-49e7-8122-b9ebfe8bb4a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:58.684334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-568a816d-d4e4-4137-a793-09f51dd12c17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:58.684659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55f5714b-b170-49e7-8122-b9ebfe8bb4a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:58.684789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-568a816d-d4e4-4137-a793-09f51dd12c17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:58.685387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55f5714b-b170-49e7-8122-b9ebfe8bb4a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:58.685497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-568a816d-d4e4-4137-a793-09f51dd12c17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:58.685860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55f5714b-b170-49e7-8122-b9ebfe8bb4a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:58.686034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-568a816d-d4e4-4137-a793-09f51dd12c17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:58.686282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55f5714b-b170-49e7-8122-b9ebfe8bb4a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:58.686386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-568a816d-d4e4-4137-a793-09f51dd12c17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:58.716620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-568a816d-d4e4-4137-a793-09f51dd12c17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045198 Aug 18 21:59:58.717449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 380/762] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 21:59:58.717575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-55f5714b-b170-49e7-8122-b9ebfe8bb4a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047104 Aug 18 21:59:58.718163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 383/763] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:58 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:59.033909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f79dca73-3c83-4683-8831-2dc4c37430b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:59.036030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f79dca73-3c83-4683-8831-2dc4c37430b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:59.042571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f79dca73-3c83-4683-8831-2dc4c37430b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:59.043054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f79dca73-3c83-4683-8831-2dc4c37430b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:59.043488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f79dca73-3c83-4683-8831-2dc4c37430b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:59.044175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f79dca73-3c83-4683-8831-2dc4c37430b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:59.044635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f79dca73-3c83-4683-8831-2dc4c37430b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:59.045060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f79dca73-3c83-4683-8831-2dc4c37430b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:59.074413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f79dca73-3c83-4683-8831-2dc4c37430b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044476 Aug 18 21:59:59.074971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 381/764] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:59 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:59.514807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a598b50-5a11-40c1-b015-50cda89cba75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:59.516914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0a598b50-5a11-40c1-b015-50cda89cba75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:59.523009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a598b50-5a11-40c1-b015-50cda89cba75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:59.523485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a598b50-5a11-40c1-b015-50cda89cba75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:59.523916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a598b50-5a11-40c1-b015-50cda89cba75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:59.524597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a598b50-5a11-40c1-b015-50cda89cba75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:59.525043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a598b50-5a11-40c1-b015-50cda89cba75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:59.525461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a598b50-5a11-40c1-b015-50cda89cba75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:59.554912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a598b50-5a11-40c1-b015-50cda89cba75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044525 Aug 18 21:59:59.555454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 384/765] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 21:59:59 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 21:59:59.728834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d7fb9e0e-d955-4b2a-a9e3-ec9cf5fcca07 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:59.730993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d7fb9e0e-d955-4b2a-a9e3-ec9cf5fcca07 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:59.737521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7fb9e0e-d955-4b2a-a9e3-ec9cf5fcca07 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:59.737521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7fb9e0e-d955-4b2a-a9e3-ec9cf5fcca07 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:59.738428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7fb9e0e-d955-4b2a-a9e3-ec9cf5fcca07 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:59.739131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7fb9e0e-d955-4b2a-a9e3-ec9cf5fcca07 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:59.739591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7fb9e0e-d955-4b2a-a9e3-ec9cf5fcca07 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:59.740018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7fb9e0e-d955-4b2a-a9e3-ec9cf5fcca07 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:59.770265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d7fb9e0e-d955-4b2a-a9e3-ec9cf5fcca07 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Aug 18 21:59:59.770830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 382/766] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 21:59:59.784212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0acab04-ebf9-4cb8-89fd-f426f42db6b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 21:59:59.786372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d0acab04-ebf9-4cb8-89fd-f426f42db6b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 21:59:59.792729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0acab04-ebf9-4cb8-89fd-f426f42db6b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:59.793208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0acab04-ebf9-4cb8-89fd-f426f42db6b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:59.793661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0acab04-ebf9-4cb8-89fd-f426f42db6b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:59.794356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0acab04-ebf9-4cb8-89fd-f426f42db6b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 21:59:59.794810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0acab04-ebf9-4cb8-89fd-f426f42db6b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 21:59:59.795485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0acab04-ebf9-4cb8-89fd-f426f42db6b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 21:59:59.824700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d0acab04-ebf9-4cb8-89fd-f426f42db6b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096432 Aug 18 21:59:59.825250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 385/767] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 21:59:59 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:00.086634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-58b55b0e-6193-4596-be8c-1d90fea2a2d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:00.089239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-58b55b0e-6193-4596-be8c-1d90fea2a2d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:00.095170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58b55b0e-6193-4596-be8c-1d90fea2a2d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:00.095663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58b55b0e-6193-4596-be8c-1d90fea2a2d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:00.096103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58b55b0e-6193-4596-be8c-1d90fea2a2d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:00.096806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58b55b0e-6193-4596-be8c-1d90fea2a2d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:00.097385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58b55b0e-6193-4596-be8c-1d90fea2a2d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:00.097845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58b55b0e-6193-4596-be8c-1d90fea2a2d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:00.126845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-58b55b0e-6193-4596-be8c-1d90fea2a2d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044143 Aug 18 22:00:00.127408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 383/768] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:00 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:00.567694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e004d56e-a366-4e40-bc7d-4349f78c741d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:00.569859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e004d56e-a366-4e40-bc7d-4349f78c741d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:00.575863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e004d56e-a366-4e40-bc7d-4349f78c741d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:00.576339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e004d56e-a366-4e40-bc7d-4349f78c741d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:00.576772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e004d56e-a366-4e40-bc7d-4349f78c741d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:00.577473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e004d56e-a366-4e40-bc7d-4349f78c741d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:00.577953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e004d56e-a366-4e40-bc7d-4349f78c741d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:00.578379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e004d56e-a366-4e40-bc7d-4349f78c741d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:00.608096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e004d56e-a366-4e40-bc7d-4349f78c741d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044282 Aug 18 22:00:00.608658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 386/769] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:00 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:00.782325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-98ea671f-e8f7-4080-8f67-0b5bd00220b1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:00.784425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-98ea671f-e8f7-4080-8f67-0b5bd00220b1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:00.790751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98ea671f-e8f7-4080-8f67-0b5bd00220b1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:00.791221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98ea671f-e8f7-4080-8f67-0b5bd00220b1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:00.792318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98ea671f-e8f7-4080-8f67-0b5bd00220b1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:00.793003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98ea671f-e8f7-4080-8f67-0b5bd00220b1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:00.793452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98ea671f-e8f7-4080-8f67-0b5bd00220b1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:00.793899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98ea671f-e8f7-4080-8f67-0b5bd00220b1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:00.821781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-98ea671f-e8f7-4080-8f67-0b5bd00220b1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043339 Aug 18 22:00:00.822333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 384/770] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:00 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:00.836753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f6731d03-32fb-4035-8631-a0d4bcb62fd0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:00.839434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f6731d03-32fb-4035-8631-a0d4bcb62fd0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:00.845758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6731d03-32fb-4035-8631-a0d4bcb62fd0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:00.846240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6731d03-32fb-4035-8631-a0d4bcb62fd0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:00.846683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6731d03-32fb-4035-8631-a0d4bcb62fd0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:00.847369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6731d03-32fb-4035-8631-a0d4bcb62fd0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:00.847824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6731d03-32fb-4035-8631-a0d4bcb62fd0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:00.848251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6731d03-32fb-4035-8631-a0d4bcb62fd0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:00.876999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f6731d03-32fb-4035-8631-a0d4bcb62fd0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044180 Aug 18 22:00:00.877552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 387/771] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:00 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:01.139571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4f027ff1-3ff9-4e0d-a59c-a9a57f303af9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:01.141684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4f027ff1-3ff9-4e0d-a59c-a9a57f303af9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:01.147535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f027ff1-3ff9-4e0d-a59c-a9a57f303af9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:01.148007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f027ff1-3ff9-4e0d-a59c-a9a57f303af9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:01.148435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f027ff1-3ff9-4e0d-a59c-a9a57f303af9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:01.149115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f027ff1-3ff9-4e0d-a59c-a9a57f303af9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:01.149563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f027ff1-3ff9-4e0d-a59c-a9a57f303af9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:01.150004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f027ff1-3ff9-4e0d-a59c-a9a57f303af9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:01.178715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4f027ff1-3ff9-4e0d-a59c-a9a57f303af9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043494 Aug 18 22:00:01.179261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 385/772] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:01 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:01.622000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-155af7c5-c4c5-467f-ad22-9d45d078789d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:01.624159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-155af7c5-c4c5-467f-ad22-9d45d078789d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:01.632134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-155af7c5-c4c5-467f-ad22-9d45d078789d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:01.632622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-155af7c5-c4c5-467f-ad22-9d45d078789d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:01.633059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-155af7c5-c4c5-467f-ad22-9d45d078789d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:01.633807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-155af7c5-c4c5-467f-ad22-9d45d078789d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:01.634260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-155af7c5-c4c5-467f-ad22-9d45d078789d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:01.636001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-155af7c5-c4c5-467f-ad22-9d45d078789d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:01.665303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-155af7c5-c4c5-467f-ad22-9d45d078789d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048069 Aug 18 22:00:01.665895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 388/773] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:01.833651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-88608f87-f872-4197-8ced-ab52fbeb3cbb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:01.835709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-88608f87-f872-4197-8ced-ab52fbeb3cbb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:01.838015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:01.843128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88608f87-f872-4197-8ced-ab52fbeb3cbb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:01.843598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88608f87-f872-4197-8ced-ab52fbeb3cbb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:01.844032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88608f87-f872-4197-8ced-ab52fbeb3cbb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:01.844724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88608f87-f872-4197-8ced-ab52fbeb3cbb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:01.845177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88608f87-f872-4197-8ced-ab52fbeb3cbb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:01.845729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88608f87-f872-4197-8ced-ab52fbeb3cbb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:01.874418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-88608f87-f872-4197-8ced-ab52fbeb3cbb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044798 Aug 18 22:00:01.874977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 386/774] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:01 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:01.888269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c79baa5d-2ce2-4b28-aedf-0549eea04f90 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:01.890482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c79baa5d-2ce2-4b28-aedf-0549eea04f90 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:01.896841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c79baa5d-2ce2-4b28-aedf-0549eea04f90 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:01.897323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c79baa5d-2ce2-4b28-aedf-0549eea04f90 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:01.897813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c79baa5d-2ce2-4b28-aedf-0549eea04f90 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:01.898509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c79baa5d-2ce2-4b28-aedf-0549eea04f90 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:01.898964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c79baa5d-2ce2-4b28-aedf-0549eea04f90 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:01.899386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c79baa5d-2ce2-4b28-aedf-0549eea04f90 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:01.930606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c79baa5d-2ce2-4b28-aedf-0549eea04f90 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046176 Aug 18 22:00:01.931168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 389/775] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:01 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:02.191719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5a692f12-3603-4365-afb3-d9112486b200 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:02.193939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5a692f12-3603-4365-afb3-d9112486b200 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:02.200053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a692f12-3603-4365-afb3-d9112486b200 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:02.200634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a692f12-3603-4365-afb3-d9112486b200 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:02.201076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a692f12-3603-4365-afb3-d9112486b200 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:02.201845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a692f12-3603-4365-afb3-d9112486b200 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:02.202310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a692f12-3603-4365-afb3-d9112486b200 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:02.202740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a692f12-3603-4365-afb3-d9112486b200 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:02.232484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5a692f12-3603-4365-afb3-d9112486b200 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045405 Aug 18 22:00:02.233056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 387/776] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:02 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:02.667528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:00:02.667705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:00:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:00:02.677647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bbf138d9-6d7a-4d01-9feb-8fd14e7bd788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:02.679794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bbf138d9-6d7a-4d01-9feb-8fd14e7bd788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:02.685887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbf138d9-6d7a-4d01-9feb-8fd14e7bd788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:02.686364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbf138d9-6d7a-4d01-9feb-8fd14e7bd788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:02.686797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbf138d9-6d7a-4d01-9feb-8fd14e7bd788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:02.687514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbf138d9-6d7a-4d01-9feb-8fd14e7bd788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:02.687973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbf138d9-6d7a-4d01-9feb-8fd14e7bd788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:02.688392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbf138d9-6d7a-4d01-9feb-8fd14e7bd788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:02.718572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bbf138d9-6d7a-4d01-9feb-8fd14e7bd788 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045089 Aug 18 22:00:02.719703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 390/777] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:00:02.887052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9767a493-4dce-459d-b5bb-b815771acfcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:02.889086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9767a493-4dce-459d-b5bb-b815771acfcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:02.895471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9767a493-4dce-459d-b5bb-b815771acfcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:02.895952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9767a493-4dce-459d-b5bb-b815771acfcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:02.896384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9767a493-4dce-459d-b5bb-b815771acfcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:02.897072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9767a493-4dce-459d-b5bb-b815771acfcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:02.897527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9767a493-4dce-459d-b5bb-b815771acfcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:02.897977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9767a493-4dce-459d-b5bb-b815771acfcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:02.926059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9767a493-4dce-459d-b5bb-b815771acfcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043704 Aug 18 22:00:02.926610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 388/778] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:02 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:02.943063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-460621ca-1012-46da-a4d7-eb0f1ae5c876 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:02.945200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-460621ca-1012-46da-a4d7-eb0f1ae5c876 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:02.952250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-460621ca-1012-46da-a4d7-eb0f1ae5c876 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:02.952736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-460621ca-1012-46da-a4d7-eb0f1ae5c876 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:02.953179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-460621ca-1012-46da-a4d7-eb0f1ae5c876 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:02.953904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-460621ca-1012-46da-a4d7-eb0f1ae5c876 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:02.954366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-460621ca-1012-46da-a4d7-eb0f1ae5c876 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:02.954795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-460621ca-1012-46da-a4d7-eb0f1ae5c876 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:02.983003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-460621ca-1012-46da-a4d7-eb0f1ae5c876 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043875 Aug 18 22:00:02.983564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 391/779] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:02 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:03.245554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c23a6f74-ef73-4ea4-88ef-3b8126b515b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:03.247607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c23a6f74-ef73-4ea4-88ef-3b8126b515b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:03.253503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c23a6f74-ef73-4ea4-88ef-3b8126b515b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:03.254022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c23a6f74-ef73-4ea4-88ef-3b8126b515b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:03.254459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c23a6f74-ef73-4ea4-88ef-3b8126b515b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:03.255152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c23a6f74-ef73-4ea4-88ef-3b8126b515b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:03.255609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c23a6f74-ef73-4ea4-88ef-3b8126b515b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:03.256033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c23a6f74-ef73-4ea4-88ef-3b8126b515b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:03.283935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c23a6f74-ef73-4ea4-88ef-3b8126b515b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043099 Aug 18 22:00:03.284487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 389/780] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:03 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:03.730822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf649fa9-ae50-43d3-8359-d5807f39a823 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:03.732973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf649fa9-ae50-43d3-8359-d5807f39a823 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:03.738936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf649fa9-ae50-43d3-8359-d5807f39a823 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:03.739413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf649fa9-ae50-43d3-8359-d5807f39a823 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:03.739847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf649fa9-ae50-43d3-8359-d5807f39a823 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:03.740527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf649fa9-ae50-43d3-8359-d5807f39a823 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:03.740975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf649fa9-ae50-43d3-8359-d5807f39a823 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:03.741392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf649fa9-ae50-43d3-8359-d5807f39a823 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:03.770499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf649fa9-ae50-43d3-8359-d5807f39a823 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043680 Aug 18 22:00:03.771044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 392/781] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:03.938901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07e360a2-a8d6-48fa-81ef-57c202858cf2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:03.940936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07e360a2-a8d6-48fa-81ef-57c202858cf2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:03.947518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07e360a2-a8d6-48fa-81ef-57c202858cf2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:03.948626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07e360a2-a8d6-48fa-81ef-57c202858cf2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:03.949061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07e360a2-a8d6-48fa-81ef-57c202858cf2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:03.949798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07e360a2-a8d6-48fa-81ef-57c202858cf2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:03.950246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07e360a2-a8d6-48fa-81ef-57c202858cf2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:03.950670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07e360a2-a8d6-48fa-81ef-57c202858cf2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:03.981143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07e360a2-a8d6-48fa-81ef-57c202858cf2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046139 Aug 18 22:00:03.981749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 390/782] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:03 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:03.996011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-33602a26-45ba-43c5-af3c-c6aaf28d36ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:03.998206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-33602a26-45ba-43c5-af3c-c6aaf28d36ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:04.008864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33602a26-45ba-43c5-af3c-c6aaf28d36ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:04.009344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33602a26-45ba-43c5-af3c-c6aaf28d36ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:04.009820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33602a26-45ba-43c5-af3c-c6aaf28d36ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:04.010524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33602a26-45ba-43c5-af3c-c6aaf28d36ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:04.010979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33602a26-45ba-43c5-af3c-c6aaf28d36ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:04.011400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33602a26-45ba-43c5-af3c-c6aaf28d36ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:04.013982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:04.044664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-33602a26-45ba-43c5-af3c-c6aaf28d36ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053163 Aug 18 22:00:04.045496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 393/783] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:03 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:04.297274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7d2e51ee-14d1-4696-ab09-e30cd7e6c60a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:04.299400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7d2e51ee-14d1-4696-ab09-e30cd7e6c60a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:04.305424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d2e51ee-14d1-4696-ab09-e30cd7e6c60a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:04.305940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d2e51ee-14d1-4696-ab09-e30cd7e6c60a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:04.306376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d2e51ee-14d1-4696-ab09-e30cd7e6c60a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:04.307159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d2e51ee-14d1-4696-ab09-e30cd7e6c60a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:04.308129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d2e51ee-14d1-4696-ab09-e30cd7e6c60a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:04.308555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d2e51ee-14d1-4696-ab09-e30cd7e6c60a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:04.338975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7d2e51ee-14d1-4696-ab09-e30cd7e6c60a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045244 Aug 18 22:00:04.339879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 391/784] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:04 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:04.783101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-737ec326-24bf-40e6-be26-17b8cf98ace1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:04.785252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-737ec326-24bf-40e6-be26-17b8cf98ace1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:04.791216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-737ec326-24bf-40e6-be26-17b8cf98ace1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:04.791701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-737ec326-24bf-40e6-be26-17b8cf98ace1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:04.792137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-737ec326-24bf-40e6-be26-17b8cf98ace1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:04.792840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-737ec326-24bf-40e6-be26-17b8cf98ace1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:04.793294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-737ec326-24bf-40e6-be26-17b8cf98ace1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:04.793756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-737ec326-24bf-40e6-be26-17b8cf98ace1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:04.825847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-737ec326-24bf-40e6-be26-17b8cf98ace1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046619 Aug 18 22:00:04.826422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 394/785] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:04.992581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a3834e60-1150-40c3-87d7-4cb3a0f2eb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:04.994682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a3834e60-1150-40c3-87d7-4cb3a0f2eb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:05.000955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3834e60-1150-40c3-87d7-4cb3a0f2eb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:05.001434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3834e60-1150-40c3-87d7-4cb3a0f2eb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:05.001906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3834e60-1150-40c3-87d7-4cb3a0f2eb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:05.002594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3834e60-1150-40c3-87d7-4cb3a0f2eb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:05.003047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3834e60-1150-40c3-87d7-4cb3a0f2eb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:05.003467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3834e60-1150-40c3-87d7-4cb3a0f2eb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:05.032284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a3834e60-1150-40c3-87d7-4cb3a0f2eb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043726 Aug 18 22:00:05.032829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 392/786] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:05.056285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f9c627d6-cca4-4419-b792-c8a7eee701ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:05.058511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f9c627d6-cca4-4419-b792-c8a7eee701ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:05.064791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9c627d6-cca4-4419-b792-c8a7eee701ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:05.065364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9c627d6-cca4-4419-b792-c8a7eee701ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:05.065838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9c627d6-cca4-4419-b792-c8a7eee701ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:05.066561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9c627d6-cca4-4419-b792-c8a7eee701ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:05.067019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9c627d6-cca4-4419-b792-c8a7eee701ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:05.067445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9c627d6-cca4-4419-b792-c8a7eee701ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:05.096782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f9c627d6-cca4-4419-b792-c8a7eee701ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044347 Aug 18 22:00:05.097340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 395/787] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:05 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:05.351925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8b2fa91f-a56d-4a8b-95cc-5bf87964452c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:05.354065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8b2fa91f-a56d-4a8b-95cc-5bf87964452c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:05.359966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b2fa91f-a56d-4a8b-95cc-5bf87964452c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:05.360455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b2fa91f-a56d-4a8b-95cc-5bf87964452c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:05.360901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b2fa91f-a56d-4a8b-95cc-5bf87964452c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:05.361609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b2fa91f-a56d-4a8b-95cc-5bf87964452c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:05.362084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b2fa91f-a56d-4a8b-95cc-5bf87964452c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:05.362514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b2fa91f-a56d-4a8b-95cc-5bf87964452c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:05.366134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:05.392545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8b2fa91f-a56d-4a8b-95cc-5bf87964452c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 Aug 18 22:00:05.393098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 393/788] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:05 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:05.838057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4cc74115-e00d-48c6-bca4-ea203c43d5ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:05.840693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4cc74115-e00d-48c6-bca4-ea203c43d5ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:05.846560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cc74115-e00d-48c6-bca4-ea203c43d5ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:05.847037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cc74115-e00d-48c6-bca4-ea203c43d5ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:05.847464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cc74115-e00d-48c6-bca4-ea203c43d5ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:05.848147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cc74115-e00d-48c6-bca4-ea203c43d5ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:05.848623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cc74115-e00d-48c6-bca4-ea203c43d5ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:05.849045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cc74115-e00d-48c6-bca4-ea203c43d5ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:05.877752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4cc74115-e00d-48c6-bca4-ea203c43d5ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043522 Aug 18 22:00:05.878233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 396/789] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:06.044918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-03acc1c5-abb3-4a13-9fcd-440865bcf749 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:06.047328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-03acc1c5-abb3-4a13-9fcd-440865bcf749 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:06.053887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03acc1c5-abb3-4a13-9fcd-440865bcf749 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:06.054371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03acc1c5-abb3-4a13-9fcd-440865bcf749 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:06.054813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03acc1c5-abb3-4a13-9fcd-440865bcf749 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:06.055508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03acc1c5-abb3-4a13-9fcd-440865bcf749 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:06.055996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03acc1c5-abb3-4a13-9fcd-440865bcf749 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:06.056426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03acc1c5-abb3-4a13-9fcd-440865bcf749 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:06.084601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-03acc1c5-abb3-4a13-9fcd-440865bcf749 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044226 Aug 18 22:00:06.085161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 394/790] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:06 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:06.109389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ed7154d4-c4e1-49f6-b15c-fc5021232692 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:06.111549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ed7154d4-c4e1-49f6-b15c-fc5021232692 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:06.117867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7154d4-c4e1-49f6-b15c-fc5021232692 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:06.118347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7154d4-c4e1-49f6-b15c-fc5021232692 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:06.118782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7154d4-c4e1-49f6-b15c-fc5021232692 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:06.119472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7154d4-c4e1-49f6-b15c-fc5021232692 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:06.119927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7154d4-c4e1-49f6-b15c-fc5021232692 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:06.120353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7154d4-c4e1-49f6-b15c-fc5021232692 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:06.149576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ed7154d4-c4e1-49f6-b15c-fc5021232692 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043963 Aug 18 22:00:06.150092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 397/791] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:06 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:06.405178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b7d6511e-f420-4182-a387-4e13af3de9a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:06.407240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b7d6511e-f420-4182-a387-4e13af3de9a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:06.413089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7d6511e-f420-4182-a387-4e13af3de9a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:06.413570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7d6511e-f420-4182-a387-4e13af3de9a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:06.414034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7d6511e-f420-4182-a387-4e13af3de9a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:06.414725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7d6511e-f420-4182-a387-4e13af3de9a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:06.415182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7d6511e-f420-4182-a387-4e13af3de9a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:06.415609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7d6511e-f420-4182-a387-4e13af3de9a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:06.443666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b7d6511e-f420-4182-a387-4e13af3de9a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043122 Aug 18 22:00:06.444224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 395/792] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:06 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:06.890452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-23e73e87-35f2-45f4-9a13-aff7e4dce95b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:06.892556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-23e73e87-35f2-45f4-9a13-aff7e4dce95b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:06.898709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23e73e87-35f2-45f4-9a13-aff7e4dce95b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:06.899183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23e73e87-35f2-45f4-9a13-aff7e4dce95b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:06.899612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23e73e87-35f2-45f4-9a13-aff7e4dce95b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:06.900298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23e73e87-35f2-45f4-9a13-aff7e4dce95b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:06.900750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23e73e87-35f2-45f4-9a13-aff7e4dce95b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:06.901286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23e73e87-35f2-45f4-9a13-aff7e4dce95b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:06.929816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-23e73e87-35f2-45f4-9a13-aff7e4dce95b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043226 Aug 18 22:00:06.930569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 398/793] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:06 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:07.096854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ecf9025b-9988-4207-8bfd-81b0c6f49e2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:07.099265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ecf9025b-9988-4207-8bfd-81b0c6f49e2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:07.106373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecf9025b-9988-4207-8bfd-81b0c6f49e2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:07.106858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecf9025b-9988-4207-8bfd-81b0c6f49e2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:07.107294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecf9025b-9988-4207-8bfd-81b0c6f49e2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:07.108112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecf9025b-9988-4207-8bfd-81b0c6f49e2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:07.108573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecf9025b-9988-4207-8bfd-81b0c6f49e2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:07.109000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecf9025b-9988-4207-8bfd-81b0c6f49e2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:07.138648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ecf9025b-9988-4207-8bfd-81b0c6f49e2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046025 Aug 18 22:00:07.139207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 396/794] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:07.161884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ecbde8b2-0835-4a88-80ef-6aad4492c398 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:07.164038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ecbde8b2-0835-4a88-80ef-6aad4492c398 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:07.170872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecbde8b2-0835-4a88-80ef-6aad4492c398 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:07.171352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecbde8b2-0835-4a88-80ef-6aad4492c398 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:07.171786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecbde8b2-0835-4a88-80ef-6aad4492c398 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:07.172477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecbde8b2-0835-4a88-80ef-6aad4492c398 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:07.172926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecbde8b2-0835-4a88-80ef-6aad4492c398 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:07.173345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecbde8b2-0835-4a88-80ef-6aad4492c398 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:07.203168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ecbde8b2-0835-4a88-80ef-6aad4492c398 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045096 Aug 18 22:00:07.203730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 399/795] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:07 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:07.456258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-784c1c7b-f84e-4d05-9862-933e6359d2fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:07.458376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-784c1c7b-f84e-4d05-9862-933e6359d2fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:07.465023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-784c1c7b-f84e-4d05-9862-933e6359d2fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:07.465512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-784c1c7b-f84e-4d05-9862-933e6359d2fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:07.465983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-784c1c7b-f84e-4d05-9862-933e6359d2fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:07.466687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-784c1c7b-f84e-4d05-9862-933e6359d2fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:07.467144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-784c1c7b-f84e-4d05-9862-933e6359d2fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:07.467600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-784c1c7b-f84e-4d05-9862-933e6359d2fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:07.497369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-784c1c7b-f84e-4d05-9862-933e6359d2fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044962 Aug 18 22:00:07.497943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 397/796] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:07 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:07.942271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d115bf25-bde4-4231-90d3-9ec34a32badf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:07.944516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d115bf25-bde4-4231-90d3-9ec34a32badf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:07.951155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d115bf25-bde4-4231-90d3-9ec34a32badf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:07.951631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d115bf25-bde4-4231-90d3-9ec34a32badf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:07.952060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d115bf25-bde4-4231-90d3-9ec34a32badf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:07.952750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d115bf25-bde4-4231-90d3-9ec34a32badf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:07.953205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d115bf25-bde4-4231-90d3-9ec34a32badf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:07.953652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d115bf25-bde4-4231-90d3-9ec34a32badf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:07.982701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d115bf25-bde4-4231-90d3-9ec34a32badf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044423 Aug 18 22:00:07.983205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 400/797] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:08.150718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ba8b27c8-1e04-4c3b-bfb8-26a9b78ff21b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:08.152876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ba8b27c8-1e04-4c3b-bfb8-26a9b78ff21b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:08.159317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba8b27c8-1e04-4c3b-bfb8-26a9b78ff21b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:08.159806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba8b27c8-1e04-4c3b-bfb8-26a9b78ff21b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:08.160248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba8b27c8-1e04-4c3b-bfb8-26a9b78ff21b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:08.160954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba8b27c8-1e04-4c3b-bfb8-26a9b78ff21b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:08.161414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba8b27c8-1e04-4c3b-bfb8-26a9b78ff21b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:08.161875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba8b27c8-1e04-4c3b-bfb8-26a9b78ff21b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:08.190624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ba8b27c8-1e04-4c3b-bfb8-26a9b78ff21b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Aug 18 22:00:08.191185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 398/798] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:08 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:08.215315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-56c09a71-1360-4087-8891-28e61f094566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:08.217533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-56c09a71-1360-4087-8891-28e61f094566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:08.223864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56c09a71-1360-4087-8891-28e61f094566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:08.224338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56c09a71-1360-4087-8891-28e61f094566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:08.224765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56c09a71-1360-4087-8891-28e61f094566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:08.225482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56c09a71-1360-4087-8891-28e61f094566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:08.225958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56c09a71-1360-4087-8891-28e61f094566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:08.226379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56c09a71-1360-4087-8891-28e61f094566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:08.255677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-56c09a71-1360-4087-8891-28e61f094566 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044143 Aug 18 22:00:08.256166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 401/799] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:08 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:08.509245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-21f8305a-4764-40e7-b8b7-76e7a9011e80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:08.511356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-21f8305a-4764-40e7-b8b7-76e7a9011e80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:08.517222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21f8305a-4764-40e7-b8b7-76e7a9011e80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:08.517741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21f8305a-4764-40e7-b8b7-76e7a9011e80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:08.518191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21f8305a-4764-40e7-b8b7-76e7a9011e80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:08.518885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21f8305a-4764-40e7-b8b7-76e7a9011e80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:08.519343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21f8305a-4764-40e7-b8b7-76e7a9011e80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:08.519772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21f8305a-4764-40e7-b8b7-76e7a9011e80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:08.548749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-21f8305a-4764-40e7-b8b7-76e7a9011e80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043454 Aug 18 22:00:08.549282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 399/800] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:08 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:08.994961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-adf9338d-a410-4269-a9b9-cefff5686c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:08.997114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-adf9338d-a410-4269-a9b9-cefff5686c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:09.004368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adf9338d-a410-4269-a9b9-cefff5686c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:09.005021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adf9338d-a410-4269-a9b9-cefff5686c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:09.005463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adf9338d-a410-4269-a9b9-cefff5686c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:09.006196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adf9338d-a410-4269-a9b9-cefff5686c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:09.006685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adf9338d-a410-4269-a9b9-cefff5686c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:09.007080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-adf9338d-a410-4269-a9b9-cefff5686c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:09.036341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-adf9338d-a410-4269-a9b9-cefff5686c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045270 Aug 18 22:00:09.036901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 402/801] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:09.203817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7851ca23-05f1-4cfb-9757-f9b8774a065b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:09.206354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7851ca23-05f1-4cfb-9757-f9b8774a065b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:09.214098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7851ca23-05f1-4cfb-9757-f9b8774a065b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:09.214588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7851ca23-05f1-4cfb-9757-f9b8774a065b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:09.215054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7851ca23-05f1-4cfb-9757-f9b8774a065b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:09.215789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7851ca23-05f1-4cfb-9757-f9b8774a065b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:09.216238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7851ca23-05f1-4cfb-9757-f9b8774a065b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:09.216657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7851ca23-05f1-4cfb-9757-f9b8774a065b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:09.245165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7851ca23-05f1-4cfb-9757-f9b8774a065b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045383 Aug 18 22:00:09.245754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 400/802] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:09 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:09.267730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-755f1cb7-8355-4426-8977-8ef10fb68c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:09.270057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-755f1cb7-8355-4426-8977-8ef10fb68c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:09.277222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-755f1cb7-8355-4426-8977-8ef10fb68c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:09.277741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-755f1cb7-8355-4426-8977-8ef10fb68c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:09.278186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-755f1cb7-8355-4426-8977-8ef10fb68c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:09.278906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-755f1cb7-8355-4426-8977-8ef10fb68c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:09.279367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-755f1cb7-8355-4426-8977-8ef10fb68c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:09.279798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-755f1cb7-8355-4426-8977-8ef10fb68c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:09.308887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-755f1cb7-8355-4426-8977-8ef10fb68c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Aug 18 22:00:09.309444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 403/803] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:09 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:09.560659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b94977df-8aa1-48f3-8c2b-a956b4d513d2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:09.562813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b94977df-8aa1-48f3-8c2b-a956b4d513d2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:09.568768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b94977df-8aa1-48f3-8c2b-a956b4d513d2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:09.569252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b94977df-8aa1-48f3-8c2b-a956b4d513d2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:09.569718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b94977df-8aa1-48f3-8c2b-a956b4d513d2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:09.570416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b94977df-8aa1-48f3-8c2b-a956b4d513d2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:09.570872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b94977df-8aa1-48f3-8c2b-a956b4d513d2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:09.571298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b94977df-8aa1-48f3-8c2b-a956b4d513d2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:09.601150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b94977df-8aa1-48f3-8c2b-a956b4d513d2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 Aug 18 22:00:09.601728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 401/804] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:09 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:10.049823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-05905633-a7a3-42d2-a745-7574830b08ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:10.051785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-05905633-a7a3-42d2-a745-7574830b08ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:10.053806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:10.059760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05905633-a7a3-42d2-a745-7574830b08ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:10.060250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05905633-a7a3-42d2-a745-7574830b08ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:10.060695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05905633-a7a3-42d2-a745-7574830b08ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:10.061405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05905633-a7a3-42d2-a745-7574830b08ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:10.061898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05905633-a7a3-42d2-a745-7574830b08ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:10.062407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05905633-a7a3-42d2-a745-7574830b08ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:10.092181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-05905633-a7a3-42d2-a745-7574830b08ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047222 Aug 18 22:00:10.092748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 404/805] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:10.257676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-423bc9f7-6fe8-46c6-b87e-6da886baf429 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:10.259754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-423bc9f7-6fe8-46c6-b87e-6da886baf429 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:10.266205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-423bc9f7-6fe8-46c6-b87e-6da886baf429 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:10.266693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-423bc9f7-6fe8-46c6-b87e-6da886baf429 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:10.267143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-423bc9f7-6fe8-46c6-b87e-6da886baf429 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:10.267841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-423bc9f7-6fe8-46c6-b87e-6da886baf429 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:10.268300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-423bc9f7-6fe8-46c6-b87e-6da886baf429 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:10.268730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-423bc9f7-6fe8-46c6-b87e-6da886baf429 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:10.297547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-423bc9f7-6fe8-46c6-b87e-6da886baf429 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043867 Aug 18 22:00:10.298139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 402/806] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:10 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:10.320341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-282f91b5-c4dd-4462-ba6f-3b112cb0410a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:10.322521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-282f91b5-c4dd-4462-ba6f-3b112cb0410a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:10.328716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-282f91b5-c4dd-4462-ba6f-3b112cb0410a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:10.329203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-282f91b5-c4dd-4462-ba6f-3b112cb0410a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:10.329669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-282f91b5-c4dd-4462-ba6f-3b112cb0410a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:10.330401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-282f91b5-c4dd-4462-ba6f-3b112cb0410a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:10.330865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-282f91b5-c4dd-4462-ba6f-3b112cb0410a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:10.331296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-282f91b5-c4dd-4462-ba6f-3b112cb0410a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:10.361668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-282f91b5-c4dd-4462-ba6f-3b112cb0410a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Aug 18 22:00:10.362227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 405/807] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:10 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:10.612321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-47d8427f-b56c-40cf-8e41-ee22ea1f606a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:10.614549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-47d8427f-b56c-40cf-8e41-ee22ea1f606a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:10.620761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d8427f-b56c-40cf-8e41-ee22ea1f606a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:10.621242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d8427f-b56c-40cf-8e41-ee22ea1f606a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:10.621709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d8427f-b56c-40cf-8e41-ee22ea1f606a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:10.622410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d8427f-b56c-40cf-8e41-ee22ea1f606a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:10.622870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d8427f-b56c-40cf-8e41-ee22ea1f606a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:10.623303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d8427f-b56c-40cf-8e41-ee22ea1f606a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:10.652655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-47d8427f-b56c-40cf-8e41-ee22ea1f606a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Aug 18 22:00:10.653219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 403/808] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:10 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:11.104439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c086a91a-9db5-48b0-bb53-731622125dad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:11.106914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c086a91a-9db5-48b0-bb53-731622125dad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:11.113170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c086a91a-9db5-48b0-bb53-731622125dad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:11.113677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c086a91a-9db5-48b0-bb53-731622125dad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:11.114118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c086a91a-9db5-48b0-bb53-731622125dad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:11.114821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c086a91a-9db5-48b0-bb53-731622125dad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:11.115279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c086a91a-9db5-48b0-bb53-731622125dad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:11.115710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c086a91a-9db5-48b0-bb53-731622125dad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:11.146061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c086a91a-9db5-48b0-bb53-731622125dad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045666 Aug 18 22:00:11.146619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 406/809] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:11.310324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6c692b37-ae8d-4911-be5c-03347c9cd153 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:11.312383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6c692b37-ae8d-4911-be5c-03347c9cd153 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:11.318798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c692b37-ae8d-4911-be5c-03347c9cd153 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:11.319282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c692b37-ae8d-4911-be5c-03347c9cd153 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:11.319724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c692b37-ae8d-4911-be5c-03347c9cd153 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:11.320414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c692b37-ae8d-4911-be5c-03347c9cd153 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:11.320873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c692b37-ae8d-4911-be5c-03347c9cd153 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:11.321312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c692b37-ae8d-4911-be5c-03347c9cd153 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:11.350571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6c692b37-ae8d-4911-be5c-03347c9cd153 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Aug 18 22:00:11.351322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 404/810] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:11.374220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52ac2b15-d237-4af3-8a6a-f287d8f135a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:11.376373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-52ac2b15-d237-4af3-8a6a-f287d8f135a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:11.382704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52ac2b15-d237-4af3-8a6a-f287d8f135a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:11.383175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52ac2b15-d237-4af3-8a6a-f287d8f135a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:11.383606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52ac2b15-d237-4af3-8a6a-f287d8f135a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:11.384286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52ac2b15-d237-4af3-8a6a-f287d8f135a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:11.384735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52ac2b15-d237-4af3-8a6a-f287d8f135a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:11.385801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52ac2b15-d237-4af3-8a6a-f287d8f135a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:11.413938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-52ac2b15-d237-4af3-8a6a-f287d8f135a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044124 Aug 18 22:00:11.414488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 407/811] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:11.664928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1a7b06fd-e748-41b0-b95b-c006e59816c1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:11.667463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1a7b06fd-e748-41b0-b95b-c006e59816c1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:11.673730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a7b06fd-e748-41b0-b95b-c006e59816c1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:11.674220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a7b06fd-e748-41b0-b95b-c006e59816c1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:11.674662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a7b06fd-e748-41b0-b95b-c006e59816c1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:11.675360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a7b06fd-e748-41b0-b95b-c006e59816c1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:11.675820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a7b06fd-e748-41b0-b95b-c006e59816c1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:11.676252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a7b06fd-e748-41b0-b95b-c006e59816c1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:11.705488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1a7b06fd-e748-41b0-b95b-c006e59816c1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Aug 18 22:00:11.706075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 405/812] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:11 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:12.158076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-510ed30c-5d12-4afd-9624-5d501882d1a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:12.160241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-510ed30c-5d12-4afd-9624-5d501882d1a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:12.167045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-510ed30c-5d12-4afd-9624-5d501882d1a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:12.167538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-510ed30c-5d12-4afd-9624-5d501882d1a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:12.167978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-510ed30c-5d12-4afd-9624-5d501882d1a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:12.168683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-510ed30c-5d12-4afd-9624-5d501882d1a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:12.169142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-510ed30c-5d12-4afd-9624-5d501882d1a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:12.169570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-510ed30c-5d12-4afd-9624-5d501882d1a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:12.200414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-510ed30c-5d12-4afd-9624-5d501882d1a6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046356 Aug 18 22:00:12.200961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 408/813] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:12 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:12.363012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bb58f9cb-5d69-422d-bb01-6fc4bf17e7a2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:12.365133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bb58f9cb-5d69-422d-bb01-6fc4bf17e7a2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:12.371496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb58f9cb-5d69-422d-bb01-6fc4bf17e7a2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:12.371912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb58f9cb-5d69-422d-bb01-6fc4bf17e7a2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:12.372343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb58f9cb-5d69-422d-bb01-6fc4bf17e7a2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:12.373023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb58f9cb-5d69-422d-bb01-6fc4bf17e7a2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:12.373473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb58f9cb-5d69-422d-bb01-6fc4bf17e7a2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:12.373925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb58f9cb-5d69-422d-bb01-6fc4bf17e7a2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:12.402780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bb58f9cb-5d69-422d-bb01-6fc4bf17e7a2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Aug 18 22:00:12.403317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 406/814] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:12 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:12.426288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c8fb7115-1348-4a04-b155-174cfed0d378 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:12.428392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c8fb7115-1348-4a04-b155-174cfed0d378 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:12.434776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8fb7115-1348-4a04-b155-174cfed0d378 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:12.435258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8fb7115-1348-4a04-b155-174cfed0d378 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:12.435694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8fb7115-1348-4a04-b155-174cfed0d378 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:12.436386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8fb7115-1348-4a04-b155-174cfed0d378 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:12.436840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8fb7115-1348-4a04-b155-174cfed0d378 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:12.437292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8fb7115-1348-4a04-b155-174cfed0d378 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:12.461880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:12.468029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c8fb7115-1348-4a04-b155-174cfed0d378 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045691 Aug 18 22:00:12.468587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 409/815] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:12 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:12.718842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-13020f69-c457-4d7b-98c2-a3c03c0d6eed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:12.720922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-13020f69-c457-4d7b-98c2-a3c03c0d6eed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:12.726829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13020f69-c457-4d7b-98c2-a3c03c0d6eed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:12.727320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13020f69-c457-4d7b-98c2-a3c03c0d6eed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:12.727762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13020f69-c457-4d7b-98c2-a3c03c0d6eed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:12.728450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13020f69-c457-4d7b-98c2-a3c03c0d6eed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:12.728898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13020f69-c457-4d7b-98c2-a3c03c0d6eed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:12.729320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13020f69-c457-4d7b-98c2-a3c03c0d6eed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:12.757456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-13020f69-c457-4d7b-98c2-a3c03c0d6eed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042715 Aug 18 22:00:12.758105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 407/816] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:12 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:13.212362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a74b7733-2dd6-4292-992a-437758c28d9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:13.214529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a74b7733-2dd6-4292-992a-437758c28d9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:13.220688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a74b7733-2dd6-4292-992a-437758c28d9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:13.221162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a74b7733-2dd6-4292-992a-437758c28d9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:13.222049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a74b7733-2dd6-4292-992a-437758c28d9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:13.222331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a74b7733-2dd6-4292-992a-437758c28d9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:13.222781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a74b7733-2dd6-4292-992a-437758c28d9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:13.223197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a74b7733-2dd6-4292-992a-437758c28d9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:13.252891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a74b7733-2dd6-4292-992a-437758c28d9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044378 Aug 18 22:00:13.253442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 410/817] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:13 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:13.414656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-be690112-0b3e-424a-af40-2b77e4de40fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:13.417382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-be690112-0b3e-424a-af40-2b77e4de40fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:13.424123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be690112-0b3e-424a-af40-2b77e4de40fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:13.424548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be690112-0b3e-424a-af40-2b77e4de40fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:13.424984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be690112-0b3e-424a-af40-2b77e4de40fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:13.425709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be690112-0b3e-424a-af40-2b77e4de40fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:13.426185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be690112-0b3e-424a-af40-2b77e4de40fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:13.426593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be690112-0b3e-424a-af40-2b77e4de40fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:13.454767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-be690112-0b3e-424a-af40-2b77e4de40fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Aug 18 22:00:13.455321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 408/818] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:13 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:13.480858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-72806b9a-240e-4593-a5bd-016ca845b102 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:13.483083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-72806b9a-240e-4593-a5bd-016ca845b102 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:13.489386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72806b9a-240e-4593-a5bd-016ca845b102 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:13.489901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72806b9a-240e-4593-a5bd-016ca845b102 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:13.490343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72806b9a-240e-4593-a5bd-016ca845b102 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:13.491060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72806b9a-240e-4593-a5bd-016ca845b102 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:13.491514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72806b9a-240e-4593-a5bd-016ca845b102 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:13.491943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72806b9a-240e-4593-a5bd-016ca845b102 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:13.520251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-72806b9a-240e-4593-a5bd-016ca845b102 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043969 Aug 18 22:00:13.520809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 411/819] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:13.770348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-330ceb70-1af9-470d-b64e-a78d7ef9c7c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:13.772460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-330ceb70-1af9-470d-b64e-a78d7ef9c7c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:13.779039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-330ceb70-1af9-470d-b64e-a78d7ef9c7c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:13.779518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-330ceb70-1af9-470d-b64e-a78d7ef9c7c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:13.779952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-330ceb70-1af9-470d-b64e-a78d7ef9c7c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:13.780640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-330ceb70-1af9-470d-b64e-a78d7ef9c7c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:13.781090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-330ceb70-1af9-470d-b64e-a78d7ef9c7c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:13.781509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-330ceb70-1af9-470d-b64e-a78d7ef9c7c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:13.805488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:13.811005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-330ceb70-1af9-470d-b64e-a78d7ef9c7c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044607 Aug 18 22:00:13.811565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 409/820] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:13 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:14.265676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a3324741-cf66-4331-823a-9e100ffa2cb5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:14.267942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a3324741-cf66-4331-823a-9e100ffa2cb5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:14.278278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3324741-cf66-4331-823a-9e100ffa2cb5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:14.278278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3324741-cf66-4331-823a-9e100ffa2cb5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:14.278278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3324741-cf66-4331-823a-9e100ffa2cb5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:14.278278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3324741-cf66-4331-823a-9e100ffa2cb5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:14.278581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3324741-cf66-4331-823a-9e100ffa2cb5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:14.278581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3324741-cf66-4331-823a-9e100ffa2cb5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:14.306316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a3324741-cf66-4331-823a-9e100ffa2cb5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044532 Aug 18 22:00:14.306869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 412/821] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:14.466486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4ccd0699-c062-4558-af60-9c7ae658ef2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:14.468526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4ccd0699-c062-4558-af60-9c7ae658ef2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:14.474929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccd0699-c062-4558-af60-9c7ae658ef2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:14.475421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccd0699-c062-4558-af60-9c7ae658ef2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:14.475867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccd0699-c062-4558-af60-9c7ae658ef2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:14.476566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccd0699-c062-4558-af60-9c7ae658ef2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:14.477027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccd0699-c062-4558-af60-9c7ae658ef2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:14.477458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccd0699-c062-4558-af60-9c7ae658ef2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:14.506354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4ccd0699-c062-4558-af60-9c7ae658ef2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 Aug 18 22:00:14.506913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 410/822] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:14.532275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e48b3eaf-9fbb-49ff-aa9c-8612a260ab39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:14.534492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e48b3eaf-9fbb-49ff-aa9c-8612a260ab39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:14.540749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e48b3eaf-9fbb-49ff-aa9c-8612a260ab39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:14.541229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e48b3eaf-9fbb-49ff-aa9c-8612a260ab39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:14.542175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e48b3eaf-9fbb-49ff-aa9c-8612a260ab39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:14.542862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e48b3eaf-9fbb-49ff-aa9c-8612a260ab39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:14.543316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e48b3eaf-9fbb-49ff-aa9c-8612a260ab39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:14.543751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e48b3eaf-9fbb-49ff-aa9c-8612a260ab39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:14.573002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e48b3eaf-9fbb-49ff-aa9c-8612a260ab39 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Aug 18 22:00:14.573552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 413/823] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:14.823616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f35e80d4-1dbe-4290-a5c0-c2a79c30ec1d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:14.825816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f35e80d4-1dbe-4290-a5c0-c2a79c30ec1d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:14.831649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f35e80d4-1dbe-4290-a5c0-c2a79c30ec1d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:14.832140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f35e80d4-1dbe-4290-a5c0-c2a79c30ec1d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:14.832578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f35e80d4-1dbe-4290-a5c0-c2a79c30ec1d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:14.833261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f35e80d4-1dbe-4290-a5c0-c2a79c30ec1d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:14.833743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f35e80d4-1dbe-4290-a5c0-c2a79c30ec1d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:14.834169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f35e80d4-1dbe-4290-a5c0-c2a79c30ec1d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:14.863305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f35e80d4-1dbe-4290-a5c0-c2a79c30ec1d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Aug 18 22:00:14.863864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 411/824] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:14 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:15.318534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fda53d03-4e72-4338-b4ec-327b5eb062eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:15.320784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fda53d03-4e72-4338-b4ec-327b5eb062eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:15.327263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fda53d03-4e72-4338-b4ec-327b5eb062eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:15.327651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fda53d03-4e72-4338-b4ec-327b5eb062eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:15.328085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fda53d03-4e72-4338-b4ec-327b5eb062eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:15.328775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fda53d03-4e72-4338-b4ec-327b5eb062eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:15.329232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fda53d03-4e72-4338-b4ec-327b5eb062eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:15.329682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fda53d03-4e72-4338-b4ec-327b5eb062eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:15.359790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fda53d03-4e72-4338-b4ec-327b5eb062eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045387 Aug 18 22:00:15.360340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 414/825] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:15.518580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9c04e1a9-5814-4138-8f86-f3aee30efdd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:15.520697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9c04e1a9-5814-4138-8f86-f3aee30efdd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:15.527693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c04e1a9-5814-4138-8f86-f3aee30efdd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:15.528178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c04e1a9-5814-4138-8f86-f3aee30efdd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:15.528616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c04e1a9-5814-4138-8f86-f3aee30efdd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:15.529314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c04e1a9-5814-4138-8f86-f3aee30efdd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:15.529808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c04e1a9-5814-4138-8f86-f3aee30efdd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:15.530242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c04e1a9-5814-4138-8f86-f3aee30efdd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:15.558855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9c04e1a9-5814-4138-8f86-f3aee30efdd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 Aug 18 22:00:15.559340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 412/826] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:15 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:15.584299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ef809330-79ec-40f3-802f-f158cd58b397 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:15.586445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ef809330-79ec-40f3-802f-f158cd58b397 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:15.592930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef809330-79ec-40f3-802f-f158cd58b397 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:15.593408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef809330-79ec-40f3-802f-f158cd58b397 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:15.593873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef809330-79ec-40f3-802f-f158cd58b397 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:15.594559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef809330-79ec-40f3-802f-f158cd58b397 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:15.595039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef809330-79ec-40f3-802f-f158cd58b397 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:15.595462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef809330-79ec-40f3-802f-f158cd58b397 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:15.625271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ef809330-79ec-40f3-802f-f158cd58b397 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044878 Aug 18 22:00:15.625853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 415/827] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:15 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:15.875625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-793dabc3-5601-4682-b941-a0f4145bf9fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:15.877661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-793dabc3-5601-4682-b941-a0f4145bf9fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:15.883532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-793dabc3-5601-4682-b941-a0f4145bf9fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:15.884006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-793dabc3-5601-4682-b941-a0f4145bf9fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:15.884437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-793dabc3-5601-4682-b941-a0f4145bf9fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:15.885771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-793dabc3-5601-4682-b941-a0f4145bf9fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:15.886227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-793dabc3-5601-4682-b941-a0f4145bf9fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:15.886648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-793dabc3-5601-4682-b941-a0f4145bf9fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:15.914486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-793dabc3-5601-4682-b941-a0f4145bf9fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042845 Aug 18 22:00:15.915028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 413/828] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:15 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:16.372893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-19654595-5a2e-4837-9c67-6ec7ad712cf8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:16.375057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-19654595-5a2e-4837-9c67-6ec7ad712cf8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:16.380926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19654595-5a2e-4837-9c67-6ec7ad712cf8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:16.381405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19654595-5a2e-4837-9c67-6ec7ad712cf8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:16.381872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19654595-5a2e-4837-9c67-6ec7ad712cf8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:16.382573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19654595-5a2e-4837-9c67-6ec7ad712cf8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:16.383029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19654595-5a2e-4837-9c67-6ec7ad712cf8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:16.383452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19654595-5a2e-4837-9c67-6ec7ad712cf8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:16.423681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-19654595-5a2e-4837-9c67-6ec7ad712cf8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055857 Aug 18 22:00:16.424236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 416/829] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:16.570506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dafd9c21-a8c7-4db2-9e80-fe5b70686a30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:16.572606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dafd9c21-a8c7-4db2-9e80-fe5b70686a30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:16.579062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dafd9c21-a8c7-4db2-9e80-fe5b70686a30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:16.579548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dafd9c21-a8c7-4db2-9e80-fe5b70686a30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:16.579987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dafd9c21-a8c7-4db2-9e80-fe5b70686a30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:16.580778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dafd9c21-a8c7-4db2-9e80-fe5b70686a30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:16.581245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dafd9c21-a8c7-4db2-9e80-fe5b70686a30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:16.581697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dafd9c21-a8c7-4db2-9e80-fe5b70686a30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:16.610611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dafd9c21-a8c7-4db2-9e80-fe5b70686a30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043895 Aug 18 22:00:16.611098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 414/830] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:16.637507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c378a53-420d-4792-a7d8-e732eed95989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:16.639753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c378a53-420d-4792-a7d8-e732eed95989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:16.645657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c378a53-420d-4792-a7d8-e732eed95989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:16.646147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c378a53-420d-4792-a7d8-e732eed95989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:16.646591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c378a53-420d-4792-a7d8-e732eed95989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:16.647289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c378a53-420d-4792-a7d8-e732eed95989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:16.647753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c378a53-420d-4792-a7d8-e732eed95989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:16.648182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c378a53-420d-4792-a7d8-e732eed95989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:16.680304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c378a53-420d-4792-a7d8-e732eed95989 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046808 Aug 18 22:00:16.680883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 417/831] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:16 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:16.926974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c7614926-d03d-4391-b03f-78750a3ac153 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:16.928988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c7614926-d03d-4391-b03f-78750a3ac153 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:16.935380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7614926-d03d-4391-b03f-78750a3ac153 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:16.935862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7614926-d03d-4391-b03f-78750a3ac153 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:16.936295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7614926-d03d-4391-b03f-78750a3ac153 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:16.936981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7614926-d03d-4391-b03f-78750a3ac153 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:16.937430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7614926-d03d-4391-b03f-78750a3ac153 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:16.937875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7614926-d03d-4391-b03f-78750a3ac153 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:16.969079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c7614926-d03d-4391-b03f-78750a3ac153 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046037 Aug 18 22:00:16.969657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 415/832] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:16 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:17.436584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-531277b3-d3c9-4775-9ac4-41b0fe59b7b8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:17.438733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-531277b3-d3c9-4775-9ac4-41b0fe59b7b8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:17.445016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-531277b3-d3c9-4775-9ac4-41b0fe59b7b8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:17.445496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-531277b3-d3c9-4775-9ac4-41b0fe59b7b8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:17.445958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-531277b3-d3c9-4775-9ac4-41b0fe59b7b8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:17.446641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-531277b3-d3c9-4775-9ac4-41b0fe59b7b8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:17.447079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-531277b3-d3c9-4775-9ac4-41b0fe59b7b8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:17.447495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-531277b3-d3c9-4775-9ac4-41b0fe59b7b8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:17.477905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-531277b3-d3c9-4775-9ac4-41b0fe59b7b8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045626 Aug 18 22:00:17.478637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 418/833] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:17.622914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-baaac124-4a4e-4443-9833-a54a1b9a936e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:17.625086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-baaac124-4a4e-4443-9833-a54a1b9a936e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:17.631708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baaac124-4a4e-4443-9833-a54a1b9a936e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:17.632196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baaac124-4a4e-4443-9833-a54a1b9a936e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:17.632641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baaac124-4a4e-4443-9833-a54a1b9a936e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:17.633341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baaac124-4a4e-4443-9833-a54a1b9a936e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:17.633827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baaac124-4a4e-4443-9833-a54a1b9a936e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:17.634261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baaac124-4a4e-4443-9833-a54a1b9a936e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:17.662272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-baaac124-4a4e-4443-9833-a54a1b9a936e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043860 Aug 18 22:00:17.662759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 416/834] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:17.692901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-051c592c-e375-416c-9cca-a6e0b0712c79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:17.695068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-051c592c-e375-416c-9cca-a6e0b0712c79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:17.700967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-051c592c-e375-416c-9cca-a6e0b0712c79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:17.701462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-051c592c-e375-416c-9cca-a6e0b0712c79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:17.701950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-051c592c-e375-416c-9cca-a6e0b0712c79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:17.702648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-051c592c-e375-416c-9cca-a6e0b0712c79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:17.703115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-051c592c-e375-416c-9cca-a6e0b0712c79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:17.703547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-051c592c-e375-416c-9cca-a6e0b0712c79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:17.732675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-051c592c-e375-416c-9cca-a6e0b0712c79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043736 Aug 18 22:00:17.733236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 419/835] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:17 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:17.981952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0bfd3f44-b227-4f4b-a32c-4fbf16eb08e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:17.983968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0bfd3f44-b227-4f4b-a32c-4fbf16eb08e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:17.989968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bfd3f44-b227-4f4b-a32c-4fbf16eb08e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:17.990450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bfd3f44-b227-4f4b-a32c-4fbf16eb08e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:17.990885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bfd3f44-b227-4f4b-a32c-4fbf16eb08e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:17.991602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bfd3f44-b227-4f4b-a32c-4fbf16eb08e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:17.992056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bfd3f44-b227-4f4b-a32c-4fbf16eb08e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:17.992479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bfd3f44-b227-4f4b-a32c-4fbf16eb08e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:18.020658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0bfd3f44-b227-4f4b-a32c-4fbf16eb08e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043418 Aug 18 22:00:18.021214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 417/836] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:17 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:18.491224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2544f87a-4262-487d-b4b8-c53a86335ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:18.493483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2544f87a-4262-487d-b4b8-c53a86335ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:18.499608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2544f87a-4262-487d-b4b8-c53a86335ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:18.500091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2544f87a-4262-487d-b4b8-c53a86335ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:18.500534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2544f87a-4262-487d-b4b8-c53a86335ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:18.501304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2544f87a-4262-487d-b4b8-c53a86335ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:18.501898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2544f87a-4262-487d-b4b8-c53a86335ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:18.502230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2544f87a-4262-487d-b4b8-c53a86335ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:18.533042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2544f87a-4262-487d-b4b8-c53a86335ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045719 Aug 18 22:00:18.533619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 420/837] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:18 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:18.674828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-403abf15-f308-4103-b407-a45e7386c471 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:18.676998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-403abf15-f308-4103-b407-a45e7386c471 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:18.683917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-403abf15-f308-4103-b407-a45e7386c471 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:18.684395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-403abf15-f308-4103-b407-a45e7386c471 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:18.684829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-403abf15-f308-4103-b407-a45e7386c471 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:18.685524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-403abf15-f308-4103-b407-a45e7386c471 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:18.686003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-403abf15-f308-4103-b407-a45e7386c471 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:18.686446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-403abf15-f308-4103-b407-a45e7386c471 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:18.717150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-403abf15-f308-4103-b407-a45e7386c471 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046367 Aug 18 22:00:18.717649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 418/838] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:18.744313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b603384b-6dd3-4eab-a33d-264494284cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:18.746998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b603384b-6dd3-4eab-a33d-264494284cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:18.752787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b603384b-6dd3-4eab-a33d-264494284cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:18.753268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b603384b-6dd3-4eab-a33d-264494284cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:18.753739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b603384b-6dd3-4eab-a33d-264494284cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:18.754434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b603384b-6dd3-4eab-a33d-264494284cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:18.754888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b603384b-6dd3-4eab-a33d-264494284cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:18.755313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b603384b-6dd3-4eab-a33d-264494284cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:18.783881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b603384b-6dd3-4eab-a33d-264494284cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043512 Aug 18 22:00:18.784431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 421/839] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:18 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:19.034767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-488c6b3b-5f93-4007-9256-0863c8c65bc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:19.036328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-488c6b3b-5f93-4007-9256-0863c8c65bc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:19.042416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-488c6b3b-5f93-4007-9256-0863c8c65bc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:19.043350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-488c6b3b-5f93-4007-9256-0863c8c65bc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:19.043791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-488c6b3b-5f93-4007-9256-0863c8c65bc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:19.044482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-488c6b3b-5f93-4007-9256-0863c8c65bc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:19.044942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-488c6b3b-5f93-4007-9256-0863c8c65bc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:19.045363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-488c6b3b-5f93-4007-9256-0863c8c65bc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:19.074874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-488c6b3b-5f93-4007-9256-0863c8c65bc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045601 Aug 18 22:00:19.075437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 419/840] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:19 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:19.545451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2c47490d-c82a-44b7-aeb1-fffc5df3071b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:19.548036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2c47490d-c82a-44b7-aeb1-fffc5df3071b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:19.554877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c47490d-c82a-44b7-aeb1-fffc5df3071b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:19.555354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c47490d-c82a-44b7-aeb1-fffc5df3071b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:19.555785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c47490d-c82a-44b7-aeb1-fffc5df3071b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:19.556658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c47490d-c82a-44b7-aeb1-fffc5df3071b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:19.557351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c47490d-c82a-44b7-aeb1-fffc5df3071b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:19.557351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c47490d-c82a-44b7-aeb1-fffc5df3071b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:19.596232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2c47490d-c82a-44b7-aeb1-fffc5df3071b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055362 Aug 18 22:00:19.596841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 422/841] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:19.728880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3a0b27be-9d70-47bf-b26a-9701b6ed13ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:19.731169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3a0b27be-9d70-47bf-b26a-9701b6ed13ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:19.737461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a0b27be-9d70-47bf-b26a-9701b6ed13ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:19.737989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a0b27be-9d70-47bf-b26a-9701b6ed13ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:19.738494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a0b27be-9d70-47bf-b26a-9701b6ed13ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:19.739196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a0b27be-9d70-47bf-b26a-9701b6ed13ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:19.739679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a0b27be-9d70-47bf-b26a-9701b6ed13ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:19.740106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a0b27be-9d70-47bf-b26a-9701b6ed13ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:19.768900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3a0b27be-9d70-47bf-b26a-9701b6ed13ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Aug 18 22:00:19.769389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 420/842] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:19 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:19.796347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-14135966-6fef-44c3-afc7-9117adc7254a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:19.798515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-14135966-6fef-44c3-afc7-9117adc7254a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:19.804480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14135966-6fef-44c3-afc7-9117adc7254a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:19.804964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14135966-6fef-44c3-afc7-9117adc7254a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:19.805398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14135966-6fef-44c3-afc7-9117adc7254a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:19.806124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14135966-6fef-44c3-afc7-9117adc7254a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:19.806577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14135966-6fef-44c3-afc7-9117adc7254a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:19.807004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14135966-6fef-44c3-afc7-9117adc7254a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:19.836379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-14135966-6fef-44c3-afc7-9117adc7254a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Aug 18 22:00:19.837252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 423/843] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:19 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:20.088503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dd7c8266-e9e1-42fb-895a-607388b67b8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:20.090687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dd7c8266-e9e1-42fb-895a-607388b67b8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:20.096901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd7c8266-e9e1-42fb-895a-607388b67b8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:20.097399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd7c8266-e9e1-42fb-895a-607388b67b8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:20.097971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd7c8266-e9e1-42fb-895a-607388b67b8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:20.098787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd7c8266-e9e1-42fb-895a-607388b67b8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:20.099293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd7c8266-e9e1-42fb-895a-607388b67b8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:20.099932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd7c8266-e9e1-42fb-895a-607388b67b8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:20.129883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dd7c8266-e9e1-42fb-895a-607388b67b8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045334 Aug 18 22:00:20.130447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 421/844] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:20 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:20.610580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-be707301-e391-4816-8efb-d17c5603dda4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:20.612823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-be707301-e391-4816-8efb-d17c5603dda4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:20.619170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be707301-e391-4816-8efb-d17c5603dda4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:20.619665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be707301-e391-4816-8efb-d17c5603dda4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:20.620106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be707301-e391-4816-8efb-d17c5603dda4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:20.620928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be707301-e391-4816-8efb-d17c5603dda4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:20.621408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be707301-e391-4816-8efb-d17c5603dda4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:20.621880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be707301-e391-4816-8efb-d17c5603dda4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:20.659438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-be707301-e391-4816-8efb-d17c5603dda4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052656 Aug 18 22:00:20.660040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 424/845] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:20 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:20.780981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a1a4778a-930e-4795-9929-895865be84f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:20.783231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a1a4778a-930e-4795-9929-895865be84f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:20.789582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1a4778a-930e-4795-9929-895865be84f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:20.790090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1a4778a-930e-4795-9929-895865be84f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:20.790529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1a4778a-930e-4795-9929-895865be84f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:20.791212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1a4778a-930e-4795-9929-895865be84f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:20.791667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1a4778a-930e-4795-9929-895865be84f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:20.792096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1a4778a-930e-4795-9929-895865be84f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:20.820757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a1a4778a-930e-4795-9929-895865be84f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044330 Aug 18 22:00:20.821305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 422/846] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:20 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:20.848784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-05a83288-3819-421d-adaa-0acda598629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:20.850887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-05a83288-3819-421d-adaa-0acda598629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:20.857380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05a83288-3819-421d-adaa-0acda598629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:20.857876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05a83288-3819-421d-adaa-0acda598629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:20.858308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05a83288-3819-421d-adaa-0acda598629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:20.858992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05a83288-3819-421d-adaa-0acda598629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:20.859439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05a83288-3819-421d-adaa-0acda598629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:20.859860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05a83288-3819-421d-adaa-0acda598629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:20.887901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-05a83288-3819-421d-adaa-0acda598629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043067 Aug 18 22:00:20.888441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 425/847] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:21.142575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-430b20f8-c1e7-4c07-8255-ebe721024dac tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:21.144600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-430b20f8-c1e7-4c07-8255-ebe721024dac tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:21.150507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-430b20f8-c1e7-4c07-8255-ebe721024dac tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:21.150981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-430b20f8-c1e7-4c07-8255-ebe721024dac tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:21.151410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-430b20f8-c1e7-4c07-8255-ebe721024dac tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:21.152636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-430b20f8-c1e7-4c07-8255-ebe721024dac tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:21.153090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-430b20f8-c1e7-4c07-8255-ebe721024dac tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:21.153507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-430b20f8-c1e7-4c07-8255-ebe721024dac tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:21.182124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-430b20f8-c1e7-4c07-8255-ebe721024dac tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Aug 18 22:00:21.182666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 423/848] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:21 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:21.672326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a631b36e-a93f-4d80-b39b-7695e70c000c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:21.674552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a631b36e-a93f-4d80-b39b-7695e70c000c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:21.681179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a631b36e-a93f-4d80-b39b-7695e70c000c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:21.681679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a631b36e-a93f-4d80-b39b-7695e70c000c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:21.682131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a631b36e-a93f-4d80-b39b-7695e70c000c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:21.682813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a631b36e-a93f-4d80-b39b-7695e70c000c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:21.683265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a631b36e-a93f-4d80-b39b-7695e70c000c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:21.684169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a631b36e-a93f-4d80-b39b-7695e70c000c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:21.698031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:21.717232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a631b36e-a93f-4d80-b39b-7695e70c000c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046470 Aug 18 22:00:21.717232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 426/849] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:21.832575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-93d66e6c-422c-4c6c-9a95-cf1cfb7cc531 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:21.834853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-93d66e6c-422c-4c6c-9a95-cf1cfb7cc531 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:21.841288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93d66e6c-422c-4c6c-9a95-cf1cfb7cc531 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:21.841812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93d66e6c-422c-4c6c-9a95-cf1cfb7cc531 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:21.842258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93d66e6c-422c-4c6c-9a95-cf1cfb7cc531 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:21.842957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93d66e6c-422c-4c6c-9a95-cf1cfb7cc531 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:21.843796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93d66e6c-422c-4c6c-9a95-cf1cfb7cc531 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:21.844229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93d66e6c-422c-4c6c-9a95-cf1cfb7cc531 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:21.872852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-93d66e6c-422c-4c6c-9a95-cf1cfb7cc531 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Aug 18 22:00:21.873416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 424/850] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:21 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:21.899994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-61401bfe-5f3d-4166-a76a-468bd0df7d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:21.902246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-61401bfe-5f3d-4166-a76a-468bd0df7d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:21.908266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61401bfe-5f3d-4166-a76a-468bd0df7d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:21.908745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61401bfe-5f3d-4166-a76a-468bd0df7d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:21.909182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61401bfe-5f3d-4166-a76a-468bd0df7d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:21.909900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61401bfe-5f3d-4166-a76a-468bd0df7d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:21.910358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61401bfe-5f3d-4166-a76a-468bd0df7d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:21.910847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61401bfe-5f3d-4166-a76a-468bd0df7d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:21.940917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-61401bfe-5f3d-4166-a76a-468bd0df7d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 Aug 18 22:00:21.941696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 427/851] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:22.194133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c83dc5ae-528e-4734-9ab2-32cc5c5c93fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:22.196165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c83dc5ae-528e-4734-9ab2-32cc5c5c93fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:22.202038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c83dc5ae-528e-4734-9ab2-32cc5c5c93fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:22.202586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c83dc5ae-528e-4734-9ab2-32cc5c5c93fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:22.203021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c83dc5ae-528e-4734-9ab2-32cc5c5c93fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:22.203704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c83dc5ae-528e-4734-9ab2-32cc5c5c93fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:22.204153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c83dc5ae-528e-4734-9ab2-32cc5c5c93fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:22.204572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c83dc5ae-528e-4734-9ab2-32cc5c5c93fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:22.232994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c83dc5ae-528e-4734-9ab2-32cc5c5c93fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042877 Aug 18 22:00:22.233540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 425/852] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:22.728607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-07be48af-0d9a-4179-acd3-72b5b3962072 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:22.730717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-07be48af-0d9a-4179-acd3-72b5b3962072 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:22.736975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07be48af-0d9a-4179-acd3-72b5b3962072 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:22.737452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07be48af-0d9a-4179-acd3-72b5b3962072 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:22.737905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07be48af-0d9a-4179-acd3-72b5b3962072 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:22.738606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07be48af-0d9a-4179-acd3-72b5b3962072 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:22.739071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07be48af-0d9a-4179-acd3-72b5b3962072 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:22.739479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07be48af-0d9a-4179-acd3-72b5b3962072 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:22.769107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-07be48af-0d9a-4179-acd3-72b5b3962072 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045170 Aug 18 22:00:22.773806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 428/853] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:22.884894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7242fff-8e32-4fbe-81c4-b2230a19f891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:22.887037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f7242fff-8e32-4fbe-81c4-b2230a19f891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:22.893942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7242fff-8e32-4fbe-81c4-b2230a19f891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:22.894424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7242fff-8e32-4fbe-81c4-b2230a19f891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:22.894860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7242fff-8e32-4fbe-81c4-b2230a19f891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:22.895550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7242fff-8e32-4fbe-81c4-b2230a19f891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:22.896005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7242fff-8e32-4fbe-81c4-b2230a19f891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:22.896430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7242fff-8e32-4fbe-81c4-b2230a19f891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:22.913121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:22.926042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f7242fff-8e32-4fbe-81c4-b2230a19f891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045044 Aug 18 22:00:22.926591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 426/854] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:22 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:22.953083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a5d2d832-ccef-4f1f-9e36-b1642fe3a6b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:22.955878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a5d2d832-ccef-4f1f-9e36-b1642fe3a6b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:22.961789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5d2d832-ccef-4f1f-9e36-b1642fe3a6b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:22.962280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5d2d832-ccef-4f1f-9e36-b1642fe3a6b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:22.962740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5d2d832-ccef-4f1f-9e36-b1642fe3a6b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:22.963423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5d2d832-ccef-4f1f-9e36-b1642fe3a6b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:22.963884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5d2d832-ccef-4f1f-9e36-b1642fe3a6b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:22.964315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5d2d832-ccef-4f1f-9e36-b1642fe3a6b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:22.992962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a5d2d832-ccef-4f1f-9e36-b1642fe3a6b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043786 Aug 18 22:00:22.993457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 429/855] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:22 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:23.245038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1b3e47fc-c45b-47e3-af73-5e502fe07d28 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:23.247133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1b3e47fc-c45b-47e3-af73-5e502fe07d28 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:23.253512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b3e47fc-c45b-47e3-af73-5e502fe07d28 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:23.254112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b3e47fc-c45b-47e3-af73-5e502fe07d28 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:23.254544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b3e47fc-c45b-47e3-af73-5e502fe07d28 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:23.255227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b3e47fc-c45b-47e3-af73-5e502fe07d28 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:23.255675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b3e47fc-c45b-47e3-af73-5e502fe07d28 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:23.256099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b3e47fc-c45b-47e3-af73-5e502fe07d28 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:23.284776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1b3e47fc-c45b-47e3-af73-5e502fe07d28 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Aug 18 22:00:23.285327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 427/856] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:23 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:23.781616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ffdb8ad7-5cf7-4735-a025-9ca23a4d039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:23.784304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ffdb8ad7-5cf7-4735-a025-9ca23a4d039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:23.790804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffdb8ad7-5cf7-4735-a025-9ca23a4d039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:23.791289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffdb8ad7-5cf7-4735-a025-9ca23a4d039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:23.791729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffdb8ad7-5cf7-4735-a025-9ca23a4d039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:23.792457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffdb8ad7-5cf7-4735-a025-9ca23a4d039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:23.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffdb8ad7-5cf7-4735-a025-9ca23a4d039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:23.793415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffdb8ad7-5cf7-4735-a025-9ca23a4d039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:23.822904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ffdb8ad7-5cf7-4735-a025-9ca23a4d039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045488 Aug 18 22:00:23.823699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 430/857] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:23.938086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fa0272d2-fa2a-48d8-a673-2073a0f9ef2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:23.940223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fa0272d2-fa2a-48d8-a673-2073a0f9ef2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:23.946532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa0272d2-fa2a-48d8-a673-2073a0f9ef2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:23.947011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa0272d2-fa2a-48d8-a673-2073a0f9ef2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:23.947445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa0272d2-fa2a-48d8-a673-2073a0f9ef2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:23.948134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa0272d2-fa2a-48d8-a673-2073a0f9ef2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:23.948583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa0272d2-fa2a-48d8-a673-2073a0f9ef2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:23.949006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa0272d2-fa2a-48d8-a673-2073a0f9ef2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:23.977942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fa0272d2-fa2a-48d8-a673-2073a0f9ef2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043571 Aug 18 22:00:23.978434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 428/858] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:23 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:24.004922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-76ca2dc6-faed-4933-9f74-09fbc28529ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:24.007086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-76ca2dc6-faed-4933-9f74-09fbc28529ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:24.012965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ca2dc6-faed-4933-9f74-09fbc28529ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:24.013455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ca2dc6-faed-4933-9f74-09fbc28529ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:24.013942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ca2dc6-faed-4933-9f74-09fbc28529ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:24.014650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ca2dc6-faed-4933-9f74-09fbc28529ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:24.015110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ca2dc6-faed-4933-9f74-09fbc28529ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:24.015542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ca2dc6-faed-4933-9f74-09fbc28529ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:24.044578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-76ca2dc6-faed-4933-9f74-09fbc28529ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043532 Aug 18 22:00:24.045142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 431/859] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:23 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:24.297256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-398f75b6-ef05-4f15-80bb-3dd8304795cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:24.299952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-398f75b6-ef05-4f15-80bb-3dd8304795cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:24.305885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-398f75b6-ef05-4f15-80bb-3dd8304795cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:24.306371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-398f75b6-ef05-4f15-80bb-3dd8304795cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:24.306813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-398f75b6-ef05-4f15-80bb-3dd8304795cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:24.307519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-398f75b6-ef05-4f15-80bb-3dd8304795cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:24.307974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-398f75b6-ef05-4f15-80bb-3dd8304795cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:24.308402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-398f75b6-ef05-4f15-80bb-3dd8304795cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:24.338333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-398f75b6-ef05-4f15-80bb-3dd8304795cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045230 Aug 18 22:00:24.338902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 429/860] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:24 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:24.835694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ff435c07-44c2-41d7-9f5c-eedf23404fcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:24.837941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ff435c07-44c2-41d7-9f5c-eedf23404fcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:24.844441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff435c07-44c2-41d7-9f5c-eedf23404fcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:24.844942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff435c07-44c2-41d7-9f5c-eedf23404fcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:24.846001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff435c07-44c2-41d7-9f5c-eedf23404fcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:24.847076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff435c07-44c2-41d7-9f5c-eedf23404fcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:24.847573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff435c07-44c2-41d7-9f5c-eedf23404fcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:24.848007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff435c07-44c2-41d7-9f5c-eedf23404fcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:24.878311 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ff435c07-44c2-41d7-9f5c-eedf23404fcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046937 Aug 18 22:00:24.879075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 432/861] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:24 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:24.990383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-207ac510-1531-4402-86df-836dd4db484e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:24.992447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-207ac510-1531-4402-86df-836dd4db484e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:24.998887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-207ac510-1531-4402-86df-836dd4db484e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:24.999376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-207ac510-1531-4402-86df-836dd4db484e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:24.999818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-207ac510-1531-4402-86df-836dd4db484e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:25.000512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-207ac510-1531-4402-86df-836dd4db484e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:25.000963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-207ac510-1531-4402-86df-836dd4db484e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:25.001395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-207ac510-1531-4402-86df-836dd4db484e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:25.030981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-207ac510-1531-4402-86df-836dd4db484e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044616 Aug 18 22:00:25.031537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 430/862] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:25.057774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7b3f5fcf-8ffc-40fc-88a6-e2f7ffe6e2b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:25.059918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7b3f5fcf-8ffc-40fc-88a6-e2f7ffe6e2b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:25.065852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b3f5fcf-8ffc-40fc-88a6-e2f7ffe6e2b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:25.066340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b3f5fcf-8ffc-40fc-88a6-e2f7ffe6e2b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:25.066779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b3f5fcf-8ffc-40fc-88a6-e2f7ffe6e2b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:25.067478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b3f5fcf-8ffc-40fc-88a6-e2f7ffe6e2b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:25.067935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b3f5fcf-8ffc-40fc-88a6-e2f7ffe6e2b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:25.068362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b3f5fcf-8ffc-40fc-88a6-e2f7ffe6e2b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:25.097828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7b3f5fcf-8ffc-40fc-88a6-e2f7ffe6e2b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043884 Aug 18 22:00:25.098381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 433/863] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:25 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:25.351544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c21ea47a-5cf7-4018-9c5e-45b905594f49 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:25.354107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c21ea47a-5cf7-4018-9c5e-45b905594f49 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:25.360101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c21ea47a-5cf7-4018-9c5e-45b905594f49 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:25.360590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c21ea47a-5cf7-4018-9c5e-45b905594f49 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:25.361147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c21ea47a-5cf7-4018-9c5e-45b905594f49 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:25.361882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c21ea47a-5cf7-4018-9c5e-45b905594f49 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:25.362347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c21ea47a-5cf7-4018-9c5e-45b905594f49 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:25.362772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c21ea47a-5cf7-4018-9c5e-45b905594f49 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:25.391375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c21ea47a-5cf7-4018-9c5e-45b905594f49 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044333 Aug 18 22:00:25.391932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 431/864] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:25.890781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-70c56461-df51-4841-84d8-d0c0ad9711b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:25.892885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-70c56461-df51-4841-84d8-d0c0ad9711b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:25.899532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70c56461-df51-4841-84d8-d0c0ad9711b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:25.900017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70c56461-df51-4841-84d8-d0c0ad9711b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:25.900451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70c56461-df51-4841-84d8-d0c0ad9711b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:25.901142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70c56461-df51-4841-84d8-d0c0ad9711b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:25.901611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70c56461-df51-4841-84d8-d0c0ad9711b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:25.902044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70c56461-df51-4841-84d8-d0c0ad9711b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:25.933105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-70c56461-df51-4841-84d8-d0c0ad9711b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046357 Aug 18 22:00:25.933696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 434/865] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:25 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:26.044135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-12888f8d-5daf-45ab-abb1-93f7482dad3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:26.046546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-12888f8d-5daf-45ab-abb1-93f7482dad3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:26.053540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12888f8d-5daf-45ab-abb1-93f7482dad3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:26.054058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12888f8d-5daf-45ab-abb1-93f7482dad3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:26.054499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12888f8d-5daf-45ab-abb1-93f7482dad3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:26.055203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12888f8d-5daf-45ab-abb1-93f7482dad3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:26.055663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12888f8d-5daf-45ab-abb1-93f7482dad3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:26.056093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12888f8d-5daf-45ab-abb1-93f7482dad3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:26.084081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-12888f8d-5daf-45ab-abb1-93f7482dad3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Aug 18 22:00:26.084633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 432/866] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:26 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:26.109936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1c29f94a-5f76-49e0-bb80-cae04b6d319c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:26.112764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1c29f94a-5f76-49e0-bb80-cae04b6d319c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:26.118650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c29f94a-5f76-49e0-bb80-cae04b6d319c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:26.119157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c29f94a-5f76-49e0-bb80-cae04b6d319c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:26.119594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c29f94a-5f76-49e0-bb80-cae04b6d319c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:26.120285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c29f94a-5f76-49e0-bb80-cae04b6d319c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:26.120744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c29f94a-5f76-49e0-bb80-cae04b6d319c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:26.121167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c29f94a-5f76-49e0-bb80-cae04b6d319c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:26.150240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1c29f94a-5f76-49e0-bb80-cae04b6d319c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Aug 18 22:00:26.150735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 435/867] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:26 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:26.404251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2fd9e5fc-8bec-4e10-83f9-19461da5aae7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:26.406325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2fd9e5fc-8bec-4e10-83f9-19461da5aae7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:26.412852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fd9e5fc-8bec-4e10-83f9-19461da5aae7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:26.413331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fd9e5fc-8bec-4e10-83f9-19461da5aae7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:26.413806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fd9e5fc-8bec-4e10-83f9-19461da5aae7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:26.414490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fd9e5fc-8bec-4e10-83f9-19461da5aae7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:26.414940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fd9e5fc-8bec-4e10-83f9-19461da5aae7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:26.415355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fd9e5fc-8bec-4e10-83f9-19461da5aae7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:26.443766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2fd9e5fc-8bec-4e10-83f9-19461da5aae7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043487 Aug 18 22:00:26.444316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 433/868] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:26 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:26.945484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-53515e66-0bee-4564-b000-ec0b8fd5941a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:26.947675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-53515e66-0bee-4564-b000-ec0b8fd5941a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:26.953980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53515e66-0bee-4564-b000-ec0b8fd5941a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:26.954456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53515e66-0bee-4564-b000-ec0b8fd5941a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:26.955264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53515e66-0bee-4564-b000-ec0b8fd5941a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:26.955573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53515e66-0bee-4564-b000-ec0b8fd5941a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:26.956020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53515e66-0bee-4564-b000-ec0b8fd5941a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:26.956468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53515e66-0bee-4564-b000-ec0b8fd5941a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:26.987138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-53515e66-0bee-4564-b000-ec0b8fd5941a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045520 Aug 18 22:00:26.987710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 436/869] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:26 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:27.096094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7f45b49e-fc86-4054-ac7a-f66ff868bf0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:27.098286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7f45b49e-fc86-4054-ac7a-f66ff868bf0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:27.104784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f45b49e-fc86-4054-ac7a-f66ff868bf0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:27.105266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f45b49e-fc86-4054-ac7a-f66ff868bf0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:27.105726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f45b49e-fc86-4054-ac7a-f66ff868bf0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:27.106420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f45b49e-fc86-4054-ac7a-f66ff868bf0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:27.106882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f45b49e-fc86-4054-ac7a-f66ff868bf0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:27.107307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f45b49e-fc86-4054-ac7a-f66ff868bf0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:27.135222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7f45b49e-fc86-4054-ac7a-f66ff868bf0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043627 Aug 18 22:00:27.135777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 434/870] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:27 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:27.163163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dc2025a1-9ed4-4f48-8f87-1f9c0a60b182 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:27.165281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dc2025a1-9ed4-4f48-8f87-1f9c0a60b182 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:27.171337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc2025a1-9ed4-4f48-8f87-1f9c0a60b182 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:27.171810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc2025a1-9ed4-4f48-8f87-1f9c0a60b182 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:27.172238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc2025a1-9ed4-4f48-8f87-1f9c0a60b182 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:27.172920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc2025a1-9ed4-4f48-8f87-1f9c0a60b182 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:27.173401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc2025a1-9ed4-4f48-8f87-1f9c0a60b182 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:27.173857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc2025a1-9ed4-4f48-8f87-1f9c0a60b182 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:27.201855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dc2025a1-9ed4-4f48-8f87-1f9c0a60b182 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042707 Aug 18 22:00:27.202403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 437/871] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:27 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:27.456685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b26cd2e6-e854-448d-89ff-593dc6e05562 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:27.458810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b26cd2e6-e854-448d-89ff-593dc6e05562 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:27.464568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b26cd2e6-e854-448d-89ff-593dc6e05562 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:27.465049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b26cd2e6-e854-448d-89ff-593dc6e05562 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:27.465480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b26cd2e6-e854-448d-89ff-593dc6e05562 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:27.466188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b26cd2e6-e854-448d-89ff-593dc6e05562 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:27.466640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b26cd2e6-e854-448d-89ff-593dc6e05562 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:27.467063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b26cd2e6-e854-448d-89ff-593dc6e05562 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:27.494812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b26cd2e6-e854-448d-89ff-593dc6e05562 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042733 Aug 18 22:00:27.495353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 435/872] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:27.999654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-990a2f3b-9371-40a8-9b7b-c364963df91d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:28.001727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-990a2f3b-9371-40a8-9b7b-c364963df91d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:28.008437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-990a2f3b-9371-40a8-9b7b-c364963df91d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:28.008910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-990a2f3b-9371-40a8-9b7b-c364963df91d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:28.009339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-990a2f3b-9371-40a8-9b7b-c364963df91d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:28.010055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-990a2f3b-9371-40a8-9b7b-c364963df91d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:28.010505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-990a2f3b-9371-40a8-9b7b-c364963df91d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:28.010924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-990a2f3b-9371-40a8-9b7b-c364963df91d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:28.041212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-990a2f3b-9371-40a8-9b7b-c364963df91d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045642 Aug 18 22:00:28.041801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 438/873] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:27 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:28.148123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7fd61e92-f2b2-4244-9243-e21c579c98dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:28.150316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7fd61e92-f2b2-4244-9243-e21c579c98dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:28.152173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:28.157297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7fd61e92-f2b2-4244-9243-e21c579c98dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:28.158581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7fd61e92-f2b2-4244-9243-e21c579c98dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:28.159011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7fd61e92-f2b2-4244-9243-e21c579c98dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:28.159692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7fd61e92-f2b2-4244-9243-e21c579c98dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:28.160143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7fd61e92-f2b2-4244-9243-e21c579c98dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:28.160561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7fd61e92-f2b2-4244-9243-e21c579c98dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:28.188426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7fd61e92-f2b2-4244-9243-e21c579c98dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Aug 18 22:00:28.189456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 436/874] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:28 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:28.214447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a01ab0ef-6bd5-4438-93a3-aa1f31de9bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:28.217322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a01ab0ef-6bd5-4438-93a3-aa1f31de9bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:28.223207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a01ab0ef-6bd5-4438-93a3-aa1f31de9bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:28.223689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a01ab0ef-6bd5-4438-93a3-aa1f31de9bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:28.224126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a01ab0ef-6bd5-4438-93a3-aa1f31de9bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:28.224816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a01ab0ef-6bd5-4438-93a3-aa1f31de9bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:28.225272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a01ab0ef-6bd5-4438-93a3-aa1f31de9bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:28.225734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a01ab0ef-6bd5-4438-93a3-aa1f31de9bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:28.254498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a01ab0ef-6bd5-4438-93a3-aa1f31de9bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043907 Aug 18 22:00:28.254987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 439/875] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:28 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:28.507315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-28d7140f-0542-447a-b7be-6053ee1e4580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:28.509324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-28d7140f-0542-447a-b7be-6053ee1e4580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:28.515197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28d7140f-0542-447a-b7be-6053ee1e4580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:28.515672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28d7140f-0542-447a-b7be-6053ee1e4580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:28.516107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28d7140f-0542-447a-b7be-6053ee1e4580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:28.516790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28d7140f-0542-447a-b7be-6053ee1e4580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:28.517899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28d7140f-0542-447a-b7be-6053ee1e4580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:28.518323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28d7140f-0542-447a-b7be-6053ee1e4580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:28.549648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-28d7140f-0542-447a-b7be-6053ee1e4580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046310 Aug 18 22:00:28.550205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 437/876] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:29.054015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ead11f19-7190-429d-af4a-e99e0de4ba29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:29.056137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ead11f19-7190-429d-af4a-e99e0de4ba29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:29.062518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ead11f19-7190-429d-af4a-e99e0de4ba29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:29.063000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ead11f19-7190-429d-af4a-e99e0de4ba29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:29.063436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ead11f19-7190-429d-af4a-e99e0de4ba29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:29.064630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ead11f19-7190-429d-af4a-e99e0de4ba29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:29.065099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ead11f19-7190-429d-af4a-e99e0de4ba29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:29.065522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ead11f19-7190-429d-af4a-e99e0de4ba29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:29.095559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ead11f19-7190-429d-af4a-e99e0de4ba29 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045511 Aug 18 22:00:29.096143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 440/877] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:29.200807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ddc2e004-11c6-4fb9-96b5-2267a71ca547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:29.202950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ddc2e004-11c6-4fb9-96b5-2267a71ca547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:29.210794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddc2e004-11c6-4fb9-96b5-2267a71ca547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:29.211277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddc2e004-11c6-4fb9-96b5-2267a71ca547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:29.211713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddc2e004-11c6-4fb9-96b5-2267a71ca547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:29.212474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddc2e004-11c6-4fb9-96b5-2267a71ca547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:29.213084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddc2e004-11c6-4fb9-96b5-2267a71ca547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:29.213509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddc2e004-11c6-4fb9-96b5-2267a71ca547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:29.242452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ddc2e004-11c6-4fb9-96b5-2267a71ca547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045471 Aug 18 22:00:29.243010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 438/878] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:29 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:29.266554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fcaac47a-a584-440e-aa3d-d63171319112 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:29.269298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fcaac47a-a584-440e-aa3d-d63171319112 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:29.275158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcaac47a-a584-440e-aa3d-d63171319112 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:29.275642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcaac47a-a584-440e-aa3d-d63171319112 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:29.276082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcaac47a-a584-440e-aa3d-d63171319112 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:29.276776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcaac47a-a584-440e-aa3d-d63171319112 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:29.277237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcaac47a-a584-440e-aa3d-d63171319112 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:29.277700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcaac47a-a584-440e-aa3d-d63171319112 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:29.306806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fcaac47a-a584-440e-aa3d-d63171319112 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 Aug 18 22:00:29.307300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 441/879] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:29 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:29.562053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d6ed4c59-28a9-4051-bc50-39a1f2becfdb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:29.564687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d6ed4c59-28a9-4051-bc50-39a1f2becfdb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:29.570654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6ed4c59-28a9-4051-bc50-39a1f2becfdb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:29.571144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6ed4c59-28a9-4051-bc50-39a1f2becfdb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:29.571615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6ed4c59-28a9-4051-bc50-39a1f2becfdb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:29.572324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6ed4c59-28a9-4051-bc50-39a1f2becfdb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:29.572778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6ed4c59-28a9-4051-bc50-39a1f2becfdb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:29.573207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d6ed4c59-28a9-4051-bc50-39a1f2becfdb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:29.601990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d6ed4c59-28a9-4051-bc50-39a1f2becfdb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Aug 18 22:00:29.602547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 439/880] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:29 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:30.107963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dba0382a-e3a7-4b51-8f70-4398e6cfa082 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:30.110134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dba0382a-e3a7-4b51-8f70-4398e6cfa082 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:30.116630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dba0382a-e3a7-4b51-8f70-4398e6cfa082 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:30.117120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dba0382a-e3a7-4b51-8f70-4398e6cfa082 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:30.117560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dba0382a-e3a7-4b51-8f70-4398e6cfa082 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:30.118280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dba0382a-e3a7-4b51-8f70-4398e6cfa082 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:30.118738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dba0382a-e3a7-4b51-8f70-4398e6cfa082 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:30.119167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dba0382a-e3a7-4b51-8f70-4398e6cfa082 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:30.149862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dba0382a-e3a7-4b51-8f70-4398e6cfa082 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045773 Aug 18 22:00:30.150443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 442/881] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:30.254747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-86db3262-2dab-4552-8f20-3bf0d60be708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:30.256847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-86db3262-2dab-4552-8f20-3bf0d60be708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:30.263272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86db3262-2dab-4552-8f20-3bf0d60be708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:30.263751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86db3262-2dab-4552-8f20-3bf0d60be708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:30.264186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86db3262-2dab-4552-8f20-3bf0d60be708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:30.264876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86db3262-2dab-4552-8f20-3bf0d60be708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:30.265331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86db3262-2dab-4552-8f20-3bf0d60be708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:30.265792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86db3262-2dab-4552-8f20-3bf0d60be708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:30.294702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-86db3262-2dab-4552-8f20-3bf0d60be708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043867 Aug 18 22:00:30.295261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 440/882] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:30.319033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a2453770-2ab5-4fd5-86c3-1663755ad809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:30.321200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a2453770-2ab5-4fd5-86c3-1663755ad809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:30.327033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2453770-2ab5-4fd5-86c3-1663755ad809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:30.327516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2453770-2ab5-4fd5-86c3-1663755ad809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:30.327953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2453770-2ab5-4fd5-86c3-1663755ad809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:30.328651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2453770-2ab5-4fd5-86c3-1663755ad809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:30.329106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2453770-2ab5-4fd5-86c3-1663755ad809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:30.330071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2453770-2ab5-4fd5-86c3-1663755ad809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:30.333741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:30.361137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a2453770-2ab5-4fd5-86c3-1663755ad809 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Aug 18 22:00:30.361638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 443/883] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:30 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:30.614406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-35b59e7d-0e46-4b39-a517-e72f9cc894c7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:30.616481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-35b59e7d-0e46-4b39-a517-e72f9cc894c7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:30.622405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35b59e7d-0e46-4b39-a517-e72f9cc894c7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:30.622895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35b59e7d-0e46-4b39-a517-e72f9cc894c7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:30.623337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35b59e7d-0e46-4b39-a517-e72f9cc894c7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:30.624033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35b59e7d-0e46-4b39-a517-e72f9cc894c7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:30.624492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35b59e7d-0e46-4b39-a517-e72f9cc894c7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:30.624921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35b59e7d-0e46-4b39-a517-e72f9cc894c7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:30.655273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-35b59e7d-0e46-4b39-a517-e72f9cc894c7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044955 Aug 18 22:00:30.655831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 441/884] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:30 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:31.162662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2beb01c9-97c5-4e29-9874-f465b6a2f506 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:31.164923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2beb01c9-97c5-4e29-9874-f465b6a2f506 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:31.171579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2beb01c9-97c5-4e29-9874-f465b6a2f506 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:31.172063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2beb01c9-97c5-4e29-9874-f465b6a2f506 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:31.172499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2beb01c9-97c5-4e29-9874-f465b6a2f506 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:31.173342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2beb01c9-97c5-4e29-9874-f465b6a2f506 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:31.174678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2beb01c9-97c5-4e29-9874-f465b6a2f506 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:31.174800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2beb01c9-97c5-4e29-9874-f465b6a2f506 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:31.204145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2beb01c9-97c5-4e29-9874-f465b6a2f506 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045403 Aug 18 22:00:31.204929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 444/885] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:31 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:31.307050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3fe0cb52-1254-43bd-88bc-5da3543cce1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:31.309176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3fe0cb52-1254-43bd-88bc-5da3543cce1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:31.315799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fe0cb52-1254-43bd-88bc-5da3543cce1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:31.316321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fe0cb52-1254-43bd-88bc-5da3543cce1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:31.316797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fe0cb52-1254-43bd-88bc-5da3543cce1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:31.317502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fe0cb52-1254-43bd-88bc-5da3543cce1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:31.317990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fe0cb52-1254-43bd-88bc-5da3543cce1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:31.318420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3fe0cb52-1254-43bd-88bc-5da3543cce1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:31.347208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3fe0cb52-1254-43bd-88bc-5da3543cce1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044086 Aug 18 22:00:31.347765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 442/886] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:31 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:31.373072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64747af6-833c-4876-ae00-443806f5c5fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:31.375321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64747af6-833c-4876-ae00-443806f5c5fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:31.381295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64747af6-833c-4876-ae00-443806f5c5fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:31.381818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64747af6-833c-4876-ae00-443806f5c5fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:31.382262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64747af6-833c-4876-ae00-443806f5c5fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:31.382959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64747af6-833c-4876-ae00-443806f5c5fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:31.383422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64747af6-833c-4876-ae00-443806f5c5fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:31.383853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64747af6-833c-4876-ae00-443806f5c5fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:31.412424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64747af6-833c-4876-ae00-443806f5c5fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043249 Aug 18 22:00:31.413027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 445/887] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:31.667763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fcce74b9-6ad0-45c3-8fa6-b558181cbd8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:31.669837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fcce74b9-6ad0-45c3-8fa6-b558181cbd8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:31.676118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcce74b9-6ad0-45c3-8fa6-b558181cbd8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:31.676602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcce74b9-6ad0-45c3-8fa6-b558181cbd8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:31.677041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcce74b9-6ad0-45c3-8fa6-b558181cbd8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:31.677778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcce74b9-6ad0-45c3-8fa6-b558181cbd8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:31.678242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcce74b9-6ad0-45c3-8fa6-b558181cbd8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:31.678670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcce74b9-6ad0-45c3-8fa6-b558181cbd8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:31.682342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:31.708471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fcce74b9-6ad0-45c3-8fa6-b558181cbd8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Aug 18 22:00:31.709038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 443/888] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:31 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:32.216576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b8cb5431-af25-4dea-bfdd-ca8b98a2b856 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:32.218734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b8cb5431-af25-4dea-bfdd-ca8b98a2b856 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:32.225254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8cb5431-af25-4dea-bfdd-ca8b98a2b856 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:32.225772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8cb5431-af25-4dea-bfdd-ca8b98a2b856 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:32.226210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8cb5431-af25-4dea-bfdd-ca8b98a2b856 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:32.226900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8cb5431-af25-4dea-bfdd-ca8b98a2b856 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:32.227355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8cb5431-af25-4dea-bfdd-ca8b98a2b856 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:32.227779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8cb5431-af25-4dea-bfdd-ca8b98a2b856 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:32.258877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b8cb5431-af25-4dea-bfdd-ca8b98a2b856 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046319 Aug 18 22:00:32.259614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 446/889] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:32.359902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9e4dd165-7230-4736-b8f2-bf7f83b50573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:32.363031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9e4dd165-7230-4736-b8f2-bf7f83b50573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:32.369314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e4dd165-7230-4736-b8f2-bf7f83b50573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:32.369828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e4dd165-7230-4736-b8f2-bf7f83b50573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:32.370262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e4dd165-7230-4736-b8f2-bf7f83b50573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:32.371109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e4dd165-7230-4736-b8f2-bf7f83b50573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:32.371751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e4dd165-7230-4736-b8f2-bf7f83b50573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:32.372177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e4dd165-7230-4736-b8f2-bf7f83b50573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:32.401144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9e4dd165-7230-4736-b8f2-bf7f83b50573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 Aug 18 22:00:32.401721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 444/890] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:32.425048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9aaaa9a4-2022-4ec7-8d91-57f7450f2b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:32.427211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9aaaa9a4-2022-4ec7-8d91-57f7450f2b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:32.433143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9aaaa9a4-2022-4ec7-8d91-57f7450f2b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:32.433654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9aaaa9a4-2022-4ec7-8d91-57f7450f2b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:32.434100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9aaaa9a4-2022-4ec7-8d91-57f7450f2b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:32.434799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9aaaa9a4-2022-4ec7-8d91-57f7450f2b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:32.435259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9aaaa9a4-2022-4ec7-8d91-57f7450f2b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:32.435690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9aaaa9a4-2022-4ec7-8d91-57f7450f2b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:32.464270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9aaaa9a4-2022-4ec7-8d91-57f7450f2b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043893 Aug 18 22:00:32.464822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 447/891] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:32 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:32.720431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a0590682-1687-4a40-b388-3065f3060f2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:32.722701 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a0590682-1687-4a40-b388-3065f3060f2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:32.728787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0590682-1687-4a40-b388-3065f3060f2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:32.729541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0590682-1687-4a40-b388-3065f3060f2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:32.729737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0590682-1687-4a40-b388-3065f3060f2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:32.730440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0590682-1687-4a40-b388-3065f3060f2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:32.730897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0590682-1687-4a40-b388-3065f3060f2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:32.731322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0590682-1687-4a40-b388-3065f3060f2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:32.760353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a0590682-1687-4a40-b388-3065f3060f2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043860 Aug 18 22:00:32.760907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 445/892] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:32 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:33.271298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-86a3d475-b1b9-4c99-8a64-893645302f35 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:33.273428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-86a3d475-b1b9-4c99-8a64-893645302f35 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:33.280059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86a3d475-b1b9-4c99-8a64-893645302f35 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:33.280546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86a3d475-b1b9-4c99-8a64-893645302f35 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:33.280998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86a3d475-b1b9-4c99-8a64-893645302f35 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:33.281724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86a3d475-b1b9-4c99-8a64-893645302f35 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:33.282186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86a3d475-b1b9-4c99-8a64-893645302f35 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:33.282619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86a3d475-b1b9-4c99-8a64-893645302f35 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:33.312379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-86a3d475-b1b9-4c99-8a64-893645302f35 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045043 Aug 18 22:00:33.312959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 448/893] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:33 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:33.412830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6d865d00-2278-4474-be46-287154901de8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:33.414973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6d865d00-2278-4474-be46-287154901de8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:33.421562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d865d00-2278-4474-be46-287154901de8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:33.422076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d865d00-2278-4474-be46-287154901de8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:33.422513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d865d00-2278-4474-be46-287154901de8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:33.423846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d865d00-2278-4474-be46-287154901de8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:33.424313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d865d00-2278-4474-be46-287154901de8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:33.424743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d865d00-2278-4474-be46-287154901de8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:33.452619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6d865d00-2278-4474-be46-287154901de8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Aug 18 22:00:33.453170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 446/894] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:33 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:33.476908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b26ffa1a-e94e-4237-b088-e7c5fd80a6a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:33.479163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b26ffa1a-e94e-4237-b088-e7c5fd80a6a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:33.485140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b26ffa1a-e94e-4237-b088-e7c5fd80a6a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:33.485666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b26ffa1a-e94e-4237-b088-e7c5fd80a6a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:33.487102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b26ffa1a-e94e-4237-b088-e7c5fd80a6a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:33.487462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b26ffa1a-e94e-4237-b088-e7c5fd80a6a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:33.487920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b26ffa1a-e94e-4237-b088-e7c5fd80a6a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:33.488378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b26ffa1a-e94e-4237-b088-e7c5fd80a6a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:33.516498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b26ffa1a-e94e-4237-b088-e7c5fd80a6a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 Aug 18 22:00:33.517055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 449/895] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:33.772448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a948f90f-e674-4347-ac9e-f4b7cadc6a98 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:33.774622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a948f90f-e674-4347-ac9e-f4b7cadc6a98 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:33.780468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a948f90f-e674-4347-ac9e-f4b7cadc6a98 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:33.780948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a948f90f-e674-4347-ac9e-f4b7cadc6a98 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:33.781376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a948f90f-e674-4347-ac9e-f4b7cadc6a98 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:33.782084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a948f90f-e674-4347-ac9e-f4b7cadc6a98 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:33.783025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a948f90f-e674-4347-ac9e-f4b7cadc6a98 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:33.783448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a948f90f-e674-4347-ac9e-f4b7cadc6a98 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:33.812633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a948f90f-e674-4347-ac9e-f4b7cadc6a98 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044126 Aug 18 22:00:33.813179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 447/896] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:33 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:34.325984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eaa64c0b-abac-4fc1-b094-0ed7d5038aec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:34.328150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eaa64c0b-abac-4fc1-b094-0ed7d5038aec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:34.335468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaa64c0b-abac-4fc1-b094-0ed7d5038aec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:34.335956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaa64c0b-abac-4fc1-b094-0ed7d5038aec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:34.336392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaa64c0b-abac-4fc1-b094-0ed7d5038aec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:34.337110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaa64c0b-abac-4fc1-b094-0ed7d5038aec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:34.337565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaa64c0b-abac-4fc1-b094-0ed7d5038aec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:34.338016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaa64c0b-abac-4fc1-b094-0ed7d5038aec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:34.371031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eaa64c0b-abac-4fc1-b094-0ed7d5038aec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049068 Aug 18 22:00:34.371628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 450/897] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:34.464299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f5a7e286-b4c0-4467-8039-e9bd574f2cfe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:34.466439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f5a7e286-b4c0-4467-8039-e9bd574f2cfe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:34.472755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5a7e286-b4c0-4467-8039-e9bd574f2cfe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:34.473251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5a7e286-b4c0-4467-8039-e9bd574f2cfe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:34.473702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5a7e286-b4c0-4467-8039-e9bd574f2cfe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:34.474389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5a7e286-b4c0-4467-8039-e9bd574f2cfe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:34.474845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5a7e286-b4c0-4467-8039-e9bd574f2cfe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:34.475291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5a7e286-b4c0-4467-8039-e9bd574f2cfe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:34.503614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f5a7e286-b4c0-4467-8039-e9bd574f2cfe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043221 Aug 18 22:00:34.504157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 448/898] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:34 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:34.528288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9403d744-efa3-4472-bfdd-fa110f316cc8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:34.530496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9403d744-efa3-4472-bfdd-fa110f316cc8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:34.536442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9403d744-efa3-4472-bfdd-fa110f316cc8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:34.536928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9403d744-efa3-4472-bfdd-fa110f316cc8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:34.537365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9403d744-efa3-4472-bfdd-fa110f316cc8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:34.538093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9403d744-efa3-4472-bfdd-fa110f316cc8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:34.538553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9403d744-efa3-4472-bfdd-fa110f316cc8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:34.538984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9403d744-efa3-4472-bfdd-fa110f316cc8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:34.569194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9403d744-efa3-4472-bfdd-fa110f316cc8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044635 Aug 18 22:00:34.569782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 451/899] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:34.824940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-52f407ac-04a9-426e-90fd-38316b2a0374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:34.827107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-52f407ac-04a9-426e-90fd-38316b2a0374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:34.833498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52f407ac-04a9-426e-90fd-38316b2a0374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:34.834007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52f407ac-04a9-426e-90fd-38316b2a0374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:34.834442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52f407ac-04a9-426e-90fd-38316b2a0374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:34.835132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52f407ac-04a9-426e-90fd-38316b2a0374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:34.835587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52f407ac-04a9-426e-90fd-38316b2a0374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:34.836011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52f407ac-04a9-426e-90fd-38316b2a0374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:34.865145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-52f407ac-04a9-426e-90fd-38316b2a0374 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Aug 18 22:00:34.865751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 449/900] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:34 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:35.383824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-38a31c3c-6cd2-4375-b02c-741597c026fb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:35.386007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-38a31c3c-6cd2-4375-b02c-741597c026fb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:35.392419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38a31c3c-6cd2-4375-b02c-741597c026fb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:35.392903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38a31c3c-6cd2-4375-b02c-741597c026fb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:35.393337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38a31c3c-6cd2-4375-b02c-741597c026fb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:35.394057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38a31c3c-6cd2-4375-b02c-741597c026fb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:35.394517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38a31c3c-6cd2-4375-b02c-741597c026fb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:35.394947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38a31c3c-6cd2-4375-b02c-741597c026fb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:35.424925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-38a31c3c-6cd2-4375-b02c-741597c026fb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044911 Aug 18 22:00:35.425299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 452/901] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:35.515693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a3d37cf2-3022-48a6-92ad-9394e95f30ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:35.517844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a3d37cf2-3022-48a6-92ad-9394e95f30ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:35.524208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d37cf2-3022-48a6-92ad-9394e95f30ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:35.524690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d37cf2-3022-48a6-92ad-9394e95f30ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:35.525127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d37cf2-3022-48a6-92ad-9394e95f30ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:35.525853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d37cf2-3022-48a6-92ad-9394e95f30ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:35.526314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d37cf2-3022-48a6-92ad-9394e95f30ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:35.526758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d37cf2-3022-48a6-92ad-9394e95f30ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:35.555384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a3d37cf2-3022-48a6-92ad-9394e95f30ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043710 Aug 18 22:00:35.555930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 450/902] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:35 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:35.581171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b830a2d-7af2-4286-bc06-5eb98630ffe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:35.583352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5b830a2d-7af2-4286-bc06-5eb98630ffe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:35.589339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b830a2d-7af2-4286-bc06-5eb98630ffe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:35.589871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b830a2d-7af2-4286-bc06-5eb98630ffe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:35.590314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b830a2d-7af2-4286-bc06-5eb98630ffe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:35.591016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b830a2d-7af2-4286-bc06-5eb98630ffe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:35.591475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b830a2d-7af2-4286-bc06-5eb98630ffe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:35.591901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b830a2d-7af2-4286-bc06-5eb98630ffe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:35.623122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5b830a2d-7af2-4286-bc06-5eb98630ffe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045900 Aug 18 22:00:35.623720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 453/903] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:35 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:35.876367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-091a3442-8452-456b-aea3-0fbab5cd68a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:35.878603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-091a3442-8452-456b-aea3-0fbab5cd68a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:35.884456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-091a3442-8452-456b-aea3-0fbab5cd68a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:35.884940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-091a3442-8452-456b-aea3-0fbab5cd68a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:35.885379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-091a3442-8452-456b-aea3-0fbab5cd68a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:35.886098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-091a3442-8452-456b-aea3-0fbab5cd68a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:35.886561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-091a3442-8452-456b-aea3-0fbab5cd68a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:35.887016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-091a3442-8452-456b-aea3-0fbab5cd68a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:35.915937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-091a3442-8452-456b-aea3-0fbab5cd68a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043488 Aug 18 22:00:35.916492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 451/904] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:36.436588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-76ffd908-a4ce-45f9-9dc1-56cddde66310 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:36.439259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-76ffd908-a4ce-45f9-9dc1-56cddde66310 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:36.441634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:36.446875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ffd908-a4ce-45f9-9dc1-56cddde66310 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:36.447351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ffd908-a4ce-45f9-9dc1-56cddde66310 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:36.447785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ffd908-a4ce-45f9-9dc1-56cddde66310 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:36.448480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ffd908-a4ce-45f9-9dc1-56cddde66310 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:36.448935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ffd908-a4ce-45f9-9dc1-56cddde66310 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:36.449359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ffd908-a4ce-45f9-9dc1-56cddde66310 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:36.478464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-76ffd908-a4ce-45f9-9dc1-56cddde66310 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045884 Aug 18 22:00:36.479028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 454/905] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:00:36.566975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3304bf34-8ce0-4ef1-992f-cab4f3273b3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:36.569099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3304bf34-8ce0-4ef1-992f-cab4f3273b3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:36.575511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3304bf34-8ce0-4ef1-992f-cab4f3273b3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:36.575993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3304bf34-8ce0-4ef1-992f-cab4f3273b3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:36.576429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3304bf34-8ce0-4ef1-992f-cab4f3273b3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:36.577117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3304bf34-8ce0-4ef1-992f-cab4f3273b3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:36.577623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3304bf34-8ce0-4ef1-992f-cab4f3273b3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:36.578053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3304bf34-8ce0-4ef1-992f-cab4f3273b3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:36.606597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3304bf34-8ce0-4ef1-992f-cab4f3273b3c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Aug 18 22:00:36.607140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 452/906] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:36 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:36.636155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-216c2574-aa4c-4de2-a6c5-9a67362303be tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:36.638344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-216c2574-aa4c-4de2-a6c5-9a67362303be tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:36.644912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-216c2574-aa4c-4de2-a6c5-9a67362303be tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:36.645408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-216c2574-aa4c-4de2-a6c5-9a67362303be tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:36.646022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-216c2574-aa4c-4de2-a6c5-9a67362303be tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:36.646738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-216c2574-aa4c-4de2-a6c5-9a67362303be tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:36.647205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-216c2574-aa4c-4de2-a6c5-9a67362303be tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:36.647635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-216c2574-aa4c-4de2-a6c5-9a67362303be tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:36.677741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-216c2574-aa4c-4de2-a6c5-9a67362303be tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045466 Aug 18 22:00:36.678304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 455/907] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:36 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:36.928306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a8c265f5-b628-4d74-9eb9-038e933819da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:36.930503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a8c265f5-b628-4d74-9eb9-038e933819da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:36.936478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8c265f5-b628-4d74-9eb9-038e933819da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:36.936959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8c265f5-b628-4d74-9eb9-038e933819da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:36.937391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8c265f5-b628-4d74-9eb9-038e933819da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:36.938111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8c265f5-b628-4d74-9eb9-038e933819da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:36.938571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8c265f5-b628-4d74-9eb9-038e933819da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:36.939096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8c265f5-b628-4d74-9eb9-038e933819da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:36.968456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a8c265f5-b628-4d74-9eb9-038e933819da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Aug 18 22:00:36.968940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 453/908] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:36 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:37.490935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2ae62b11-5ce5-4984-8b0c-5fb02f663024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:37.493089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2ae62b11-5ce5-4984-8b0c-5fb02f663024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:37.499578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ae62b11-5ce5-4984-8b0c-5fb02f663024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:37.500059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ae62b11-5ce5-4984-8b0c-5fb02f663024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:37.500498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ae62b11-5ce5-4984-8b0c-5fb02f663024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:37.501689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ae62b11-5ce5-4984-8b0c-5fb02f663024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:37.502160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ae62b11-5ce5-4984-8b0c-5fb02f663024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:37.502595 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ae62b11-5ce5-4984-8b0c-5fb02f663024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:37.533121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2ae62b11-5ce5-4984-8b0c-5fb02f663024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046204 Aug 18 22:00:37.533702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 456/909] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:37.618763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2b99434-4ecc-49d6-a96a-2f1f2cf66f5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:37.620879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e2b99434-4ecc-49d6-a96a-2f1f2cf66f5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:37.628176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2b99434-4ecc-49d6-a96a-2f1f2cf66f5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:37.628661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2b99434-4ecc-49d6-a96a-2f1f2cf66f5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:37.629101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2b99434-4ecc-49d6-a96a-2f1f2cf66f5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:37.629841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2b99434-4ecc-49d6-a96a-2f1f2cf66f5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:37.630303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2b99434-4ecc-49d6-a96a-2f1f2cf66f5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:37.630734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2b99434-4ecc-49d6-a96a-2f1f2cf66f5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:37.659143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e2b99434-4ecc-49d6-a96a-2f1f2cf66f5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044280 Aug 18 22:00:37.659688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 454/910] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:37 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:37.690618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2c04ebc0-6786-4ee5-be63-237a94ea15e7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:37.692735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2c04ebc0-6786-4ee5-be63-237a94ea15e7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:37.698737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c04ebc0-6786-4ee5-be63-237a94ea15e7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:37.699216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c04ebc0-6786-4ee5-be63-237a94ea15e7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:37.699645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c04ebc0-6786-4ee5-be63-237a94ea15e7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:37.700335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c04ebc0-6786-4ee5-be63-237a94ea15e7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:37.700787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c04ebc0-6786-4ee5-be63-237a94ea15e7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:37.701208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c04ebc0-6786-4ee5-be63-237a94ea15e7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:37.729423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2c04ebc0-6786-4ee5-be63-237a94ea15e7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043354 Aug 18 22:00:37.730009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 457/911] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:37 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:37.981616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4dc4f7a6-644d-4c73-beec-8fb4e52ca700 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:37.983722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4dc4f7a6-644d-4c73-beec-8fb4e52ca700 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:37.990224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4dc4f7a6-644d-4c73-beec-8fb4e52ca700 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:37.990709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4dc4f7a6-644d-4c73-beec-8fb4e52ca700 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:37.991142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4dc4f7a6-644d-4c73-beec-8fb4e52ca700 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:37.991855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4dc4f7a6-644d-4c73-beec-8fb4e52ca700 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:37.992318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4dc4f7a6-644d-4c73-beec-8fb4e52ca700 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:37.992791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4dc4f7a6-644d-4c73-beec-8fb4e52ca700 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:38.020816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4dc4f7a6-644d-4c73-beec-8fb4e52ca700 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043170 Aug 18 22:00:38.021373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 455/912] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:37 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:38.545206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da73aeca-e259-488d-b16a-cc0e0964bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:38.547594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-da73aeca-e259-488d-b16a-cc0e0964bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:38.553903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da73aeca-e259-488d-b16a-cc0e0964bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:38.554377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da73aeca-e259-488d-b16a-cc0e0964bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:38.554808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da73aeca-e259-488d-b16a-cc0e0964bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:38.555494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da73aeca-e259-488d-b16a-cc0e0964bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:38.555940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da73aeca-e259-488d-b16a-cc0e0964bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:38.556395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da73aeca-e259-488d-b16a-cc0e0964bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:38.585476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da73aeca-e259-488d-b16a-cc0e0964bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044135 Aug 18 22:00:38.586067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 458/913] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:38 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:38.671520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6910122a-80f6-4ac1-8896-c867c9d043cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:38.674282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6910122a-80f6-4ac1-8896-c867c9d043cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:38.680757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6910122a-80f6-4ac1-8896-c867c9d043cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:38.681241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6910122a-80f6-4ac1-8896-c867c9d043cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:38.681704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6910122a-80f6-4ac1-8896-c867c9d043cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:38.682439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6910122a-80f6-4ac1-8896-c867c9d043cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:38.682899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6910122a-80f6-4ac1-8896-c867c9d043cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:38.683341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6910122a-80f6-4ac1-8896-c867c9d043cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:38.712430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6910122a-80f6-4ac1-8896-c867c9d043cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044990 Aug 18 22:00:38.713019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 456/914] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:38 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:38.742293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3cb312ef-8aae-4ee3-92c6-efee2fd36233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:38.744432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3cb312ef-8aae-4ee3-92c6-efee2fd36233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:38.750333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3cb312ef-8aae-4ee3-92c6-efee2fd36233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:38.750813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3cb312ef-8aae-4ee3-92c6-efee2fd36233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:38.751244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3cb312ef-8aae-4ee3-92c6-efee2fd36233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:38.751925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3cb312ef-8aae-4ee3-92c6-efee2fd36233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:38.752374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3cb312ef-8aae-4ee3-92c6-efee2fd36233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:38.752795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3cb312ef-8aae-4ee3-92c6-efee2fd36233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:38.776669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:38.782009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3cb312ef-8aae-4ee3-92c6-efee2fd36233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043782 Aug 18 22:00:38.783083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 459/915] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:38 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:39.033541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-edb3246a-1090-4d34-acd1-3786af54b252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:39.035663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-edb3246a-1090-4d34-acd1-3786af54b252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:39.041534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-edb3246a-1090-4d34-acd1-3786af54b252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:39.042043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-edb3246a-1090-4d34-acd1-3786af54b252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:39.042474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-edb3246a-1090-4d34-acd1-3786af54b252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:39.043161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-edb3246a-1090-4d34-acd1-3786af54b252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:39.043607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-edb3246a-1090-4d34-acd1-3786af54b252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:39.044029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-edb3246a-1090-4d34-acd1-3786af54b252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:39.072707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-edb3246a-1090-4d34-acd1-3786af54b252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043736 Aug 18 22:00:39.073251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 457/916] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:39.598100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9a40a573-0763-4249-80be-e02f05ff103e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:39.600295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9a40a573-0763-4249-80be-e02f05ff103e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:39.607018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a40a573-0763-4249-80be-e02f05ff103e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:39.607502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a40a573-0763-4249-80be-e02f05ff103e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:39.607936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a40a573-0763-4249-80be-e02f05ff103e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:39.608634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a40a573-0763-4249-80be-e02f05ff103e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:39.609087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a40a573-0763-4249-80be-e02f05ff103e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:39.609512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a40a573-0763-4249-80be-e02f05ff103e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:39.638162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9a40a573-0763-4249-80be-e02f05ff103e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044012 Aug 18 22:00:39.638718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 460/917] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:00:39.724335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6f1777c6-8ad1-4f94-8491-17481655f88f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:39.726495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6f1777c6-8ad1-4f94-8491-17481655f88f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:39.732808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f1777c6-8ad1-4f94-8491-17481655f88f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:39.733279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f1777c6-8ad1-4f94-8491-17481655f88f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:39.733764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f1777c6-8ad1-4f94-8491-17481655f88f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:39.734432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f1777c6-8ad1-4f94-8491-17481655f88f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:39.734885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f1777c6-8ad1-4f94-8491-17481655f88f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:39.735302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f1777c6-8ad1-4f94-8491-17481655f88f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:39.764615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6f1777c6-8ad1-4f94-8491-17481655f88f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Aug 18 22:00:39.765166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 458/918] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:39 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:39.794848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5a9850f6-0e4b-4ba0-a9e7-306fdc7da973 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:39.797261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5a9850f6-0e4b-4ba0-a9e7-306fdc7da973 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:39.803658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9850f6-0e4b-4ba0-a9e7-306fdc7da973 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:39.804136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9850f6-0e4b-4ba0-a9e7-306fdc7da973 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:39.804573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9850f6-0e4b-4ba0-a9e7-306fdc7da973 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:39.805258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9850f6-0e4b-4ba0-a9e7-306fdc7da973 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:39.805747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9850f6-0e4b-4ba0-a9e7-306fdc7da973 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:39.806175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9850f6-0e4b-4ba0-a9e7-306fdc7da973 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:39.834914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5a9850f6-0e4b-4ba0-a9e7-306fdc7da973 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044026 Aug 18 22:00:39.835466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 461/919] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:39 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:40.084443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bc295f7e-8a54-4182-aaba-6007ae06de77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:40.086572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bc295f7e-8a54-4182-aaba-6007ae06de77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:40.092436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc295f7e-8a54-4182-aaba-6007ae06de77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:40.092924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc295f7e-8a54-4182-aaba-6007ae06de77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:40.093354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc295f7e-8a54-4182-aaba-6007ae06de77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:40.094178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc295f7e-8a54-4182-aaba-6007ae06de77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:40.094631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc295f7e-8a54-4182-aaba-6007ae06de77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:40.095055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc295f7e-8a54-4182-aaba-6007ae06de77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:40.119037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:40.124293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bc295f7e-8a54-4182-aaba-6007ae06de77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043816 Aug 18 22:00:40.124852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 459/920] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:40 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:40.651143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c68f83f9-04ee-4056-ae92-b22024791a09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:40.653295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c68f83f9-04ee-4056-ae92-b22024791a09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:40.660282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c68f83f9-04ee-4056-ae92-b22024791a09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:40.660756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c68f83f9-04ee-4056-ae92-b22024791a09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:40.661184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c68f83f9-04ee-4056-ae92-b22024791a09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:40.661985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c68f83f9-04ee-4056-ae92-b22024791a09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:40.662439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c68f83f9-04ee-4056-ae92-b22024791a09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:40.662860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c68f83f9-04ee-4056-ae92-b22024791a09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:40.693062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c68f83f9-04ee-4056-ae92-b22024791a09 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045763 Aug 18 22:00:40.694006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 462/921] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:40.777624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-64c36926-4617-425a-8bba-2511f1698a01 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:40.779778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-64c36926-4617-425a-8bba-2511f1698a01 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:40.787058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c36926-4617-425a-8bba-2511f1698a01 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:40.787550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c36926-4617-425a-8bba-2511f1698a01 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:40.787991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c36926-4617-425a-8bba-2511f1698a01 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:40.788691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c36926-4617-425a-8bba-2511f1698a01 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:40.789151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c36926-4617-425a-8bba-2511f1698a01 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:40.789584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c36926-4617-425a-8bba-2511f1698a01 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:40.818170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-64c36926-4617-425a-8bba-2511f1698a01 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044598 Aug 18 22:00:40.818737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 460/922] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:40 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:40.847806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a2ae6c77-2932-4943-8a43-b3a0c6feff1a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:40.849982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a2ae6c77-2932-4943-8a43-b3a0c6feff1a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:40.856122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2ae6c77-2932-4943-8a43-b3a0c6feff1a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:40.856600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2ae6c77-2932-4943-8a43-b3a0c6feff1a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:40.857040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2ae6c77-2932-4943-8a43-b3a0c6feff1a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:40.857781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2ae6c77-2932-4943-8a43-b3a0c6feff1a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:40.858232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2ae6c77-2932-4943-8a43-b3a0c6feff1a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:40.858652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2ae6c77-2932-4943-8a43-b3a0c6feff1a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:40.887342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a2ae6c77-2932-4943-8a43-b3a0c6feff1a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Aug 18 22:00:40.887896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 463/923] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:41.137270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-677efb9b-8986-4a6c-8e61-4c1a5b851ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:41.139452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-677efb9b-8986-4a6c-8e61-4c1a5b851ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:41.145969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-677efb9b-8986-4a6c-8e61-4c1a5b851ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:41.146455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-677efb9b-8986-4a6c-8e61-4c1a5b851ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:41.146895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-677efb9b-8986-4a6c-8e61-4c1a5b851ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:41.147616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-677efb9b-8986-4a6c-8e61-4c1a5b851ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:41.148076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-677efb9b-8986-4a6c-8e61-4c1a5b851ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:41.148503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-677efb9b-8986-4a6c-8e61-4c1a5b851ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:41.177881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-677efb9b-8986-4a6c-8e61-4c1a5b851ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Aug 18 22:00:41.178444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 461/924] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:41 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:41.704390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-53429b51-6cca-494f-8fe1-f9b13e751fbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:41.706537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-53429b51-6cca-494f-8fe1-f9b13e751fbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:41.712835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53429b51-6cca-494f-8fe1-f9b13e751fbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:41.713310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53429b51-6cca-494f-8fe1-f9b13e751fbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:41.713780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53429b51-6cca-494f-8fe1-f9b13e751fbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:41.714467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53429b51-6cca-494f-8fe1-f9b13e751fbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:41.714918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53429b51-6cca-494f-8fe1-f9b13e751fbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:41.715338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53429b51-6cca-494f-8fe1-f9b13e751fbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:41.744912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-53429b51-6cca-494f-8fe1-f9b13e751fbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044423 Aug 18 22:00:41.745460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 464/925] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:41.830823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d5135c2b-bc85-456f-b449-8febb3657f51 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:41.832984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d5135c2b-bc85-456f-b449-8febb3657f51 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:41.839437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5135c2b-bc85-456f-b449-8febb3657f51 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:41.839910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5135c2b-bc85-456f-b449-8febb3657f51 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:41.840337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5135c2b-bc85-456f-b449-8febb3657f51 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:41.841022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5135c2b-bc85-456f-b449-8febb3657f51 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:41.841477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5135c2b-bc85-456f-b449-8febb3657f51 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:41.841922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5135c2b-bc85-456f-b449-8febb3657f51 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:41.870961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d5135c2b-bc85-456f-b449-8febb3657f51 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044198 Aug 18 22:00:41.871509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 462/926] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:41 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:41.899404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-19556b3b-dc75-44f7-82ce-1ef4a283414e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:41.901621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-19556b3b-dc75-44f7-82ce-1ef4a283414e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:41.908034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19556b3b-dc75-44f7-82ce-1ef4a283414e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:41.908538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19556b3b-dc75-44f7-82ce-1ef4a283414e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:41.909315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19556b3b-dc75-44f7-82ce-1ef4a283414e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:41.910145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19556b3b-dc75-44f7-82ce-1ef4a283414e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:41.910600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19556b3b-dc75-44f7-82ce-1ef4a283414e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:41.911012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19556b3b-dc75-44f7-82ce-1ef4a283414e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:41.940395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-19556b3b-dc75-44f7-82ce-1ef4a283414e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045000 Aug 18 22:00:41.940961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 465/927] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:42.190222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f70fe1de-e42c-4be8-b90d-b3ce5e179d6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:42.192372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f70fe1de-e42c-4be8-b90d-b3ce5e179d6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:42.198415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f70fe1de-e42c-4be8-b90d-b3ce5e179d6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:42.198899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f70fe1de-e42c-4be8-b90d-b3ce5e179d6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:42.199334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f70fe1de-e42c-4be8-b90d-b3ce5e179d6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:42.200027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f70fe1de-e42c-4be8-b90d-b3ce5e179d6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:42.200482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f70fe1de-e42c-4be8-b90d-b3ce5e179d6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:42.200905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f70fe1de-e42c-4be8-b90d-b3ce5e179d6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:42.230627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f70fe1de-e42c-4be8-b90d-b3ce5e179d6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044382 Aug 18 22:00:42.231194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 463/928] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:42.756862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dd7c495a-ced4-43bf-9e9c-ef37243a4679 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:42.759024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dd7c495a-ced4-43bf-9e9c-ef37243a4679 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:42.765616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd7c495a-ced4-43bf-9e9c-ef37243a4679 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:42.766116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd7c495a-ced4-43bf-9e9c-ef37243a4679 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:42.766561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd7c495a-ced4-43bf-9e9c-ef37243a4679 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:42.767927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd7c495a-ced4-43bf-9e9c-ef37243a4679 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:42.768396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd7c495a-ced4-43bf-9e9c-ef37243a4679 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:42.768814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd7c495a-ced4-43bf-9e9c-ef37243a4679 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:42.797187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dd7c495a-ced4-43bf-9e9c-ef37243a4679 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044296 Aug 18 22:00:42.797776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 466/929] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:42.883739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-80c8bc8c-8a71-4dff-acdf-262ef41d0e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:42.885865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-80c8bc8c-8a71-4dff-acdf-262ef41d0e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:42.892331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80c8bc8c-8a71-4dff-acdf-262ef41d0e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:42.892805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80c8bc8c-8a71-4dff-acdf-262ef41d0e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:42.893233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80c8bc8c-8a71-4dff-acdf-262ef41d0e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:42.893943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80c8bc8c-8a71-4dff-acdf-262ef41d0e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:42.894395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80c8bc8c-8a71-4dff-acdf-262ef41d0e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:42.894816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80c8bc8c-8a71-4dff-acdf-262ef41d0e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:42.923021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-80c8bc8c-8a71-4dff-acdf-262ef41d0e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043176 Aug 18 22:00:42.924064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 464/930] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:42 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:42.952249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a6ac5765-c179-4a55-af6f-d748c7fdc713 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:42.954435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a6ac5765-c179-4a55-af6f-d748c7fdc713 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:42.960325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6ac5765-c179-4a55-af6f-d748c7fdc713 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:42.960806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6ac5765-c179-4a55-af6f-d748c7fdc713 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:42.961243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6ac5765-c179-4a55-af6f-d748c7fdc713 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:42.961961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6ac5765-c179-4a55-af6f-d748c7fdc713 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:42.962418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6ac5765-c179-4a55-af6f-d748c7fdc713 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:42.962844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6ac5765-c179-4a55-af6f-d748c7fdc713 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:42.991570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a6ac5765-c179-4a55-af6f-d748c7fdc713 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043134 Aug 18 22:00:42.992056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 467/931] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:42 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:43.243268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-522b49dd-3fe2-4138-8c2e-fabd04993c93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:43.245310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-522b49dd-3fe2-4138-8c2e-fabd04993c93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:43.251197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-522b49dd-3fe2-4138-8c2e-fabd04993c93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:43.251677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-522b49dd-3fe2-4138-8c2e-fabd04993c93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:43.252115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-522b49dd-3fe2-4138-8c2e-fabd04993c93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:43.252858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-522b49dd-3fe2-4138-8c2e-fabd04993c93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:43.253310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-522b49dd-3fe2-4138-8c2e-fabd04993c93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:43.253771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-522b49dd-3fe2-4138-8c2e-fabd04993c93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:43.281858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-522b49dd-3fe2-4138-8c2e-fabd04993c93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042544 Aug 18 22:00:43.282411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 465/932] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:43 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:43.808906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-712f63be-79be-4fe3-946d-9f3df7e7a2a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:43.811057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-712f63be-79be-4fe3-946d-9f3df7e7a2a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:43.817438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-712f63be-79be-4fe3-946d-9f3df7e7a2a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:43.817955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-712f63be-79be-4fe3-946d-9f3df7e7a2a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:43.818398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-712f63be-79be-4fe3-946d-9f3df7e7a2a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:43.819090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-712f63be-79be-4fe3-946d-9f3df7e7a2a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:43.819550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-712f63be-79be-4fe3-946d-9f3df7e7a2a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:43.819975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-712f63be-79be-4fe3-946d-9f3df7e7a2a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:43.849615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-712f63be-79be-4fe3-946d-9f3df7e7a2a4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044577 Aug 18 22:00:43.850208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 468/933] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:43.935878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b1214ac4-23de-4682-81ec-8309cea558f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:43.938296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b1214ac4-23de-4682-81ec-8309cea558f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:43.945098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b1214ac4-23de-4682-81ec-8309cea558f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:43.945575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b1214ac4-23de-4682-81ec-8309cea558f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:43.946036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b1214ac4-23de-4682-81ec-8309cea558f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:43.946883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b1214ac4-23de-4682-81ec-8309cea558f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:43.947341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b1214ac4-23de-4682-81ec-8309cea558f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:43.947761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b1214ac4-23de-4682-81ec-8309cea558f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:43.976880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b1214ac4-23de-4682-81ec-8309cea558f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044814 Aug 18 22:00:43.977362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 466/934] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:43 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:44.004114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c8e83bb5-bf03-4128-aded-d23b7c9aba4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:44.006307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c8e83bb5-bf03-4128-aded-d23b7c9aba4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:44.012219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8e83bb5-bf03-4128-aded-d23b7c9aba4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:44.012702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8e83bb5-bf03-4128-aded-d23b7c9aba4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:44.013138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8e83bb5-bf03-4128-aded-d23b7c9aba4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:44.013869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8e83bb5-bf03-4128-aded-d23b7c9aba4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:44.014332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8e83bb5-bf03-4128-aded-d23b7c9aba4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:44.014762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8e83bb5-bf03-4128-aded-d23b7c9aba4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:44.044044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c8e83bb5-bf03-4128-aded-d23b7c9aba4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044309 Aug 18 22:00:44.044602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 469/935] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:43 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:44.294757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2f4fd40d-430f-48e4-9dae-584182930f46 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:44.297134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2f4fd40d-430f-48e4-9dae-584182930f46 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:44.303638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f4fd40d-430f-48e4-9dae-584182930f46 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:44.304125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f4fd40d-430f-48e4-9dae-584182930f46 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:44.304565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f4fd40d-430f-48e4-9dae-584182930f46 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:44.305262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f4fd40d-430f-48e4-9dae-584182930f46 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:44.305751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f4fd40d-430f-48e4-9dae-584182930f46 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:44.306181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f4fd40d-430f-48e4-9dae-584182930f46 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:44.335720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2f4fd40d-430f-48e4-9dae-584182930f46 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044864 Aug 18 22:00:44.336279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 467/936] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:44 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:44.863269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dfdb3d9a-2ba5-4d68-8db3-0833120e7809 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:44.865388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dfdb3d9a-2ba5-4d68-8db3-0833120e7809 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:44.872088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfdb3d9a-2ba5-4d68-8db3-0833120e7809 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:44.872581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfdb3d9a-2ba5-4d68-8db3-0833120e7809 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:44.873001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfdb3d9a-2ba5-4d68-8db3-0833120e7809 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:44.873718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfdb3d9a-2ba5-4d68-8db3-0833120e7809 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:44.874175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfdb3d9a-2ba5-4d68-8db3-0833120e7809 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:44.874598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfdb3d9a-2ba5-4d68-8db3-0833120e7809 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:44.902780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dfdb3d9a-2ba5-4d68-8db3-0833120e7809 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044348 Aug 18 22:00:44.903335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 470/937] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:00:44.989226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f17a2e71-4ec6-4ed7-af9b-8f131479a214 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:44.992476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f17a2e71-4ec6-4ed7-af9b-8f131479a214 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:44.999074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f17a2e71-4ec6-4ed7-af9b-8f131479a214 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:44.999567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f17a2e71-4ec6-4ed7-af9b-8f131479a214 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:45.000049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f17a2e71-4ec6-4ed7-af9b-8f131479a214 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:45.000777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f17a2e71-4ec6-4ed7-af9b-8f131479a214 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:45.001240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f17a2e71-4ec6-4ed7-af9b-8f131479a214 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:45.001722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f17a2e71-4ec6-4ed7-af9b-8f131479a214 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:45.030613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f17a2e71-4ec6-4ed7-af9b-8f131479a214 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046227 Aug 18 22:00:45.031169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 468/938] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:45.056258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-47fd4f32-513d-46ee-80b3-95e12145876b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:45.058403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-47fd4f32-513d-46ee-80b3-95e12145876b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:45.064338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47fd4f32-513d-46ee-80b3-95e12145876b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:45.064818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47fd4f32-513d-46ee-80b3-95e12145876b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:45.065492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47fd4f32-513d-46ee-80b3-95e12145876b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:45.065944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47fd4f32-513d-46ee-80b3-95e12145876b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:45.066390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47fd4f32-513d-46ee-80b3-95e12145876b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:45.066810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47fd4f32-513d-46ee-80b3-95e12145876b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:45.096571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-47fd4f32-513d-46ee-80b3-95e12145876b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044150 Aug 18 22:00:45.097127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 471/939] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:45 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:45.348443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d72fd2e2-4847-403d-8f6d-d8dcd69df236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:45.350580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d72fd2e2-4847-403d-8f6d-d8dcd69df236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:45.357108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d72fd2e2-4847-403d-8f6d-d8dcd69df236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:45.357586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d72fd2e2-4847-403d-8f6d-d8dcd69df236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:45.358046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d72fd2e2-4847-403d-8f6d-d8dcd69df236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:45.358727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d72fd2e2-4847-403d-8f6d-d8dcd69df236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:45.359177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d72fd2e2-4847-403d-8f6d-d8dcd69df236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:45.359598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d72fd2e2-4847-403d-8f6d-d8dcd69df236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:45.388713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d72fd2e2-4847-403d-8f6d-d8dcd69df236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044637 Aug 18 22:00:45.389298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 469/940] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:45 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:45.915170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ee19555e-1764-4510-80f9-39eb9caa5117 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:45.917333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ee19555e-1764-4510-80f9-39eb9caa5117 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:45.924119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee19555e-1764-4510-80f9-39eb9caa5117 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:45.924591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee19555e-1764-4510-80f9-39eb9caa5117 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:45.925202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee19555e-1764-4510-80f9-39eb9caa5117 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:45.926312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee19555e-1764-4510-80f9-39eb9caa5117 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:45.926779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee19555e-1764-4510-80f9-39eb9caa5117 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:45.927209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee19555e-1764-4510-80f9-39eb9caa5117 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:45.956424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ee19555e-1764-4510-80f9-39eb9caa5117 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045282 Aug 18 22:00:45.956990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 472/941] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:45 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:46.050803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-37a595ce-8be3-41fa-aafd-1b3fcb5e81a7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:46.050803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-37a595ce-8be3-41fa-aafd-1b3fcb5e81a7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:46.052919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37a595ce-8be3-41fa-aafd-1b3fcb5e81a7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:46.053411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37a595ce-8be3-41fa-aafd-1b3fcb5e81a7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:46.054129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37a595ce-8be3-41fa-aafd-1b3fcb5e81a7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:46.054892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37a595ce-8be3-41fa-aafd-1b3fcb5e81a7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:46.055375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37a595ce-8be3-41fa-aafd-1b3fcb5e81a7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:46.055788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37a595ce-8be3-41fa-aafd-1b3fcb5e81a7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:46.086193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-37a595ce-8be3-41fa-aafd-1b3fcb5e81a7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046713 Aug 18 22:00:46.086764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 470/942] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:46 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:46.108351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5a2d5f39-1410-41eb-af33-1918e7f523a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:46.110606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5a2d5f39-1410-41eb-af33-1918e7f523a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:46.117474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a2d5f39-1410-41eb-af33-1918e7f523a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:46.117997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a2d5f39-1410-41eb-af33-1918e7f523a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:46.118439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a2d5f39-1410-41eb-af33-1918e7f523a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:46.119139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a2d5f39-1410-41eb-af33-1918e7f523a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:46.119599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a2d5f39-1410-41eb-af33-1918e7f523a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:46.120031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a2d5f39-1410-41eb-af33-1918e7f523a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:46.148890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5a2d5f39-1410-41eb-af33-1918e7f523a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044552 Aug 18 22:00:46.149445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 473/943] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:46.401958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-40389338-0e46-48f5-a47d-4bd97ca0312c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:46.404086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-40389338-0e46-48f5-a47d-4bd97ca0312c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:46.410502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40389338-0e46-48f5-a47d-4bd97ca0312c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:46.410993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40389338-0e46-48f5-a47d-4bd97ca0312c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:46.411434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40389338-0e46-48f5-a47d-4bd97ca0312c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:46.412130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40389338-0e46-48f5-a47d-4bd97ca0312c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:46.412593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40389338-0e46-48f5-a47d-4bd97ca0312c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:46.413022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40389338-0e46-48f5-a47d-4bd97ca0312c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:46.442275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-40389338-0e46-48f5-a47d-4bd97ca0312c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044275 Aug 18 22:00:46.442823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 471/944] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:46 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:46.968618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ffa8ed3-fe41-4afc-ab8e-ccb9ec99c6a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:46.970735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ffa8ed3-fe41-4afc-ab8e-ccb9ec99c6a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:46.977432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ffa8ed3-fe41-4afc-ab8e-ccb9ec99c6a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:46.977951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ffa8ed3-fe41-4afc-ab8e-ccb9ec99c6a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:46.978390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ffa8ed3-fe41-4afc-ab8e-ccb9ec99c6a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:46.979086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ffa8ed3-fe41-4afc-ab8e-ccb9ec99c6a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:46.979546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ffa8ed3-fe41-4afc-ab8e-ccb9ec99c6a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:46.979979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ffa8ed3-fe41-4afc-ab8e-ccb9ec99c6a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:47.008932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ffa8ed3-fe41-4afc-ab8e-ccb9ec99c6a9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044380 Aug 18 22:00:47.009500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 474/945] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:46 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:47.098514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b72a4e8f-5204-40f2-836b-fe9a17fbe4db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:47.100880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b72a4e8f-5204-40f2-836b-fe9a17fbe4db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:47.107928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b72a4e8f-5204-40f2-836b-fe9a17fbe4db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:47.108417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b72a4e8f-5204-40f2-836b-fe9a17fbe4db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:47.108899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b72a4e8f-5204-40f2-836b-fe9a17fbe4db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:47.109709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b72a4e8f-5204-40f2-836b-fe9a17fbe4db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:47.110167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b72a4e8f-5204-40f2-836b-fe9a17fbe4db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:47.110507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b72a4e8f-5204-40f2-836b-fe9a17fbe4db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:47.143300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b72a4e8f-5204-40f2-836b-fe9a17fbe4db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048960 Aug 18 22:00:47.143851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 472/946] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:47 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:47.160272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-724d56aa-237d-43b7-a64d-b00803d9a22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:47.162513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-724d56aa-237d-43b7-a64d-b00803d9a22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:47.168848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-724d56aa-237d-43b7-a64d-b00803d9a22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:47.169330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-724d56aa-237d-43b7-a64d-b00803d9a22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:47.169802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-724d56aa-237d-43b7-a64d-b00803d9a22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:47.170501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-724d56aa-237d-43b7-a64d-b00803d9a22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:47.171210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-724d56aa-237d-43b7-a64d-b00803d9a22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:47.171644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-724d56aa-237d-43b7-a64d-b00803d9a22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:47.199948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-724d56aa-237d-43b7-a64d-b00803d9a22e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043628 Aug 18 22:00:47.200533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 475/947] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:47.454640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f2190f69-d700-452e-8316-a2f6f7c54d80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:47.456959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f2190f69-d700-452e-8316-a2f6f7c54d80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:47.462985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2190f69-d700-452e-8316-a2f6f7c54d80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:47.463478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2190f69-d700-452e-8316-a2f6f7c54d80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:47.463918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2190f69-d700-452e-8316-a2f6f7c54d80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:47.464645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2190f69-d700-452e-8316-a2f6f7c54d80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:47.465239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2190f69-d700-452e-8316-a2f6f7c54d80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:47.465688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2190f69-d700-452e-8316-a2f6f7c54d80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:47.494191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f2190f69-d700-452e-8316-a2f6f7c54d80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043523 Aug 18 22:00:47.494751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 473/948] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:47 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:48.021906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-90d670cf-84e3-4e81-97e4-bb551bab58cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:48.024109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-90d670cf-84e3-4e81-97e4-bb551bab58cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:48.030045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90d670cf-84e3-4e81-97e4-bb551bab58cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:48.030529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90d670cf-84e3-4e81-97e4-bb551bab58cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:48.030967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90d670cf-84e3-4e81-97e4-bb551bab58cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:48.031670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90d670cf-84e3-4e81-97e4-bb551bab58cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:48.032128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90d670cf-84e3-4e81-97e4-bb551bab58cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:48.033225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90d670cf-84e3-4e81-97e4-bb551bab58cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:48.047594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:48.064064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-90d670cf-84e3-4e81-97e4-bb551bab58cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046709 Aug 18 22:00:48.064638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 476/949] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:48.155264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7b7b359e-583a-432c-8bd7-65bcc1a07d24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:48.157406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7b7b359e-583a-432c-8bd7-65bcc1a07d24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:48.164633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b7b359e-583a-432c-8bd7-65bcc1a07d24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:48.165118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b7b359e-583a-432c-8bd7-65bcc1a07d24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:48.165555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b7b359e-583a-432c-8bd7-65bcc1a07d24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:48.166253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b7b359e-583a-432c-8bd7-65bcc1a07d24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:48.166712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b7b359e-583a-432c-8bd7-65bcc1a07d24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:48.167136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b7b359e-583a-432c-8bd7-65bcc1a07d24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:48.195993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7b7b359e-583a-432c-8bd7-65bcc1a07d24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044608 Aug 18 22:00:48.196546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 474/950] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:48 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:48.212169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f0f2e0b9-bf31-440a-a932-141f587fdeb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:48.214445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f0f2e0b9-bf31-440a-a932-141f587fdeb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:48.221434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0f2e0b9-bf31-440a-a932-141f587fdeb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:48.221936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0f2e0b9-bf31-440a-a932-141f587fdeb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:48.222367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0f2e0b9-bf31-440a-a932-141f587fdeb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:48.223054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0f2e0b9-bf31-440a-a932-141f587fdeb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:48.223503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0f2e0b9-bf31-440a-a932-141f587fdeb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:48.223926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0f2e0b9-bf31-440a-a932-141f587fdeb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:48.251960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f0f2e0b9-bf31-440a-a932-141f587fdeb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043665 Aug 18 22:00:48.252505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 477/951] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:48 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:48.506114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a414303c-3dc9-4780-aa3e-32ccd9148fe3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:48.508189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a414303c-3dc9-4780-aa3e-32ccd9148fe3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:48.513988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a414303c-3dc9-4780-aa3e-32ccd9148fe3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:48.514463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a414303c-3dc9-4780-aa3e-32ccd9148fe3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:48.514897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a414303c-3dc9-4780-aa3e-32ccd9148fe3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:48.515578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a414303c-3dc9-4780-aa3e-32ccd9148fe3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:48.516029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a414303c-3dc9-4780-aa3e-32ccd9148fe3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:48.516444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a414303c-3dc9-4780-aa3e-32ccd9148fe3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:48.545811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a414303c-3dc9-4780-aa3e-32ccd9148fe3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044207 Aug 18 22:00:48.546619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 475/952] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:48 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:49.076597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e1f16b08-74e7-4819-b87e-bbb4daf87a32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:49.078737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e1f16b08-74e7-4819-b87e-bbb4daf87a32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:49.085083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e1f16b08-74e7-4819-b87e-bbb4daf87a32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:49.085558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e1f16b08-74e7-4819-b87e-bbb4daf87a32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:49.086012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e1f16b08-74e7-4819-b87e-bbb4daf87a32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:49.086703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e1f16b08-74e7-4819-b87e-bbb4daf87a32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:49.087150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e1f16b08-74e7-4819-b87e-bbb4daf87a32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:49.087570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e1f16b08-74e7-4819-b87e-bbb4daf87a32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:49.116638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e1f16b08-74e7-4819-b87e-bbb4daf87a32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044048 Aug 18 22:00:49.117196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 478/953] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:49.216353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-61df1a38-7c2b-49d4-b446-e5f196c26443 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:49.222588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-61df1a38-7c2b-49d4-b446-e5f196c26443 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:49.227235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61df1a38-7c2b-49d4-b446-e5f196c26443 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:49.227896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61df1a38-7c2b-49d4-b446-e5f196c26443 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:49.228330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61df1a38-7c2b-49d4-b446-e5f196c26443 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:49.229027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61df1a38-7c2b-49d4-b446-e5f196c26443 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:49.229478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61df1a38-7c2b-49d4-b446-e5f196c26443 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:49.229928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61df1a38-7c2b-49d4-b446-e5f196c26443 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:49.247110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:49.260009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-61df1a38-7c2b-49d4-b446-e5f196c26443 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055794 Aug 18 22:00:49.260566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 476/954] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:49 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:49.264323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6b56f7d9-ef31-4d6c-86cd-a1f4442cffe0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:49.266525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6b56f7d9-ef31-4d6c-86cd-a1f4442cffe0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:49.273085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b56f7d9-ef31-4d6c-86cd-a1f4442cffe0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:49.273576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b56f7d9-ef31-4d6c-86cd-a1f4442cffe0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:49.274056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b56f7d9-ef31-4d6c-86cd-a1f4442cffe0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:49.274760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b56f7d9-ef31-4d6c-86cd-a1f4442cffe0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:49.275256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b56f7d9-ef31-4d6c-86cd-a1f4442cffe0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:49.275716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b56f7d9-ef31-4d6c-86cd-a1f4442cffe0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:49.305830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6b56f7d9-ef31-4d6c-86cd-a1f4442cffe0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045593 Aug 18 22:00:49.306386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 479/955] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:49 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:49.558440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-008c9963-dbd3-47b6-9465-6d2a1a1427d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:49.560555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-008c9963-dbd3-47b6-9465-6d2a1a1427d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:49.566591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-008c9963-dbd3-47b6-9465-6d2a1a1427d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:49.566998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-008c9963-dbd3-47b6-9465-6d2a1a1427d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:49.567437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-008c9963-dbd3-47b6-9465-6d2a1a1427d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:49.568134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-008c9963-dbd3-47b6-9465-6d2a1a1427d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:49.568598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-008c9963-dbd3-47b6-9465-6d2a1a1427d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:49.569025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-008c9963-dbd3-47b6-9465-6d2a1a1427d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:49.599773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-008c9963-dbd3-47b6-9465-6d2a1a1427d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Aug 18 22:00:49.600332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 477/956] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:49 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:50.129470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9fe1c612-0718-4b2f-8ebf-7b467c9f2a16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:50.131609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9fe1c612-0718-4b2f-8ebf-7b467c9f2a16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:50.137449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fe1c612-0718-4b2f-8ebf-7b467c9f2a16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:50.137949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fe1c612-0718-4b2f-8ebf-7b467c9f2a16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:50.138379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fe1c612-0718-4b2f-8ebf-7b467c9f2a16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:50.139061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fe1c612-0718-4b2f-8ebf-7b467c9f2a16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:50.139508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fe1c612-0718-4b2f-8ebf-7b467c9f2a16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:50.139927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fe1c612-0718-4b2f-8ebf-7b467c9f2a16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:50.169689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9fe1c612-0718-4b2f-8ebf-7b467c9f2a16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044686 Aug 18 22:00:50.170254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 480/957] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:50.272693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-69a7f13e-807e-4682-8ea0-6244f9fd17e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:50.274835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-69a7f13e-807e-4682-8ea0-6244f9fd17e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:50.281257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-69a7f13e-807e-4682-8ea0-6244f9fd17e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:50.281831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-69a7f13e-807e-4682-8ea0-6244f9fd17e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:50.282214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-69a7f13e-807e-4682-8ea0-6244f9fd17e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:50.282951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-69a7f13e-807e-4682-8ea0-6244f9fd17e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:50.283486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-69a7f13e-807e-4682-8ea0-6244f9fd17e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:50.283910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-69a7f13e-807e-4682-8ea0-6244f9fd17e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:50.313874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-69a7f13e-807e-4682-8ea0-6244f9fd17e8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Aug 18 22:00:50.315052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 478/958] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:50.318844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b71b7448-6bfc-4745-bfc0-1566e60d73b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:50.321026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b71b7448-6bfc-4745-bfc0-1566e60d73b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:50.327429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b71b7448-6bfc-4745-bfc0-1566e60d73b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:50.327906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b71b7448-6bfc-4745-bfc0-1566e60d73b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:50.328337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b71b7448-6bfc-4745-bfc0-1566e60d73b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:50.329029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b71b7448-6bfc-4745-bfc0-1566e60d73b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:50.329504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b71b7448-6bfc-4745-bfc0-1566e60d73b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:50.329999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b71b7448-6bfc-4745-bfc0-1566e60d73b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:50.358441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b71b7448-6bfc-4745-bfc0-1566e60d73b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Aug 18 22:00:50.358991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 481/959] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:50 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:50.612546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c5017729-4970-4cee-8981-634d97846915 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:50.614658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c5017729-4970-4cee-8981-634d97846915 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:50.620684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5017729-4970-4cee-8981-634d97846915 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:50.621176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5017729-4970-4cee-8981-634d97846915 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:50.621683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5017729-4970-4cee-8981-634d97846915 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:50.622382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5017729-4970-4cee-8981-634d97846915 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:50.622844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5017729-4970-4cee-8981-634d97846915 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:50.623305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5017729-4970-4cee-8981-634d97846915 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:50.652905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c5017729-4970-4cee-8981-634d97846915 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044825 Aug 18 22:00:50.653482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 479/960] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:50 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:51.182545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da8a56a3-5845-4aa6-b4f6-cb54a646b2ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:51.184690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-da8a56a3-5845-4aa6-b4f6-cb54a646b2ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:51.190593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da8a56a3-5845-4aa6-b4f6-cb54a646b2ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:51.191075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da8a56a3-5845-4aa6-b4f6-cb54a646b2ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:51.191513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da8a56a3-5845-4aa6-b4f6-cb54a646b2ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:51.192205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da8a56a3-5845-4aa6-b4f6-cb54a646b2ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:51.192661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da8a56a3-5845-4aa6-b4f6-cb54a646b2ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:51.193091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da8a56a3-5845-4aa6-b4f6-cb54a646b2ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:51.222710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da8a56a3-5845-4aa6-b4f6-cb54a646b2ab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044090 Aug 18 22:00:51.223278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 482/961] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:51 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:51.326315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-929465b9-f015-4dfd-9092-73a960c8eec7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:51.328457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-929465b9-f015-4dfd-9092-73a960c8eec7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:51.335344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-929465b9-f015-4dfd-9092-73a960c8eec7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:51.335837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-929465b9-f015-4dfd-9092-73a960c8eec7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:51.336278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-929465b9-f015-4dfd-9092-73a960c8eec7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:51.336979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-929465b9-f015-4dfd-9092-73a960c8eec7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:51.337439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-929465b9-f015-4dfd-9092-73a960c8eec7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:51.337896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-929465b9-f015-4dfd-9092-73a960c8eec7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:51.367971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-929465b9-f015-4dfd-9092-73a960c8eec7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045944 Aug 18 22:00:51.368534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 480/962] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:51.371631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8c9c4183-aa5a-406f-9846-4591d912cf3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:51.373913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8c9c4183-aa5a-406f-9846-4591d912cf3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:51.380263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c9c4183-aa5a-406f-9846-4591d912cf3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:51.380749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c9c4183-aa5a-406f-9846-4591d912cf3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:51.381188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c9c4183-aa5a-406f-9846-4591d912cf3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:51.381918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c9c4183-aa5a-406f-9846-4591d912cf3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:51.382446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c9c4183-aa5a-406f-9846-4591d912cf3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:51.382880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c9c4183-aa5a-406f-9846-4591d912cf3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:51.412241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8c9c4183-aa5a-406f-9846-4591d912cf3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Aug 18 22:00:51.412792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 483/963] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:51 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:51.664201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-535ff56f-4f8c-476e-9d9a-6dcf98552a96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:51.666371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-535ff56f-4f8c-476e-9d9a-6dcf98552a96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:51.672440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-535ff56f-4f8c-476e-9d9a-6dcf98552a96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:51.672916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-535ff56f-4f8c-476e-9d9a-6dcf98552a96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:51.673349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-535ff56f-4f8c-476e-9d9a-6dcf98552a96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:51.674084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-535ff56f-4f8c-476e-9d9a-6dcf98552a96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:51.674536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-535ff56f-4f8c-476e-9d9a-6dcf98552a96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:51.674958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-535ff56f-4f8c-476e-9d9a-6dcf98552a96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:51.705531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-535ff56f-4f8c-476e-9d9a-6dcf98552a96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044382 Aug 18 22:00:51.706093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 481/964] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:51 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:52.235119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ee973a26-e561-4a82-bc34-ba0c81590fd2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:52.237910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ee973a26-e561-4a82-bc34-ba0c81590fd2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:52.243922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee973a26-e561-4a82-bc34-ba0c81590fd2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:52.244403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee973a26-e561-4a82-bc34-ba0c81590fd2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:52.244842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee973a26-e561-4a82-bc34-ba0c81590fd2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:52.245533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee973a26-e561-4a82-bc34-ba0c81590fd2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:52.246086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee973a26-e561-4a82-bc34-ba0c81590fd2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:52.246518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee973a26-e561-4a82-bc34-ba0c81590fd2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:52.274803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ee973a26-e561-4a82-bc34-ba0c81590fd2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043638 Aug 18 22:00:52.275360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 484/965] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:52 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:52.379540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9deab09c-2233-45c6-919d-3555030bb10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:52.381559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9deab09c-2233-45c6-919d-3555030bb10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:52.387906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9deab09c-2233-45c6-919d-3555030bb10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:52.388501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9deab09c-2233-45c6-919d-3555030bb10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:52.388819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9deab09c-2233-45c6-919d-3555030bb10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:52.389519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9deab09c-2233-45c6-919d-3555030bb10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:52.390004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9deab09c-2233-45c6-919d-3555030bb10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:52.390507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9deab09c-2233-45c6-919d-3555030bb10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:52.422346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9deab09c-2233-45c6-919d-3555030bb10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046743 Aug 18 22:00:52.422917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 482/966] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:52.425624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1257c08c-486a-4e27-97b3-111d2bdec9a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:52.427891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1257c08c-486a-4e27-97b3-111d2bdec9a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:52.434186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1257c08c-486a-4e27-97b3-111d2bdec9a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:52.434691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1257c08c-486a-4e27-97b3-111d2bdec9a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:52.435123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1257c08c-486a-4e27-97b3-111d2bdec9a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:52.435807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1257c08c-486a-4e27-97b3-111d2bdec9a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:52.436371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1257c08c-486a-4e27-97b3-111d2bdec9a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:52.436793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1257c08c-486a-4e27-97b3-111d2bdec9a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:52.465031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1257c08c-486a-4e27-97b3-111d2bdec9a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Aug 18 22:00:52.465579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 485/967] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:52.717982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-21d9e215-c414-4088-8781-cb346a6b0767 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:52.720794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-21d9e215-c414-4088-8781-cb346a6b0767 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:52.726768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d9e215-c414-4088-8781-cb346a6b0767 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:52.727243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d9e215-c414-4088-8781-cb346a6b0767 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:52.727676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d9e215-c414-4088-8781-cb346a6b0767 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:52.728362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d9e215-c414-4088-8781-cb346a6b0767 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:52.728814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d9e215-c414-4088-8781-cb346a6b0767 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:52.729233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d9e215-c414-4088-8781-cb346a6b0767 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:52.757508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-21d9e215-c414-4088-8781-cb346a6b0767 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043500 Aug 18 22:00:52.758096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 483/968] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:52 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:53.286386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-506a6fa2-3d74-44b5-8d40-d33adabd9d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:53.288540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-506a6fa2-3d74-44b5-8d40-d33adabd9d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:53.294559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-506a6fa2-3d74-44b5-8d40-d33adabd9d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:53.295032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-506a6fa2-3d74-44b5-8d40-d33adabd9d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:53.295468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-506a6fa2-3d74-44b5-8d40-d33adabd9d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:53.296413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-506a6fa2-3d74-44b5-8d40-d33adabd9d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:53.296865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-506a6fa2-3d74-44b5-8d40-d33adabd9d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:53.297288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-506a6fa2-3d74-44b5-8d40-d33adabd9d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:53.326282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-506a6fa2-3d74-44b5-8d40-d33adabd9d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044042 Aug 18 22:00:53.326840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 486/969] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:53 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:53.434796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b18d1f0b-b3a7-468f-9c5c-aa5446a79d0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:53.436909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b18d1f0b-b3a7-468f-9c5c-aa5446a79d0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:53.444228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b18d1f0b-b3a7-468f-9c5c-aa5446a79d0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:53.444714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b18d1f0b-b3a7-468f-9c5c-aa5446a79d0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:53.445146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b18d1f0b-b3a7-468f-9c5c-aa5446a79d0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:53.445872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b18d1f0b-b3a7-468f-9c5c-aa5446a79d0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:53.446329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b18d1f0b-b3a7-468f-9c5c-aa5446a79d0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:53.446752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b18d1f0b-b3a7-468f-9c5c-aa5446a79d0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:53.476218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b18d1f0b-b3a7-468f-9c5c-aa5446a79d0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045203 Aug 18 22:00:53.476423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fffa3c36-3b1c-4858-8adc-cb17f8e166db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:53.477189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 484/970] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:53 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:53.478449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fffa3c36-3b1c-4858-8adc-cb17f8e166db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:53.484751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fffa3c36-3b1c-4858-8adc-cb17f8e166db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:53.485230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fffa3c36-3b1c-4858-8adc-cb17f8e166db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:53.486177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fffa3c36-3b1c-4858-8adc-cb17f8e166db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:53.486882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fffa3c36-3b1c-4858-8adc-cb17f8e166db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:53.487360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fffa3c36-3b1c-4858-8adc-cb17f8e166db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:53.487786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fffa3c36-3b1c-4858-8adc-cb17f8e166db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:53.516620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fffa3c36-3b1c-4858-8adc-cb17f8e166db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Aug 18 22:00:53.517197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 487/971] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:53.769646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5a426741-3b12-4869-901d-c203bdd418f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:53.771831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5a426741-3b12-4869-901d-c203bdd418f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:53.777805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a426741-3b12-4869-901d-c203bdd418f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:53.778288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a426741-3b12-4869-901d-c203bdd418f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:53.778724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a426741-3b12-4869-901d-c203bdd418f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:53.779413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a426741-3b12-4869-901d-c203bdd418f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:53.779871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a426741-3b12-4869-901d-c203bdd418f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:53.780297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a426741-3b12-4869-901d-c203bdd418f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:53.809867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5a426741-3b12-4869-901d-c203bdd418f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Aug 18 22:00:53.810418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 485/972] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:53 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:54.338571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-35cf88d3-105a-44bb-a7cc-14f9646ad041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:54.340693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-35cf88d3-105a-44bb-a7cc-14f9646ad041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:54.347289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35cf88d3-105a-44bb-a7cc-14f9646ad041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:54.347767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35cf88d3-105a-44bb-a7cc-14f9646ad041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:54.348204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35cf88d3-105a-44bb-a7cc-14f9646ad041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:54.348891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35cf88d3-105a-44bb-a7cc-14f9646ad041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:54.349345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35cf88d3-105a-44bb-a7cc-14f9646ad041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:54.349807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35cf88d3-105a-44bb-a7cc-14f9646ad041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:54.378838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-35cf88d3-105a-44bb-a7cc-14f9646ad041 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044194 Aug 18 22:00:54.379404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 488/973] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:54 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:54.488370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c2d5e7c8-c581-40de-9216-4e79e674532f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:54.490493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c2d5e7c8-c581-40de-9216-4e79e674532f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:54.492788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:54.497952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d5e7c8-c581-40de-9216-4e79e674532f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:54.498427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d5e7c8-c581-40de-9216-4e79e674532f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:54.498859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d5e7c8-c581-40de-9216-4e79e674532f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:54.499553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d5e7c8-c581-40de-9216-4e79e674532f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:54.500002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d5e7c8-c581-40de-9216-4e79e674532f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:54.500426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d5e7c8-c581-40de-9216-4e79e674532f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:54.534244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a9c19638-6423-4441-9788-478999def8a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:54.534878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c2d5e7c8-c581-40de-9216-4e79e674532f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050364 Aug 18 22:00:54.535439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 486/974] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:54 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:54.536400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a9c19638-6423-4441-9788-478999def8a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:54.542540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9c19638-6423-4441-9788-478999def8a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:54.543025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9c19638-6423-4441-9788-478999def8a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:54.543466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9c19638-6423-4441-9788-478999def8a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:54.544168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9c19638-6423-4441-9788-478999def8a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:54.544625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9c19638-6423-4441-9788-478999def8a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:54.545053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9c19638-6423-4441-9788-478999def8a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:54.574291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a9c19638-6423-4441-9788-478999def8a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049889 Aug 18 22:00:54.575044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 489/975] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:54.822696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f96cd351-0d06-43ed-8c76-de76bcd4f909 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:54.824938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f96cd351-0d06-43ed-8c76-de76bcd4f909 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:54.830926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f96cd351-0d06-43ed-8c76-de76bcd4f909 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:54.831405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f96cd351-0d06-43ed-8c76-de76bcd4f909 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:54.831836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f96cd351-0d06-43ed-8c76-de76bcd4f909 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:54.832528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f96cd351-0d06-43ed-8c76-de76bcd4f909 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:54.832984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f96cd351-0d06-43ed-8c76-de76bcd4f909 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:54.833407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f96cd351-0d06-43ed-8c76-de76bcd4f909 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:54.861908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f96cd351-0d06-43ed-8c76-de76bcd4f909 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043596 Aug 18 22:00:54.862458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 487/976] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:54 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:55.391435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f3e6ca81-5dd0-4385-af07-257047ada371 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:55.393771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f3e6ca81-5dd0-4385-af07-257047ada371 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:55.399896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3e6ca81-5dd0-4385-af07-257047ada371 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:55.400382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3e6ca81-5dd0-4385-af07-257047ada371 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:55.400824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3e6ca81-5dd0-4385-af07-257047ada371 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:55.401531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3e6ca81-5dd0-4385-af07-257047ada371 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:55.402019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3e6ca81-5dd0-4385-af07-257047ada371 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:55.402450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3e6ca81-5dd0-4385-af07-257047ada371 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:55.432741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f3e6ca81-5dd0-4385-af07-257047ada371 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045366 Aug 18 22:00:55.433302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 490/977] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:55.547025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bab28000-70f3-4361-969a-977767f227a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:55.549205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bab28000-70f3-4361-969a-977767f227a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:55.555515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bab28000-70f3-4361-969a-977767f227a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:55.556006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bab28000-70f3-4361-969a-977767f227a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:55.556448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bab28000-70f3-4361-969a-977767f227a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:55.557152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bab28000-70f3-4361-969a-977767f227a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:55.557624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bab28000-70f3-4361-969a-977767f227a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:55.558075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bab28000-70f3-4361-969a-977767f227a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:55.589120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8bab0950-2780-4837-83c3-897af173a58a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:55.589551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bab28000-70f3-4361-969a-977767f227a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045126 Aug 18 22:00:55.589551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 488/978] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:55 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:55.589761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8bab0950-2780-4837-83c3-897af173a58a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:55.596073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bab0950-2780-4837-83c3-897af173a58a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:55.596562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bab0950-2780-4837-83c3-897af173a58a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:55.597009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bab0950-2780-4837-83c3-897af173a58a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:55.597761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bab0950-2780-4837-83c3-897af173a58a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:55.598226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bab0950-2780-4837-83c3-897af173a58a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:55.598655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8bab0950-2780-4837-83c3-897af173a58a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:55.628310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8bab0950-2780-4837-83c3-897af173a58a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 Aug 18 22:00:55.628878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 491/979] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:55 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:55.874253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bfdc867f-5548-4080-aa38-29d86060f9ce tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:55.876388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bfdc867f-5548-4080-aa38-29d86060f9ce tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:55.882389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfdc867f-5548-4080-aa38-29d86060f9ce tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:55.882876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfdc867f-5548-4080-aa38-29d86060f9ce tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:55.883316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfdc867f-5548-4080-aa38-29d86060f9ce tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:55.884011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfdc867f-5548-4080-aa38-29d86060f9ce tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:55.884469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfdc867f-5548-4080-aa38-29d86060f9ce tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:55.884899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfdc867f-5548-4080-aa38-29d86060f9ce tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:55.914879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bfdc867f-5548-4080-aa38-29d86060f9ce tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044350 Aug 18 22:00:55.915255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 489/980] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:55 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:56.445529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e9c07cbb-520b-4f6b-a4b8-c034ae7a7e70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:56.447669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e9c07cbb-520b-4f6b-a4b8-c034ae7a7e70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:56.453515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9c07cbb-520b-4f6b-a4b8-c034ae7a7e70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:56.454022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9c07cbb-520b-4f6b-a4b8-c034ae7a7e70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:56.454453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9c07cbb-520b-4f6b-a4b8-c034ae7a7e70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:56.455145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9c07cbb-520b-4f6b-a4b8-c034ae7a7e70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:56.455587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9c07cbb-520b-4f6b-a4b8-c034ae7a7e70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:56.456002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9c07cbb-520b-4f6b-a4b8-c034ae7a7e70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:56.484739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e9c07cbb-520b-4f6b-a4b8-c034ae7a7e70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043744 Aug 18 22:00:56.485285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 492/981] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:56.599803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0913edce-5212-484f-9e05-3ab1dae1d7bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:56.602134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0913edce-5212-484f-9e05-3ab1dae1d7bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:56.608167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0913edce-5212-484f-9e05-3ab1dae1d7bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:56.608653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0913edce-5212-484f-9e05-3ab1dae1d7bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:56.609091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0913edce-5212-484f-9e05-3ab1dae1d7bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:56.609830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0913edce-5212-484f-9e05-3ab1dae1d7bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:56.610291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0913edce-5212-484f-9e05-3ab1dae1d7bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:56.611304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0913edce-5212-484f-9e05-3ab1dae1d7bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:56.641003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d48a39d8-2ba4-43f1-8e96-275dcd0211a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:56.642145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0913edce-5212-484f-9e05-3ab1dae1d7bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046315 Aug 18 22:00:56.646677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 490/982] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:56 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:56.647065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d48a39d8-2ba4-43f1-8e96-275dcd0211a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:56.651015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d48a39d8-2ba4-43f1-8e96-275dcd0211a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:56.651500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d48a39d8-2ba4-43f1-8e96-275dcd0211a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:56.651939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d48a39d8-2ba4-43f1-8e96-275dcd0211a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:56.652677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d48a39d8-2ba4-43f1-8e96-275dcd0211a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:56.653132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d48a39d8-2ba4-43f1-8e96-275dcd0211a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:56.653559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d48a39d8-2ba4-43f1-8e96-275dcd0211a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:56.657183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:56.684044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d48a39d8-2ba4-43f1-8e96-275dcd0211a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047416 Aug 18 22:00:56.684603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 493/983] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:56 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:56.928095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-55446859-b390-445e-9174-0d9e4caf2826 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:56.930261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-55446859-b390-445e-9174-0d9e4caf2826 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:56.936127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55446859-b390-445e-9174-0d9e4caf2826 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:56.936609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55446859-b390-445e-9174-0d9e4caf2826 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:56.937046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55446859-b390-445e-9174-0d9e4caf2826 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:56.937771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55446859-b390-445e-9174-0d9e4caf2826 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:56.938226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55446859-b390-445e-9174-0d9e4caf2826 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:56.938650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55446859-b390-445e-9174-0d9e4caf2826 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:56.966889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-55446859-b390-445e-9174-0d9e4caf2826 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043325 Aug 18 22:00:56.972089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 491/984] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:56 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:57.497684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e30b02fe-fb0a-4dd9-8774-8345ec689f0d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:57.499847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e30b02fe-fb0a-4dd9-8774-8345ec689f0d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:57.506515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e30b02fe-fb0a-4dd9-8774-8345ec689f0d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:57.507006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e30b02fe-fb0a-4dd9-8774-8345ec689f0d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:57.507501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e30b02fe-fb0a-4dd9-8774-8345ec689f0d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:57.508263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e30b02fe-fb0a-4dd9-8774-8345ec689f0d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:57.508713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e30b02fe-fb0a-4dd9-8774-8345ec689f0d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:57.509141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e30b02fe-fb0a-4dd9-8774-8345ec689f0d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:57.543801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e30b02fe-fb0a-4dd9-8774-8345ec689f0d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050076 Aug 18 22:00:57.544384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 494/985] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:57.653845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-db3057a5-2dd9-41b6-b8ba-9920aec344d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:57.655948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-db3057a5-2dd9-41b6-b8ba-9920aec344d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:57.662448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db3057a5-2dd9-41b6-b8ba-9920aec344d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:57.662928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db3057a5-2dd9-41b6-b8ba-9920aec344d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:57.663360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db3057a5-2dd9-41b6-b8ba-9920aec344d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:57.664054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db3057a5-2dd9-41b6-b8ba-9920aec344d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:57.664503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db3057a5-2dd9-41b6-b8ba-9920aec344d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:57.664923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db3057a5-2dd9-41b6-b8ba-9920aec344d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:57.697404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6d24c21e-124c-4a3c-8178-0727e43889ff tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:57.699673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6d24c21e-124c-4a3c-8178-0727e43889ff tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:57.705778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-db3057a5-2dd9-41b6-b8ba-9920aec344d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055747 Aug 18 22:00:57.706597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d24c21e-124c-4a3c-8178-0727e43889ff tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:57.707374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d24c21e-124c-4a3c-8178-0727e43889ff tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:57.708082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d24c21e-124c-4a3c-8178-0727e43889ff tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:57.710522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 492/986] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:57.714745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d24c21e-124c-4a3c-8178-0727e43889ff tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:57.715325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d24c21e-124c-4a3c-8178-0727e43889ff tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:57.715887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d24c21e-124c-4a3c-8178-0727e43889ff tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:57.745090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6d24c21e-124c-4a3c-8178-0727e43889ff tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051777 Aug 18 22:00:57.745668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 495/987] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:57 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:57.979586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c4727e36-de5b-478f-be69-cc459e1b7115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:57.981746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c4727e36-de5b-478f-be69-cc459e1b7115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:57.988318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4727e36-de5b-478f-be69-cc459e1b7115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:57.988809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4727e36-de5b-478f-be69-cc459e1b7115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:57.989248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4727e36-de5b-478f-be69-cc459e1b7115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:57.989977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4727e36-de5b-478f-be69-cc459e1b7115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:57.990440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4727e36-de5b-478f-be69-cc459e1b7115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:57.990872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4727e36-de5b-478f-be69-cc459e1b7115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:57.994537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:00:58.020544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c4727e36-de5b-478f-be69-cc459e1b7115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044930 Aug 18 22:00:58.021101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 493/988] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:57 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:58.556897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9e2bd493-178e-4443-b460-a4999d44e98d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:58.559169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9e2bd493-178e-4443-b460-a4999d44e98d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:58.565238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e2bd493-178e-4443-b460-a4999d44e98d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:58.565754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e2bd493-178e-4443-b460-a4999d44e98d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:58.566194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e2bd493-178e-4443-b460-a4999d44e98d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:58.566893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e2bd493-178e-4443-b460-a4999d44e98d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:58.567351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e2bd493-178e-4443-b460-a4999d44e98d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:58.567780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e2bd493-178e-4443-b460-a4999d44e98d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:58.598650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9e2bd493-178e-4443-b460-a4999d44e98d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045747 Aug 18 22:00:58.599232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 496/989] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:58.719359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4eebc1a1-e14e-4115-b94e-bc7247258161 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:58.722477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4eebc1a1-e14e-4115-b94e-bc7247258161 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:58.729377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eebc1a1-e14e-4115-b94e-bc7247258161 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:58.729993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eebc1a1-e14e-4115-b94e-bc7247258161 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:58.730496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eebc1a1-e14e-4115-b94e-bc7247258161 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:58.731244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eebc1a1-e14e-4115-b94e-bc7247258161 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:58.731762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eebc1a1-e14e-4115-b94e-bc7247258161 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:58.732302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eebc1a1-e14e-4115-b94e-bc7247258161 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:58.762111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2b8225a4-a7f7-4f36-ab6f-d42bb75039bd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:58.762111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2b8225a4-a7f7-4f36-ab6f-d42bb75039bd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:58.773400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b8225a4-a7f7-4f36-ab6f-d42bb75039bd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:58.773940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b8225a4-a7f7-4f36-ab6f-d42bb75039bd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:58.774381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b8225a4-a7f7-4f36-ab6f-d42bb75039bd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:58.775207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4eebc1a1-e14e-4115-b94e-bc7247258161 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060701 Aug 18 22:00:58.775350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b8225a4-a7f7-4f36-ab6f-d42bb75039bd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:58.775771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b8225a4-a7f7-4f36-ab6f-d42bb75039bd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:58.776111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 494/990] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:58 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:58.780509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b8225a4-a7f7-4f36-ab6f-d42bb75039bd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:58.812515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2b8225a4-a7f7-4f36-ab6f-d42bb75039bd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059452 Aug 18 22:00:58.813205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 497/991] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:00:59.032478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9bb3407c-30c3-4d1c-9ba8-4de9af0c3c55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:59.034779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9bb3407c-30c3-4d1c-9ba8-4de9af0c3c55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:59.041085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bb3407c-30c3-4d1c-9ba8-4de9af0c3c55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:59.041619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bb3407c-30c3-4d1c-9ba8-4de9af0c3c55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:59.042068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bb3407c-30c3-4d1c-9ba8-4de9af0c3c55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:59.042762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bb3407c-30c3-4d1c-9ba8-4de9af0c3c55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:59.043216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bb3407c-30c3-4d1c-9ba8-4de9af0c3c55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:59.043660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bb3407c-30c3-4d1c-9ba8-4de9af0c3c55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:59.076234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9bb3407c-30c3-4d1c-9ba8-4de9af0c3c55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047614 Aug 18 22:00:59.076730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 495/992] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:59 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:59.611928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8f0aa16a-addf-4e3d-a47e-c521a025f546 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:59.613984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8f0aa16a-addf-4e3d-a47e-c521a025f546 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:59.619928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f0aa16a-addf-4e3d-a47e-c521a025f546 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:59.620412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f0aa16a-addf-4e3d-a47e-c521a025f546 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:59.620848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f0aa16a-addf-4e3d-a47e-c521a025f546 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:59.621547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f0aa16a-addf-4e3d-a47e-c521a025f546 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:59.622032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f0aa16a-addf-4e3d-a47e-c521a025f546 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:59.622463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f0aa16a-addf-4e3d-a47e-c521a025f546 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:59.651673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8f0aa16a-addf-4e3d-a47e-c521a025f546 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044434 Aug 18 22:00:59.652227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 498/993] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:00:59 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:00:59.788468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3acd95b9-6de4-4702-8a88-9bbd69225fe0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:59.790652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3acd95b9-6de4-4702-8a88-9bbd69225fe0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:59.796904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3acd95b9-6de4-4702-8a88-9bbd69225fe0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:59.797391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3acd95b9-6de4-4702-8a88-9bbd69225fe0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:59.797866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3acd95b9-6de4-4702-8a88-9bbd69225fe0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:59.799274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3acd95b9-6de4-4702-8a88-9bbd69225fe0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:59.799747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3acd95b9-6de4-4702-8a88-9bbd69225fe0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:59.800168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3acd95b9-6de4-4702-8a88-9bbd69225fe0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:59.829295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d006a18b-e5d8-4e64-8add-0bf4cb8a880b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:00:59.831815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d006a18b-e5d8-4e64-8add-0bf4cb8a880b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:00:59.838332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d006a18b-e5d8-4e64-8add-0bf4cb8a880b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:59.838820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d006a18b-e5d8-4e64-8add-0bf4cb8a880b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:59.839247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3acd95b9-6de4-4702-8a88-9bbd69225fe0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054868 Aug 18 22:00:59.839373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d006a18b-e5d8-4e64-8add-0bf4cb8a880b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:59.839986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 496/994] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:00:59.840111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d006a18b-e5d8-4e64-8add-0bf4cb8a880b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:00:59.840582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d006a18b-e5d8-4e64-8add-0bf4cb8a880b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:00:59.841088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d006a18b-e5d8-4e64-8add-0bf4cb8a880b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:00:59.870778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d006a18b-e5d8-4e64-8add-0bf4cb8a880b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Aug 18 22:00:59.871278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 499/995] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:00:59 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:00.089030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bcd14b68-3a1f-46be-a29d-ba928dbb3da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:00.091197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bcd14b68-3a1f-46be-a29d-ba928dbb3da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:00.098128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcd14b68-3a1f-46be-a29d-ba928dbb3da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:00.098607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcd14b68-3a1f-46be-a29d-ba928dbb3da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:00.099047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcd14b68-3a1f-46be-a29d-ba928dbb3da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:00.099736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcd14b68-3a1f-46be-a29d-ba928dbb3da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:00.100219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcd14b68-3a1f-46be-a29d-ba928dbb3da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:00.100642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcd14b68-3a1f-46be-a29d-ba928dbb3da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:00.129053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bcd14b68-3a1f-46be-a29d-ba928dbb3da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Aug 18 22:01:00.129546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 497/996] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:00 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:00.664242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8c06a003-62e5-4dcf-96a3-09ab0492afcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:00.666500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8c06a003-62e5-4dcf-96a3-09ab0492afcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:00.672762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c06a003-62e5-4dcf-96a3-09ab0492afcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:00.673247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c06a003-62e5-4dcf-96a3-09ab0492afcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:00.673768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c06a003-62e5-4dcf-96a3-09ab0492afcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:00.674497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c06a003-62e5-4dcf-96a3-09ab0492afcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:00.674955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c06a003-62e5-4dcf-96a3-09ab0492afcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:00.675386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c06a003-62e5-4dcf-96a3-09ab0492afcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:00.706155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8c06a003-62e5-4dcf-96a3-09ab0492afcd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045922 Aug 18 22:01:00.706710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 500/997] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:00 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:00.851384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b41e1419-6d11-4380-b23c-903fc946779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:00.853529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b41e1419-6d11-4380-b23c-903fc946779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:00.859329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b41e1419-6d11-4380-b23c-903fc946779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:00.859815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b41e1419-6d11-4380-b23c-903fc946779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:00.860260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b41e1419-6d11-4380-b23c-903fc946779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:00.861465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b41e1419-6d11-4380-b23c-903fc946779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:00.861956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b41e1419-6d11-4380-b23c-903fc946779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:00.862379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b41e1419-6d11-4380-b23c-903fc946779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:00.883446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-495f5d23-8a7f-460e-b187-1c386dc6d1da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:00.885659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-495f5d23-8a7f-460e-b187-1c386dc6d1da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:00.892078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-495f5d23-8a7f-460e-b187-1c386dc6d1da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:00.894880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-495f5d23-8a7f-460e-b187-1c386dc6d1da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:00.894880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-495f5d23-8a7f-460e-b187-1c386dc6d1da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:00.894880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-495f5d23-8a7f-460e-b187-1c386dc6d1da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:00.895319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b41e1419-6d11-4380-b23c-903fc946779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046498 Aug 18 22:01:00.895416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-495f5d23-8a7f-460e-b187-1c386dc6d1da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:00.895416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-495f5d23-8a7f-460e-b187-1c386dc6d1da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:00.895568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 498/998] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:00 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:00.924029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-495f5d23-8a7f-460e-b187-1c386dc6d1da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043715 Aug 18 22:01:00.924499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 501/999] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:00 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:01:01.140698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-06e0bf01-6467-4048-b90f-47bff5917aed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:01.142934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-06e0bf01-6467-4048-b90f-47bff5917aed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:01.149153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06e0bf01-6467-4048-b90f-47bff5917aed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:01.149656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06e0bf01-6467-4048-b90f-47bff5917aed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:01.150090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06e0bf01-6467-4048-b90f-47bff5917aed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:01.150775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06e0bf01-6467-4048-b90f-47bff5917aed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:01.151222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06e0bf01-6467-4048-b90f-47bff5917aed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:01.151645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06e0bf01-6467-4048-b90f-47bff5917aed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:01.181634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-06e0bf01-6467-4048-b90f-47bff5917aed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Aug 18 22:01:01.182108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 499/1000] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:01 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:01.718429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-505135e3-c584-49cb-9239-390204cc3a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:01.721408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-505135e3-c584-49cb-9239-390204cc3a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:01.727529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-505135e3-c584-49cb-9239-390204cc3a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:01.728012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-505135e3-c584-49cb-9239-390204cc3a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:01.728449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-505135e3-c584-49cb-9239-390204cc3a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:01.729505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-505135e3-c584-49cb-9239-390204cc3a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:01.729656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-505135e3-c584-49cb-9239-390204cc3a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:01.730081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-505135e3-c584-49cb-9239-390204cc3a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:01.760907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-505135e3-c584-49cb-9239-390204cc3a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046610 Aug 18 22:01:01.761480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 502/1001] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:01.905983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c3a60bb6-1566-41c0-b39d-15c61bb5fac7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:01.908989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c3a60bb6-1566-41c0-b39d-15c61bb5fac7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:01.915029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3a60bb6-1566-41c0-b39d-15c61bb5fac7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:01.915548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3a60bb6-1566-41c0-b39d-15c61bb5fac7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:01.915986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3a60bb6-1566-41c0-b39d-15c61bb5fac7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:01.916684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3a60bb6-1566-41c0-b39d-15c61bb5fac7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:01.917148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3a60bb6-1566-41c0-b39d-15c61bb5fac7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:01.917576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3a60bb6-1566-41c0-b39d-15c61bb5fac7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:01.936648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6697ea33-eba9-408c-802e-021586e57561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:01.939593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6697ea33-eba9-408c-802e-021586e57561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:01.947469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6697ea33-eba9-408c-802e-021586e57561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:01.948383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6697ea33-eba9-408c-802e-021586e57561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:01.949107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6697ea33-eba9-408c-802e-021586e57561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:01.950322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6697ea33-eba9-408c-802e-021586e57561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:01.951526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c3a60bb6-1566-41c0-b39d-15c61bb5fac7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049429 Aug 18 22:01:01.951688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6697ea33-eba9-408c-802e-021586e57561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:01.952292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6697ea33-eba9-408c-802e-021586e57561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:01.952408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 500/1002] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:01 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:01.983776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6697ea33-eba9-408c-802e-021586e57561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052083 Aug 18 22:01:01.984356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 503/1003] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:01 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:02.194193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3e5e3659-32fc-4abb-8856-b6a44ea20538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:02.196345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3e5e3659-32fc-4abb-8856-b6a44ea20538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:02.202741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e5e3659-32fc-4abb-8856-b6a44ea20538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:02.203225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e5e3659-32fc-4abb-8856-b6a44ea20538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:02.203663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e5e3659-32fc-4abb-8856-b6a44ea20538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:02.204985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e5e3659-32fc-4abb-8856-b6a44ea20538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:02.205451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e5e3659-32fc-4abb-8856-b6a44ea20538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:02.205909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e5e3659-32fc-4abb-8856-b6a44ea20538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:02.234239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3e5e3659-32fc-4abb-8856-b6a44ea20538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043864 Aug 18 22:01:02.234730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 501/1004] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:02 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:02.772390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f0e4e126-15b8-46c0-925a-c4ea06858173 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:02.774573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f0e4e126-15b8-46c0-925a-c4ea06858173 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:02.776668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:02.781872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0e4e126-15b8-46c0-925a-c4ea06858173 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:02.782854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0e4e126-15b8-46c0-925a-c4ea06858173 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:02.783290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0e4e126-15b8-46c0-925a-c4ea06858173 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:02.784099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0e4e126-15b8-46c0-925a-c4ea06858173 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:02.785527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0e4e126-15b8-46c0-925a-c4ea06858173 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:02.786001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0e4e126-15b8-46c0-925a-c4ea06858173 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:02.818501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f0e4e126-15b8-46c0-925a-c4ea06858173 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050032 Aug 18 22:01:02.819068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 504/1005] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:02.964223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-367d49e5-b19d-413c-9a07-4d276a58a144 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:02.966443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-367d49e5-b19d-413c-9a07-4d276a58a144 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:02.972967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-367d49e5-b19d-413c-9a07-4d276a58a144 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:02.973452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-367d49e5-b19d-413c-9a07-4d276a58a144 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:02.973911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-367d49e5-b19d-413c-9a07-4d276a58a144 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:02.974608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-367d49e5-b19d-413c-9a07-4d276a58a144 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:02.975059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-367d49e5-b19d-413c-9a07-4d276a58a144 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:02.975538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-367d49e5-b19d-413c-9a07-4d276a58a144 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:02.998810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-044cb88f-3877-4320-a219-0cf334bd217c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:03.001496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-044cb88f-3877-4320-a219-0cf334bd217c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:03.005412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-367d49e5-b19d-413c-9a07-4d276a58a144 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044983 Aug 18 22:01:03.006190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 502/1006] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:02 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:03.008329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-044cb88f-3877-4320-a219-0cf334bd217c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:03.008818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-044cb88f-3877-4320-a219-0cf334bd217c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:03.009257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-044cb88f-3877-4320-a219-0cf334bd217c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:03.010005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-044cb88f-3877-4320-a219-0cf334bd217c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:03.010501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-044cb88f-3877-4320-a219-0cf334bd217c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:03.010877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-044cb88f-3877-4320-a219-0cf334bd217c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:03.043739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-044cb88f-3877-4320-a219-0cf334bd217c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050085 Aug 18 22:01:03.044301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 505/1007] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:02 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:03.246540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ec50e7a7-6171-4f7d-8459-3aad056eaa40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:03.248582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ec50e7a7-6171-4f7d-8459-3aad056eaa40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:03.255367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec50e7a7-6171-4f7d-8459-3aad056eaa40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:03.255856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec50e7a7-6171-4f7d-8459-3aad056eaa40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:03.256297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec50e7a7-6171-4f7d-8459-3aad056eaa40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:03.256992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec50e7a7-6171-4f7d-8459-3aad056eaa40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:03.257449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec50e7a7-6171-4f7d-8459-3aad056eaa40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:03.257901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec50e7a7-6171-4f7d-8459-3aad056eaa40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:03.287522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ec50e7a7-6171-4f7d-8459-3aad056eaa40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 Aug 18 22:01:03.288083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 503/1008] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:03 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:03.830380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cf386287-4ef1-443d-9f97-cfc84a14207a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:03.832490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cf386287-4ef1-443d-9f97-cfc84a14207a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:03.838475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf386287-4ef1-443d-9f97-cfc84a14207a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:03.838948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf386287-4ef1-443d-9f97-cfc84a14207a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:03.839381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf386287-4ef1-443d-9f97-cfc84a14207a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:03.840067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf386287-4ef1-443d-9f97-cfc84a14207a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:03.840522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf386287-4ef1-443d-9f97-cfc84a14207a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:03.840945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf386287-4ef1-443d-9f97-cfc84a14207a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:03.869487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cf386287-4ef1-443d-9f97-cfc84a14207a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043027 Aug 18 22:01:03.870069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 506/1009] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:04.016604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b324fcf0-d06f-48e5-8cb8-084818f971eb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:04.019527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b324fcf0-d06f-48e5-8cb8-084818f971eb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:04.025623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b324fcf0-d06f-48e5-8cb8-084818f971eb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:04.026124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b324fcf0-d06f-48e5-8cb8-084818f971eb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:04.026564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b324fcf0-d06f-48e5-8cb8-084818f971eb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:04.027264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b324fcf0-d06f-48e5-8cb8-084818f971eb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:04.027748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b324fcf0-d06f-48e5-8cb8-084818f971eb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:04.028186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b324fcf0-d06f-48e5-8cb8-084818f971eb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:04.058059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-221a808a-021b-4790-b7a4-a0946365a2ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:04.058556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b324fcf0-d06f-48e5-8cb8-084818f971eb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045770 Aug 18 22:01:04.059189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 504/1010] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:04.060606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-221a808a-021b-4790-b7a4-a0946365a2ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:04.066663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221a808a-021b-4790-b7a4-a0946365a2ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:04.067216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221a808a-021b-4790-b7a4-a0946365a2ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:04.067659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221a808a-021b-4790-b7a4-a0946365a2ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:04.068418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221a808a-021b-4790-b7a4-a0946365a2ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:04.068878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221a808a-021b-4790-b7a4-a0946365a2ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:04.069307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221a808a-021b-4790-b7a4-a0946365a2ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:04.098607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-221a808a-021b-4790-b7a4-a0946365a2ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046567 Aug 18 22:01:04.099165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 507/1011] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:04 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:04.300461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cb748f7d-4c33-4bca-977e-1a8237d31315 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:04.302619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cb748f7d-4c33-4bca-977e-1a8237d31315 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:04.308870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb748f7d-4c33-4bca-977e-1a8237d31315 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:04.309344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb748f7d-4c33-4bca-977e-1a8237d31315 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:04.309814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb748f7d-4c33-4bca-977e-1a8237d31315 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:04.310495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb748f7d-4c33-4bca-977e-1a8237d31315 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:04.310942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb748f7d-4c33-4bca-977e-1a8237d31315 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:04.311362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb748f7d-4c33-4bca-977e-1a8237d31315 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:04.339129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cb748f7d-4c33-4bca-977e-1a8237d31315 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043416 Aug 18 22:01:04.339667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 505/1012] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:04 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:04.881978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0137a483-58ae-4e5a-843d-63e8060d83ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:04.884148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0137a483-58ae-4e5a-843d-63e8060d83ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:04.890124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0137a483-58ae-4e5a-843d-63e8060d83ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:04.890605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0137a483-58ae-4e5a-843d-63e8060d83ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:04.891032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0137a483-58ae-4e5a-843d-63e8060d83ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:04.892223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0137a483-58ae-4e5a-843d-63e8060d83ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:04.892787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0137a483-58ae-4e5a-843d-63e8060d83ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:04.893208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0137a483-58ae-4e5a-843d-63e8060d83ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:04.923848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0137a483-58ae-4e5a-843d-63e8060d83ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045617 Aug 18 22:01:04.924424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 508/1013] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:05.072426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b7d31ee9-b242-4b43-acd8-147abce0d9ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:05.074540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b7d31ee9-b242-4b43-acd8-147abce0d9ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:05.081265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7d31ee9-b242-4b43-acd8-147abce0d9ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:05.081784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7d31ee9-b242-4b43-acd8-147abce0d9ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:05.082219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7d31ee9-b242-4b43-acd8-147abce0d9ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:05.082915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7d31ee9-b242-4b43-acd8-147abce0d9ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:05.083362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7d31ee9-b242-4b43-acd8-147abce0d9ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:05.083778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7d31ee9-b242-4b43-acd8-147abce0d9ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:05.112307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ea382642-1cc6-44a0-8504-fedfe9037ba1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:05.113950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b7d31ee9-b242-4b43-acd8-147abce0d9ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046951 Aug 18 22:01:05.114676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ea382642-1cc6-44a0-8504-fedfe9037ba1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:05.114808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 506/1014] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:05 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:05.121803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea382642-1cc6-44a0-8504-fedfe9037ba1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:05.122287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea382642-1cc6-44a0-8504-fedfe9037ba1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:05.122714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea382642-1cc6-44a0-8504-fedfe9037ba1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:05.123411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea382642-1cc6-44a0-8504-fedfe9037ba1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:05.124036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea382642-1cc6-44a0-8504-fedfe9037ba1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:05.124267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea382642-1cc6-44a0-8504-fedfe9037ba1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:05.151247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:05.156529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea382642-1cc6-44a0-8504-fedfe9037ba1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049293 Aug 18 22:01:05.157085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 509/1015] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:05 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:05.351598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c958b276-3c25-4459-a5fd-0acc008e6849 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:05.353719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c958b276-3c25-4459-a5fd-0acc008e6849 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:05.360224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c958b276-3c25-4459-a5fd-0acc008e6849 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:05.361203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c958b276-3c25-4459-a5fd-0acc008e6849 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:05.361677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c958b276-3c25-4459-a5fd-0acc008e6849 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:05.362392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c958b276-3c25-4459-a5fd-0acc008e6849 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:05.362854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c958b276-3c25-4459-a5fd-0acc008e6849 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:05.363291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c958b276-3c25-4459-a5fd-0acc008e6849 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:05.393329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c958b276-3c25-4459-a5fd-0acc008e6849 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045806 Aug 18 22:01:05.393941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 507/1016] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:05 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:05.937803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b99099eb-f1e4-4fbd-9cec-060930d7327b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:05.939974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b99099eb-f1e4-4fbd-9cec-060930d7327b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:05.946278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b99099eb-f1e4-4fbd-9cec-060930d7327b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:05.946760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b99099eb-f1e4-4fbd-9cec-060930d7327b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:05.947196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b99099eb-f1e4-4fbd-9cec-060930d7327b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:05.947891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b99099eb-f1e4-4fbd-9cec-060930d7327b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:05.948350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b99099eb-f1e4-4fbd-9cec-060930d7327b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:05.948778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b99099eb-f1e4-4fbd-9cec-060930d7327b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:05.977801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b99099eb-f1e4-4fbd-9cec-060930d7327b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044125 Aug 18 22:01:05.978359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 510/1017] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:06.125267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-81fa919a-c877-46ec-a732-ea2ce8c64d71 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:06.127585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-81fa919a-c877-46ec-a732-ea2ce8c64d71 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:06.133450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81fa919a-c877-46ec-a732-ea2ce8c64d71 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:06.133973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81fa919a-c877-46ec-a732-ea2ce8c64d71 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:06.134408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81fa919a-c877-46ec-a732-ea2ce8c64d71 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:06.135164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81fa919a-c877-46ec-a732-ea2ce8c64d71 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:06.135571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81fa919a-c877-46ec-a732-ea2ce8c64d71 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:06.135997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81fa919a-c877-46ec-a732-ea2ce8c64d71 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:06.174381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-81fa919a-c877-46ec-a732-ea2ce8c64d71 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Aug 18 22:01:06.174381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 508/1018] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:06 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:06.178019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7b4a495b-f1d5-4eff-a8d0-7cc3c650be9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:06.180522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7b4a495b-f1d5-4eff-a8d0-7cc3c650be9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:06.186822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b4a495b-f1d5-4eff-a8d0-7cc3c650be9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:06.187300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b4a495b-f1d5-4eff-a8d0-7cc3c650be9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:06.187730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b4a495b-f1d5-4eff-a8d0-7cc3c650be9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:06.188542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b4a495b-f1d5-4eff-a8d0-7cc3c650be9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:06.188943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b4a495b-f1d5-4eff-a8d0-7cc3c650be9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:06.189365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b4a495b-f1d5-4eff-a8d0-7cc3c650be9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:06.219168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7b4a495b-f1d5-4eff-a8d0-7cc3c650be9e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054383 Aug 18 22:01:06.219727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 511/1019] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:06 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:06.405333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7b64a4d7-8efd-4fa1-b8ed-b729dc19684f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:06.408096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7b64a4d7-8efd-4fa1-b8ed-b729dc19684f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:06.414536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b64a4d7-8efd-4fa1-b8ed-b729dc19684f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:06.415020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b64a4d7-8efd-4fa1-b8ed-b729dc19684f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:06.415489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b64a4d7-8efd-4fa1-b8ed-b729dc19684f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:06.416187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b64a4d7-8efd-4fa1-b8ed-b729dc19684f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:06.416663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b64a4d7-8efd-4fa1-b8ed-b729dc19684f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:06.417074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b64a4d7-8efd-4fa1-b8ed-b729dc19684f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:06.442157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:06.446915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7b64a4d7-8efd-4fa1-b8ed-b729dc19684f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045568 Aug 18 22:01:06.447476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 509/1020] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:06 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:06.990874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-48c66792-5438-4530-ae08-91d721d43e32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:06.992962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-48c66792-5438-4530-ae08-91d721d43e32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:06.999187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c66792-5438-4530-ae08-91d721d43e32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:06.999666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c66792-5438-4530-ae08-91d721d43e32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:07.000102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c66792-5438-4530-ae08-91d721d43e32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:07.000811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c66792-5438-4530-ae08-91d721d43e32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:07.001845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c66792-5438-4530-ae08-91d721d43e32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:07.002272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c66792-5438-4530-ae08-91d721d43e32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:07.030244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-48c66792-5438-4530-ae08-91d721d43e32 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043442 Aug 18 22:01:07.030799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 512/1021] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:06 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:07.178201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0a6f9732-09a2-4085-bb80-eb29931ee85d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:07.180575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0a6f9732-09a2-4085-bb80-eb29931ee85d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:07.186918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a6f9732-09a2-4085-bb80-eb29931ee85d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:07.187458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a6f9732-09a2-4085-bb80-eb29931ee85d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:07.187899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a6f9732-09a2-4085-bb80-eb29931ee85d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:07.188598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a6f9732-09a2-4085-bb80-eb29931ee85d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:07.189053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a6f9732-09a2-4085-bb80-eb29931ee85d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:07.189638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a6f9732-09a2-4085-bb80-eb29931ee85d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:07.218132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0a6f9732-09a2-4085-bb80-eb29931ee85d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Aug 18 22:01:07.218736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 510/1022] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:07.234473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7e9c027e-ad47-4ca8-8b4f-16f3c0a60442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:07.234473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7e9c027e-ad47-4ca8-8b4f-16f3c0a60442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:07.241365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e9c027e-ad47-4ca8-8b4f-16f3c0a60442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:07.241936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e9c027e-ad47-4ca8-8b4f-16f3c0a60442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:07.242320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e9c027e-ad47-4ca8-8b4f-16f3c0a60442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:07.243023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e9c027e-ad47-4ca8-8b4f-16f3c0a60442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:07.243481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e9c027e-ad47-4ca8-8b4f-16f3c0a60442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:07.243904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e9c027e-ad47-4ca8-8b4f-16f3c0a60442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:07.274531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7e9c027e-ad47-4ca8-8b4f-16f3c0a60442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046332 Aug 18 22:01:07.275294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 513/1023] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:07 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:07.459327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7d67a97-2376-4a9c-9a31-21a99f52e6a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:07.461533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f7d67a97-2376-4a9c-9a31-21a99f52e6a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:07.467907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7d67a97-2376-4a9c-9a31-21a99f52e6a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:07.468464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7d67a97-2376-4a9c-9a31-21a99f52e6a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:07.468812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7d67a97-2376-4a9c-9a31-21a99f52e6a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:07.469495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7d67a97-2376-4a9c-9a31-21a99f52e6a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:07.470475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7d67a97-2376-4a9c-9a31-21a99f52e6a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:07.470904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7d67a97-2376-4a9c-9a31-21a99f52e6a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:07.500287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f7d67a97-2376-4a9c-9a31-21a99f52e6a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044909 Aug 18 22:01:07.500762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 511/1024] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:07 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:08.043065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f004c939-5818-4504-b646-4907f23a2100 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:08.045214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f004c939-5818-4504-b646-4907f23a2100 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:08.051473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f004c939-5818-4504-b646-4907f23a2100 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:08.051955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f004c939-5818-4504-b646-4907f23a2100 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:08.052394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f004c939-5818-4504-b646-4907f23a2100 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:08.053089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f004c939-5818-4504-b646-4907f23a2100 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:08.053547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f004c939-5818-4504-b646-4907f23a2100 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:08.054007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f004c939-5818-4504-b646-4907f23a2100 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:08.083690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f004c939-5818-4504-b646-4907f23a2100 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044604 Aug 18 22:01:08.084246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 514/1025] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:08.231195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a7ee0ec2-2464-4a48-a0eb-2ac9d5cbc11b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:08.233303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a7ee0ec2-2464-4a48-a0eb-2ac9d5cbc11b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:08.239847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7ee0ec2-2464-4a48-a0eb-2ac9d5cbc11b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:08.240360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7ee0ec2-2464-4a48-a0eb-2ac9d5cbc11b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:08.240798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7ee0ec2-2464-4a48-a0eb-2ac9d5cbc11b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:08.241490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7ee0ec2-2464-4a48-a0eb-2ac9d5cbc11b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:08.241994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7ee0ec2-2464-4a48-a0eb-2ac9d5cbc11b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:08.242422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7ee0ec2-2464-4a48-a0eb-2ac9d5cbc11b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:08.272961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a7ee0ec2-2464-4a48-a0eb-2ac9d5cbc11b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045681 Aug 18 22:01:08.273532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 512/1026] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:08 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:08.286560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ef487f64-3561-42d3-8f14-9667e6872d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:08.288994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ef487f64-3561-42d3-8f14-9667e6872d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:08.295110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef487f64-3561-42d3-8f14-9667e6872d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:08.295534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef487f64-3561-42d3-8f14-9667e6872d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:08.295972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef487f64-3561-42d3-8f14-9667e6872d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:08.296926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef487f64-3561-42d3-8f14-9667e6872d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:08.297385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef487f64-3561-42d3-8f14-9667e6872d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:08.297849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef487f64-3561-42d3-8f14-9667e6872d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:08.327604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ef487f64-3561-42d3-8f14-9667e6872d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044973 Aug 18 22:01:08.328160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 515/1027] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:08 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:08.511854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-540dc43e-9641-4fbf-896f-bb75010e2922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:08.514010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-540dc43e-9641-4fbf-896f-bb75010e2922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:08.520239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-540dc43e-9641-4fbf-896f-bb75010e2922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:08.520718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-540dc43e-9641-4fbf-896f-bb75010e2922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:08.521188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-540dc43e-9641-4fbf-896f-bb75010e2922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:08.521902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-540dc43e-9641-4fbf-896f-bb75010e2922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:08.522359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-540dc43e-9641-4fbf-896f-bb75010e2922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:08.522785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-540dc43e-9641-4fbf-896f-bb75010e2922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:08.553093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-540dc43e-9641-4fbf-896f-bb75010e2922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Aug 18 22:01:08.553612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 513/1028] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:08 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:09.096110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5d8fc332-9ecd-45ef-a823-e6a3a16107a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:09.098289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5d8fc332-9ecd-45ef-a823-e6a3a16107a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:09.104182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d8fc332-9ecd-45ef-a823-e6a3a16107a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:09.104659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d8fc332-9ecd-45ef-a823-e6a3a16107a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:09.105091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d8fc332-9ecd-45ef-a823-e6a3a16107a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:09.105814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d8fc332-9ecd-45ef-a823-e6a3a16107a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:09.106268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d8fc332-9ecd-45ef-a823-e6a3a16107a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:09.106688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d8fc332-9ecd-45ef-a823-e6a3a16107a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:09.136502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5d8fc332-9ecd-45ef-a823-e6a3a16107a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045012 Aug 18 22:01:09.137066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 516/1029] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:09.284933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ccbe0cba-fe8c-44ac-88c2-fad313134c4a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:09.287098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ccbe0cba-fe8c-44ac-88c2-fad313134c4a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:09.293187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ccbe0cba-fe8c-44ac-88c2-fad313134c4a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:09.293701 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ccbe0cba-fe8c-44ac-88c2-fad313134c4a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:09.294141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ccbe0cba-fe8c-44ac-88c2-fad313134c4a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:09.294836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ccbe0cba-fe8c-44ac-88c2-fad313134c4a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:09.295677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ccbe0cba-fe8c-44ac-88c2-fad313134c4a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:09.295677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ccbe0cba-fe8c-44ac-88c2-fad313134c4a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:09.325541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ccbe0cba-fe8c-44ac-88c2-fad313134c4a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 Aug 18 22:01:09.326127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 514/1030] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:09 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:09.350546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d5b9e27-9163-4be4-8318-e21a7efdc2e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:09.350546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1d5b9e27-9163-4be4-8318-e21a7efdc2e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:09.350546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d5b9e27-9163-4be4-8318-e21a7efdc2e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:09.350546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d5b9e27-9163-4be4-8318-e21a7efdc2e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:09.351643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d5b9e27-9163-4be4-8318-e21a7efdc2e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:09.351643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d5b9e27-9163-4be4-8318-e21a7efdc2e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:09.352272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d5b9e27-9163-4be4-8318-e21a7efdc2e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:09.352403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d5b9e27-9163-4be4-8318-e21a7efdc2e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:09.381877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1d5b9e27-9163-4be4-8318-e21a7efdc2e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045990 Aug 18 22:01:09.382434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 517/1031] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:09 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:09.565459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b4e088e7-6ec5-40ac-8b6c-1a5933798522 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:09.567572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b4e088e7-6ec5-40ac-8b6c-1a5933798522 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:09.573885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4e088e7-6ec5-40ac-8b6c-1a5933798522 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:09.574368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4e088e7-6ec5-40ac-8b6c-1a5933798522 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:09.574803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4e088e7-6ec5-40ac-8b6c-1a5933798522 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:09.575490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4e088e7-6ec5-40ac-8b6c-1a5933798522 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:09.575943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4e088e7-6ec5-40ac-8b6c-1a5933798522 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:09.576368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4e088e7-6ec5-40ac-8b6c-1a5933798522 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:09.605869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b4e088e7-6ec5-40ac-8b6c-1a5933798522 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Aug 18 22:01:09.606547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 515/1032] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:09 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:10.148782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d2a37763-e4fd-4cd0-bf20-4b9f338774a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:10.150988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d2a37763-e4fd-4cd0-bf20-4b9f338774a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:10.156833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2a37763-e4fd-4cd0-bf20-4b9f338774a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:10.157832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2a37763-e4fd-4cd0-bf20-4b9f338774a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:10.158334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2a37763-e4fd-4cd0-bf20-4b9f338774a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:10.159026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2a37763-e4fd-4cd0-bf20-4b9f338774a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:10.159402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2a37763-e4fd-4cd0-bf20-4b9f338774a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:10.159824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2a37763-e4fd-4cd0-bf20-4b9f338774a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:10.188715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d2a37763-e4fd-4cd0-bf20-4b9f338774a5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043840 Aug 18 22:01:10.189275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 518/1033] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:10.338255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ac2c1afb-6d23-4732-8b0c-81a2d36fc79d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:10.340371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ac2c1afb-6d23-4732-8b0c-81a2d36fc79d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:10.346923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac2c1afb-6d23-4732-8b0c-81a2d36fc79d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:10.347406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac2c1afb-6d23-4732-8b0c-81a2d36fc79d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:10.347849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac2c1afb-6d23-4732-8b0c-81a2d36fc79d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:10.348540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac2c1afb-6d23-4732-8b0c-81a2d36fc79d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:10.348999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac2c1afb-6d23-4732-8b0c-81a2d36fc79d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:10.349430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac2c1afb-6d23-4732-8b0c-81a2d36fc79d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:10.382110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ac2c1afb-6d23-4732-8b0c-81a2d36fc79d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047701 Aug 18 22:01:10.382689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 516/1034] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:10 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:10.393964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d7cba1e9-9b40-4a98-9078-1727f6b596e9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:10.409183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d7cba1e9-9b40-4a98-9078-1727f6b596e9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:10.409183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7cba1e9-9b40-4a98-9078-1727f6b596e9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:10.409183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7cba1e9-9b40-4a98-9078-1727f6b596e9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:10.409183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7cba1e9-9b40-4a98-9078-1727f6b596e9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:10.409539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7cba1e9-9b40-4a98-9078-1727f6b596e9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:10.409539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7cba1e9-9b40-4a98-9078-1727f6b596e9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:10.409539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7cba1e9-9b40-4a98-9078-1727f6b596e9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:10.436842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d7cba1e9-9b40-4a98-9078-1727f6b596e9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046783 Aug 18 22:01:10.437397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 519/1035] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:10 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:10.618261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c9420696-ce8a-46b5-9448-1495813b1a80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:10.620372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c9420696-ce8a-46b5-9448-1495813b1a80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:10.627162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9420696-ce8a-46b5-9448-1495813b1a80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:10.627419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9420696-ce8a-46b5-9448-1495813b1a80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:10.627856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9420696-ce8a-46b5-9448-1495813b1a80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:10.628552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9420696-ce8a-46b5-9448-1495813b1a80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:10.629009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9420696-ce8a-46b5-9448-1495813b1a80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:10.629438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9420696-ce8a-46b5-9448-1495813b1a80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:10.659707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c9420696-ce8a-46b5-9448-1495813b1a80 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Aug 18 22:01:10.660193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 517/1036] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:10 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:11.202420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b9281fed-835f-4a8f-9463-0c9a2fd4f31b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:11.205381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b9281fed-835f-4a8f-9463-0c9a2fd4f31b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:11.211293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9281fed-835f-4a8f-9463-0c9a2fd4f31b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:11.211762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9281fed-835f-4a8f-9463-0c9a2fd4f31b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:11.212194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9281fed-835f-4a8f-9463-0c9a2fd4f31b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:11.212875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9281fed-835f-4a8f-9463-0c9a2fd4f31b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:11.213319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9281fed-835f-4a8f-9463-0c9a2fd4f31b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:11.213784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9281fed-835f-4a8f-9463-0c9a2fd4f31b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:11.241876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b9281fed-835f-4a8f-9463-0c9a2fd4f31b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043368 Aug 18 22:01:11.242441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 520/1037] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:11.394585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9a39f407-f5e2-4ee1-950e-1449e5c763ad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:11.396728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9a39f407-f5e2-4ee1-950e-1449e5c763ad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:11.402655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a39f407-f5e2-4ee1-950e-1449e5c763ad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:11.403132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a39f407-f5e2-4ee1-950e-1449e5c763ad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:11.403564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a39f407-f5e2-4ee1-950e-1449e5c763ad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:11.404248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a39f407-f5e2-4ee1-950e-1449e5c763ad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:11.404698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a39f407-f5e2-4ee1-950e-1449e5c763ad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:11.405132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a39f407-f5e2-4ee1-950e-1449e5c763ad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:11.434957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9a39f407-f5e2-4ee1-950e-1449e5c763ad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Aug 18 22:01:11.435670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 518/1038] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:11.448582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6489752a-5e53-4e55-99a6-66015fd73fe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:11.450889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6489752a-5e53-4e55-99a6-66015fd73fe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:11.457384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6489752a-5e53-4e55-99a6-66015fd73fe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:11.457957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6489752a-5e53-4e55-99a6-66015fd73fe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:11.458331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6489752a-5e53-4e55-99a6-66015fd73fe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:11.459041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6489752a-5e53-4e55-99a6-66015fd73fe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:11.459503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6489752a-5e53-4e55-99a6-66015fd73fe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:11.459936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6489752a-5e53-4e55-99a6-66015fd73fe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:11.489930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6489752a-5e53-4e55-99a6-66015fd73fe9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045204 Aug 18 22:01:11.490493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 521/1039] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:11.672364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-95a03be8-8b26-457f-a6b0-7219a71818fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:11.675137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-95a03be8-8b26-457f-a6b0-7219a71818fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:11.681466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95a03be8-8b26-457f-a6b0-7219a71818fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:11.681983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95a03be8-8b26-457f-a6b0-7219a71818fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:11.682419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95a03be8-8b26-457f-a6b0-7219a71818fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:11.683114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95a03be8-8b26-457f-a6b0-7219a71818fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:11.683566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95a03be8-8b26-457f-a6b0-7219a71818fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:11.683989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95a03be8-8b26-457f-a6b0-7219a71818fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:11.713314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-95a03be8-8b26-457f-a6b0-7219a71818fe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045011 Aug 18 22:01:11.713831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 519/1040] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:11 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:12.254480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6b365017-5099-4f46-a2e3-fb9d2bedebc2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:12.256620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6b365017-5099-4f46-a2e3-fb9d2bedebc2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:12.262501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b365017-5099-4f46-a2e3-fb9d2bedebc2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:12.262979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b365017-5099-4f46-a2e3-fb9d2bedebc2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:12.263408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b365017-5099-4f46-a2e3-fb9d2bedebc2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:12.264088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b365017-5099-4f46-a2e3-fb9d2bedebc2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:12.264535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b365017-5099-4f46-a2e3-fb9d2bedebc2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:12.264955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b365017-5099-4f46-a2e3-fb9d2bedebc2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:12.294226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6b365017-5099-4f46-a2e3-fb9d2bedebc2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043697 Aug 18 22:01:12.294777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 522/1041] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:12 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:12.447464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-123637ef-24e1-43cb-998f-21691c47ffeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:12.449589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-123637ef-24e1-43cb-998f-21691c47ffeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:12.456153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-123637ef-24e1-43cb-998f-21691c47ffeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:12.456633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-123637ef-24e1-43cb-998f-21691c47ffeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:12.457064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-123637ef-24e1-43cb-998f-21691c47ffeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:12.457777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-123637ef-24e1-43cb-998f-21691c47ffeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:12.458228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-123637ef-24e1-43cb-998f-21691c47ffeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:12.458647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-123637ef-24e1-43cb-998f-21691c47ffeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:12.487503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-123637ef-24e1-43cb-998f-21691c47ffeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043899 Aug 18 22:01:12.488066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 520/1042] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:12 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:12.502335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b4c8c475-14fa-4ff1-b646-878adab75f00 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:12.504559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b4c8c475-14fa-4ff1-b646-878adab75f00 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:12.510753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4c8c475-14fa-4ff1-b646-878adab75f00 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:12.511224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4c8c475-14fa-4ff1-b646-878adab75f00 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:12.511652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4c8c475-14fa-4ff1-b646-878adab75f00 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:12.512338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4c8c475-14fa-4ff1-b646-878adab75f00 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:12.512791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4c8c475-14fa-4ff1-b646-878adab75f00 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:12.513210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4c8c475-14fa-4ff1-b646-878adab75f00 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:12.543173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b4c8c475-14fa-4ff1-b646-878adab75f00 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Aug 18 22:01:12.543717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 523/1043] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:12 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:12.725373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9dab9b4d-27f3-44a0-9c23-9c3bedaab343 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:12.727504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9dab9b4d-27f3-44a0-9c23-9c3bedaab343 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:12.733823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9dab9b4d-27f3-44a0-9c23-9c3bedaab343 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:12.734296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9dab9b4d-27f3-44a0-9c23-9c3bedaab343 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:12.734729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9dab9b4d-27f3-44a0-9c23-9c3bedaab343 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:12.735405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9dab9b4d-27f3-44a0-9c23-9c3bedaab343 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:12.735853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9dab9b4d-27f3-44a0-9c23-9c3bedaab343 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:12.736290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9dab9b4d-27f3-44a0-9c23-9c3bedaab343 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:12.764979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9dab9b4d-27f3-44a0-9c23-9c3bedaab343 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043462 Aug 18 22:01:12.765537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 521/1044] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:12 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:13.306812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9986f123-2af3-49cb-a34c-f43b04df2365 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:13.308922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9986f123-2af3-49cb-a34c-f43b04df2365 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:13.314848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9986f123-2af3-49cb-a34c-f43b04df2365 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:13.315325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9986f123-2af3-49cb-a34c-f43b04df2365 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:13.315766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9986f123-2af3-49cb-a34c-f43b04df2365 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:13.316454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9986f123-2af3-49cb-a34c-f43b04df2365 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:13.316907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9986f123-2af3-49cb-a34c-f43b04df2365 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:13.317335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9986f123-2af3-49cb-a34c-f43b04df2365 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:13.345865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9986f123-2af3-49cb-a34c-f43b04df2365 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043011 Aug 18 22:01:13.346419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 524/1045] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:13 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:13.498922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b48f05b6-a24d-4f08-a555-aa4d5c778617 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:13.501014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b48f05b6-a24d-4f08-a555-aa4d5c778617 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:13.506910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b48f05b6-a24d-4f08-a555-aa4d5c778617 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:13.507380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b48f05b6-a24d-4f08-a555-aa4d5c778617 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:13.507807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b48f05b6-a24d-4f08-a555-aa4d5c778617 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:13.508484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b48f05b6-a24d-4f08-a555-aa4d5c778617 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:13.508926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b48f05b6-a24d-4f08-a555-aa4d5c778617 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:13.509344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b48f05b6-a24d-4f08-a555-aa4d5c778617 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:13.538320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b48f05b6-a24d-4f08-a555-aa4d5c778617 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043285 Aug 18 22:01:13.539117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 522/1046] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:13 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:13.555558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ffcc7e3b-55c4-4055-a52b-13dc19942dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:13.557799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ffcc7e3b-55c4-4055-a52b-13dc19942dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:13.564032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffcc7e3b-55c4-4055-a52b-13dc19942dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:13.564516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffcc7e3b-55c4-4055-a52b-13dc19942dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:13.564951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffcc7e3b-55c4-4055-a52b-13dc19942dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:13.565673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffcc7e3b-55c4-4055-a52b-13dc19942dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:13.566129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffcc7e3b-55c4-4055-a52b-13dc19942dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:13.566555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffcc7e3b-55c4-4055-a52b-13dc19942dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:13.597555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ffcc7e3b-55c4-4055-a52b-13dc19942dc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046311 Aug 18 22:01:13.598136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 525/1047] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:13.777648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4627a2c4-f7d4-4f7f-b022-bd18bd2da037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:13.779763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4627a2c4-f7d4-4f7f-b022-bd18bd2da037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:13.786805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4627a2c4-f7d4-4f7f-b022-bd18bd2da037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:13.787292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4627a2c4-f7d4-4f7f-b022-bd18bd2da037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:13.787734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4627a2c4-f7d4-4f7f-b022-bd18bd2da037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:13.788430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4627a2c4-f7d4-4f7f-b022-bd18bd2da037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:13.788887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4627a2c4-f7d4-4f7f-b022-bd18bd2da037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:13.789342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4627a2c4-f7d4-4f7f-b022-bd18bd2da037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:13.818114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4627a2c4-f7d4-4f7f-b022-bd18bd2da037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044257 Aug 18 22:01:13.818602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 523/1048] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:13 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:14.358188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eade146b-d8e0-453e-a969-9e27abe78b0b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:14.360871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eade146b-d8e0-453e-a969-9e27abe78b0b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:14.366925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eade146b-d8e0-453e-a969-9e27abe78b0b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:14.367409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eade146b-d8e0-453e-a969-9e27abe78b0b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:14.367848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eade146b-d8e0-453e-a969-9e27abe78b0b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:14.368549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eade146b-d8e0-453e-a969-9e27abe78b0b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:14.369026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eade146b-d8e0-453e-a969-9e27abe78b0b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:14.369438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eade146b-d8e0-453e-a969-9e27abe78b0b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:14.383581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:14.399075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eade146b-d8e0-453e-a969-9e27abe78b0b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044888 Aug 18 22:01:14.399640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 526/1049] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:14.551144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d0e92630-0453-4bad-82cc-d6fa1fe6ce89 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:14.553251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d0e92630-0453-4bad-82cc-d6fa1fe6ce89 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:14.559203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0e92630-0453-4bad-82cc-d6fa1fe6ce89 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:14.559692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0e92630-0453-4bad-82cc-d6fa1fe6ce89 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:14.560131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0e92630-0453-4bad-82cc-d6fa1fe6ce89 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:14.560826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0e92630-0453-4bad-82cc-d6fa1fe6ce89 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:14.561285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0e92630-0453-4bad-82cc-d6fa1fe6ce89 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:14.561740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0e92630-0453-4bad-82cc-d6fa1fe6ce89 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:14.591347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d0e92630-0453-4bad-82cc-d6fa1fe6ce89 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044797 Aug 18 22:01:14.592439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 524/1050] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:14.609227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1451e7e4-5a37-4b75-a974-59290e77f216 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:14.611882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1451e7e4-5a37-4b75-a974-59290e77f216 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:14.618343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1451e7e4-5a37-4b75-a974-59290e77f216 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:14.618825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1451e7e4-5a37-4b75-a974-59290e77f216 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:14.619262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1451e7e4-5a37-4b75-a974-59290e77f216 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:14.619958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1451e7e4-5a37-4b75-a974-59290e77f216 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:14.620436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1451e7e4-5a37-4b75-a974-59290e77f216 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:14.620858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1451e7e4-5a37-4b75-a974-59290e77f216 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:14.650763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1451e7e4-5a37-4b75-a974-59290e77f216 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045464 Aug 18 22:01:14.651360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 527/1051] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:14.830266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a77dca82-9471-4d39-8a05-1bef6f55029e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:14.832223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a77dca82-9471-4d39-8a05-1bef6f55029e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:14.838460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a77dca82-9471-4d39-8a05-1bef6f55029e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:14.838947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a77dca82-9471-4d39-8a05-1bef6f55029e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:14.839385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a77dca82-9471-4d39-8a05-1bef6f55029e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:14.840086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a77dca82-9471-4d39-8a05-1bef6f55029e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:14.840538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a77dca82-9471-4d39-8a05-1bef6f55029e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:14.840965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a77dca82-9471-4d39-8a05-1bef6f55029e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:14.870307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a77dca82-9471-4d39-8a05-1bef6f55029e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Aug 18 22:01:14.870795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 525/1052] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:14 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:15.411336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2869c5fa-ccb0-4f3e-ad24-70b1d5049a9d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:15.413470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2869c5fa-ccb0-4f3e-ad24-70b1d5049a9d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:15.419399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2869c5fa-ccb0-4f3e-ad24-70b1d5049a9d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:15.419875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2869c5fa-ccb0-4f3e-ad24-70b1d5049a9d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:15.420307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2869c5fa-ccb0-4f3e-ad24-70b1d5049a9d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:15.420996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2869c5fa-ccb0-4f3e-ad24-70b1d5049a9d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:15.421723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2869c5fa-ccb0-4f3e-ad24-70b1d5049a9d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:15.422149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2869c5fa-ccb0-4f3e-ad24-70b1d5049a9d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:15.451225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2869c5fa-ccb0-4f3e-ad24-70b1d5049a9d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044632 Aug 18 22:01:15.451768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 528/1053] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:15.603635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-50651933-4c56-42e7-8712-c29bc0ad1b6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:15.605781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-50651933-4c56-42e7-8712-c29bc0ad1b6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:15.611794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50651933-4c56-42e7-8712-c29bc0ad1b6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:15.612441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50651933-4c56-42e7-8712-c29bc0ad1b6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:15.612882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50651933-4c56-42e7-8712-c29bc0ad1b6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:15.613572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50651933-4c56-42e7-8712-c29bc0ad1b6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:15.614050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50651933-4c56-42e7-8712-c29bc0ad1b6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:15.614477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50651933-4c56-42e7-8712-c29bc0ad1b6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:15.631340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:15.644888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-50651933-4c56-42e7-8712-c29bc0ad1b6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 Aug 18 22:01:15.645439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 526/1054] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:15 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:15.662927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d936a96f-a651-4363-9050-b531a2dfd047 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:15.665225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d936a96f-a651-4363-9050-b531a2dfd047 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:15.671082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d936a96f-a651-4363-9050-b531a2dfd047 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:15.671827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d936a96f-a651-4363-9050-b531a2dfd047 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:15.672268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d936a96f-a651-4363-9050-b531a2dfd047 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:15.672973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d936a96f-a651-4363-9050-b531a2dfd047 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:15.673429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d936a96f-a651-4363-9050-b531a2dfd047 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:15.673918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d936a96f-a651-4363-9050-b531a2dfd047 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:15.847439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d936a96f-a651-4363-9050-b531a2dfd047 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188520 Aug 18 22:01:15.847993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 529/1055] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:15 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:01:15.883111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fbfc1255-5189-40c8-88a8-cbca88ed6ec5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:15.885240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fbfc1255-5189-40c8-88a8-cbca88ed6ec5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:15.891682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbfc1255-5189-40c8-88a8-cbca88ed6ec5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:15.892159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbfc1255-5189-40c8-88a8-cbca88ed6ec5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:15.892589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbfc1255-5189-40c8-88a8-cbca88ed6ec5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:15.893275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbfc1255-5189-40c8-88a8-cbca88ed6ec5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:15.893758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbfc1255-5189-40c8-88a8-cbca88ed6ec5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:15.894186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbfc1255-5189-40c8-88a8-cbca88ed6ec5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:15.922436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fbfc1255-5189-40c8-88a8-cbca88ed6ec5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043173 Aug 18 22:01:15.923415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 527/1056] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:15 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:16.464375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6ebfb8e0-3776-4286-bdf7-3f1f57735813 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:16.466489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6ebfb8e0-3776-4286-bdf7-3f1f57735813 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:16.473245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ebfb8e0-3776-4286-bdf7-3f1f57735813 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:16.473742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ebfb8e0-3776-4286-bdf7-3f1f57735813 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:16.474171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ebfb8e0-3776-4286-bdf7-3f1f57735813 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:16.474857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ebfb8e0-3776-4286-bdf7-3f1f57735813 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:16.475303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ebfb8e0-3776-4286-bdf7-3f1f57735813 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:16.475722 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ebfb8e0-3776-4286-bdf7-3f1f57735813 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:16.504322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6ebfb8e0-3776-4286-bdf7-3f1f57735813 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043920 Aug 18 22:01:16.504870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 530/1057] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:16.658027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-14a0bfd4-93bc-4566-beb6-9c08749f330f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:16.660173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-14a0bfd4-93bc-4566-beb6-9c08749f330f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:16.666157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14a0bfd4-93bc-4566-beb6-9c08749f330f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:16.666638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14a0bfd4-93bc-4566-beb6-9c08749f330f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:16.667076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14a0bfd4-93bc-4566-beb6-9c08749f330f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:16.667762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14a0bfd4-93bc-4566-beb6-9c08749f330f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:16.668216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14a0bfd4-93bc-4566-beb6-9c08749f330f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:16.668639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14a0bfd4-93bc-4566-beb6-9c08749f330f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:16.697126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-14a0bfd4-93bc-4566-beb6-9c08749f330f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043729 Aug 18 22:01:16.697710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 528/1058] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:16.859436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d6029224-f90f-4d53-afdb-eae0c13b05a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:16.861718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d6029224-f90f-4d53-afdb-eae0c13b05a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:16.867411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6029224-f90f-4d53-afdb-eae0c13b05a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:16.867888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6029224-f90f-4d53-afdb-eae0c13b05a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:16.868320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6029224-f90f-4d53-afdb-eae0c13b05a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:16.869001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6029224-f90f-4d53-afdb-eae0c13b05a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:16.869448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6029224-f90f-4d53-afdb-eae0c13b05a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:16.869900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6029224-f90f-4d53-afdb-eae0c13b05a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:16.898497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d6029224-f90f-4d53-afdb-eae0c13b05a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042634 Aug 18 22:01:16.899041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 531/1059] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:16 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:16.934853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f5791fd6-eb99-47b9-a0c9-ebc234a8abaf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:16.936999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f5791fd6-eb99-47b9-a0c9-ebc234a8abaf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:16.943885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5791fd6-eb99-47b9-a0c9-ebc234a8abaf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:16.944370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5791fd6-eb99-47b9-a0c9-ebc234a8abaf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:16.944811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5791fd6-eb99-47b9-a0c9-ebc234a8abaf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:16.945504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5791fd6-eb99-47b9-a0c9-ebc234a8abaf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:16.945990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5791fd6-eb99-47b9-a0c9-ebc234a8abaf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:16.946421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5791fd6-eb99-47b9-a0c9-ebc234a8abaf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:16.975360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f5791fd6-eb99-47b9-a0c9-ebc234a8abaf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Aug 18 22:01:16.976029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 529/1060] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:16 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:17.516532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-de363682-1832-417d-a092-993e30026ef6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:17.518669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-de363682-1832-417d-a092-993e30026ef6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:17.525082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de363682-1832-417d-a092-993e30026ef6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:17.525560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de363682-1832-417d-a092-993e30026ef6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:17.526026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de363682-1832-417d-a092-993e30026ef6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:17.526720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de363682-1832-417d-a092-993e30026ef6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:17.527175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de363682-1832-417d-a092-993e30026ef6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:17.527602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de363682-1832-417d-a092-993e30026ef6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:17.558355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-de363682-1832-417d-a092-993e30026ef6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045743 Aug 18 22:01:17.558915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 532/1061] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:17.709000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-11dcd51d-ab04-48c4-9b0c-4e090f6a03f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:17.711152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-11dcd51d-ab04-48c4-9b0c-4e090f6a03f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:17.717188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11dcd51d-ab04-48c4-9b0c-4e090f6a03f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:17.717692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11dcd51d-ab04-48c4-9b0c-4e090f6a03f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:17.718128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11dcd51d-ab04-48c4-9b0c-4e090f6a03f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:17.718813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11dcd51d-ab04-48c4-9b0c-4e090f6a03f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:17.719258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11dcd51d-ab04-48c4-9b0c-4e090f6a03f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:17.720200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11dcd51d-ab04-48c4-9b0c-4e090f6a03f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:17.748529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-11dcd51d-ab04-48c4-9b0c-4e090f6a03f5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043515 Aug 18 22:01:17.749079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 530/1062] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:17.911175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9157bb8a-8bec-40ec-9f25-8257bc739bda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:17.913336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9157bb8a-8bec-40ec-9f25-8257bc739bda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:17.919277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9157bb8a-8bec-40ec-9f25-8257bc739bda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:17.919761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9157bb8a-8bec-40ec-9f25-8257bc739bda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:17.920202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9157bb8a-8bec-40ec-9f25-8257bc739bda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:17.920901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9157bb8a-8bec-40ec-9f25-8257bc739bda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:17.921360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9157bb8a-8bec-40ec-9f25-8257bc739bda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:17.922071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9157bb8a-8bec-40ec-9f25-8257bc739bda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:17.951116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9157bb8a-8bec-40ec-9f25-8257bc739bda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 Aug 18 22:01:17.951670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 533/1063] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:17 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:18.041700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2cfed0ca-e1eb-49cd-85ce-c17cd0339366 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:18.043864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2cfed0ca-e1eb-49cd-85ce-c17cd0339366 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:18.050025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2cfed0ca-e1eb-49cd-85ce-c17cd0339366 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:18.050514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2cfed0ca-e1eb-49cd-85ce-c17cd0339366 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:18.050956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2cfed0ca-e1eb-49cd-85ce-c17cd0339366 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:18.051651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2cfed0ca-e1eb-49cd-85ce-c17cd0339366 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:18.052110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2cfed0ca-e1eb-49cd-85ce-c17cd0339366 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:18.052539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2cfed0ca-e1eb-49cd-85ce-c17cd0339366 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:18.081615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2cfed0ca-e1eb-49cd-85ce-c17cd0339366 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097836 Aug 18 22:01:18.082164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 531/1064] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:17 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:18.570754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-92ef5ae0-4a26-434e-9237-c2f479ea0336 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:18.572939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-92ef5ae0-4a26-434e-9237-c2f479ea0336 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:18.580033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92ef5ae0-4a26-434e-9237-c2f479ea0336 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:18.580511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92ef5ae0-4a26-434e-9237-c2f479ea0336 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:18.580947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92ef5ae0-4a26-434e-9237-c2f479ea0336 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:18.582054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92ef5ae0-4a26-434e-9237-c2f479ea0336 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:18.582520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92ef5ae0-4a26-434e-9237-c2f479ea0336 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:18.582949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92ef5ae0-4a26-434e-9237-c2f479ea0336 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:18.612645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-92ef5ae0-4a26-434e-9237-c2f479ea0336 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045823 Aug 18 22:01:18.613202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 534/1065] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:18 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:18.760782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-397d6bda-2ef6-41ca-976c-dda5378290d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:18.762937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-397d6bda-2ef6-41ca-976c-dda5378290d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:18.770116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-397d6bda-2ef6-41ca-976c-dda5378290d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:18.770599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-397d6bda-2ef6-41ca-976c-dda5378290d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:18.771027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-397d6bda-2ef6-41ca-976c-dda5378290d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:18.772025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-397d6bda-2ef6-41ca-976c-dda5378290d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:18.772561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-397d6bda-2ef6-41ca-976c-dda5378290d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:18.772984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-397d6bda-2ef6-41ca-976c-dda5378290d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:18.802084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-397d6bda-2ef6-41ca-976c-dda5378290d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045208 Aug 18 22:01:18.802638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 532/1066] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:18.963402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9078d134-9715-47e4-a678-2855e36a5c15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:18.965507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9078d134-9715-47e4-a678-2855e36a5c15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:18.971376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9078d134-9715-47e4-a678-2855e36a5c15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:18.971853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9078d134-9715-47e4-a678-2855e36a5c15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:18.972280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9078d134-9715-47e4-a678-2855e36a5c15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:18.972960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9078d134-9715-47e4-a678-2855e36a5c15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:18.973410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9078d134-9715-47e4-a678-2855e36a5c15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:18.973865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9078d134-9715-47e4-a678-2855e36a5c15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:19.003858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9078d134-9715-47e4-a678-2855e36a5c15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Aug 18 22:01:19.004402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 535/1067] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:18 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:19.093051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-62c9b213-4af3-425d-ab43-7bca44618ad7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:19.095093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-62c9b213-4af3-425d-ab43-7bca44618ad7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:19.101395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62c9b213-4af3-425d-ab43-7bca44618ad7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:19.101932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62c9b213-4af3-425d-ab43-7bca44618ad7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:19.102354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62c9b213-4af3-425d-ab43-7bca44618ad7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:19.103043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62c9b213-4af3-425d-ab43-7bca44618ad7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:19.103498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62c9b213-4af3-425d-ab43-7bca44618ad7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:19.103927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-62c9b213-4af3-425d-ab43-7bca44618ad7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:19.133294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-62c9b213-4af3-425d-ab43-7bca44618ad7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Aug 18 22:01:19.133894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 533/1068] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:19 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:19.625166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-99069610-859f-4241-b1d2-a042e59ceb31 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:19.627363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-99069610-859f-4241-b1d2-a042e59ceb31 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:19.633745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99069610-859f-4241-b1d2-a042e59ceb31 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:19.634231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99069610-859f-4241-b1d2-a042e59ceb31 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:19.634671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99069610-859f-4241-b1d2-a042e59ceb31 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:19.635370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99069610-859f-4241-b1d2-a042e59ceb31 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:19.635823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99069610-859f-4241-b1d2-a042e59ceb31 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:19.636249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99069610-859f-4241-b1d2-a042e59ceb31 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:19.665691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-99069610-859f-4241-b1d2-a042e59ceb31 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044472 Aug 18 22:01:19.666243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 536/1069] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:01:19.814902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-97dfac9b-8523-42d6-9790-dd908a258c44 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:19.817135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-97dfac9b-8523-42d6-9790-dd908a258c44 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:19.823242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97dfac9b-8523-42d6-9790-dd908a258c44 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:19.823730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97dfac9b-8523-42d6-9790-dd908a258c44 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:19.824177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97dfac9b-8523-42d6-9790-dd908a258c44 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:19.824874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97dfac9b-8523-42d6-9790-dd908a258c44 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:19.825328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97dfac9b-8523-42d6-9790-dd908a258c44 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:19.825789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97dfac9b-8523-42d6-9790-dd908a258c44 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:19.855271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-97dfac9b-8523-42d6-9790-dd908a258c44 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Aug 18 22:01:19.855842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 534/1070] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:19 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:20.015829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-83e02fea-6de6-4077-86ca-b1faa1beabef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:20.018737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-83e02fea-6de6-4077-86ca-b1faa1beabef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:20.024628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83e02fea-6de6-4077-86ca-b1faa1beabef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:20.025109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83e02fea-6de6-4077-86ca-b1faa1beabef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:20.025546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83e02fea-6de6-4077-86ca-b1faa1beabef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:20.026266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83e02fea-6de6-4077-86ca-b1faa1beabef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:20.026724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83e02fea-6de6-4077-86ca-b1faa1beabef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:20.027152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83e02fea-6de6-4077-86ca-b1faa1beabef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:20.055748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-83e02fea-6de6-4077-86ca-b1faa1beabef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043849 Aug 18 22:01:20.056303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 537/1071] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:20.146219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c77ac263-453d-4848-994f-3768d40ac32d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:20.148262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c77ac263-453d-4848-994f-3768d40ac32d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:20.154543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c77ac263-453d-4848-994f-3768d40ac32d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:20.155020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c77ac263-453d-4848-994f-3768d40ac32d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:20.155451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c77ac263-453d-4848-994f-3768d40ac32d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:20.156131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c77ac263-453d-4848-994f-3768d40ac32d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:20.156578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c77ac263-453d-4848-994f-3768d40ac32d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:20.156999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c77ac263-453d-4848-994f-3768d40ac32d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:20.185589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c77ac263-453d-4848-994f-3768d40ac32d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044104 Aug 18 22:01:20.186168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 535/1072] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:20 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:20.679252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4dcb8d98-6409-4969-975c-1c31403e010f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:20.681363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4dcb8d98-6409-4969-975c-1c31403e010f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:20.687717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dcb8d98-6409-4969-975c-1c31403e010f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:20.688203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dcb8d98-6409-4969-975c-1c31403e010f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:20.688642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dcb8d98-6409-4969-975c-1c31403e010f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:20.689374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dcb8d98-6409-4969-975c-1c31403e010f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:20.689863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dcb8d98-6409-4969-975c-1c31403e010f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:20.690289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dcb8d98-6409-4969-975c-1c31403e010f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:20.719278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4dcb8d98-6409-4969-975c-1c31403e010f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043824 Aug 18 22:01:20.720146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 538/1073] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:20 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:20.867288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-92cd3498-0d57-4a1f-9ac5-bee471aabda5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:20.869412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-92cd3498-0d57-4a1f-9ac5-bee471aabda5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:20.871317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:20.876364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92cd3498-0d57-4a1f-9ac5-bee471aabda5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:20.876837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92cd3498-0d57-4a1f-9ac5-bee471aabda5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:20.877268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92cd3498-0d57-4a1f-9ac5-bee471aabda5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:20.877977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92cd3498-0d57-4a1f-9ac5-bee471aabda5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:20.878427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92cd3498-0d57-4a1f-9ac5-bee471aabda5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:20.878847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92cd3498-0d57-4a1f-9ac5-bee471aabda5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:20.907879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-92cd3498-0d57-4a1f-9ac5-bee471aabda5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Aug 18 22:01:20.908425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 536/1074] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:20 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:21.067907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ee20db18-7f4a-47fa-b1df-4d16a8f2d92b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:21.070059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ee20db18-7f4a-47fa-b1df-4d16a8f2d92b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:21.075973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee20db18-7f4a-47fa-b1df-4d16a8f2d92b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:21.076459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee20db18-7f4a-47fa-b1df-4d16a8f2d92b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:21.076929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee20db18-7f4a-47fa-b1df-4d16a8f2d92b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:21.077651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee20db18-7f4a-47fa-b1df-4d16a8f2d92b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:21.078108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee20db18-7f4a-47fa-b1df-4d16a8f2d92b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:21.078535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee20db18-7f4a-47fa-b1df-4d16a8f2d92b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:21.109415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ee20db18-7f4a-47fa-b1df-4d16a8f2d92b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045225 Aug 18 22:01:21.110213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 539/1075] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:21.197498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-00925062-fef2-4ff2-9083-e01d725bfdd2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:21.199554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-00925062-fef2-4ff2-9083-e01d725bfdd2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:21.206882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00925062-fef2-4ff2-9083-e01d725bfdd2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:21.207355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00925062-fef2-4ff2-9083-e01d725bfdd2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:21.207782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00925062-fef2-4ff2-9083-e01d725bfdd2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:21.208699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00925062-fef2-4ff2-9083-e01d725bfdd2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:21.209150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00925062-fef2-4ff2-9083-e01d725bfdd2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:21.209571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00925062-fef2-4ff2-9083-e01d725bfdd2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:21.238279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-00925062-fef2-4ff2-9083-e01d725bfdd2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044851 Aug 18 22:01:21.238836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 537/1076] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:21 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:21.731904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-35a12c09-11ca-4834-8a32-13403910ce06 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:21.734032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-35a12c09-11ca-4834-8a32-13403910ce06 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:21.740332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35a12c09-11ca-4834-8a32-13403910ce06 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:21.740806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35a12c09-11ca-4834-8a32-13403910ce06 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:21.741234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35a12c09-11ca-4834-8a32-13403910ce06 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:21.741947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35a12c09-11ca-4834-8a32-13403910ce06 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:21.742397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35a12c09-11ca-4834-8a32-13403910ce06 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:21.742814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35a12c09-11ca-4834-8a32-13403910ce06 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:21.771840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-35a12c09-11ca-4834-8a32-13403910ce06 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043921 Aug 18 22:01:21.772396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 540/1077] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:21.919761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1e61607d-f051-4a74-b39d-c34d76e18b28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:21.922175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1e61607d-f051-4a74-b39d-c34d76e18b28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:21.928574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e61607d-f051-4a74-b39d-c34d76e18b28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:21.929054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e61607d-f051-4a74-b39d-c34d76e18b28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:21.929491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e61607d-f051-4a74-b39d-c34d76e18b28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:21.930220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e61607d-f051-4a74-b39d-c34d76e18b28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:21.930677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e61607d-f051-4a74-b39d-c34d76e18b28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:21.931107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e61607d-f051-4a74-b39d-c34d76e18b28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:21.960211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1e61607d-f051-4a74-b39d-c34d76e18b28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044432 Aug 18 22:01:21.960771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 538/1078] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:21 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:22.121889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ca88d9c3-cd74-491d-bbcd-75587b6105b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:22.124043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ca88d9c3-cd74-491d-bbcd-75587b6105b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:22.130707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca88d9c3-cd74-491d-bbcd-75587b6105b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:22.131193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca88d9c3-cd74-491d-bbcd-75587b6105b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:22.131634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca88d9c3-cd74-491d-bbcd-75587b6105b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:22.132329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca88d9c3-cd74-491d-bbcd-75587b6105b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:22.132787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca88d9c3-cd74-491d-bbcd-75587b6105b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:22.133217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca88d9c3-cd74-491d-bbcd-75587b6105b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:22.161577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ca88d9c3-cd74-491d-bbcd-75587b6105b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043689 Aug 18 22:01:22.162154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 541/1079] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:22 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:22.249923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b2a22c8e-d5c3-4d27-9fac-f149bfb8cf56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:22.251965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b2a22c8e-d5c3-4d27-9fac-f149bfb8cf56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:22.258261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2a22c8e-d5c3-4d27-9fac-f149bfb8cf56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:22.258739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2a22c8e-d5c3-4d27-9fac-f149bfb8cf56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:22.259171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2a22c8e-d5c3-4d27-9fac-f149bfb8cf56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:22.259854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2a22c8e-d5c3-4d27-9fac-f149bfb8cf56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:22.260302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2a22c8e-d5c3-4d27-9fac-f149bfb8cf56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:22.260722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2a22c8e-d5c3-4d27-9fac-f149bfb8cf56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:22.289022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b2a22c8e-d5c3-4d27-9fac-f149bfb8cf56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043066 Aug 18 22:01:22.289563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 539/1080] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:22.784821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-093d9b16-e639-4b34-a9de-4faa64ec4c72 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:22.786976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-093d9b16-e639-4b34-a9de-4faa64ec4c72 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:22.793420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-093d9b16-e639-4b34-a9de-4faa64ec4c72 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:22.793936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-093d9b16-e639-4b34-a9de-4faa64ec4c72 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:22.794373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-093d9b16-e639-4b34-a9de-4faa64ec4c72 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:22.795064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-093d9b16-e639-4b34-a9de-4faa64ec4c72 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:22.795521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-093d9b16-e639-4b34-a9de-4faa64ec4c72 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:22.795950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-093d9b16-e639-4b34-a9de-4faa64ec4c72 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:22.824200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-093d9b16-e639-4b34-a9de-4faa64ec4c72 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044040 Aug 18 22:01:22.824744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 542/1081] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:22.972677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-765548a6-adfa-4c14-8c9e-0edaf9362e8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:22.974719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-765548a6-adfa-4c14-8c9e-0edaf9362e8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:22.980588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-765548a6-adfa-4c14-8c9e-0edaf9362e8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:22.981062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-765548a6-adfa-4c14-8c9e-0edaf9362e8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:22.981493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-765548a6-adfa-4c14-8c9e-0edaf9362e8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:22.982208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-765548a6-adfa-4c14-8c9e-0edaf9362e8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:22.982657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-765548a6-adfa-4c14-8c9e-0edaf9362e8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:22.983075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-765548a6-adfa-4c14-8c9e-0edaf9362e8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:23.011052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-765548a6-adfa-4c14-8c9e-0edaf9362e8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042412 Aug 18 22:01:23.011594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 540/1082] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:22 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:23.174063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f802ef23-9924-4f85-9604-89f71efbfb71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:23.176236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f802ef23-9924-4f85-9604-89f71efbfb71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:23.182113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f802ef23-9924-4f85-9604-89f71efbfb71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:23.182590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f802ef23-9924-4f85-9604-89f71efbfb71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:23.183021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f802ef23-9924-4f85-9604-89f71efbfb71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:23.183708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f802ef23-9924-4f85-9604-89f71efbfb71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:23.184161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f802ef23-9924-4f85-9604-89f71efbfb71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:23.184586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f802ef23-9924-4f85-9604-89f71efbfb71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:23.188112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:23.214894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f802ef23-9924-4f85-9604-89f71efbfb71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045069 Aug 18 22:01:23.215557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 543/1083] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:23 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:23.301472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b6ffbe08-1588-4060-86f1-f8752616f8ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:23.303646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b6ffbe08-1588-4060-86f1-f8752616f8ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:23.309939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6ffbe08-1588-4060-86f1-f8752616f8ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:23.310415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6ffbe08-1588-4060-86f1-f8752616f8ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:23.310850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6ffbe08-1588-4060-86f1-f8752616f8ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:23.311538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6ffbe08-1588-4060-86f1-f8752616f8ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:23.311990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6ffbe08-1588-4060-86f1-f8752616f8ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:23.312414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6ffbe08-1588-4060-86f1-f8752616f8ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:23.341756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b6ffbe08-1588-4060-86f1-f8752616f8ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Aug 18 22:01:23.342307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 541/1084] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:23 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:23.836718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c8171a9e-029a-44bd-bda1-f55d90d7072f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:23.838507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c8171a9e-029a-44bd-bda1-f55d90d7072f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:23.845346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8171a9e-029a-44bd-bda1-f55d90d7072f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:23.845898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8171a9e-029a-44bd-bda1-f55d90d7072f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:23.846333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8171a9e-029a-44bd-bda1-f55d90d7072f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:23.847029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8171a9e-029a-44bd-bda1-f55d90d7072f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:23.847479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8171a9e-029a-44bd-bda1-f55d90d7072f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:23.847902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8171a9e-029a-44bd-bda1-f55d90d7072f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:23.876606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c8171a9e-029a-44bd-bda1-f55d90d7072f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044272 Aug 18 22:01:23.877155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 544/1085] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:24.022793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-61e222a9-22b2-4d81-b7be-70b8a9365a97 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:24.025181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-61e222a9-22b2-4d81-b7be-70b8a9365a97 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:24.031131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61e222a9-22b2-4d81-b7be-70b8a9365a97 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:24.031615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61e222a9-22b2-4d81-b7be-70b8a9365a97 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:24.032055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61e222a9-22b2-4d81-b7be-70b8a9365a97 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:24.033384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61e222a9-22b2-4d81-b7be-70b8a9365a97 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:24.033852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61e222a9-22b2-4d81-b7be-70b8a9365a97 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:24.034279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61e222a9-22b2-4d81-b7be-70b8a9365a97 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:24.062260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-61e222a9-22b2-4d81-b7be-70b8a9365a97 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043378 Aug 18 22:01:24.062809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 542/1086] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:24.227111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-76a84fd7-2b0e-4e28-8c9e-20d5983fb958 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:24.229214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-76a84fd7-2b0e-4e28-8c9e-20d5983fb958 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:24.235024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76a84fd7-2b0e-4e28-8c9e-20d5983fb958 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:24.235500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76a84fd7-2b0e-4e28-8c9e-20d5983fb958 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:24.235940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76a84fd7-2b0e-4e28-8c9e-20d5983fb958 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:24.236621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76a84fd7-2b0e-4e28-8c9e-20d5983fb958 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:24.237068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76a84fd7-2b0e-4e28-8c9e-20d5983fb958 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:24.237486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76a84fd7-2b0e-4e28-8c9e-20d5983fb958 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:24.265260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-76a84fd7-2b0e-4e28-8c9e-20d5983fb958 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042077 Aug 18 22:01:24.265831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 545/1087] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:24 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:24.354642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a332d101-50a4-478c-9750-d66c3695e091 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:24.356998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a332d101-50a4-478c-9750-d66c3695e091 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:24.362879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a332d101-50a4-478c-9750-d66c3695e091 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:24.363362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a332d101-50a4-478c-9750-d66c3695e091 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:24.363795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a332d101-50a4-478c-9750-d66c3695e091 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:24.364480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a332d101-50a4-478c-9750-d66c3695e091 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:24.364934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a332d101-50a4-478c-9750-d66c3695e091 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:24.365357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a332d101-50a4-478c-9750-d66c3695e091 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:24.368892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:24.394212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a332d101-50a4-478c-9750-d66c3695e091 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Aug 18 22:01:24.394766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 543/1088] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:24 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:24.889451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f3d2b7a-02a7-417d-9e86-5e0dd22e917b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:24.891700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f3d2b7a-02a7-417d-9e86-5e0dd22e917b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:24.898218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f3d2b7a-02a7-417d-9e86-5e0dd22e917b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:24.898809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f3d2b7a-02a7-417d-9e86-5e0dd22e917b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:24.899254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f3d2b7a-02a7-417d-9e86-5e0dd22e917b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:24.899967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f3d2b7a-02a7-417d-9e86-5e0dd22e917b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:24.900422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f3d2b7a-02a7-417d-9e86-5e0dd22e917b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:24.900852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f3d2b7a-02a7-417d-9e86-5e0dd22e917b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:24.930845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f3d2b7a-02a7-417d-9e86-5e0dd22e917b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045607 Aug 18 22:01:24.931406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 546/1089] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:24 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:25.074414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c0fd0283-8b0b-4ba1-9189-d4098498dda7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:25.076527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c0fd0283-8b0b-4ba1-9189-d4098498dda7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:25.082497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fd0283-8b0b-4ba1-9189-d4098498dda7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:25.082982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fd0283-8b0b-4ba1-9189-d4098498dda7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:25.083416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fd0283-8b0b-4ba1-9189-d4098498dda7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:25.084104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fd0283-8b0b-4ba1-9189-d4098498dda7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:25.084556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fd0283-8b0b-4ba1-9189-d4098498dda7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:25.084981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fd0283-8b0b-4ba1-9189-d4098498dda7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:25.113207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c0fd0283-8b0b-4ba1-9189-d4098498dda7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042700 Aug 18 22:01:25.113786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 544/1090] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:25 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:25.277762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e24b1c01-08c9-4d9b-93f6-7764632dcfde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:25.279905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e24b1c01-08c9-4d9b-93f6-7764632dcfde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:25.286603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e24b1c01-08c9-4d9b-93f6-7764632dcfde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:25.287086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e24b1c01-08c9-4d9b-93f6-7764632dcfde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:25.287527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e24b1c01-08c9-4d9b-93f6-7764632dcfde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:25.288224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e24b1c01-08c9-4d9b-93f6-7764632dcfde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:25.288682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e24b1c01-08c9-4d9b-93f6-7764632dcfde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:25.289110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e24b1c01-08c9-4d9b-93f6-7764632dcfde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:25.319139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e24b1c01-08c9-4d9b-93f6-7764632dcfde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045255 Aug 18 22:01:25.319691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 547/1091] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:25 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:25.406256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-456fd18c-fe43-4ce8-8242-9b0b94053640 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:25.408890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-456fd18c-fe43-4ce8-8242-9b0b94053640 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:25.415296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-456fd18c-fe43-4ce8-8242-9b0b94053640 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:25.415783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-456fd18c-fe43-4ce8-8242-9b0b94053640 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:25.416224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-456fd18c-fe43-4ce8-8242-9b0b94053640 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:25.416922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-456fd18c-fe43-4ce8-8242-9b0b94053640 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:25.417382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-456fd18c-fe43-4ce8-8242-9b0b94053640 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:25.417841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-456fd18c-fe43-4ce8-8242-9b0b94053640 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:25.446877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-456fd18c-fe43-4ce8-8242-9b0b94053640 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044681 Aug 18 22:01:25.447432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 545/1092] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:25.943723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2e939607-b7f7-4e07-b062-60efecc25ac8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:25.945919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2e939607-b7f7-4e07-b062-60efecc25ac8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:25.952471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e939607-b7f7-4e07-b062-60efecc25ac8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:25.952946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e939607-b7f7-4e07-b062-60efecc25ac8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:25.953374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e939607-b7f7-4e07-b062-60efecc25ac8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:25.954704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e939607-b7f7-4e07-b062-60efecc25ac8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:25.955155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e939607-b7f7-4e07-b062-60efecc25ac8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:25.955574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e939607-b7f7-4e07-b062-60efecc25ac8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:25.983790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2e939607-b7f7-4e07-b062-60efecc25ac8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043934 Aug 18 22:01:25.984262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 548/1093] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:25 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:26.127485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0eaa68dd-e9e6-4b57-949b-c27c29b93ce4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:26.131090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0eaa68dd-e9e6-4b57-949b-c27c29b93ce4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:26.137792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0eaa68dd-e9e6-4b57-949b-c27c29b93ce4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:26.138281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0eaa68dd-e9e6-4b57-949b-c27c29b93ce4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:26.138722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0eaa68dd-e9e6-4b57-949b-c27c29b93ce4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:26.139439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0eaa68dd-e9e6-4b57-949b-c27c29b93ce4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:26.139900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0eaa68dd-e9e6-4b57-949b-c27c29b93ce4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:26.140329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0eaa68dd-e9e6-4b57-949b-c27c29b93ce4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:26.169072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0eaa68dd-e9e6-4b57-949b-c27c29b93ce4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047614 Aug 18 22:01:26.169643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 546/1094] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:26 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:26.331397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-76ffab36-003f-4111-8ac6-9c9019b8b309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:26.333550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-76ffab36-003f-4111-8ac6-9c9019b8b309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:26.339425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ffab36-003f-4111-8ac6-9c9019b8b309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:26.339907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ffab36-003f-4111-8ac6-9c9019b8b309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:26.340340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ffab36-003f-4111-8ac6-9c9019b8b309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:26.341029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ffab36-003f-4111-8ac6-9c9019b8b309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:26.341483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ffab36-003f-4111-8ac6-9c9019b8b309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:26.341947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76ffab36-003f-4111-8ac6-9c9019b8b309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:26.372681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-76ffab36-003f-4111-8ac6-9c9019b8b309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 Aug 18 22:01:26.373232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 549/1095] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:26 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:26.459231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-933530ba-b695-4141-9067-eb72d71a5c0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:26.461349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-933530ba-b695-4141-9067-eb72d71a5c0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:26.467819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-933530ba-b695-4141-9067-eb72d71a5c0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:26.468320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-933530ba-b695-4141-9067-eb72d71a5c0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:26.468742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-933530ba-b695-4141-9067-eb72d71a5c0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:26.469437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-933530ba-b695-4141-9067-eb72d71a5c0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:26.469920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-933530ba-b695-4141-9067-eb72d71a5c0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:26.470657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-933530ba-b695-4141-9067-eb72d71a5c0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:26.499948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-933530ba-b695-4141-9067-eb72d71a5c0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044571 Aug 18 22:01:26.500430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 547/1096] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:26 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:26.996097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eaeb0289-a7b8-4cff-b888-7103ca5c2f1f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:26.998378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eaeb0289-a7b8-4cff-b888-7103ca5c2f1f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:27.004820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaeb0289-a7b8-4cff-b888-7103ca5c2f1f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:27.005290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaeb0289-a7b8-4cff-b888-7103ca5c2f1f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:27.005749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaeb0289-a7b8-4cff-b888-7103ca5c2f1f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:27.006439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaeb0289-a7b8-4cff-b888-7103ca5c2f1f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:27.006884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaeb0289-a7b8-4cff-b888-7103ca5c2f1f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:27.007306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaeb0289-a7b8-4cff-b888-7103ca5c2f1f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:27.036424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eaeb0289-a7b8-4cff-b888-7103ca5c2f1f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044285 Aug 18 22:01:27.036971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 550/1097] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:26 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:27.180866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-625e3445-394f-4313-a159-0e5194cbd6a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:27.183005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-625e3445-394f-4313-a159-0e5194cbd6a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:27.188929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-625e3445-394f-4313-a159-0e5194cbd6a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:27.189415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-625e3445-394f-4313-a159-0e5194cbd6a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:27.189888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-625e3445-394f-4313-a159-0e5194cbd6a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:27.190580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-625e3445-394f-4313-a159-0e5194cbd6a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:27.191037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-625e3445-394f-4313-a159-0e5194cbd6a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:27.191464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-625e3445-394f-4313-a159-0e5194cbd6a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:27.220857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-625e3445-394f-4313-a159-0e5194cbd6a8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043932 Aug 18 22:01:27.221420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 548/1098] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:27 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:27.385640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4ed843db-b164-4017-a572-e615e8f07ee8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:27.387805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4ed843db-b164-4017-a572-e615e8f07ee8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:27.394214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ed843db-b164-4017-a572-e615e8f07ee8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:27.394696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ed843db-b164-4017-a572-e615e8f07ee8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:27.395136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ed843db-b164-4017-a572-e615e8f07ee8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:27.395828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ed843db-b164-4017-a572-e615e8f07ee8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:27.396284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ed843db-b164-4017-a572-e615e8f07ee8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:27.396710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ed843db-b164-4017-a572-e615e8f07ee8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:27.426215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4ed843db-b164-4017-a572-e615e8f07ee8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044639 Aug 18 22:01:27.426782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 551/1099] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:27 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:27.512811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-052ebe52-1dc3-47d4-9f2e-c256969f6b02 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:27.514973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-052ebe52-1dc3-47d4-9f2e-c256969f6b02 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:27.522066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-052ebe52-1dc3-47d4-9f2e-c256969f6b02 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:27.522559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-052ebe52-1dc3-47d4-9f2e-c256969f6b02 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:27.523004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-052ebe52-1dc3-47d4-9f2e-c256969f6b02 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:27.523709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-052ebe52-1dc3-47d4-9f2e-c256969f6b02 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:27.524170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-052ebe52-1dc3-47d4-9f2e-c256969f6b02 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:27.524604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-052ebe52-1dc3-47d4-9f2e-c256969f6b02 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:27.556989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-052ebe52-1dc3-47d4-9f2e-c256969f6b02 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048126 Aug 18 22:01:27.557508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 549/1100] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:28.049265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d14f25da-50b4-46b1-abc5-9d28371a641f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:28.051430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d14f25da-50b4-46b1-abc5-9d28371a641f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:28.057789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d14f25da-50b4-46b1-abc5-9d28371a641f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:28.058263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d14f25da-50b4-46b1-abc5-9d28371a641f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:28.058698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d14f25da-50b4-46b1-abc5-9d28371a641f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:28.059389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d14f25da-50b4-46b1-abc5-9d28371a641f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:28.059842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d14f25da-50b4-46b1-abc5-9d28371a641f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:28.060266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d14f25da-50b4-46b1-abc5-9d28371a641f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:28.089540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d14f25da-50b4-46b1-abc5-9d28371a641f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045097 Aug 18 22:01:28.090137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 552/1101] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:28.232912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f5d9fe33-a3a3-4277-85b5-c526c430523b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:28.235078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f5d9fe33-a3a3-4277-85b5-c526c430523b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:28.241886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5d9fe33-a3a3-4277-85b5-c526c430523b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:28.242373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5d9fe33-a3a3-4277-85b5-c526c430523b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:28.242815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5d9fe33-a3a3-4277-85b5-c526c430523b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:28.243508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5d9fe33-a3a3-4277-85b5-c526c430523b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:28.243970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5d9fe33-a3a3-4277-85b5-c526c430523b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:28.244403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5d9fe33-a3a3-4277-85b5-c526c430523b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:28.272856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f5d9fe33-a3a3-4277-85b5-c526c430523b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043843 Aug 18 22:01:28.273407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 550/1102] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:28 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:28.438451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f0f4c158-ff86-48c1-aca6-6572406e6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:28.440614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f0f4c158-ff86-48c1-aca6-6572406e6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:28.446476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0f4c158-ff86-48c1-aca6-6572406e6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:28.446961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0f4c158-ff86-48c1-aca6-6572406e6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:28.447420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0f4c158-ff86-48c1-aca6-6572406e6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:28.448101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0f4c158-ff86-48c1-aca6-6572406e6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:28.448562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0f4c158-ff86-48c1-aca6-6572406e6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:28.448990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0f4c158-ff86-48c1-aca6-6572406e6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:28.477462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f0f4c158-ff86-48c1-aca6-6572406e6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042937 Aug 18 22:01:28.478053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 553/1103] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:28 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:28.569411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ba84eba1-0450-44ae-bf8e-cf5aa75607c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:28.571577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ba84eba1-0450-44ae-bf8e-cf5aa75607c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:28.577506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba84eba1-0450-44ae-bf8e-cf5aa75607c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:28.577947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba84eba1-0450-44ae-bf8e-cf5aa75607c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:28.578375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba84eba1-0450-44ae-bf8e-cf5aa75607c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:28.579557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba84eba1-0450-44ae-bf8e-cf5aa75607c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:28.580002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba84eba1-0450-44ae-bf8e-cf5aa75607c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:28.580418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ba84eba1-0450-44ae-bf8e-cf5aa75607c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:28.610062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ba84eba1-0450-44ae-bf8e-cf5aa75607c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044518 Aug 18 22:01:28.610657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 551/1104] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:29.102042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b63f7f96-6a8d-4dd3-88c8-63b49c551273 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:29.104178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b63f7f96-6a8d-4dd3-88c8-63b49c551273 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:29.106540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:29.111873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b63f7f96-6a8d-4dd3-88c8-63b49c551273 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:29.112347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b63f7f96-6a8d-4dd3-88c8-63b49c551273 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:29.112779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b63f7f96-6a8d-4dd3-88c8-63b49c551273 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:29.113462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b63f7f96-6a8d-4dd3-88c8-63b49c551273 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:29.113950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b63f7f96-6a8d-4dd3-88c8-63b49c551273 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:29.114373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b63f7f96-6a8d-4dd3-88c8-63b49c551273 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:29.144007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b63f7f96-6a8d-4dd3-88c8-63b49c551273 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045936 Aug 18 22:01:29.144563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 554/1105] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:01:29.284954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e80a0cfe-0ce8-4cd1-bc85-188860f20c75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:29.287080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e80a0cfe-0ce8-4cd1-bc85-188860f20c75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:29.293417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e80a0cfe-0ce8-4cd1-bc85-188860f20c75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:29.293922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e80a0cfe-0ce8-4cd1-bc85-188860f20c75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:29.294354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e80a0cfe-0ce8-4cd1-bc85-188860f20c75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:29.295035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e80a0cfe-0ce8-4cd1-bc85-188860f20c75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:29.295480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e80a0cfe-0ce8-4cd1-bc85-188860f20c75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:29.295926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e80a0cfe-0ce8-4cd1-bc85-188860f20c75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:29.326135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e80a0cfe-0ce8-4cd1-bc85-188860f20c75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045045 Aug 18 22:01:29.326691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 552/1106] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:29 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:29.490036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2fcd4370-321f-42bc-a1a0-b14ce37079c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:29.492191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2fcd4370-321f-42bc-a1a0-b14ce37079c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:29.498151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fcd4370-321f-42bc-a1a0-b14ce37079c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:29.498628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fcd4370-321f-42bc-a1a0-b14ce37079c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:29.499059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fcd4370-321f-42bc-a1a0-b14ce37079c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:29.499741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fcd4370-321f-42bc-a1a0-b14ce37079c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:29.500195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fcd4370-321f-42bc-a1a0-b14ce37079c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:29.500606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fcd4370-321f-42bc-a1a0-b14ce37079c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:29.529312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2fcd4370-321f-42bc-a1a0-b14ce37079c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Aug 18 22:01:29.529892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 555/1107] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:29 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:29.622153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b8f84833-1391-40ad-9188-d27fad511927 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:29.624293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b8f84833-1391-40ad-9188-d27fad511927 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:29.631246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8f84833-1391-40ad-9188-d27fad511927 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:29.631730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8f84833-1391-40ad-9188-d27fad511927 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:29.632214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8f84833-1391-40ad-9188-d27fad511927 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:29.632873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8f84833-1391-40ad-9188-d27fad511927 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:29.633330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8f84833-1391-40ad-9188-d27fad511927 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:29.633799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8f84833-1391-40ad-9188-d27fad511927 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:29.662956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b8f84833-1391-40ad-9188-d27fad511927 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Aug 18 22:01:29.663515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 553/1108] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:29 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:30.156368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-80528c51-d9e6-4196-ba32-1844bdab5675 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:30.159212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-80528c51-d9e6-4196-ba32-1844bdab5675 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:30.165529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80528c51-d9e6-4196-ba32-1844bdab5675 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:30.166045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80528c51-d9e6-4196-ba32-1844bdab5675 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:30.166480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80528c51-d9e6-4196-ba32-1844bdab5675 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:30.167168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80528c51-d9e6-4196-ba32-1844bdab5675 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:30.167619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80528c51-d9e6-4196-ba32-1844bdab5675 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:30.168043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80528c51-d9e6-4196-ba32-1844bdab5675 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:30.196113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-80528c51-d9e6-4196-ba32-1844bdab5675 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043758 Aug 18 22:01:30.196657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 556/1109] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:30.338286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d9ae321d-534b-4a2c-add2-59d496cb64a6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:30.340402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d9ae321d-534b-4a2c-add2-59d496cb64a6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:30.347678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9ae321d-534b-4a2c-add2-59d496cb64a6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:30.348163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9ae321d-534b-4a2c-add2-59d496cb64a6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:30.348606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9ae321d-534b-4a2c-add2-59d496cb64a6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:30.349299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9ae321d-534b-4a2c-add2-59d496cb64a6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:30.349787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9ae321d-534b-4a2c-add2-59d496cb64a6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:30.350217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9ae321d-534b-4a2c-add2-59d496cb64a6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:30.378262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d9ae321d-534b-4a2c-add2-59d496cb64a6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043852 Aug 18 22:01:30.378891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 554/1110] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:30.541844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b4f07699-2628-402e-9442-19296c6797f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:30.543960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b4f07699-2628-402e-9442-19296c6797f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:30.550036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4f07699-2628-402e-9442-19296c6797f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:30.550506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4f07699-2628-402e-9442-19296c6797f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:30.550935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4f07699-2628-402e-9442-19296c6797f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:30.551623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4f07699-2628-402e-9442-19296c6797f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:30.552074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4f07699-2628-402e-9442-19296c6797f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:30.552494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4f07699-2628-402e-9442-19296c6797f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:30.581406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b4f07699-2628-402e-9442-19296c6797f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Aug 18 22:01:30.581982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 557/1111] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:30 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:30.674581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dbf49101-e817-4d5c-a7cf-e2bd11368b59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:30.676661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dbf49101-e817-4d5c-a7cf-e2bd11368b59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:30.682568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbf49101-e817-4d5c-a7cf-e2bd11368b59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:30.683043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbf49101-e817-4d5c-a7cf-e2bd11368b59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:30.683471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbf49101-e817-4d5c-a7cf-e2bd11368b59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:30.684159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbf49101-e817-4d5c-a7cf-e2bd11368b59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:30.684610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbf49101-e817-4d5c-a7cf-e2bd11368b59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:30.685030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbf49101-e817-4d5c-a7cf-e2bd11368b59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:30.716263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dbf49101-e817-4d5c-a7cf-e2bd11368b59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Aug 18 22:01:30.716963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 555/1112] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:30 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:31.208197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-498d4d99-e805-4bea-9812-a4a431acdbbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:31.210337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-498d4d99-e805-4bea-9812-a4a431acdbbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:31.217083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-498d4d99-e805-4bea-9812-a4a431acdbbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:31.217570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-498d4d99-e805-4bea-9812-a4a431acdbbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:31.218043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-498d4d99-e805-4bea-9812-a4a431acdbbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:31.218754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-498d4d99-e805-4bea-9812-a4a431acdbbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:31.219216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-498d4d99-e805-4bea-9812-a4a431acdbbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:31.220149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-498d4d99-e805-4bea-9812-a4a431acdbbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:31.249270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-498d4d99-e805-4bea-9812-a4a431acdbbb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045057 Aug 18 22:01:31.249860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 558/1113] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:31 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:31.490181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9ffa616b-dcb5-4bd8-8ca5-f90223c76cd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:31.492310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9ffa616b-dcb5-4bd8-8ca5-f90223c76cd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:31.501084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ffa616b-dcb5-4bd8-8ca5-f90223c76cd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:31.501986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ffa616b-dcb5-4bd8-8ca5-f90223c76cd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:31.502754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ffa616b-dcb5-4bd8-8ca5-f90223c76cd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:31.503975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ffa616b-dcb5-4bd8-8ca5-f90223c76cd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:31.504848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ffa616b-dcb5-4bd8-8ca5-f90223c76cd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:31.505581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ffa616b-dcb5-4bd8-8ca5-f90223c76cd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:31.535828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9ffa616b-dcb5-4bd8-8ca5-f90223c76cd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.149837 Aug 18 22:01:31.536402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 556/1114] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:31 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:31.593400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1f393202-6846-461f-9d51-65a4ed5b95ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:31.596218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1f393202-6846-461f-9d51-65a4ed5b95ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:31.602047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f393202-6846-461f-9d51-65a4ed5b95ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:31.602522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f393202-6846-461f-9d51-65a4ed5b95ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:31.602958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f393202-6846-461f-9d51-65a4ed5b95ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:31.603649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f393202-6846-461f-9d51-65a4ed5b95ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:31.604101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f393202-6846-461f-9d51-65a4ed5b95ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:31.604524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f393202-6846-461f-9d51-65a4ed5b95ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:31.629118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:31.634257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1f393202-6846-461f-9d51-65a4ed5b95ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Aug 18 22:01:31.634810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 559/1115] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:31.728480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b17d8bcf-3188-43a6-92da-0ca6dbc18d67 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:31.730589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b17d8bcf-3188-43a6-92da-0ca6dbc18d67 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:31.736557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b17d8bcf-3188-43a6-92da-0ca6dbc18d67 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:31.737149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b17d8bcf-3188-43a6-92da-0ca6dbc18d67 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:31.737465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b17d8bcf-3188-43a6-92da-0ca6dbc18d67 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:31.738181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b17d8bcf-3188-43a6-92da-0ca6dbc18d67 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:31.738629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b17d8bcf-3188-43a6-92da-0ca6dbc18d67 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:31.739048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b17d8bcf-3188-43a6-92da-0ca6dbc18d67 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:31.767577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b17d8bcf-3188-43a6-92da-0ca6dbc18d67 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 Aug 18 22:01:31.768120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 557/1116] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:31 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:32.261897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52349b99-303b-45ac-97ab-7a74c6d88ff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:32.264024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-52349b99-303b-45ac-97ab-7a74c6d88ff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:32.271026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52349b99-303b-45ac-97ab-7a74c6d88ff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:32.271526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52349b99-303b-45ac-97ab-7a74c6d88ff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:32.271941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52349b99-303b-45ac-97ab-7a74c6d88ff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:32.272636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52349b99-303b-45ac-97ab-7a74c6d88ff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:32.273088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52349b99-303b-45ac-97ab-7a74c6d88ff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:32.273512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52349b99-303b-45ac-97ab-7a74c6d88ff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:32.302355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-52349b99-303b-45ac-97ab-7a74c6d88ff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044658 Aug 18 22:01:32.302912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 560/1117] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:32.549047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07db25e0-efcb-49ea-a5da-1e5054c6d070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:32.551364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07db25e0-efcb-49ea-a5da-1e5054c6d070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:32.558304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07db25e0-efcb-49ea-a5da-1e5054c6d070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:32.558909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07db25e0-efcb-49ea-a5da-1e5054c6d070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:32.559347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07db25e0-efcb-49ea-a5da-1e5054c6d070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:32.560037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07db25e0-efcb-49ea-a5da-1e5054c6d070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:32.560487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07db25e0-efcb-49ea-a5da-1e5054c6d070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:32.560928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07db25e0-efcb-49ea-a5da-1e5054c6d070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:32.590403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07db25e0-efcb-49ea-a5da-1e5054c6d070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046048 Aug 18 22:01:32.590989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 558/1118] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:32.646332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6595c732-8b53-493f-8402-53c8036539fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:32.648521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6595c732-8b53-493f-8402-53c8036539fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:32.654418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6595c732-8b53-493f-8402-53c8036539fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:32.654901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6595c732-8b53-493f-8402-53c8036539fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:32.655341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6595c732-8b53-493f-8402-53c8036539fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:32.656043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6595c732-8b53-493f-8402-53c8036539fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:32.656500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6595c732-8b53-493f-8402-53c8036539fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:32.657428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6595c732-8b53-493f-8402-53c8036539fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:32.687038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6595c732-8b53-493f-8402-53c8036539fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044543 Aug 18 22:01:32.687612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 561/1119] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:32 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:32.779665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-301fbf23-09f2-46b2-ac80-d82ddba3a056 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:32.781819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-301fbf23-09f2-46b2-ac80-d82ddba3a056 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:32.788256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-301fbf23-09f2-46b2-ac80-d82ddba3a056 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:32.788737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-301fbf23-09f2-46b2-ac80-d82ddba3a056 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:32.789177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-301fbf23-09f2-46b2-ac80-d82ddba3a056 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:32.789901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-301fbf23-09f2-46b2-ac80-d82ddba3a056 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:32.790359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-301fbf23-09f2-46b2-ac80-d82ddba3a056 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:32.790787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-301fbf23-09f2-46b2-ac80-d82ddba3a056 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:32.815891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:32.821258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-301fbf23-09f2-46b2-ac80-d82ddba3a056 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045505 Aug 18 22:01:32.821850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 559/1120] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:32 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:33.314881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f2ec51e7-4d6d-41db-ab6c-6b03431b70d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:33.317026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f2ec51e7-4d6d-41db-ab6c-6b03431b70d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:33.323365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2ec51e7-4d6d-41db-ab6c-6b03431b70d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:33.323846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2ec51e7-4d6d-41db-ab6c-6b03431b70d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:33.324284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2ec51e7-4d6d-41db-ab6c-6b03431b70d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:33.324976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2ec51e7-4d6d-41db-ab6c-6b03431b70d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:33.325433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2ec51e7-4d6d-41db-ab6c-6b03431b70d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:33.326040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2ec51e7-4d6d-41db-ab6c-6b03431b70d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:33.354294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f2ec51e7-4d6d-41db-ab6c-6b03431b70d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044068 Aug 18 22:01:33.354900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 562/1121] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:33 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:33.603266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-195906d0-be5b-49f3-b327-2f1bf99f54b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:33.605364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-195906d0-be5b-49f3-b327-2f1bf99f54b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:33.612446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-195906d0-be5b-49f3-b327-2f1bf99f54b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:33.612922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-195906d0-be5b-49f3-b327-2f1bf99f54b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:33.613350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-195906d0-be5b-49f3-b327-2f1bf99f54b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:33.614062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-195906d0-be5b-49f3-b327-2f1bf99f54b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:33.614541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-195906d0-be5b-49f3-b327-2f1bf99f54b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:33.614958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-195906d0-be5b-49f3-b327-2f1bf99f54b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:33.643322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-195906d0-be5b-49f3-b327-2f1bf99f54b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Aug 18 22:01:33.643888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 560/1122] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:33 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:33.698330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d7d1bd68-7dae-491b-9f2f-45261fe05b3b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:33.700444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d7d1bd68-7dae-491b-9f2f-45261fe05b3b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:33.706330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7d1bd68-7dae-491b-9f2f-45261fe05b3b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:33.706797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7d1bd68-7dae-491b-9f2f-45261fe05b3b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:33.707224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7d1bd68-7dae-491b-9f2f-45261fe05b3b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:33.707905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7d1bd68-7dae-491b-9f2f-45261fe05b3b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:33.708349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7d1bd68-7dae-491b-9f2f-45261fe05b3b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:33.708763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7d1bd68-7dae-491b-9f2f-45261fe05b3b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:33.738363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d7d1bd68-7dae-491b-9f2f-45261fe05b3b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Aug 18 22:01:33.738915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 563/1123] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:33.834375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d3ca03ad-cf5e-4000-8089-5ae21ec4c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:33.836685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d3ca03ad-cf5e-4000-8089-5ae21ec4c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:33.842763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3ca03ad-cf5e-4000-8089-5ae21ec4c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:33.843249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3ca03ad-cf5e-4000-8089-5ae21ec4c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:33.843689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3ca03ad-cf5e-4000-8089-5ae21ec4c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:33.844388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3ca03ad-cf5e-4000-8089-5ae21ec4c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:33.845475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3ca03ad-cf5e-4000-8089-5ae21ec4c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:33.846074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3ca03ad-cf5e-4000-8089-5ae21ec4c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:33.879429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d3ca03ad-cf5e-4000-8089-5ae21ec4c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048975 Aug 18 22:01:33.879930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 561/1124] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:33 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:34.367009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c7ebb013-5dbb-4bd2-a7a0-b8400e6320a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:34.369149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c7ebb013-5dbb-4bd2-a7a0-b8400e6320a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:34.375606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7ebb013-5dbb-4bd2-a7a0-b8400e6320a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:34.376623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7ebb013-5dbb-4bd2-a7a0-b8400e6320a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:34.377062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7ebb013-5dbb-4bd2-a7a0-b8400e6320a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:34.377795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7ebb013-5dbb-4bd2-a7a0-b8400e6320a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:34.378255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7ebb013-5dbb-4bd2-a7a0-b8400e6320a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:34.378684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7ebb013-5dbb-4bd2-a7a0-b8400e6320a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:34.407693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c7ebb013-5dbb-4bd2-a7a0-b8400e6320a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044701 Aug 18 22:01:34.408248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 564/1125] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:34.655270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-faa74f10-ac39-4fda-a2f2-e4f249c8274d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:34.657394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-faa74f10-ac39-4fda-a2f2-e4f249c8274d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:34.663817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa74f10-ac39-4fda-a2f2-e4f249c8274d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:34.664298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa74f10-ac39-4fda-a2f2-e4f249c8274d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:34.664738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa74f10-ac39-4fda-a2f2-e4f249c8274d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:34.665430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa74f10-ac39-4fda-a2f2-e4f249c8274d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:34.665915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa74f10-ac39-4fda-a2f2-e4f249c8274d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:34.666347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa74f10-ac39-4fda-a2f2-e4f249c8274d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:34.697620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-faa74f10-ac39-4fda-a2f2-e4f249c8274d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046250 Aug 18 22:01:34.698189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 562/1126] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:34 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:34.751931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6e294dce-cb7b-4955-a365-8646f7baadf2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:34.754156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6e294dce-cb7b-4955-a365-8646f7baadf2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:34.760020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e294dce-cb7b-4955-a365-8646f7baadf2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:34.760507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e294dce-cb7b-4955-a365-8646f7baadf2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:34.760949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e294dce-cb7b-4955-a365-8646f7baadf2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:34.761666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e294dce-cb7b-4955-a365-8646f7baadf2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:34.762586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e294dce-cb7b-4955-a365-8646f7baadf2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:34.762586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e294dce-cb7b-4955-a365-8646f7baadf2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:34.790821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6e294dce-cb7b-4955-a365-8646f7baadf2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044263 Aug 18 22:01:34.791379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 565/1127] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:34.893337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b8f0591b-4a75-4867-ac47-454bc5a832d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:34.895575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b8f0591b-4a75-4867-ac47-454bc5a832d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:34.901406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8f0591b-4a75-4867-ac47-454bc5a832d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:34.901947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8f0591b-4a75-4867-ac47-454bc5a832d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:34.902380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8f0591b-4a75-4867-ac47-454bc5a832d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:34.903118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8f0591b-4a75-4867-ac47-454bc5a832d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:34.903569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8f0591b-4a75-4867-ac47-454bc5a832d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:34.903992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8f0591b-4a75-4867-ac47-454bc5a832d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:34.934820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b8f0591b-4a75-4867-ac47-454bc5a832d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Aug 18 22:01:34.935302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 563/1128] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:34 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:35.420038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c6f1b126-1238-4f7c-8628-3503a2484eeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:35.422453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c6f1b126-1238-4f7c-8628-3503a2484eeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:35.429331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6f1b126-1238-4f7c-8628-3503a2484eeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:35.429841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6f1b126-1238-4f7c-8628-3503a2484eeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:35.430274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6f1b126-1238-4f7c-8628-3503a2484eeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:35.430992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6f1b126-1238-4f7c-8628-3503a2484eeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:35.431440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6f1b126-1238-4f7c-8628-3503a2484eeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:35.431862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6f1b126-1238-4f7c-8628-3503a2484eeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:35.460694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c6f1b126-1238-4f7c-8628-3503a2484eeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044636 Aug 18 22:01:35.461250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 566/1129] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:35.710136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b13905e2-bf89-40dc-afb6-a2a351ddd204 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:35.712177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b13905e2-bf89-40dc-afb6-a2a351ddd204 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:35.718687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b13905e2-bf89-40dc-afb6-a2a351ddd204 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:35.719033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b13905e2-bf89-40dc-afb6-a2a351ddd204 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:35.719960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b13905e2-bf89-40dc-afb6-a2a351ddd204 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:35.720657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b13905e2-bf89-40dc-afb6-a2a351ddd204 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:35.721111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b13905e2-bf89-40dc-afb6-a2a351ddd204 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:35.721537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b13905e2-bf89-40dc-afb6-a2a351ddd204 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:35.751298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b13905e2-bf89-40dc-afb6-a2a351ddd204 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045165 Aug 18 22:01:35.751882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 564/1130] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:35 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:35.803976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fddbb337-cd7c-4c85-b820-eec2835ad3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:35.806148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fddbb337-cd7c-4c85-b820-eec2835ad3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:35.811965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fddbb337-cd7c-4c85-b820-eec2835ad3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:35.812424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fddbb337-cd7c-4c85-b820-eec2835ad3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:35.812853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fddbb337-cd7c-4c85-b820-eec2835ad3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:35.813567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fddbb337-cd7c-4c85-b820-eec2835ad3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:35.814046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fddbb337-cd7c-4c85-b820-eec2835ad3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:35.814564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fddbb337-cd7c-4c85-b820-eec2835ad3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:35.842049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fddbb337-cd7c-4c85-b820-eec2835ad3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041935 Aug 18 22:01:35.842596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 567/1131] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:35 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:35.946144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1e88fe54-8bf0-4d76-9654-5cbee2a519e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:35.948240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1e88fe54-8bf0-4d76-9654-5cbee2a519e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:35.954213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e88fe54-8bf0-4d76-9654-5cbee2a519e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:35.954693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e88fe54-8bf0-4d76-9654-5cbee2a519e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:35.955258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e88fe54-8bf0-4d76-9654-5cbee2a519e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:35.955789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e88fe54-8bf0-4d76-9654-5cbee2a519e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:35.956244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e88fe54-8bf0-4d76-9654-5cbee2a519e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:35.956661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e88fe54-8bf0-4d76-9654-5cbee2a519e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:35.985045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1e88fe54-8bf0-4d76-9654-5cbee2a519e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042711 Aug 18 22:01:35.986314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 565/1132] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:36.472267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5c886689-1e92-4a53-9bba-e791ff519acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:36.474472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5c886689-1e92-4a53-9bba-e791ff519acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:36.480834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c886689-1e92-4a53-9bba-e791ff519acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:36.481312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c886689-1e92-4a53-9bba-e791ff519acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:36.481772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c886689-1e92-4a53-9bba-e791ff519acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:36.482467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c886689-1e92-4a53-9bba-e791ff519acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:36.482925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c886689-1e92-4a53-9bba-e791ff519acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:36.483349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c886689-1e92-4a53-9bba-e791ff519acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:36.512332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5c886689-1e92-4a53-9bba-e791ff519acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044051 Aug 18 22:01:36.512884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 568/1133] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:36.764516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b57ebbc9-8ad0-4844-b154-a6e9d7b95c08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:36.767391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b57ebbc9-8ad0-4844-b154-a6e9d7b95c08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:36.773751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b57ebbc9-8ad0-4844-b154-a6e9d7b95c08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:36.774240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b57ebbc9-8ad0-4844-b154-a6e9d7b95c08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:36.774651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b57ebbc9-8ad0-4844-b154-a6e9d7b95c08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:36.775336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b57ebbc9-8ad0-4844-b154-a6e9d7b95c08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:36.775780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b57ebbc9-8ad0-4844-b154-a6e9d7b95c08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:36.776197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b57ebbc9-8ad0-4844-b154-a6e9d7b95c08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:36.805285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b57ebbc9-8ad0-4844-b154-a6e9d7b95c08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Aug 18 22:01:36.805879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 566/1134] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:36 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:36.854668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dca7f194-fae0-4969-8e6b-5eb4451170fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:36.856892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dca7f194-fae0-4969-8e6b-5eb4451170fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:36.863318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dca7f194-fae0-4969-8e6b-5eb4451170fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:36.863802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dca7f194-fae0-4969-8e6b-5eb4451170fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:36.864238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dca7f194-fae0-4969-8e6b-5eb4451170fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:36.864933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dca7f194-fae0-4969-8e6b-5eb4451170fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:36.865389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dca7f194-fae0-4969-8e6b-5eb4451170fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:36.865843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dca7f194-fae0-4969-8e6b-5eb4451170fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:36.895327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dca7f194-fae0-4969-8e6b-5eb4451170fa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Aug 18 22:01:36.895879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 569/1135] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:36 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:36.998048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cf128507-41b0-4b28-840e-30f79b22b660 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:37.000558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cf128507-41b0-4b28-840e-30f79b22b660 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:37.007584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf128507-41b0-4b28-840e-30f79b22b660 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:37.008070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf128507-41b0-4b28-840e-30f79b22b660 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:37.008512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf128507-41b0-4b28-840e-30f79b22b660 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:37.009210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf128507-41b0-4b28-840e-30f79b22b660 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:37.009699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf128507-41b0-4b28-840e-30f79b22b660 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:37.010129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf128507-41b0-4b28-840e-30f79b22b660 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:37.038769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cf128507-41b0-4b28-840e-30f79b22b660 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044704 Aug 18 22:01:37.039332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 567/1136] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:36 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:37.524600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-859025e9-31d4-4b58-be4f-5a0fbf195a50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:37.526788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-859025e9-31d4-4b58-be4f-5a0fbf195a50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:37.533737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-859025e9-31d4-4b58-be4f-5a0fbf195a50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:37.534233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-859025e9-31d4-4b58-be4f-5a0fbf195a50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:37.534673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-859025e9-31d4-4b58-be4f-5a0fbf195a50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:37.535382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-859025e9-31d4-4b58-be4f-5a0fbf195a50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:37.535838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-859025e9-31d4-4b58-be4f-5a0fbf195a50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:37.536264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-859025e9-31d4-4b58-be4f-5a0fbf195a50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:37.567303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-859025e9-31d4-4b58-be4f-5a0fbf195a50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046597 Aug 18 22:01:37.567856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 570/1137] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:37.817495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a0ba7c77-ed8b-44a1-ac96-058c4d26090f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:37.819631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a0ba7c77-ed8b-44a1-ac96-058c4d26090f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:37.826049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0ba7c77-ed8b-44a1-ac96-058c4d26090f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:37.826534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0ba7c77-ed8b-44a1-ac96-058c4d26090f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:37.826969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0ba7c77-ed8b-44a1-ac96-058c4d26090f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:37.827665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0ba7c77-ed8b-44a1-ac96-058c4d26090f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:37.828119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0ba7c77-ed8b-44a1-ac96-058c4d26090f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:37.828549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0ba7c77-ed8b-44a1-ac96-058c4d26090f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:37.858058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a0ba7c77-ed8b-44a1-ac96-058c4d26090f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044459 Aug 18 22:01:37.858627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 568/1138] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:37 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:37.907579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ec28801-aa1f-460b-a802-2f6d67ee59a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:37.909878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ec28801-aa1f-460b-a802-2f6d67ee59a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:37.915962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ec28801-aa1f-460b-a802-2f6d67ee59a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:37.916446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ec28801-aa1f-460b-a802-2f6d67ee59a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:37.916883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ec28801-aa1f-460b-a802-2f6d67ee59a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:37.917581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ec28801-aa1f-460b-a802-2f6d67ee59a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:37.918061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ec28801-aa1f-460b-a802-2f6d67ee59a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:37.918489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ec28801-aa1f-460b-a802-2f6d67ee59a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:37.948429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ec28801-aa1f-460b-a802-2f6d67ee59a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Aug 18 22:01:37.948984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 571/1139] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:37 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:38.050421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e5fcea14-66a5-4d06-aa22-4a649487a80d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:38.052565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e5fcea14-66a5-4d06-aa22-4a649487a80d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:38.058460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e5fcea14-66a5-4d06-aa22-4a649487a80d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:38.058969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e5fcea14-66a5-4d06-aa22-4a649487a80d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:38.059410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e5fcea14-66a5-4d06-aa22-4a649487a80d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:38.060107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e5fcea14-66a5-4d06-aa22-4a649487a80d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:38.060566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e5fcea14-66a5-4d06-aa22-4a649487a80d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:38.060993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e5fcea14-66a5-4d06-aa22-4a649487a80d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:38.090183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e5fcea14-66a5-4d06-aa22-4a649487a80d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Aug 18 22:01:38.090675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 569/1140] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:38 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:38.579737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b937a33e-5124-4122-b9aa-674b48d1aa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:38.582097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b937a33e-5124-4122-b9aa-674b48d1aa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:38.588423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b937a33e-5124-4122-b9aa-674b48d1aa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:38.588903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b937a33e-5124-4122-b9aa-674b48d1aa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:38.589336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b937a33e-5124-4122-b9aa-674b48d1aa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:38.590060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b937a33e-5124-4122-b9aa-674b48d1aa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:38.590516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b937a33e-5124-4122-b9aa-674b48d1aa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:38.590970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b937a33e-5124-4122-b9aa-674b48d1aa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:38.621242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b937a33e-5124-4122-b9aa-674b48d1aa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045455 Aug 18 22:01:38.621828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 572/1141] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:38 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:38.870139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3ea88c83-d69c-4c5b-80ea-4f7e590b0cf7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:38.872282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3ea88c83-d69c-4c5b-80ea-4f7e590b0cf7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:38.878821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ea88c83-d69c-4c5b-80ea-4f7e590b0cf7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:38.879310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ea88c83-d69c-4c5b-80ea-4f7e590b0cf7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:38.879748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ea88c83-d69c-4c5b-80ea-4f7e590b0cf7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:38.880434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ea88c83-d69c-4c5b-80ea-4f7e590b0cf7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:38.880886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ea88c83-d69c-4c5b-80ea-4f7e590b0cf7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:38.881312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ea88c83-d69c-4c5b-80ea-4f7e590b0cf7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:38.910360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3ea88c83-d69c-4c5b-80ea-4f7e590b0cf7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Aug 18 22:01:38.910922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 570/1142] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:38 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:38.960575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b543e98c-6f51-4005-959d-411b4c2c0137 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:38.962506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b543e98c-6f51-4005-959d-411b4c2c0137 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:38.968431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b543e98c-6f51-4005-959d-411b4c2c0137 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:38.968967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b543e98c-6f51-4005-959d-411b4c2c0137 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:38.969420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b543e98c-6f51-4005-959d-411b4c2c0137 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:38.970165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b543e98c-6f51-4005-959d-411b4c2c0137 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:38.971155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b543e98c-6f51-4005-959d-411b4c2c0137 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:38.971588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b543e98c-6f51-4005-959d-411b4c2c0137 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:39.000219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b543e98c-6f51-4005-959d-411b4c2c0137 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Aug 18 22:01:39.000762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 573/1143] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:38 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:39.102849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a043da96-f084-4d3c-85d1-90b467b53fd0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:39.104954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a043da96-f084-4d3c-85d1-90b467b53fd0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:39.110842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a043da96-f084-4d3c-85d1-90b467b53fd0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:39.111324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a043da96-f084-4d3c-85d1-90b467b53fd0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:39.111760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a043da96-f084-4d3c-85d1-90b467b53fd0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:39.112444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a043da96-f084-4d3c-85d1-90b467b53fd0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:39.112899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a043da96-f084-4d3c-85d1-90b467b53fd0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:39.113323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a043da96-f084-4d3c-85d1-90b467b53fd0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:39.141192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a043da96-f084-4d3c-85d1-90b467b53fd0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042247 Aug 18 22:01:39.141774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 571/1144] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:39.634200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-18588eee-499e-4f3e-8a01-b153164150b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:39.636338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-18588eee-499e-4f3e-8a01-b153164150b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:39.643372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18588eee-499e-4f3e-8a01-b153164150b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:39.643847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18588eee-499e-4f3e-8a01-b153164150b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:39.644283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18588eee-499e-4f3e-8a01-b153164150b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:39.644971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18588eee-499e-4f3e-8a01-b153164150b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:39.645424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18588eee-499e-4f3e-8a01-b153164150b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:39.645874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18588eee-499e-4f3e-8a01-b153164150b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:39.674058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-18588eee-499e-4f3e-8a01-b153164150b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043773 Aug 18 22:01:39.674610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 574/1145] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:39.923229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b16e78a4-bcd3-42b0-8d02-33bdf7cd8c8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:39.926087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b16e78a4-bcd3-42b0-8d02-33bdf7cd8c8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:39.933093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b16e78a4-bcd3-42b0-8d02-33bdf7cd8c8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:39.933584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b16e78a4-bcd3-42b0-8d02-33bdf7cd8c8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:39.934050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b16e78a4-bcd3-42b0-8d02-33bdf7cd8c8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:39.934762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b16e78a4-bcd3-42b0-8d02-33bdf7cd8c8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:39.935223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b16e78a4-bcd3-42b0-8d02-33bdf7cd8c8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:39.935655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b16e78a4-bcd3-42b0-8d02-33bdf7cd8c8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:39.964569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b16e78a4-bcd3-42b0-8d02-33bdf7cd8c8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045428 Aug 18 22:01:39.964987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 572/1146] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:39 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:40.012504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bb95529b-466c-495f-90f9-d7c8d56ca875 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:40.014987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bb95529b-466c-495f-90f9-d7c8d56ca875 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:40.020808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb95529b-466c-495f-90f9-d7c8d56ca875 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:40.021293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb95529b-466c-495f-90f9-d7c8d56ca875 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:40.021803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb95529b-466c-495f-90f9-d7c8d56ca875 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:40.022514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb95529b-466c-495f-90f9-d7c8d56ca875 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:40.023025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb95529b-466c-495f-90f9-d7c8d56ca875 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:40.023457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb95529b-466c-495f-90f9-d7c8d56ca875 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:40.052916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bb95529b-466c-495f-90f9-d7c8d56ca875 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044300 Aug 18 22:01:40.053477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 575/1147] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:40.153918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-caba509d-0b74-40de-8782-544095bece53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:40.156073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-caba509d-0b74-40de-8782-544095bece53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:40.162641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caba509d-0b74-40de-8782-544095bece53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:40.163124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caba509d-0b74-40de-8782-544095bece53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:40.163563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caba509d-0b74-40de-8782-544095bece53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:40.164253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caba509d-0b74-40de-8782-544095bece53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:40.164708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caba509d-0b74-40de-8782-544095bece53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:40.165133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caba509d-0b74-40de-8782-544095bece53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:40.194243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-caba509d-0b74-40de-8782-544095bece53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044185 Aug 18 22:01:40.194731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 573/1148] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:40 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:40.685840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c469fc68-054d-44dc-895c-0c0e7875124f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:40.688159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c469fc68-054d-44dc-895c-0c0e7875124f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:40.694660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c469fc68-054d-44dc-895c-0c0e7875124f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:40.695139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c469fc68-054d-44dc-895c-0c0e7875124f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:40.695575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c469fc68-054d-44dc-895c-0c0e7875124f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:40.696274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c469fc68-054d-44dc-895c-0c0e7875124f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:40.696725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c469fc68-054d-44dc-895c-0c0e7875124f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:40.697148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c469fc68-054d-44dc-895c-0c0e7875124f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:40.711220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:40.728590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c469fc68-054d-44dc-895c-0c0e7875124f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046760 Aug 18 22:01:40.729145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 576/1149] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:40.977090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f2aacc77-e8c5-4767-ad50-6c0e92d9251b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:40.979167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f2aacc77-e8c5-4767-ad50-6c0e92d9251b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:40.985766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2aacc77-e8c5-4767-ad50-6c0e92d9251b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:40.986285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2aacc77-e8c5-4767-ad50-6c0e92d9251b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:40.987274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2aacc77-e8c5-4767-ad50-6c0e92d9251b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:40.987971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2aacc77-e8c5-4767-ad50-6c0e92d9251b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:40.988415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2aacc77-e8c5-4767-ad50-6c0e92d9251b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:40.988836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2aacc77-e8c5-4767-ad50-6c0e92d9251b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:41.018002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f2aacc77-e8c5-4767-ad50-6c0e92d9251b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044839 Aug 18 22:01:41.018562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 574/1150] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:40 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:41.064348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf994b0a-2090-446e-8a49-bbec10c084c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:41.066560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf994b0a-2090-446e-8a49-bbec10c084c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:41.072402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf994b0a-2090-446e-8a49-bbec10c084c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:41.072878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf994b0a-2090-446e-8a49-bbec10c084c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:41.073307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf994b0a-2090-446e-8a49-bbec10c084c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:41.074035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf994b0a-2090-446e-8a49-bbec10c084c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:41.074488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf994b0a-2090-446e-8a49-bbec10c084c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:41.074909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf994b0a-2090-446e-8a49-bbec10c084c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:41.103726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf994b0a-2090-446e-8a49-bbec10c084c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043356 Aug 18 22:01:41.104274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 577/1151] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:41.206331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-29afc846-402c-4f72-a385-1db2411f8a7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:41.208582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-29afc846-402c-4f72-a385-1db2411f8a7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:41.214844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29afc846-402c-4f72-a385-1db2411f8a7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:41.215333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29afc846-402c-4f72-a385-1db2411f8a7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:41.215783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29afc846-402c-4f72-a385-1db2411f8a7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:41.216479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29afc846-402c-4f72-a385-1db2411f8a7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:41.216939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29afc846-402c-4f72-a385-1db2411f8a7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:41.217370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29afc846-402c-4f72-a385-1db2411f8a7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:41.246941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-29afc846-402c-4f72-a385-1db2411f8a7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044558 Aug 18 22:01:41.247409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 575/1152] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:41 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:41.740490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-14c405d0-b277-48dd-ba7c-81e57c98b312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:41.742674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-14c405d0-b277-48dd-ba7c-81e57c98b312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:41.749196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c405d0-b277-48dd-ba7c-81e57c98b312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:41.749714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c405d0-b277-48dd-ba7c-81e57c98b312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:41.750158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c405d0-b277-48dd-ba7c-81e57c98b312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:41.750859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c405d0-b277-48dd-ba7c-81e57c98b312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:41.751317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c405d0-b277-48dd-ba7c-81e57c98b312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:41.751751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c405d0-b277-48dd-ba7c-81e57c98b312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:41.781094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-14c405d0-b277-48dd-ba7c-81e57c98b312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044628 Aug 18 22:01:41.781666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 578/1153] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:42.030194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-01c3cd14-0462-4264-ad23-9d30620d366c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:42.032345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-01c3cd14-0462-4264-ad23-9d30620d366c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:42.038803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01c3cd14-0462-4264-ad23-9d30620d366c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:42.039301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01c3cd14-0462-4264-ad23-9d30620d366c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:42.039723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01c3cd14-0462-4264-ad23-9d30620d366c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:42.040416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01c3cd14-0462-4264-ad23-9d30620d366c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:42.040874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01c3cd14-0462-4264-ad23-9d30620d366c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:42.041301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01c3cd14-0462-4264-ad23-9d30620d366c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:42.058215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:42.071748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-01c3cd14-0462-4264-ad23-9d30620d366c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045603 Aug 18 22:01:42.072458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 576/1154] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:42 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:42.115929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-abe3a433-802b-49b8-b97c-276344ec8dec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:42.118106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-abe3a433-802b-49b8-b97c-276344ec8dec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:42.124102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abe3a433-802b-49b8-b97c-276344ec8dec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:42.124816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abe3a433-802b-49b8-b97c-276344ec8dec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:42.125251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abe3a433-802b-49b8-b97c-276344ec8dec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:42.125970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abe3a433-802b-49b8-b97c-276344ec8dec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:42.126420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abe3a433-802b-49b8-b97c-276344ec8dec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:42.126891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abe3a433-802b-49b8-b97c-276344ec8dec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:42.155986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-abe3a433-802b-49b8-b97c-276344ec8dec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Aug 18 22:01:42.156533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 579/1155] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:42 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:42.259291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-79232ae2-4092-4bc1-a40f-63f487674bba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:42.261655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-79232ae2-4092-4bc1-a40f-63f487674bba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:42.267846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79232ae2-4092-4bc1-a40f-63f487674bba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:42.268332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79232ae2-4092-4bc1-a40f-63f487674bba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:42.268767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79232ae2-4092-4bc1-a40f-63f487674bba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:42.269456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79232ae2-4092-4bc1-a40f-63f487674bba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:42.269939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79232ae2-4092-4bc1-a40f-63f487674bba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:42.270352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79232ae2-4092-4bc1-a40f-63f487674bba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:42.299833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-79232ae2-4092-4bc1-a40f-63f487674bba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044368 Aug 18 22:01:42.300316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 577/1156] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:42.792590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-386e2973-dacb-4c70-957b-3ea7ea0e868f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:42.794785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-386e2973-dacb-4c70-957b-3ea7ea0e868f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:42.801419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-386e2973-dacb-4c70-957b-3ea7ea0e868f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:42.801939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-386e2973-dacb-4c70-957b-3ea7ea0e868f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:42.802384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-386e2973-dacb-4c70-957b-3ea7ea0e868f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:42.803080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-386e2973-dacb-4c70-957b-3ea7ea0e868f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:42.803539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-386e2973-dacb-4c70-957b-3ea7ea0e868f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:42.803968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-386e2973-dacb-4c70-957b-3ea7ea0e868f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:42.834655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-386e2973-dacb-4c70-957b-3ea7ea0e868f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046068 Aug 18 22:01:42.835205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 580/1157] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:43.084414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1b20ceb2-3dd6-44f7-8035-6104e600f236 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:43.086532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1b20ceb2-3dd6-44f7-8035-6104e600f236 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:43.092767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b20ceb2-3dd6-44f7-8035-6104e600f236 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:43.093237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b20ceb2-3dd6-44f7-8035-6104e600f236 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:43.093769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b20ceb2-3dd6-44f7-8035-6104e600f236 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:43.094453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b20ceb2-3dd6-44f7-8035-6104e600f236 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:43.094902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b20ceb2-3dd6-44f7-8035-6104e600f236 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:43.095330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b20ceb2-3dd6-44f7-8035-6104e600f236 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:43.123852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1b20ceb2-3dd6-44f7-8035-6104e600f236 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043883 Aug 18 22:01:43.124404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 578/1158] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:43 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:43.168061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d4b72506-b924-4d50-ad1a-94f3ca79c0a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:43.170326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d4b72506-b924-4d50-ad1a-94f3ca79c0a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:43.176612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4b72506-b924-4d50-ad1a-94f3ca79c0a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:43.177091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4b72506-b924-4d50-ad1a-94f3ca79c0a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:43.177528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4b72506-b924-4d50-ad1a-94f3ca79c0a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:43.178249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4b72506-b924-4d50-ad1a-94f3ca79c0a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:43.178706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4b72506-b924-4d50-ad1a-94f3ca79c0a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:43.179123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4b72506-b924-4d50-ad1a-94f3ca79c0a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:43.209049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d4b72506-b924-4d50-ad1a-94f3ca79c0a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Aug 18 22:01:43.209579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 581/1159] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:43 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:43.312005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-29793bbb-d1a2-4039-8791-fd803f8e2ec9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:43.314128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-29793bbb-d1a2-4039-8791-fd803f8e2ec9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:43.320493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29793bbb-d1a2-4039-8791-fd803f8e2ec9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:43.320973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29793bbb-d1a2-4039-8791-fd803f8e2ec9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:43.321417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29793bbb-d1a2-4039-8791-fd803f8e2ec9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:43.322138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29793bbb-d1a2-4039-8791-fd803f8e2ec9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:43.322597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29793bbb-d1a2-4039-8791-fd803f8e2ec9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:43.323057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29793bbb-d1a2-4039-8791-fd803f8e2ec9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:43.351800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-29793bbb-d1a2-4039-8791-fd803f8e2ec9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Aug 18 22:01:43.352295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 579/1160] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:43 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:43.846895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b8d59924-5fbc-4f78-8d95-fb11ebdaef7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:43.849122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b8d59924-5fbc-4f78-8d95-fb11ebdaef7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:43.855516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8d59924-5fbc-4f78-8d95-fb11ebdaef7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:43.855996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8d59924-5fbc-4f78-8d95-fb11ebdaef7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:43.856442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8d59924-5fbc-4f78-8d95-fb11ebdaef7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:43.857133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8d59924-5fbc-4f78-8d95-fb11ebdaef7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:43.857628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8d59924-5fbc-4f78-8d95-fb11ebdaef7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:43.858066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8d59924-5fbc-4f78-8d95-fb11ebdaef7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:43.887454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b8d59924-5fbc-4f78-8d95-fb11ebdaef7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044491 Aug 18 22:01:43.888008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 582/1161] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:44.136471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e8ae71ed-d87a-47d3-a290-6a625c735813 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:44.138608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e8ae71ed-d87a-47d3-a290-6a625c735813 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:44.144968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8ae71ed-d87a-47d3-a290-6a625c735813 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:44.145451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8ae71ed-d87a-47d3-a290-6a625c735813 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:44.145928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8ae71ed-d87a-47d3-a290-6a625c735813 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:44.146653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8ae71ed-d87a-47d3-a290-6a625c735813 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:44.147108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8ae71ed-d87a-47d3-a290-6a625c735813 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:44.147535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8ae71ed-d87a-47d3-a290-6a625c735813 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:44.176796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e8ae71ed-d87a-47d3-a290-6a625c735813 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044288 Aug 18 22:01:44.177341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 580/1162] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:44.222312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-34440b85-1e98-408c-ac6f-3278dbdcb777 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:44.224494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-34440b85-1e98-408c-ac6f-3278dbdcb777 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:44.230385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34440b85-1e98-408c-ac6f-3278dbdcb777 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:44.230931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34440b85-1e98-408c-ac6f-3278dbdcb777 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:44.231370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34440b85-1e98-408c-ac6f-3278dbdcb777 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:44.232068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34440b85-1e98-408c-ac6f-3278dbdcb777 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:44.232525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34440b85-1e98-408c-ac6f-3278dbdcb777 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:44.232952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34440b85-1e98-408c-ac6f-3278dbdcb777 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:44.263182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-34440b85-1e98-408c-ac6f-3278dbdcb777 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045973 Aug 18 22:01:44.263738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 583/1163] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:44 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:44.364177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ca2f6036-d880-47f4-a3bb-03875b46d89c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:44.366373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ca2f6036-d880-47f4-a3bb-03875b46d89c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:44.372297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca2f6036-d880-47f4-a3bb-03875b46d89c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:44.372781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca2f6036-d880-47f4-a3bb-03875b46d89c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:44.373220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca2f6036-d880-47f4-a3bb-03875b46d89c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:44.373940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca2f6036-d880-47f4-a3bb-03875b46d89c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:44.374400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca2f6036-d880-47f4-a3bb-03875b46d89c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:44.374829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca2f6036-d880-47f4-a3bb-03875b46d89c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:44.403256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ca2f6036-d880-47f4-a3bb-03875b46d89c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042956 Aug 18 22:01:44.403746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 581/1164] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:44 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:44.899958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f025aefd-6a4d-4b79-a760-f815564ed372 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:44.902167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f025aefd-6a4d-4b79-a760-f815564ed372 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:44.908548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f025aefd-6a4d-4b79-a760-f815564ed372 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:44.909030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f025aefd-6a4d-4b79-a760-f815564ed372 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:44.909528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f025aefd-6a4d-4b79-a760-f815564ed372 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:44.910241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f025aefd-6a4d-4b79-a760-f815564ed372 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:44.910697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f025aefd-6a4d-4b79-a760-f815564ed372 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:44.911127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f025aefd-6a4d-4b79-a760-f815564ed372 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:44.940493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f025aefd-6a4d-4b79-a760-f815564ed372 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044502 Aug 18 22:01:44.941059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 584/1165] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:45.188953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dfc48f74-e757-4294-804b-da42cc0d0aba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:45.191717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dfc48f74-e757-4294-804b-da42cc0d0aba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:45.198047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfc48f74-e757-4294-804b-da42cc0d0aba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:45.198522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfc48f74-e757-4294-804b-da42cc0d0aba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:45.198957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfc48f74-e757-4294-804b-da42cc0d0aba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:45.199639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfc48f74-e757-4294-804b-da42cc0d0aba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:45.200086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfc48f74-e757-4294-804b-da42cc0d0aba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:45.200507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfc48f74-e757-4294-804b-da42cc0d0aba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:45.227917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dfc48f74-e757-4294-804b-da42cc0d0aba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042879 Aug 18 22:01:45.228460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 582/1166] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:45 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:45.275396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-00bec814-fb9b-4320-a681-01032230ed42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:45.277539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-00bec814-fb9b-4320-a681-01032230ed42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:45.283535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00bec814-fb9b-4320-a681-01032230ed42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:45.284129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00bec814-fb9b-4320-a681-01032230ed42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:45.284573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00bec814-fb9b-4320-a681-01032230ed42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:45.285280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00bec814-fb9b-4320-a681-01032230ed42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:45.285772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00bec814-fb9b-4320-a681-01032230ed42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:45.286205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00bec814-fb9b-4320-a681-01032230ed42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:45.316561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-00bec814-fb9b-4320-a681-01032230ed42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045061 Aug 18 22:01:45.317120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 585/1167] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:45 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:45.415555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7adc7786-b9a1-43a3-ab38-7f40c2557074 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:45.417697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7adc7786-b9a1-43a3-ab38-7f40c2557074 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:45.424399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7adc7786-b9a1-43a3-ab38-7f40c2557074 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:45.424879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7adc7786-b9a1-43a3-ab38-7f40c2557074 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:45.425317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7adc7786-b9a1-43a3-ab38-7f40c2557074 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:45.426041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7adc7786-b9a1-43a3-ab38-7f40c2557074 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:45.426501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7adc7786-b9a1-43a3-ab38-7f40c2557074 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:45.426928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7adc7786-b9a1-43a3-ab38-7f40c2557074 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:45.455034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7adc7786-b9a1-43a3-ab38-7f40c2557074 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043295 Aug 18 22:01:45.455515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 583/1168] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:45 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:45.952849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7010a4c7-19b4-498e-9e18-a4175dfd46b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:45.955212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7010a4c7-19b4-498e-9e18-a4175dfd46b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:45.961121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7010a4c7-19b4-498e-9e18-a4175dfd46b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:45.961607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7010a4c7-19b4-498e-9e18-a4175dfd46b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:45.962055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7010a4c7-19b4-498e-9e18-a4175dfd46b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:45.962735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7010a4c7-19b4-498e-9e18-a4175dfd46b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:45.963184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7010a4c7-19b4-498e-9e18-a4175dfd46b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:45.963601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7010a4c7-19b4-498e-9e18-a4175dfd46b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:45.992521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7010a4c7-19b4-498e-9e18-a4175dfd46b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043547 Aug 18 22:01:45.993009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 586/1169] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:45 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:46.240656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-49592936-70d1-4e42-862e-712e8b3a0434 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:46.242851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-49592936-70d1-4e42-862e-712e8b3a0434 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:46.249157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49592936-70d1-4e42-862e-712e8b3a0434 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:46.249671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49592936-70d1-4e42-862e-712e8b3a0434 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:46.250140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49592936-70d1-4e42-862e-712e8b3a0434 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:46.250829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49592936-70d1-4e42-862e-712e8b3a0434 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:46.251284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49592936-70d1-4e42-862e-712e8b3a0434 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:46.251708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-49592936-70d1-4e42-862e-712e8b3a0434 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:46.279243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-49592936-70d1-4e42-862e-712e8b3a0434 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043146 Aug 18 22:01:46.279792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 584/1170] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:46 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:46.329247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d6b92f4c-b314-4737-a008-7e20185b1ec7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:46.331502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d6b92f4c-b314-4737-a008-7e20185b1ec7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:46.337824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6b92f4c-b314-4737-a008-7e20185b1ec7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:46.338310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6b92f4c-b314-4737-a008-7e20185b1ec7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:46.338751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6b92f4c-b314-4737-a008-7e20185b1ec7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:46.339456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6b92f4c-b314-4737-a008-7e20185b1ec7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:46.340021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6b92f4c-b314-4737-a008-7e20185b1ec7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:46.340337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6b92f4c-b314-4737-a008-7e20185b1ec7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:46.372599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d6b92f4c-b314-4737-a008-7e20185b1ec7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048247 Aug 18 22:01:46.373156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 587/1171] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:46.467113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-743aa62f-90ef-4c8f-86b8-a3511c89ec74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:46.469216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-743aa62f-90ef-4c8f-86b8-a3511c89ec74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:46.475591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-743aa62f-90ef-4c8f-86b8-a3511c89ec74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:46.476071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-743aa62f-90ef-4c8f-86b8-a3511c89ec74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:46.476502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-743aa62f-90ef-4c8f-86b8-a3511c89ec74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:46.477187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-743aa62f-90ef-4c8f-86b8-a3511c89ec74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:46.477663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-743aa62f-90ef-4c8f-86b8-a3511c89ec74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:46.478088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-743aa62f-90ef-4c8f-86b8-a3511c89ec74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:46.507852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-743aa62f-90ef-4c8f-86b8-a3511c89ec74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 18 22:01:46.508332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 585/1172] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:46 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:01:47.006767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-809ef952-cc51-44c4-b018-aff1e75879ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:47.009295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-809ef952-cc51-44c4-b018-aff1e75879ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:47.015585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-809ef952-cc51-44c4-b018-aff1e75879ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:47.016172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-809ef952-cc51-44c4-b018-aff1e75879ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:47.016491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-809ef952-cc51-44c4-b018-aff1e75879ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:47.017183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-809ef952-cc51-44c4-b018-aff1e75879ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:47.018412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-809ef952-cc51-44c4-b018-aff1e75879ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:47.018755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-809ef952-cc51-44c4-b018-aff1e75879ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:47.047661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-809ef952-cc51-44c4-b018-aff1e75879ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046248 Aug 18 22:01:47.048224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 588/1173] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:46 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:47.291743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-74f76326-bc2a-400c-beff-29bebf9859a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:47.293916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-74f76326-bc2a-400c-beff-29bebf9859a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:47.296244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:47.303525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74f76326-bc2a-400c-beff-29bebf9859a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:47.304094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74f76326-bc2a-400c-beff-29bebf9859a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:47.304549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74f76326-bc2a-400c-beff-29bebf9859a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:47.305252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74f76326-bc2a-400c-beff-29bebf9859a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:47.305735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74f76326-bc2a-400c-beff-29bebf9859a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:47.306162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74f76326-bc2a-400c-beff-29bebf9859a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:47.336561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-74f76326-bc2a-400c-beff-29bebf9859a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048697 Aug 18 22:01:47.337135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 586/1174] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:47 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:47.384989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d049a4c5-1c28-4717-8d93-477a2ed33cac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:47.387274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d049a4c5-1c28-4717-8d93-477a2ed33cac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:47.393471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d049a4c5-1c28-4717-8d93-477a2ed33cac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:47.393981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d049a4c5-1c28-4717-8d93-477a2ed33cac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:47.394419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d049a4c5-1c28-4717-8d93-477a2ed33cac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:47.395111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d049a4c5-1c28-4717-8d93-477a2ed33cac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:47.395567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d049a4c5-1c28-4717-8d93-477a2ed33cac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:47.396018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d049a4c5-1c28-4717-8d93-477a2ed33cac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:47.425681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d049a4c5-1c28-4717-8d93-477a2ed33cac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044772 Aug 18 22:01:47.426225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 589/1175] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:47.519885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1d974677-fd39-4dd2-be53-bb93d79928a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:47.522037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1d974677-fd39-4dd2-be53-bb93d79928a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:47.527918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d974677-fd39-4dd2-be53-bb93d79928a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:47.528402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d974677-fd39-4dd2-be53-bb93d79928a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:47.528840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d974677-fd39-4dd2-be53-bb93d79928a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:47.529528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d974677-fd39-4dd2-be53-bb93d79928a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:47.530013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d974677-fd39-4dd2-be53-bb93d79928a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:47.530443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d974677-fd39-4dd2-be53-bb93d79928a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:47.561391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1d974677-fd39-4dd2-be53-bb93d79928a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045232 Aug 18 22:01:47.561888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 587/1176] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:47 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:48.059326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-893ee4ac-897e-4f05-8721-91c877474062 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:48.061459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-893ee4ac-897e-4f05-8721-91c877474062 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:48.067619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-893ee4ac-897e-4f05-8721-91c877474062 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:48.068103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-893ee4ac-897e-4f05-8721-91c877474062 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:48.068543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-893ee4ac-897e-4f05-8721-91c877474062 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:48.069241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-893ee4ac-897e-4f05-8721-91c877474062 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:48.069719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-893ee4ac-897e-4f05-8721-91c877474062 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:48.070150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-893ee4ac-897e-4f05-8721-91c877474062 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:48.099652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-893ee4ac-897e-4f05-8721-91c877474062 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044319 Aug 18 22:01:48.100218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 590/1177] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:48.349379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5c2e7101-cd1d-43f7-804f-eb201c49e339 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:48.351409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5c2e7101-cd1d-43f7-804f-eb201c49e339 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:48.358223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c2e7101-cd1d-43f7-804f-eb201c49e339 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:48.358774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c2e7101-cd1d-43f7-804f-eb201c49e339 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:48.359204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c2e7101-cd1d-43f7-804f-eb201c49e339 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:48.359888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c2e7101-cd1d-43f7-804f-eb201c49e339 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:48.360334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c2e7101-cd1d-43f7-804f-eb201c49e339 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:48.360753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c2e7101-cd1d-43f7-804f-eb201c49e339 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:48.388861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5c2e7101-cd1d-43f7-804f-eb201c49e339 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044077 Aug 18 22:01:48.389413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 588/1178] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:48 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:48.436832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2ba34199-4340-474a-8e93-1612ccb83a0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:48.439007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2ba34199-4340-474a-8e93-1612ccb83a0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:48.445816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ba34199-4340-474a-8e93-1612ccb83a0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:48.446305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ba34199-4340-474a-8e93-1612ccb83a0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:48.446746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ba34199-4340-474a-8e93-1612ccb83a0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:48.447447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ba34199-4340-474a-8e93-1612ccb83a0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:48.447906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ba34199-4340-474a-8e93-1612ccb83a0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:48.448340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ba34199-4340-474a-8e93-1612ccb83a0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:48.478233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2ba34199-4340-474a-8e93-1612ccb83a0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Aug 18 22:01:48.478786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 591/1179] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:48 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:48.574092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5d388364-bdca-4250-82b1-5775e98412d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:48.576216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5d388364-bdca-4250-82b1-5775e98412d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:48.582783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d388364-bdca-4250-82b1-5775e98412d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:48.583265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d388364-bdca-4250-82b1-5775e98412d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:48.583693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d388364-bdca-4250-82b1-5775e98412d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:48.584374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d388364-bdca-4250-82b1-5775e98412d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:48.584822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d388364-bdca-4250-82b1-5775e98412d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:48.585242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d388364-bdca-4250-82b1-5775e98412d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:48.614257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5d388364-bdca-4250-82b1-5775e98412d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043941 Aug 18 22:01:48.614917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 589/1180] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:48 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:49.112809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bd3dd3b8-c25d-4bfe-bd69-265a8a8de510 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:49.115013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bd3dd3b8-c25d-4bfe-bd69-265a8a8de510 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:49.120881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd3dd3b8-c25d-4bfe-bd69-265a8a8de510 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:49.121351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd3dd3b8-c25d-4bfe-bd69-265a8a8de510 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:49.121822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd3dd3b8-c25d-4bfe-bd69-265a8a8de510 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:49.122506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd3dd3b8-c25d-4bfe-bd69-265a8a8de510 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:49.122952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd3dd3b8-c25d-4bfe-bd69-265a8a8de510 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:49.123370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd3dd3b8-c25d-4bfe-bd69-265a8a8de510 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:49.152136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bd3dd3b8-c25d-4bfe-bd69-265a8a8de510 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043884 Aug 18 22:01:49.152705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 592/1181] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:49.401945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a5a9361d-fe80-4cb6-b797-71bfca5efc5a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:49.403959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a5a9361d-fe80-4cb6-b797-71bfca5efc5a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:49.411028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5a9361d-fe80-4cb6-b797-71bfca5efc5a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:49.411501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5a9361d-fe80-4cb6-b797-71bfca5efc5a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:49.411928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5a9361d-fe80-4cb6-b797-71bfca5efc5a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:49.412641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5a9361d-fe80-4cb6-b797-71bfca5efc5a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:49.413085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5a9361d-fe80-4cb6-b797-71bfca5efc5a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:49.413502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5a9361d-fe80-4cb6-b797-71bfca5efc5a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:49.441757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a5a9361d-fe80-4cb6-b797-71bfca5efc5a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043851 Aug 18 22:01:49.442303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 590/1182] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:49 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:49.491181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-571289ef-acaa-4444-a05b-7b0af1a10b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:49.493481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-571289ef-acaa-4444-a05b-7b0af1a10b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:49.499348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-571289ef-acaa-4444-a05b-7b0af1a10b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:49.499830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-571289ef-acaa-4444-a05b-7b0af1a10b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:49.500263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-571289ef-acaa-4444-a05b-7b0af1a10b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:49.500956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-571289ef-acaa-4444-a05b-7b0af1a10b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:49.501588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-571289ef-acaa-4444-a05b-7b0af1a10b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:49.501985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-571289ef-acaa-4444-a05b-7b0af1a10b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:49.505580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:49.532401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-571289ef-acaa-4444-a05b-7b0af1a10b0d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046108 Aug 18 22:01:49.533772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 593/1183] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:49 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:49.627926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0e98ee76-e676-427c-a7dc-ac4e4b7b9912 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:49.630124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0e98ee76-e676-427c-a7dc-ac4e4b7b9912 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:49.636127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e98ee76-e676-427c-a7dc-ac4e4b7b9912 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:49.636615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e98ee76-e676-427c-a7dc-ac4e4b7b9912 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:49.637055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e98ee76-e676-427c-a7dc-ac4e4b7b9912 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:49.637799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e98ee76-e676-427c-a7dc-ac4e4b7b9912 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:49.638261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e98ee76-e676-427c-a7dc-ac4e4b7b9912 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:49.638692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e98ee76-e676-427c-a7dc-ac4e4b7b9912 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:49.669450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0e98ee76-e676-427c-a7dc-ac4e4b7b9912 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046566 Aug 18 22:01:49.669949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 591/1184] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:49 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:50.164459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aba49829-4e28-41e8-889b-4d258cbb9887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:50.166652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aba49829-4e28-41e8-889b-4d258cbb9887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:50.173012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aba49829-4e28-41e8-889b-4d258cbb9887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:50.173495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aba49829-4e28-41e8-889b-4d258cbb9887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:50.173962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aba49829-4e28-41e8-889b-4d258cbb9887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:50.174663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aba49829-4e28-41e8-889b-4d258cbb9887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:50.175126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aba49829-4e28-41e8-889b-4d258cbb9887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:50.175553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aba49829-4e28-41e8-889b-4d258cbb9887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:50.204267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aba49829-4e28-41e8-889b-4d258cbb9887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043791 Aug 18 22:01:50.206335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 594/1185] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:50.453298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ab86c40d-4d4c-4bfa-bbd0-f117c0cc0a3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:50.455442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ab86c40d-4d4c-4bfa-bbd0-f117c0cc0a3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:50.461827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab86c40d-4d4c-4bfa-bbd0-f117c0cc0a3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:50.462309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab86c40d-4d4c-4bfa-bbd0-f117c0cc0a3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:50.462746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab86c40d-4d4c-4bfa-bbd0-f117c0cc0a3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:50.463436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab86c40d-4d4c-4bfa-bbd0-f117c0cc0a3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:50.463890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab86c40d-4d4c-4bfa-bbd0-f117c0cc0a3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:50.464313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab86c40d-4d4c-4bfa-bbd0-f117c0cc0a3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:50.492709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ab86c40d-4d4c-4bfa-bbd0-f117c0cc0a3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043447 Aug 18 22:01:50.493254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 592/1186] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:50.544259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ccc49ec7-a1a3-4d04-bb0e-5da1c6789270 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:50.546400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ccc49ec7-a1a3-4d04-bb0e-5da1c6789270 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:50.553463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccc49ec7-a1a3-4d04-bb0e-5da1c6789270 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:50.553960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccc49ec7-a1a3-4d04-bb0e-5da1c6789270 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:50.554378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccc49ec7-a1a3-4d04-bb0e-5da1c6789270 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:50.555060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccc49ec7-a1a3-4d04-bb0e-5da1c6789270 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:50.555509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccc49ec7-a1a3-4d04-bb0e-5da1c6789270 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:50.555926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccc49ec7-a1a3-4d04-bb0e-5da1c6789270 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:50.595995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ccc49ec7-a1a3-4d04-bb0e-5da1c6789270 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055218 Aug 18 22:01:50.596557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 595/1187] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:50 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:50.681326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-60b28fd8-1b98-4e2b-b1b5-285f22c1267a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:50.683466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-60b28fd8-1b98-4e2b-b1b5-285f22c1267a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:50.689450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60b28fd8-1b98-4e2b-b1b5-285f22c1267a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:50.689963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60b28fd8-1b98-4e2b-b1b5-285f22c1267a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:50.690440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60b28fd8-1b98-4e2b-b1b5-285f22c1267a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:50.691138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60b28fd8-1b98-4e2b-b1b5-285f22c1267a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:50.691589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60b28fd8-1b98-4e2b-b1b5-285f22c1267a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:50.692016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60b28fd8-1b98-4e2b-b1b5-285f22c1267a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:50.695789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:50.721905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-60b28fd8-1b98-4e2b-b1b5-285f22c1267a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Aug 18 22:01:50.722470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 593/1188] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:50 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:51.218101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-74159459-d4ad-4c0c-a8d9-33fb02aefa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:51.220243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-74159459-d4ad-4c0c-a8d9-33fb02aefa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:51.227264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74159459-d4ad-4c0c-a8d9-33fb02aefa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:51.227745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74159459-d4ad-4c0c-a8d9-33fb02aefa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:51.228177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74159459-d4ad-4c0c-a8d9-33fb02aefa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:51.228870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74159459-d4ad-4c0c-a8d9-33fb02aefa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:51.229319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74159459-d4ad-4c0c-a8d9-33fb02aefa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:51.229781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74159459-d4ad-4c0c-a8d9-33fb02aefa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:51.257859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-74159459-d4ad-4c0c-a8d9-33fb02aefa84 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043776 Aug 18 22:01:51.258413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 596/1189] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:51 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:51.505271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5f0dea11-d8a0-4f8e-80f4-1824a1fba612 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:51.507322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5f0dea11-d8a0-4f8e-80f4-1824a1fba612 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:51.513854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f0dea11-d8a0-4f8e-80f4-1824a1fba612 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:51.514333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f0dea11-d8a0-4f8e-80f4-1824a1fba612 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:51.514764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f0dea11-d8a0-4f8e-80f4-1824a1fba612 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:51.515445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f0dea11-d8a0-4f8e-80f4-1824a1fba612 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:51.515893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f0dea11-d8a0-4f8e-80f4-1824a1fba612 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:51.516313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f0dea11-d8a0-4f8e-80f4-1824a1fba612 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:51.544242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5f0dea11-d8a0-4f8e-80f4-1824a1fba612 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043474 Aug 18 22:01:51.544781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 594/1190] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:51.607743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3868ef55-64cf-4476-be39-da4d3ead7cdf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:51.609887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3868ef55-64cf-4476-be39-da4d3ead7cdf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:51.616244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3868ef55-64cf-4476-be39-da4d3ead7cdf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:51.616722 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3868ef55-64cf-4476-be39-da4d3ead7cdf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:51.617230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3868ef55-64cf-4476-be39-da4d3ead7cdf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:51.617861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3868ef55-64cf-4476-be39-da4d3ead7cdf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:51.618343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3868ef55-64cf-4476-be39-da4d3ead7cdf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:51.618766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3868ef55-64cf-4476-be39-da4d3ead7cdf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:51.655945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3868ef55-64cf-4476-be39-da4d3ead7cdf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051991 Aug 18 22:01:51.656510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 597/1191] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:51 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:51.734336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c4d32fdf-7e0e-4bf5-ad8c-60fc2480834a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:51.737000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c4d32fdf-7e0e-4bf5-ad8c-60fc2480834a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:51.742890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4d32fdf-7e0e-4bf5-ad8c-60fc2480834a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:51.743373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4d32fdf-7e0e-4bf5-ad8c-60fc2480834a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:51.743821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4d32fdf-7e0e-4bf5-ad8c-60fc2480834a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:51.744520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4d32fdf-7e0e-4bf5-ad8c-60fc2480834a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:51.744979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4d32fdf-7e0e-4bf5-ad8c-60fc2480834a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:51.745409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4d32fdf-7e0e-4bf5-ad8c-60fc2480834a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:51.774062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c4d32fdf-7e0e-4bf5-ad8c-60fc2480834a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 Aug 18 22:01:51.774631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 595/1192] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:51 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:52.270434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-18e7887a-684f-4cbd-b3d4-5b087fc89b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:52.272455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-18e7887a-684f-4cbd-b3d4-5b087fc89b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:52.278384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18e7887a-684f-4cbd-b3d4-5b087fc89b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:52.278843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18e7887a-684f-4cbd-b3d4-5b087fc89b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:52.279270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18e7887a-684f-4cbd-b3d4-5b087fc89b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:52.279953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18e7887a-684f-4cbd-b3d4-5b087fc89b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:52.280396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18e7887a-684f-4cbd-b3d4-5b087fc89b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:52.280819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18e7887a-684f-4cbd-b3d4-5b087fc89b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:52.310213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-18e7887a-684f-4cbd-b3d4-5b087fc89b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043914 Aug 18 22:01:52.310765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 598/1193] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:52 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:52.555765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-35eb5f97-b296-4c67-9eca-be9f19f1ffdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:52.557878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-35eb5f97-b296-4c67-9eca-be9f19f1ffdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:52.564346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35eb5f97-b296-4c67-9eca-be9f19f1ffdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:52.564822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35eb5f97-b296-4c67-9eca-be9f19f1ffdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:52.565430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35eb5f97-b296-4c67-9eca-be9f19f1ffdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:52.566380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35eb5f97-b296-4c67-9eca-be9f19f1ffdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:52.567065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35eb5f97-b296-4c67-9eca-be9f19f1ffdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:52.567490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35eb5f97-b296-4c67-9eca-be9f19f1ffdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:52.596535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-35eb5f97-b296-4c67-9eca-be9f19f1ffdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043991 Aug 18 22:01:52.597084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 596/1194] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:52.670406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d71daf96-2701-4baf-805e-2a00c3a799c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:52.672791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d71daf96-2701-4baf-805e-2a00c3a799c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:52.678772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d71daf96-2701-4baf-805e-2a00c3a799c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:52.679248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d71daf96-2701-4baf-805e-2a00c3a799c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:52.679681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d71daf96-2701-4baf-805e-2a00c3a799c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:52.680370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d71daf96-2701-4baf-805e-2a00c3a799c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:52.680820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d71daf96-2701-4baf-805e-2a00c3a799c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:52.681242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d71daf96-2701-4baf-805e-2a00c3a799c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:52.714935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d71daf96-2701-4baf-805e-2a00c3a799c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048384 Aug 18 22:01:52.715640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 599/1195] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:52.786929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7cfba24c-cdf0-443c-b2a6-11cb21ee9576 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:52.789045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7cfba24c-cdf0-443c-b2a6-11cb21ee9576 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:52.795016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cfba24c-cdf0-443c-b2a6-11cb21ee9576 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:52.795497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cfba24c-cdf0-443c-b2a6-11cb21ee9576 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:52.795934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cfba24c-cdf0-443c-b2a6-11cb21ee9576 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:52.796622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cfba24c-cdf0-443c-b2a6-11cb21ee9576 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:52.797330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cfba24c-cdf0-443c-b2a6-11cb21ee9576 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:52.797794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cfba24c-cdf0-443c-b2a6-11cb21ee9576 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:52.825948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7cfba24c-cdf0-443c-b2a6-11cb21ee9576 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043426 Aug 18 22:01:52.826441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 597/1196] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:52 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:53.322444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aee726bc-756c-48c2-a2d4-78b53de58ffc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:53.324562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aee726bc-756c-48c2-a2d4-78b53de58ffc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:53.330489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aee726bc-756c-48c2-a2d4-78b53de58ffc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:53.330970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aee726bc-756c-48c2-a2d4-78b53de58ffc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:53.331406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aee726bc-756c-48c2-a2d4-78b53de58ffc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:53.332095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aee726bc-756c-48c2-a2d4-78b53de58ffc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:53.332546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aee726bc-756c-48c2-a2d4-78b53de58ffc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:53.332971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aee726bc-756c-48c2-a2d4-78b53de58ffc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:53.362095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aee726bc-756c-48c2-a2d4-78b53de58ffc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043028 Aug 18 22:01:53.362573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 600/1197] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:53 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:53.608275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-98d2403f-01b3-408c-a10e-a1517c18f59e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:53.610420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-98d2403f-01b3-408c-a10e-a1517c18f59e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:53.617985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98d2403f-01b3-408c-a10e-a1517c18f59e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:53.618410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98d2403f-01b3-408c-a10e-a1517c18f59e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:53.618853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98d2403f-01b3-408c-a10e-a1517c18f59e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:53.619577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98d2403f-01b3-408c-a10e-a1517c18f59e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:53.620033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98d2403f-01b3-408c-a10e-a1517c18f59e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:53.620460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98d2403f-01b3-408c-a10e-a1517c18f59e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:53.649142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-98d2403f-01b3-408c-a10e-a1517c18f59e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044761 Aug 18 22:01:53.649714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 598/1198] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:53 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:53.727426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c41f9ff6-f6aa-437f-8504-2798632c110c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:53.729572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c41f9ff6-f6aa-437f-8504-2798632c110c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:53.735910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c41f9ff6-f6aa-437f-8504-2798632c110c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:53.736976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c41f9ff6-f6aa-437f-8504-2798632c110c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:53.737415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c41f9ff6-f6aa-437f-8504-2798632c110c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:53.738167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c41f9ff6-f6aa-437f-8504-2798632c110c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:53.738624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c41f9ff6-f6aa-437f-8504-2798632c110c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:53.739055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c41f9ff6-f6aa-437f-8504-2798632c110c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:53.768165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c41f9ff6-f6aa-437f-8504-2798632c110c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044590 Aug 18 22:01:53.768826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 601/1199] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:53.838052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e611f604-1232-4ab8-a79b-00b8c244f39e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:53.840178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e611f604-1232-4ab8-a79b-00b8c244f39e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:53.846600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e611f604-1232-4ab8-a79b-00b8c244f39e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:53.847100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e611f604-1232-4ab8-a79b-00b8c244f39e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:53.847535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e611f604-1232-4ab8-a79b-00b8c244f39e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:53.848220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e611f604-1232-4ab8-a79b-00b8c244f39e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:53.848674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e611f604-1232-4ab8-a79b-00b8c244f39e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:53.849100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e611f604-1232-4ab8-a79b-00b8c244f39e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:53.877808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e611f604-1232-4ab8-a79b-00b8c244f39e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043599 Aug 18 22:01:53.878304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 599/1200] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:53 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:54.374668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1f517600-498d-4e8c-9ac8-5b376b0920de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:54.377285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1f517600-498d-4e8c-9ac8-5b376b0920de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:54.383181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f517600-498d-4e8c-9ac8-5b376b0920de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:54.383653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f517600-498d-4e8c-9ac8-5b376b0920de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:54.384080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f517600-498d-4e8c-9ac8-5b376b0920de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:54.384763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f517600-498d-4e8c-9ac8-5b376b0920de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:54.385208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f517600-498d-4e8c-9ac8-5b376b0920de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:54.385654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f517600-498d-4e8c-9ac8-5b376b0920de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:54.413835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1f517600-498d-4e8c-9ac8-5b376b0920de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043206 Aug 18 22:01:54.414372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 602/1201] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:54 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:54.660581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9a2d9ea9-a4a3-463f-a84e-c475224768e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:54.662648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9a2d9ea9-a4a3-463f-a84e-c475224768e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:54.668927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a2d9ea9-a4a3-463f-a84e-c475224768e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:54.669435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a2d9ea9-a4a3-463f-a84e-c475224768e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:54.669896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a2d9ea9-a4a3-463f-a84e-c475224768e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:54.670580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a2d9ea9-a4a3-463f-a84e-c475224768e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:54.671026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a2d9ea9-a4a3-463f-a84e-c475224768e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:54.671444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a2d9ea9-a4a3-463f-a84e-c475224768e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:54.701990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9a2d9ea9-a4a3-463f-a84e-c475224768e0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045384 Aug 18 22:01:54.702559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 600/1202] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:54 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:54.780391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1801a10b-a3f0-47bc-852b-848285f65546 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:54.782644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1801a10b-a3f0-47bc-852b-848285f65546 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:54.788901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1801a10b-a3f0-47bc-852b-848285f65546 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:54.789385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1801a10b-a3f0-47bc-852b-848285f65546 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:54.789857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1801a10b-a3f0-47bc-852b-848285f65546 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:54.790561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1801a10b-a3f0-47bc-852b-848285f65546 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:54.791012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1801a10b-a3f0-47bc-852b-848285f65546 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:54.791441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1801a10b-a3f0-47bc-852b-848285f65546 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:54.831667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1801a10b-a3f0-47bc-852b-848285f65546 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054952 Aug 18 22:01:54.832494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 603/1203] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:54.889023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0b7f8a82-8055-42c6-94a6-7dc4fca7c29f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:54.891191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0b7f8a82-8055-42c6-94a6-7dc4fca7c29f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:54.897128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b7f8a82-8055-42c6-94a6-7dc4fca7c29f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:54.897632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b7f8a82-8055-42c6-94a6-7dc4fca7c29f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:54.898077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b7f8a82-8055-42c6-94a6-7dc4fca7c29f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:54.898770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b7f8a82-8055-42c6-94a6-7dc4fca7c29f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:54.899227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b7f8a82-8055-42c6-94a6-7dc4fca7c29f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:54.899655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0b7f8a82-8055-42c6-94a6-7dc4fca7c29f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:54.929792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0b7f8a82-8055-42c6-94a6-7dc4fca7c29f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Aug 18 22:01:54.930293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 601/1204] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:54 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:01:55.426982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8d7979d3-1e59-4409-a6ee-1db651b878f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:55.429118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8d7979d3-1e59-4409-a6ee-1db651b878f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:55.431023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:55.436337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d7979d3-1e59-4409-a6ee-1db651b878f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:55.436814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d7979d3-1e59-4409-a6ee-1db651b878f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:55.437248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d7979d3-1e59-4409-a6ee-1db651b878f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:55.437971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d7979d3-1e59-4409-a6ee-1db651b878f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:55.438428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d7979d3-1e59-4409-a6ee-1db651b878f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:55.438855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d7979d3-1e59-4409-a6ee-1db651b878f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:55.467613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8d7979d3-1e59-4409-a6ee-1db651b878f9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045539 Aug 18 22:01:55.468302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 604/1205] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:55.714027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b011f956-a12a-45ac-b663-778118775262 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:55.716076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b011f956-a12a-45ac-b663-778118775262 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:55.723247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b011f956-a12a-45ac-b663-778118775262 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:55.723723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b011f956-a12a-45ac-b663-778118775262 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:55.724151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b011f956-a12a-45ac-b663-778118775262 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:55.724834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b011f956-a12a-45ac-b663-778118775262 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:55.725281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b011f956-a12a-45ac-b663-778118775262 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:55.725731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b011f956-a12a-45ac-b663-778118775262 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:55.753519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b011f956-a12a-45ac-b663-778118775262 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043554 Aug 18 22:01:55.754110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 602/1206] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:55 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:55.846086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0e89bb89-9d57-4c44-8245-0df5dd5257b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:55.848332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0e89bb89-9d57-4c44-8245-0df5dd5257b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:55.854650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e89bb89-9d57-4c44-8245-0df5dd5257b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:55.855133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e89bb89-9d57-4c44-8245-0df5dd5257b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:55.855571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e89bb89-9d57-4c44-8245-0df5dd5257b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:55.856269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e89bb89-9d57-4c44-8245-0df5dd5257b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:55.856726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e89bb89-9d57-4c44-8245-0df5dd5257b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:55.857158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e89bb89-9d57-4c44-8245-0df5dd5257b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:55.887271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0e89bb89-9d57-4c44-8245-0df5dd5257b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046976 Aug 18 22:01:55.887826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 605/1207] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:55 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:55.942362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bf8dcd3e-fe09-458a-af7f-f10bab6bbebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:55.944480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bf8dcd3e-fe09-458a-af7f-f10bab6bbebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:55.950402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf8dcd3e-fe09-458a-af7f-f10bab6bbebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:55.950889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf8dcd3e-fe09-458a-af7f-f10bab6bbebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:55.951332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf8dcd3e-fe09-458a-af7f-f10bab6bbebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:55.952033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf8dcd3e-fe09-458a-af7f-f10bab6bbebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:55.952491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf8dcd3e-fe09-458a-af7f-f10bab6bbebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:55.952921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf8dcd3e-fe09-458a-af7f-f10bab6bbebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:55.981505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bf8dcd3e-fe09-458a-af7f-f10bab6bbebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043582 Aug 18 22:01:55.982030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 603/1208] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:55 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:56.480811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f87a2cc9-5b7b-444d-b036-26b4357b5312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:56.482982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f87a2cc9-5b7b-444d-b036-26b4357b5312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:56.489796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f87a2cc9-5b7b-444d-b036-26b4357b5312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:56.490272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f87a2cc9-5b7b-444d-b036-26b4357b5312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:56.490702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f87a2cc9-5b7b-444d-b036-26b4357b5312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:56.491385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f87a2cc9-5b7b-444d-b036-26b4357b5312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:56.491832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f87a2cc9-5b7b-444d-b036-26b4357b5312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:56.492250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f87a2cc9-5b7b-444d-b036-26b4357b5312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:56.520780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f87a2cc9-5b7b-444d-b036-26b4357b5312 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043927 Aug 18 22:01:56.521330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 606/1209] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:56.765966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d26d9313-227d-4328-9636-0e2733b38b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:56.768054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d26d9313-227d-4328-9636-0e2733b38b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:56.774420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26d9313-227d-4328-9636-0e2733b38b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:56.774892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26d9313-227d-4328-9636-0e2733b38b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:56.775461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26d9313-227d-4328-9636-0e2733b38b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:56.776028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26d9313-227d-4328-9636-0e2733b38b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:56.776430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26d9313-227d-4328-9636-0e2733b38b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:56.776855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26d9313-227d-4328-9636-0e2733b38b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:56.806652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d26d9313-227d-4328-9636-0e2733b38b75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Aug 18 22:01:56.807232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 604/1210] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:56 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:56.899390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-df2e31b1-d84b-40e6-9f20-68707a127ef9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:56.901582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-df2e31b1-d84b-40e6-9f20-68707a127ef9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:56.907810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df2e31b1-d84b-40e6-9f20-68707a127ef9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:56.908776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df2e31b1-d84b-40e6-9f20-68707a127ef9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:56.909210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df2e31b1-d84b-40e6-9f20-68707a127ef9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:56.909946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df2e31b1-d84b-40e6-9f20-68707a127ef9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:56.910397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df2e31b1-d84b-40e6-9f20-68707a127ef9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:56.910821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df2e31b1-d84b-40e6-9f20-68707a127ef9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:56.943390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-df2e31b1-d84b-40e6-9f20-68707a127ef9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047976 Aug 18 22:01:56.943941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 607/1211] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:56 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:56.994407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7ec26707-05e3-48cc-8c86-a2cfca02c231 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:56.996568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7ec26707-05e3-48cc-8c86-a2cfca02c231 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:57.002796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ec26707-05e3-48cc-8c86-a2cfca02c231 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:57.003280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ec26707-05e3-48cc-8c86-a2cfca02c231 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:57.003720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ec26707-05e3-48cc-8c86-a2cfca02c231 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:57.004424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ec26707-05e3-48cc-8c86-a2cfca02c231 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:57.004882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ec26707-05e3-48cc-8c86-a2cfca02c231 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:57.005313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ec26707-05e3-48cc-8c86-a2cfca02c231 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:57.036425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7ec26707-05e3-48cc-8c86-a2cfca02c231 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046519 Aug 18 22:01:57.037005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 605/1212] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:56 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:57.533269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-41d235e3-686f-4ca4-83af-7cd94c479f57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:57.535458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-41d235e3-686f-4ca4-83af-7cd94c479f57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:57.541460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41d235e3-686f-4ca4-83af-7cd94c479f57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:57.542001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41d235e3-686f-4ca4-83af-7cd94c479f57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:57.542546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41d235e3-686f-4ca4-83af-7cd94c479f57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:57.543358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41d235e3-686f-4ca4-83af-7cd94c479f57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:57.543991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41d235e3-686f-4ca4-83af-7cd94c479f57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:57.544424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41d235e3-686f-4ca4-83af-7cd94c479f57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:57.574850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-41d235e3-686f-4ca4-83af-7cd94c479f57 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045606 Aug 18 22:01:57.575388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 608/1213] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:57.819121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-88aa5ef4-d3a1-4ff1-87c9-c7000e41abb3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:57.821128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-88aa5ef4-d3a1-4ff1-87c9-c7000e41abb3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:57.827220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88aa5ef4-d3a1-4ff1-87c9-c7000e41abb3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:57.827698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88aa5ef4-d3a1-4ff1-87c9-c7000e41abb3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:57.828129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88aa5ef4-d3a1-4ff1-87c9-c7000e41abb3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:57.828812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88aa5ef4-d3a1-4ff1-87c9-c7000e41abb3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:57.829318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88aa5ef4-d3a1-4ff1-87c9-c7000e41abb3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:57.829827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88aa5ef4-d3a1-4ff1-87c9-c7000e41abb3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:57.857102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-88aa5ef4-d3a1-4ff1-87c9-c7000e41abb3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042531 Aug 18 22:01:57.857670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 606/1214] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:57.955284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eaa2524f-20d8-44e5-b9a8-4e77a3284e56 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:57.957447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eaa2524f-20d8-44e5-b9a8-4e77a3284e56 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:57.963717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaa2524f-20d8-44e5-b9a8-4e77a3284e56 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:57.964201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaa2524f-20d8-44e5-b9a8-4e77a3284e56 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:57.964640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaa2524f-20d8-44e5-b9a8-4e77a3284e56 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:57.965340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaa2524f-20d8-44e5-b9a8-4e77a3284e56 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:57.965826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaa2524f-20d8-44e5-b9a8-4e77a3284e56 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:57.966258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaa2524f-20d8-44e5-b9a8-4e77a3284e56 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:57.995700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:58.001427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eaa2524f-20d8-44e5-b9a8-4e77a3284e56 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050070 Aug 18 22:01:58.002555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 609/1215] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:57 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:58.048984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-917bb0b4-3722-4090-a1d6-fdf3f82d2e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:58.051089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-917bb0b4-3722-4090-a1d6-fdf3f82d2e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:58.056934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-917bb0b4-3722-4090-a1d6-fdf3f82d2e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:58.057439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-917bb0b4-3722-4090-a1d6-fdf3f82d2e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:58.057907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-917bb0b4-3722-4090-a1d6-fdf3f82d2e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:58.058591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-917bb0b4-3722-4090-a1d6-fdf3f82d2e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:58.059040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-917bb0b4-3722-4090-a1d6-fdf3f82d2e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:58.059461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-917bb0b4-3722-4090-a1d6-fdf3f82d2e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:58.088609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-917bb0b4-3722-4090-a1d6-fdf3f82d2e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Aug 18 22:01:58.089089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 607/1216] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:58 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:58.587820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ea59dff9-f77a-45ef-aed6-55f2568916d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:58.589979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ea59dff9-f77a-45ef-aed6-55f2568916d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:58.596349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea59dff9-f77a-45ef-aed6-55f2568916d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:58.596825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea59dff9-f77a-45ef-aed6-55f2568916d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:58.597248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea59dff9-f77a-45ef-aed6-55f2568916d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:58.597954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea59dff9-f77a-45ef-aed6-55f2568916d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:58.598397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea59dff9-f77a-45ef-aed6-55f2568916d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:58.598816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea59dff9-f77a-45ef-aed6-55f2568916d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:58.628582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea59dff9-f77a-45ef-aed6-55f2568916d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044811 Aug 18 22:01:58.629243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 610/1217] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:58.870265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-26fa1b98-a8c1-4afd-b3c9-bf0317db06d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:58.872307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-26fa1b98-a8c1-4afd-b3c9-bf0317db06d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:58.879243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26fa1b98-a8c1-4afd-b3c9-bf0317db06d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:58.879727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26fa1b98-a8c1-4afd-b3c9-bf0317db06d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:58.880164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26fa1b98-a8c1-4afd-b3c9-bf0317db06d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:58.880898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26fa1b98-a8c1-4afd-b3c9-bf0317db06d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:58.881359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26fa1b98-a8c1-4afd-b3c9-bf0317db06d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:58.881817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26fa1b98-a8c1-4afd-b3c9-bf0317db06d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:58.910269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-26fa1b98-a8c1-4afd-b3c9-bf0317db06d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044026 Aug 18 22:01:58.910826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 608/1218] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:58 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:59.013974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-27fd0114-3ee4-4f10-a681-fb4444e0339b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:59.016218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-27fd0114-3ee4-4f10-a681-fb4444e0339b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:59.023138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27fd0114-3ee4-4f10-a681-fb4444e0339b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:59.023614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27fd0114-3ee4-4f10-a681-fb4444e0339b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:59.024051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27fd0114-3ee4-4f10-a681-fb4444e0339b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:59.024746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27fd0114-3ee4-4f10-a681-fb4444e0339b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:59.025198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27fd0114-3ee4-4f10-a681-fb4444e0339b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:59.025647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27fd0114-3ee4-4f10-a681-fb4444e0339b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:59.062480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-27fd0114-3ee4-4f10-a681-fb4444e0339b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052401 Aug 18 22:01:59.063042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 611/1219] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:59 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:59.100425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ecec9ed4-d53b-4511-927c-d662a394b756 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:59.102575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ecec9ed4-d53b-4511-927c-d662a394b756 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:59.108493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecec9ed4-d53b-4511-927c-d662a394b756 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:59.108972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecec9ed4-d53b-4511-927c-d662a394b756 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:59.109412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecec9ed4-d53b-4511-927c-d662a394b756 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:59.110128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecec9ed4-d53b-4511-927c-d662a394b756 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:59.110594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecec9ed4-d53b-4511-927c-d662a394b756 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:59.111021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecec9ed4-d53b-4511-927c-d662a394b756 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:59.135442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:01:59.146608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ecec9ed4-d53b-4511-927c-d662a394b756 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050055 Aug 18 22:01:59.147199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 609/1220] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:59 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:01:59.641023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e78fdf87-8d39-442d-948e-cc7697e579ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:59.643831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e78fdf87-8d39-442d-948e-cc7697e579ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:59.649806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e78fdf87-8d39-442d-948e-cc7697e579ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:59.650285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e78fdf87-8d39-442d-948e-cc7697e579ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:59.650721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e78fdf87-8d39-442d-948e-cc7697e579ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:59.651415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e78fdf87-8d39-442d-948e-cc7697e579ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:59.651874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e78fdf87-8d39-442d-948e-cc7697e579ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:59.652301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e78fdf87-8d39-442d-948e-cc7697e579ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:59.680952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e78fdf87-8d39-442d-948e-cc7697e579ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043941 Aug 18 22:01:59.681506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 612/1221] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:01:59 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:01:59.922709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-74e8fa69-12b6-4ac9-b843-f4dcb03f8ea4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:01:59.924767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-74e8fa69-12b6-4ac9-b843-f4dcb03f8ea4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:01:59.931177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74e8fa69-12b6-4ac9-b843-f4dcb03f8ea4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:59.931661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74e8fa69-12b6-4ac9-b843-f4dcb03f8ea4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:59.932104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74e8fa69-12b6-4ac9-b843-f4dcb03f8ea4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:59.932801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74e8fa69-12b6-4ac9-b843-f4dcb03f8ea4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:01:59.933260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74e8fa69-12b6-4ac9-b843-f4dcb03f8ea4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:01:59.933727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74e8fa69-12b6-4ac9-b843-f4dcb03f8ea4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:01:59.963109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-74e8fa69-12b6-4ac9-b843-f4dcb03f8ea4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044883 Aug 18 22:01:59.963662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 610/1222] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:01:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:00.075268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ce981c2c-17c0-482e-9e46-19f75929b673 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:00.077530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ce981c2c-17c0-482e-9e46-19f75929b673 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:00.083983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce981c2c-17c0-482e-9e46-19f75929b673 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:00.084468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce981c2c-17c0-482e-9e46-19f75929b673 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:00.084906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce981c2c-17c0-482e-9e46-19f75929b673 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:00.085638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce981c2c-17c0-482e-9e46-19f75929b673 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:00.086188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce981c2c-17c0-482e-9e46-19f75929b673 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:00.086620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce981c2c-17c0-482e-9e46-19f75929b673 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:00.116274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ce981c2c-17c0-482e-9e46-19f75929b673 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045108 Aug 18 22:02:00.116820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 613/1223] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:00 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:00.158830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2f33f1b-6a5d-4e05-ac49-b48dc901cc4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:00.160906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e2f33f1b-6a5d-4e05-ac49-b48dc901cc4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:00.166766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2f33f1b-6a5d-4e05-ac49-b48dc901cc4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:00.167244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2f33f1b-6a5d-4e05-ac49-b48dc901cc4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:00.167672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2f33f1b-6a5d-4e05-ac49-b48dc901cc4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:00.168357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2f33f1b-6a5d-4e05-ac49-b48dc901cc4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:00.168804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2f33f1b-6a5d-4e05-ac49-b48dc901cc4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:00.169226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2f33f1b-6a5d-4e05-ac49-b48dc901cc4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:00.199131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e2f33f1b-6a5d-4e05-ac49-b48dc901cc4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044115 Aug 18 22:02:00.199624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 611/1224] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:00 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:00.693007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fc643d95-5ba0-46e5-ba6d-3cd03544fcf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:00.695470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fc643d95-5ba0-46e5-ba6d-3cd03544fcf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:00.701514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc643d95-5ba0-46e5-ba6d-3cd03544fcf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:00.702016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc643d95-5ba0-46e5-ba6d-3cd03544fcf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:00.702448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc643d95-5ba0-46e5-ba6d-3cd03544fcf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:00.703145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc643d95-5ba0-46e5-ba6d-3cd03544fcf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:00.703593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc643d95-5ba0-46e5-ba6d-3cd03544fcf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:00.704012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc643d95-5ba0-46e5-ba6d-3cd03544fcf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:00.734173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fc643d95-5ba0-46e5-ba6d-3cd03544fcf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045171 Aug 18 22:02:00.734723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 614/1225] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:00 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:00.976114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d3c52b96-08f8-4c97-a611-d5d072277070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:00.978394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d3c52b96-08f8-4c97-a611-d5d072277070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:00.984634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c52b96-08f8-4c97-a611-d5d072277070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:00.985113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c52b96-08f8-4c97-a611-d5d072277070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:00.986373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c52b96-08f8-4c97-a611-d5d072277070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:00.986373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c52b96-08f8-4c97-a611-d5d072277070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:00.986724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c52b96-08f8-4c97-a611-d5d072277070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:00.987144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3c52b96-08f8-4c97-a611-d5d072277070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:01.016524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d3c52b96-08f8-4c97-a611-d5d072277070 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044449 Aug 18 22:02:01.017081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 612/1226] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:00 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:01.129081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf2b8c80-3700-4aaa-a3bc-8b5b66c101af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:01.131533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf2b8c80-3700-4aaa-a3bc-8b5b66c101af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:01.138056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf2b8c80-3700-4aaa-a3bc-8b5b66c101af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:01.138558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf2b8c80-3700-4aaa-a3bc-8b5b66c101af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:01.139021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf2b8c80-3700-4aaa-a3bc-8b5b66c101af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:01.139728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf2b8c80-3700-4aaa-a3bc-8b5b66c101af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:01.140215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf2b8c80-3700-4aaa-a3bc-8b5b66c101af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:01.140640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf2b8c80-3700-4aaa-a3bc-8b5b66c101af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:01.178246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf2b8c80-3700-4aaa-a3bc-8b5b66c101af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053683 Aug 18 22:02:01.179548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 615/1227] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:01 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:01.211842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d95af045-5c24-4c9f-983f-6175a513398c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:01.213996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d95af045-5c24-4c9f-983f-6175a513398c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:01.219869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d95af045-5c24-4c9f-983f-6175a513398c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:01.220539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d95af045-5c24-4c9f-983f-6175a513398c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:01.220967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d95af045-5c24-4c9f-983f-6175a513398c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:01.221694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d95af045-5c24-4c9f-983f-6175a513398c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:01.222417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d95af045-5c24-4c9f-983f-6175a513398c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:01.222950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d95af045-5c24-4c9f-983f-6175a513398c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:01.253423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d95af045-5c24-4c9f-983f-6175a513398c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045589 Aug 18 22:02:01.254023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 613/1228] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:01 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:01.747120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8aa8a72a-5bb5-49a4-a6cb-9a113e7b2441 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:01.749235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8aa8a72a-5bb5-49a4-a6cb-9a113e7b2441 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:01.755978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8aa8a72a-5bb5-49a4-a6cb-9a113e7b2441 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:01.756453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8aa8a72a-5bb5-49a4-a6cb-9a113e7b2441 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:01.756890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8aa8a72a-5bb5-49a4-a6cb-9a113e7b2441 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:01.757582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8aa8a72a-5bb5-49a4-a6cb-9a113e7b2441 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:01.758097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8aa8a72a-5bb5-49a4-a6cb-9a113e7b2441 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:01.758520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8aa8a72a-5bb5-49a4-a6cb-9a113e7b2441 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:01.787086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8aa8a72a-5bb5-49a4-a6cb-9a113e7b2441 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043957 Aug 18 22:02:01.787636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 616/1229] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:02.028355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7999aac2-714c-49df-a903-25924da898bd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:02.030479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7999aac2-714c-49df-a903-25924da898bd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:02.037462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7999aac2-714c-49df-a903-25924da898bd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:02.037970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7999aac2-714c-49df-a903-25924da898bd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:02.038406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7999aac2-714c-49df-a903-25924da898bd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:02.039089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7999aac2-714c-49df-a903-25924da898bd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:02.039538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7999aac2-714c-49df-a903-25924da898bd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:02.039959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7999aac2-714c-49df-a903-25924da898bd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:02.069692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7999aac2-714c-49df-a903-25924da898bd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045168 Aug 18 22:02:02.070251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 614/1230] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:02 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:02.190881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6f2ce137-d629-40e6-baad-1e809da5ceb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:02.193096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6f2ce137-d629-40e6-baad-1e809da5ceb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:02.199516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f2ce137-d629-40e6-baad-1e809da5ceb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:02.200000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f2ce137-d629-40e6-baad-1e809da5ceb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:02.200442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f2ce137-d629-40e6-baad-1e809da5ceb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:02.201150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f2ce137-d629-40e6-baad-1e809da5ceb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:02.201626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f2ce137-d629-40e6-baad-1e809da5ceb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:02.202061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f2ce137-d629-40e6-baad-1e809da5ceb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:02.231878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6f2ce137-d629-40e6-baad-1e809da5ceb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045015 Aug 18 22:02:02.232437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 617/1231] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:02 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:02.265889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0f9a66c7-4eee-4781-bbc7-9d2c1dbf770e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:02.268530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0f9a66c7-4eee-4781-bbc7-9d2c1dbf770e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:02.274448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f9a66c7-4eee-4781-bbc7-9d2c1dbf770e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:02.274947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f9a66c7-4eee-4781-bbc7-9d2c1dbf770e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:02.275364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f9a66c7-4eee-4781-bbc7-9d2c1dbf770e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:02.276053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f9a66c7-4eee-4781-bbc7-9d2c1dbf770e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:02.276505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f9a66c7-4eee-4781-bbc7-9d2c1dbf770e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:02.276928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f9a66c7-4eee-4781-bbc7-9d2c1dbf770e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:02.305817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0f9a66c7-4eee-4781-bbc7-9d2c1dbf770e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 Aug 18 22:02:02.306302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 615/1232] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:02 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:02.799918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-54a9c02a-0769-4753-858c-335d3bbbed08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:02.802131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-54a9c02a-0769-4753-858c-335d3bbbed08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:02.808023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54a9c02a-0769-4753-858c-335d3bbbed08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:02.808508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54a9c02a-0769-4753-858c-335d3bbbed08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:02.808945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54a9c02a-0769-4753-858c-335d3bbbed08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:02.809674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54a9c02a-0769-4753-858c-335d3bbbed08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:02.810131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54a9c02a-0769-4753-858c-335d3bbbed08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:02.810561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54a9c02a-0769-4753-858c-335d3bbbed08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:02.842338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-54a9c02a-0769-4753-858c-335d3bbbed08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046675 Aug 18 22:02:02.842900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 618/1233] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:03.081902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dcbe26ca-134a-4eec-a444-649bfb44ce52 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:03.083999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dcbe26ca-134a-4eec-a444-649bfb44ce52 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:03.090359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcbe26ca-134a-4eec-a444-649bfb44ce52 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:03.090835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcbe26ca-134a-4eec-a444-649bfb44ce52 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:03.091265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcbe26ca-134a-4eec-a444-649bfb44ce52 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:03.091952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcbe26ca-134a-4eec-a444-649bfb44ce52 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:03.092400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcbe26ca-134a-4eec-a444-649bfb44ce52 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:03.092824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcbe26ca-134a-4eec-a444-649bfb44ce52 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:03.121497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dcbe26ca-134a-4eec-a444-649bfb44ce52 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043563 Aug 18 22:02:03.122080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 616/1234] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:03 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:03.243334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f449985f-aa89-43aa-a90e-f83f46f811b5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:03.245680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f449985f-aa89-43aa-a90e-f83f46f811b5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:03.252316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f449985f-aa89-43aa-a90e-f83f46f811b5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:03.253057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f449985f-aa89-43aa-a90e-f83f46f811b5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:03.253501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f449985f-aa89-43aa-a90e-f83f46f811b5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:03.254266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f449985f-aa89-43aa-a90e-f83f46f811b5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:03.254731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f449985f-aa89-43aa-a90e-f83f46f811b5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:03.255159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f449985f-aa89-43aa-a90e-f83f46f811b5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:03.284544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f449985f-aa89-43aa-a90e-f83f46f811b5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045189 Aug 18 22:02:03.285100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 619/1235] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:03 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:03.318309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-349cbe77-8458-48f9-bad5-aa81a0b9fe15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:03.320424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-349cbe77-8458-48f9-bad5-aa81a0b9fe15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:03.326403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-349cbe77-8458-48f9-bad5-aa81a0b9fe15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:03.326895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-349cbe77-8458-48f9-bad5-aa81a0b9fe15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:03.327332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-349cbe77-8458-48f9-bad5-aa81a0b9fe15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:03.328032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-349cbe77-8458-48f9-bad5-aa81a0b9fe15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:03.328493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-349cbe77-8458-48f9-bad5-aa81a0b9fe15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:03.328922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-349cbe77-8458-48f9-bad5-aa81a0b9fe15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:03.363460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-349cbe77-8458-48f9-bad5-aa81a0b9fe15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049587 Aug 18 22:02:03.363953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 617/1236] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:03 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:03.854813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dad3efc3-a24f-4eb1-bc58-8d50662ce904 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:03.856958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dad3efc3-a24f-4eb1-bc58-8d50662ce904 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:03.862896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dad3efc3-a24f-4eb1-bc58-8d50662ce904 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:03.863365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dad3efc3-a24f-4eb1-bc58-8d50662ce904 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:03.863791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dad3efc3-a24f-4eb1-bc58-8d50662ce904 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:03.864471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dad3efc3-a24f-4eb1-bc58-8d50662ce904 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:03.864917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dad3efc3-a24f-4eb1-bc58-8d50662ce904 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:03.865336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dad3efc3-a24f-4eb1-bc58-8d50662ce904 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:03.893285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dad3efc3-a24f-4eb1-bc58-8d50662ce904 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042427 Aug 18 22:02:03.893932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 620/1237] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:02:04.133914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2405a2ac-63da-4b74-95a2-7a1784e13a6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:04.136105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2405a2ac-63da-4b74-95a2-7a1784e13a6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:04.143051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2405a2ac-63da-4b74-95a2-7a1784e13a6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:04.143542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2405a2ac-63da-4b74-95a2-7a1784e13a6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:04.144011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2405a2ac-63da-4b74-95a2-7a1784e13a6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:04.144707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2405a2ac-63da-4b74-95a2-7a1784e13a6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:04.145163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2405a2ac-63da-4b74-95a2-7a1784e13a6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:04.145621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2405a2ac-63da-4b74-95a2-7a1784e13a6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:04.173453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2405a2ac-63da-4b74-95a2-7a1784e13a6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043518 Aug 18 22:02:04.174037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 618/1238] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:04.296115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2acbcbbe-0c08-4c6b-9fe4-c20b50704c53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:04.298752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2acbcbbe-0c08-4c6b-9fe4-c20b50704c53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:04.305080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2acbcbbe-0c08-4c6b-9fe4-c20b50704c53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:04.305560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2acbcbbe-0c08-4c6b-9fe4-c20b50704c53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:04.306013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2acbcbbe-0c08-4c6b-9fe4-c20b50704c53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:04.306701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2acbcbbe-0c08-4c6b-9fe4-c20b50704c53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:04.307817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2acbcbbe-0c08-4c6b-9fe4-c20b50704c53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:04.308242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2acbcbbe-0c08-4c6b-9fe4-c20b50704c53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:04.339755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2acbcbbe-0c08-4c6b-9fe4-c20b50704c53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047484 Aug 18 22:02:04.340600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 621/1239] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:04 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:04.375497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3155b8c3-1f02-4888-b98d-02d07ea28619 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:04.378204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3155b8c3-1f02-4888-b98d-02d07ea28619 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:04.384223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3155b8c3-1f02-4888-b98d-02d07ea28619 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:04.384646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3155b8c3-1f02-4888-b98d-02d07ea28619 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:04.385085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3155b8c3-1f02-4888-b98d-02d07ea28619 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:04.385817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3155b8c3-1f02-4888-b98d-02d07ea28619 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:04.386276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3155b8c3-1f02-4888-b98d-02d07ea28619 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:04.386707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3155b8c3-1f02-4888-b98d-02d07ea28619 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:04.425745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3155b8c3-1f02-4888-b98d-02d07ea28619 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054106 Aug 18 22:02:04.426317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 619/1240] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:04 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:04.905729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-441a2b23-44b8-4fae-8d13-977b337af35b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:04.908417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-441a2b23-44b8-4fae-8d13-977b337af35b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:04.914444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-441a2b23-44b8-4fae-8d13-977b337af35b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:04.914926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-441a2b23-44b8-4fae-8d13-977b337af35b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:04.915366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-441a2b23-44b8-4fae-8d13-977b337af35b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:04.916068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-441a2b23-44b8-4fae-8d13-977b337af35b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:04.916525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-441a2b23-44b8-4fae-8d13-977b337af35b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:04.916955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-441a2b23-44b8-4fae-8d13-977b337af35b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:04.946290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-441a2b23-44b8-4fae-8d13-977b337af35b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044571 Aug 18 22:02:04.946845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 622/1241] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:05.185775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7f70f0db-09ac-4f91-9917-a1e12266ac2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:05.187938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7f70f0db-09ac-4f91-9917-a1e12266ac2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:05.194387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f70f0db-09ac-4f91-9917-a1e12266ac2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:05.194869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f70f0db-09ac-4f91-9917-a1e12266ac2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:05.195306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f70f0db-09ac-4f91-9917-a1e12266ac2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:05.196004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f70f0db-09ac-4f91-9917-a1e12266ac2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:05.196459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f70f0db-09ac-4f91-9917-a1e12266ac2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:05.196888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f70f0db-09ac-4f91-9917-a1e12266ac2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:05.225398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7f70f0db-09ac-4f91-9917-a1e12266ac2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043558 Aug 18 22:02:05.225981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 620/1242] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:05 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:05.352439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-05344fa6-ed3e-466c-a83d-0b4341b5b78c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:05.354731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-05344fa6-ed3e-466c-a83d-0b4341b5b78c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:05.361058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05344fa6-ed3e-466c-a83d-0b4341b5b78c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:05.361540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05344fa6-ed3e-466c-a83d-0b4341b5b78c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:05.362013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05344fa6-ed3e-466c-a83d-0b4341b5b78c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:05.362716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05344fa6-ed3e-466c-a83d-0b4341b5b78c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:05.363165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05344fa6-ed3e-466c-a83d-0b4341b5b78c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:05.363592 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05344fa6-ed3e-466c-a83d-0b4341b5b78c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:05.393627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-05344fa6-ed3e-466c-a83d-0b4341b5b78c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044609 Aug 18 22:02:05.394354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 623/1243] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:05 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:05.437795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a5b72a7a-8eb2-437e-a3e1-ebac864e7d6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:05.439965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a5b72a7a-8eb2-437e-a3e1-ebac864e7d6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:05.445888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5b72a7a-8eb2-437e-a3e1-ebac864e7d6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:05.446373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5b72a7a-8eb2-437e-a3e1-ebac864e7d6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:05.446811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5b72a7a-8eb2-437e-a3e1-ebac864e7d6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:05.447507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5b72a7a-8eb2-437e-a3e1-ebac864e7d6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:05.447965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5b72a7a-8eb2-437e-a3e1-ebac864e7d6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:05.448392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5b72a7a-8eb2-437e-a3e1-ebac864e7d6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:05.477500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a5b72a7a-8eb2-437e-a3e1-ebac864e7d6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043626 Aug 18 22:02:05.478078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 621/1244] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:05 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:05.959335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-68083461-23c2-4f6f-bc9c-29e4d739a528 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:05.961471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-68083461-23c2-4f6f-bc9c-29e4d739a528 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:05.967290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68083461-23c2-4f6f-bc9c-29e4d739a528 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:05.967759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68083461-23c2-4f6f-bc9c-29e4d739a528 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:05.968188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68083461-23c2-4f6f-bc9c-29e4d739a528 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:05.968915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68083461-23c2-4f6f-bc9c-29e4d739a528 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:05.969313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68083461-23c2-4f6f-bc9c-29e4d739a528 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:05.969767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68083461-23c2-4f6f-bc9c-29e4d739a528 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:05.998646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-68083461-23c2-4f6f-bc9c-29e4d739a528 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044024 Aug 18 22:02:05.999194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 624/1245] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:06.238310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-db0f71d3-8a26-45ac-b0b1-994cef9486f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:06.240390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-db0f71d3-8a26-45ac-b0b1-994cef9486f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:06.246817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db0f71d3-8a26-45ac-b0b1-994cef9486f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:06.247302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db0f71d3-8a26-45ac-b0b1-994cef9486f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:06.247743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db0f71d3-8a26-45ac-b0b1-994cef9486f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:06.248459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db0f71d3-8a26-45ac-b0b1-994cef9486f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:06.248913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db0f71d3-8a26-45ac-b0b1-994cef9486f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:06.249337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db0f71d3-8a26-45ac-b0b1-994cef9486f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:06.277895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-db0f71d3-8a26-45ac-b0b1-994cef9486f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044208 Aug 18 22:02:06.278448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 622/1246] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:06 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:06.406002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-145b885a-fefb-4e9a-afdd-7f607897377b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:06.408793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-145b885a-fefb-4e9a-afdd-7f607897377b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:06.415035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-145b885a-fefb-4e9a-afdd-7f607897377b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:06.415491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-145b885a-fefb-4e9a-afdd-7f607897377b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:06.415922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-145b885a-fefb-4e9a-afdd-7f607897377b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:06.416613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-145b885a-fefb-4e9a-afdd-7f607897377b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:06.417155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-145b885a-fefb-4e9a-afdd-7f607897377b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:06.417584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-145b885a-fefb-4e9a-afdd-7f607897377b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:06.446860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-145b885a-fefb-4e9a-afdd-7f607897377b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044864 Aug 18 22:02:06.447567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 625/1247] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:06 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:06.490350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-17812256-4a4f-4986-8d42-dbefd0cf641f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:06.492445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-17812256-4a4f-4986-8d42-dbefd0cf641f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:06.498302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17812256-4a4f-4986-8d42-dbefd0cf641f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:06.498784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17812256-4a4f-4986-8d42-dbefd0cf641f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:06.499220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17812256-4a4f-4986-8d42-dbefd0cf641f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:06.499910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17812256-4a4f-4986-8d42-dbefd0cf641f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:06.500358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17812256-4a4f-4986-8d42-dbefd0cf641f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:06.500787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17812256-4a4f-4986-8d42-dbefd0cf641f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:06.528782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-17812256-4a4f-4986-8d42-dbefd0cf641f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043010 Aug 18 22:02:06.529323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 623/1248] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:06 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:07.011699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-36cae675-f118-4a77-9d0e-6e0ca611a048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:07.013859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-36cae675-f118-4a77-9d0e-6e0ca611a048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:07.020582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36cae675-f118-4a77-9d0e-6e0ca611a048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:07.021060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36cae675-f118-4a77-9d0e-6e0ca611a048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:07.021492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36cae675-f118-4a77-9d0e-6e0ca611a048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:07.022230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36cae675-f118-4a77-9d0e-6e0ca611a048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:07.022679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36cae675-f118-4a77-9d0e-6e0ca611a048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:07.023102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36cae675-f118-4a77-9d0e-6e0ca611a048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:07.038462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:07.054922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-36cae675-f118-4a77-9d0e-6e0ca611a048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047233 Aug 18 22:02:07.055492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 626/1249] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:07.289901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-771a9fcc-c423-41e9-b6eb-d180c792fe6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:07.291942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-771a9fcc-c423-41e9-b6eb-d180c792fe6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:07.298758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-771a9fcc-c423-41e9-b6eb-d180c792fe6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:07.299244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-771a9fcc-c423-41e9-b6eb-d180c792fe6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:07.299684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-771a9fcc-c423-41e9-b6eb-d180c792fe6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:07.300399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-771a9fcc-c423-41e9-b6eb-d180c792fe6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:07.300855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-771a9fcc-c423-41e9-b6eb-d180c792fe6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:07.301279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-771a9fcc-c423-41e9-b6eb-d180c792fe6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:07.336521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-771a9fcc-c423-41e9-b6eb-d180c792fe6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050618 Aug 18 22:02:07.337100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 624/1250] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:07.459851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-96e44113-b335-4771-9b68-2a4cf0d9d7fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:07.462052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-96e44113-b335-4771-9b68-2a4cf0d9d7fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:07.468432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96e44113-b335-4771-9b68-2a4cf0d9d7fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:07.468919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96e44113-b335-4771-9b68-2a4cf0d9d7fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:07.469355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96e44113-b335-4771-9b68-2a4cf0d9d7fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:07.470163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96e44113-b335-4771-9b68-2a4cf0d9d7fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:07.470619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96e44113-b335-4771-9b68-2a4cf0d9d7fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:07.471038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96e44113-b335-4771-9b68-2a4cf0d9d7fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:07.503061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-96e44113-b335-4771-9b68-2a4cf0d9d7fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046614 Aug 18 22:02:07.503652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 627/1251] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:07 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:02:07.542439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2d30323-a171-4bfe-93da-409ec56560a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:07.544564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e2d30323-a171-4bfe-93da-409ec56560a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:07.552150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2d30323-a171-4bfe-93da-409ec56560a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:07.552631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2d30323-a171-4bfe-93da-409ec56560a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:07.553061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2d30323-a171-4bfe-93da-409ec56560a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:07.553804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2d30323-a171-4bfe-93da-409ec56560a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:07.554256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2d30323-a171-4bfe-93da-409ec56560a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:07.554677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2d30323-a171-4bfe-93da-409ec56560a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:07.586946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e2d30323-a171-4bfe-93da-409ec56560a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049119 Aug 18 22:02:07.587559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 625/1252] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:07 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:08.066978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a49ac8e6-8080-4fa6-a268-0b91029b9f19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:08.069111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a49ac8e6-8080-4fa6-a268-0b91029b9f19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:08.075026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49ac8e6-8080-4fa6-a268-0b91029b9f19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:08.075508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49ac8e6-8080-4fa6-a268-0b91029b9f19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:08.075946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49ac8e6-8080-4fa6-a268-0b91029b9f19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:08.076643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49ac8e6-8080-4fa6-a268-0b91029b9f19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:08.077099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49ac8e6-8080-4fa6-a268-0b91029b9f19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:08.077530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49ac8e6-8080-4fa6-a268-0b91029b9f19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:08.106753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a49ac8e6-8080-4fa6-a268-0b91029b9f19 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043724 Aug 18 22:02:08.107316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 628/1253] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:08.349113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c484a720-22f1-42bd-b0de-ffc6ddc619d8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:08.351195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c484a720-22f1-42bd-b0de-ffc6ddc619d8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:08.357572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c484a720-22f1-42bd-b0de-ffc6ddc619d8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:08.358270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c484a720-22f1-42bd-b0de-ffc6ddc619d8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:08.358707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c484a720-22f1-42bd-b0de-ffc6ddc619d8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:08.359581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c484a720-22f1-42bd-b0de-ffc6ddc619d8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:08.360033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c484a720-22f1-42bd-b0de-ffc6ddc619d8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:08.360454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c484a720-22f1-42bd-b0de-ffc6ddc619d8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:08.376483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:08.389303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c484a720-22f1-42bd-b0de-ffc6ddc619d8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044798 Aug 18 22:02:08.389879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 626/1254] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:08 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:08.515218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5518500a-3a3f-401e-b8f5-abb2502f47d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:08.517900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5518500a-3a3f-401e-b8f5-abb2502f47d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:08.524246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5518500a-3a3f-401e-b8f5-abb2502f47d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:08.524806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5518500a-3a3f-401e-b8f5-abb2502f47d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:08.525147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5518500a-3a3f-401e-b8f5-abb2502f47d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:08.525863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5518500a-3a3f-401e-b8f5-abb2502f47d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:08.526317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5518500a-3a3f-401e-b8f5-abb2502f47d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:08.526742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5518500a-3a3f-401e-b8f5-abb2502f47d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:08.557397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5518500a-3a3f-401e-b8f5-abb2502f47d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046023 Aug 18 22:02:08.557998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 629/1255] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:08 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:08.599814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-35e33e04-fd47-4b70-bf6e-12386214c37f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:08.601905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-35e33e04-fd47-4b70-bf6e-12386214c37f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:08.607775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35e33e04-fd47-4b70-bf6e-12386214c37f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:08.608254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35e33e04-fd47-4b70-bf6e-12386214c37f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:08.608697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35e33e04-fd47-4b70-bf6e-12386214c37f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:08.609396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35e33e04-fd47-4b70-bf6e-12386214c37f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:08.609881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35e33e04-fd47-4b70-bf6e-12386214c37f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:08.610313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35e33e04-fd47-4b70-bf6e-12386214c37f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:08.639815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-35e33e04-fd47-4b70-bf6e-12386214c37f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044513 Aug 18 22:02:08.640377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 627/1256] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:08 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:09.119953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d6874b7f-5fde-4f88-a1bc-d53a0156219e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:09.122102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d6874b7f-5fde-4f88-a1bc-d53a0156219e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:09.128559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6874b7f-5fde-4f88-a1bc-d53a0156219e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:09.129022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6874b7f-5fde-4f88-a1bc-d53a0156219e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:09.129459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6874b7f-5fde-4f88-a1bc-d53a0156219e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:09.130171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6874b7f-5fde-4f88-a1bc-d53a0156219e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:09.130624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6874b7f-5fde-4f88-a1bc-d53a0156219e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:09.131043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6874b7f-5fde-4f88-a1bc-d53a0156219e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:09.159005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d6874b7f-5fde-4f88-a1bc-d53a0156219e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042995 Aug 18 22:02:09.159565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 630/1257] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:09.401820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5e321801-c701-47af-844c-8653c347900d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:09.403891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5e321801-c701-47af-844c-8653c347900d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:09.410811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e321801-c701-47af-844c-8653c347900d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:09.411296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e321801-c701-47af-844c-8653c347900d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:09.411738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e321801-c701-47af-844c-8653c347900d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:09.412433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e321801-c701-47af-844c-8653c347900d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:09.412888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e321801-c701-47af-844c-8653c347900d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:09.413317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e321801-c701-47af-844c-8653c347900d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:09.441807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5e321801-c701-47af-844c-8653c347900d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043984 Aug 18 22:02:09.442358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 628/1258] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:09 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:09.569801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a5506d45-31f8-45b4-9838-5f4b33341192 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:09.571937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a5506d45-31f8-45b4-9838-5f4b33341192 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:09.578329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5506d45-31f8-45b4-9838-5f4b33341192 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:09.578795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5506d45-31f8-45b4-9838-5f4b33341192 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:09.579420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5506d45-31f8-45b4-9838-5f4b33341192 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:09.579931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5506d45-31f8-45b4-9838-5f4b33341192 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:09.580377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5506d45-31f8-45b4-9838-5f4b33341192 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:09.580805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5506d45-31f8-45b4-9838-5f4b33341192 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:09.610639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a5506d45-31f8-45b4-9838-5f4b33341192 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Aug 18 22:02:09.611795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 631/1259] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:09 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:09.652233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-305ad471-fae6-40a0-91ae-d8392d7d22ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:09.654328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-305ad471-fae6-40a0-91ae-d8392d7d22ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:09.660724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-305ad471-fae6-40a0-91ae-d8392d7d22ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:09.661209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-305ad471-fae6-40a0-91ae-d8392d7d22ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:09.661675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-305ad471-fae6-40a0-91ae-d8392d7d22ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:09.662372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-305ad471-fae6-40a0-91ae-d8392d7d22ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:09.662830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-305ad471-fae6-40a0-91ae-d8392d7d22ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:09.663261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-305ad471-fae6-40a0-91ae-d8392d7d22ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:09.692588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-305ad471-fae6-40a0-91ae-d8392d7d22ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044218 Aug 18 22:02:09.693160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 629/1260] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:09 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:10.171386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4a097285-4898-47e1-84fa-c79bad280882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:10.173814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4a097285-4898-47e1-84fa-c79bad280882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:10.179655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a097285-4898-47e1-84fa-c79bad280882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:10.180132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a097285-4898-47e1-84fa-c79bad280882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:10.180564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a097285-4898-47e1-84fa-c79bad280882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:10.181249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a097285-4898-47e1-84fa-c79bad280882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:10.181727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a097285-4898-47e1-84fa-c79bad280882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:10.182152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a097285-4898-47e1-84fa-c79bad280882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:10.211107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4a097285-4898-47e1-84fa-c79bad280882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043782 Aug 18 22:02:10.211650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 632/1261] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:10.453358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0fe89744-12fd-4558-a71b-7f1b60549966 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:10.456138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0fe89744-12fd-4558-a71b-7f1b60549966 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:10.462538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fe89744-12fd-4558-a71b-7f1b60549966 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:10.463011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fe89744-12fd-4558-a71b-7f1b60549966 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:10.463443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fe89744-12fd-4558-a71b-7f1b60549966 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:10.464133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fe89744-12fd-4558-a71b-7f1b60549966 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:10.464586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fe89744-12fd-4558-a71b-7f1b60549966 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:10.465010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fe89744-12fd-4558-a71b-7f1b60549966 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:10.493215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0fe89744-12fd-4558-a71b-7f1b60549966 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043828 Aug 18 22:02:10.493791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 630/1262] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:10 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:02:10.623494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-81b8487e-b9f8-4098-bb35-75f81468a852 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:10.625654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-81b8487e-b9f8-4098-bb35-75f81468a852 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:10.632591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81b8487e-b9f8-4098-bb35-75f81468a852 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:10.633074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81b8487e-b9f8-4098-bb35-75f81468a852 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:10.633512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81b8487e-b9f8-4098-bb35-75f81468a852 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:10.634453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81b8487e-b9f8-4098-bb35-75f81468a852 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:10.634693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81b8487e-b9f8-4098-bb35-75f81468a852 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:10.635122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-81b8487e-b9f8-4098-bb35-75f81468a852 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:10.664635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-81b8487e-b9f8-4098-bb35-75f81468a852 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Aug 18 22:02:10.665377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 633/1263] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:10 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:02:10.704363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b9eec7bc-2ea5-4c6e-ab66-121439e5f277 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:10.706432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b9eec7bc-2ea5-4c6e-ab66-121439e5f277 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:10.712375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9eec7bc-2ea5-4c6e-ab66-121439e5f277 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:10.712890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9eec7bc-2ea5-4c6e-ab66-121439e5f277 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:10.713324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9eec7bc-2ea5-4c6e-ab66-121439e5f277 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:10.714041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9eec7bc-2ea5-4c6e-ab66-121439e5f277 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:10.714494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9eec7bc-2ea5-4c6e-ab66-121439e5f277 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:10.714913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9eec7bc-2ea5-4c6e-ab66-121439e5f277 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:10.744807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b9eec7bc-2ea5-4c6e-ab66-121439e5f277 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Aug 18 22:02:10.745356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 631/1264] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:10 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:11.223751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3b756f5a-55df-4b24-922e-33d9b2c8a803 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:11.225912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3b756f5a-55df-4b24-922e-33d9b2c8a803 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:11.231940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b756f5a-55df-4b24-922e-33d9b2c8a803 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:11.232458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b756f5a-55df-4b24-922e-33d9b2c8a803 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:11.232885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b756f5a-55df-4b24-922e-33d9b2c8a803 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:11.233580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b756f5a-55df-4b24-922e-33d9b2c8a803 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:11.234053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b756f5a-55df-4b24-922e-33d9b2c8a803 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:11.234476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b756f5a-55df-4b24-922e-33d9b2c8a803 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:11.263715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3b756f5a-55df-4b24-922e-33d9b2c8a803 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044554 Aug 18 22:02:11.264282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 634/1265] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:11.504827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-104b987d-6258-4d89-86a9-b32b6a3f1ad5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:11.506864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-104b987d-6258-4d89-86a9-b32b6a3f1ad5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:11.513134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-104b987d-6258-4d89-86a9-b32b6a3f1ad5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:11.513627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-104b987d-6258-4d89-86a9-b32b6a3f1ad5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:11.514057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-104b987d-6258-4d89-86a9-b32b6a3f1ad5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:11.514823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-104b987d-6258-4d89-86a9-b32b6a3f1ad5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:11.515267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-104b987d-6258-4d89-86a9-b32b6a3f1ad5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:11.515713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-104b987d-6258-4d89-86a9-b32b6a3f1ad5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:11.544688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-104b987d-6258-4d89-86a9-b32b6a3f1ad5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043905 Aug 18 22:02:11.545231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 632/1266] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:11.676964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-813115a1-32dd-4b96-8a88-8f1fa5dab95f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:11.679560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-813115a1-32dd-4b96-8a88-8f1fa5dab95f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:11.685845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-813115a1-32dd-4b96-8a88-8f1fa5dab95f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:11.686316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-813115a1-32dd-4b96-8a88-8f1fa5dab95f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:11.686746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-813115a1-32dd-4b96-8a88-8f1fa5dab95f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:11.687461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-813115a1-32dd-4b96-8a88-8f1fa5dab95f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:11.687958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-813115a1-32dd-4b96-8a88-8f1fa5dab95f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:11.688383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-813115a1-32dd-4b96-8a88-8f1fa5dab95f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:11.726641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-813115a1-32dd-4b96-8a88-8f1fa5dab95f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053757 Aug 18 22:02:11.727216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 635/1267] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:11.757302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e99b4e4c-766b-4053-94fd-3c997222bb74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:11.759473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e99b4e4c-766b-4053-94fd-3c997222bb74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:11.765371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e99b4e4c-766b-4053-94fd-3c997222bb74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:11.765887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e99b4e4c-766b-4053-94fd-3c997222bb74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:11.766330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e99b4e4c-766b-4053-94fd-3c997222bb74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:11.768091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e99b4e4c-766b-4053-94fd-3c997222bb74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:11.768091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e99b4e4c-766b-4053-94fd-3c997222bb74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:11.768491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e99b4e4c-766b-4053-94fd-3c997222bb74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:11.796572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e99b4e4c-766b-4053-94fd-3c997222bb74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043213 Aug 18 22:02:11.797132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 633/1268] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:11 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:12.276483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab8b4953-414e-440b-a37a-d4837d172be1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:12.278633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab8b4953-414e-440b-a37a-d4837d172be1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:12.284561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8b4953-414e-440b-a37a-d4837d172be1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:12.285035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8b4953-414e-440b-a37a-d4837d172be1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:12.285475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8b4953-414e-440b-a37a-d4837d172be1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:12.286196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8b4953-414e-440b-a37a-d4837d172be1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:12.286650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8b4953-414e-440b-a37a-d4837d172be1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:12.287074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8b4953-414e-440b-a37a-d4837d172be1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:12.316416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab8b4953-414e-440b-a37a-d4837d172be1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043882 Aug 18 22:02:12.316967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 636/1269] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:12 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:12.557116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a9bb5f85-87c2-4c70-b997-34cf609f06da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:12.559235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a9bb5f85-87c2-4c70-b997-34cf609f06da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:12.565625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9bb5f85-87c2-4c70-b997-34cf609f06da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:12.566117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9bb5f85-87c2-4c70-b997-34cf609f06da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:12.566548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9bb5f85-87c2-4c70-b997-34cf609f06da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:12.567227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9bb5f85-87c2-4c70-b997-34cf609f06da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:12.567678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9bb5f85-87c2-4c70-b997-34cf609f06da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:12.568100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9bb5f85-87c2-4c70-b997-34cf609f06da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:12.596347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a9bb5f85-87c2-4c70-b997-34cf609f06da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Aug 18 22:02:12.596892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 634/1270] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:12 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:12.739782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0e696f1c-dfec-4e9a-960b-f2150530f62b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:12.741989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0e696f1c-dfec-4e9a-960b-f2150530f62b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:12.748337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e696f1c-dfec-4e9a-960b-f2150530f62b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:12.748822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e696f1c-dfec-4e9a-960b-f2150530f62b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:12.749265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e696f1c-dfec-4e9a-960b-f2150530f62b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:12.749995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e696f1c-dfec-4e9a-960b-f2150530f62b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:12.750457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e696f1c-dfec-4e9a-960b-f2150530f62b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:12.750887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e696f1c-dfec-4e9a-960b-f2150530f62b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:12.780517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0e696f1c-dfec-4e9a-960b-f2150530f62b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Aug 18 22:02:12.781401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 637/1271] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:12 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:12.808611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1acef493-8c52-4f90-911b-1f4395ea4d53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:12.810688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1acef493-8c52-4f90-911b-1f4395ea4d53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:12.816566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1acef493-8c52-4f90-911b-1f4395ea4d53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:12.817054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1acef493-8c52-4f90-911b-1f4395ea4d53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:12.817555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1acef493-8c52-4f90-911b-1f4395ea4d53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:12.818359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1acef493-8c52-4f90-911b-1f4395ea4d53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:12.818825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1acef493-8c52-4f90-911b-1f4395ea4d53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:12.819260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1acef493-8c52-4f90-911b-1f4395ea4d53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:12.848755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1acef493-8c52-4f90-911b-1f4395ea4d53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044257 Aug 18 22:02:12.849307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 635/1272] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:12 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:13.328855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-09c3c2af-a197-49e0-a35a-b8458cac537f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:13.331719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-09c3c2af-a197-49e0-a35a-b8458cac537f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:13.337621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09c3c2af-a197-49e0-a35a-b8458cac537f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:13.338091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09c3c2af-a197-49e0-a35a-b8458cac537f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:13.338519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09c3c2af-a197-49e0-a35a-b8458cac537f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:13.339232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09c3c2af-a197-49e0-a35a-b8458cac537f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:13.339712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09c3c2af-a197-49e0-a35a-b8458cac537f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:13.340129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09c3c2af-a197-49e0-a35a-b8458cac537f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:13.367881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-09c3c2af-a197-49e0-a35a-b8458cac537f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043041 Aug 18 22:02:13.368449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 638/1273] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:13 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:13.608391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-12f84c29-c1f0-4e05-9243-8c28edf8c8a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:13.610450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-12f84c29-c1f0-4e05-9243-8c28edf8c8a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:13.613273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:13.618442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12f84c29-c1f0-4e05-9243-8c28edf8c8a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:13.618917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12f84c29-c1f0-4e05-9243-8c28edf8c8a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:13.619356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12f84c29-c1f0-4e05-9243-8c28edf8c8a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:13.620046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12f84c29-c1f0-4e05-9243-8c28edf8c8a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:13.620496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12f84c29-c1f0-4e05-9243-8c28edf8c8a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:13.620919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12f84c29-c1f0-4e05-9243-8c28edf8c8a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:13.649439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-12f84c29-c1f0-4e05-9243-8c28edf8c8a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044953 Aug 18 22:02:13.650011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 636/1274] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:13 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:13.793572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eaeb713e-eaa5-4009-9bc3-46ea9e82796c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:13.795702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eaeb713e-eaa5-4009-9bc3-46ea9e82796c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:13.802742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaeb713e-eaa5-4009-9bc3-46ea9e82796c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:13.803216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaeb713e-eaa5-4009-9bc3-46ea9e82796c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:13.803648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaeb713e-eaa5-4009-9bc3-46ea9e82796c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:13.804367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaeb713e-eaa5-4009-9bc3-46ea9e82796c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:13.804816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaeb713e-eaa5-4009-9bc3-46ea9e82796c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:13.805234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eaeb713e-eaa5-4009-9bc3-46ea9e82796c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:13.835031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eaeb713e-eaa5-4009-9bc3-46ea9e82796c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045335 Aug 18 22:02:13.835588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 639/1275] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:13.861390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-67d50deb-f1a0-4840-97c6-cc5e10223bbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:13.864714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-67d50deb-f1a0-4840-97c6-cc5e10223bbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:13.870566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d50deb-f1a0-4840-97c6-cc5e10223bbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:13.871049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d50deb-f1a0-4840-97c6-cc5e10223bbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:13.871579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d50deb-f1a0-4840-97c6-cc5e10223bbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:13.872168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d50deb-f1a0-4840-97c6-cc5e10223bbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:13.872699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d50deb-f1a0-4840-97c6-cc5e10223bbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:13.873221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d50deb-f1a0-4840-97c6-cc5e10223bbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:13.902082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-67d50deb-f1a0-4840-97c6-cc5e10223bbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045262 Aug 18 22:02:13.902631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 637/1276] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:13 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:14.380293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-753ea910-ddb3-4c04-8fc4-bc9e8e7027ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:14.382466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-753ea910-ddb3-4c04-8fc4-bc9e8e7027ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:14.388429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-753ea910-ddb3-4c04-8fc4-bc9e8e7027ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:14.388913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-753ea910-ddb3-4c04-8fc4-bc9e8e7027ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:14.389351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-753ea910-ddb3-4c04-8fc4-bc9e8e7027ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:14.390084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-753ea910-ddb3-4c04-8fc4-bc9e8e7027ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:14.390546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-753ea910-ddb3-4c04-8fc4-bc9e8e7027ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:14.390973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-753ea910-ddb3-4c04-8fc4-bc9e8e7027ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:14.420107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-753ea910-ddb3-4c04-8fc4-bc9e8e7027ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043854 Aug 18 22:02:14.420650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 640/1277] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:14.661639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-37d0a32e-48af-428c-a7f1-4b7a8a3a55f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:14.663686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-37d0a32e-48af-428c-a7f1-4b7a8a3a55f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:14.670020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37d0a32e-48af-428c-a7f1-4b7a8a3a55f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:14.670498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37d0a32e-48af-428c-a7f1-4b7a8a3a55f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:14.670927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37d0a32e-48af-428c-a7f1-4b7a8a3a55f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:14.671609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37d0a32e-48af-428c-a7f1-4b7a8a3a55f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:14.672054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37d0a32e-48af-428c-a7f1-4b7a8a3a55f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:14.672725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37d0a32e-48af-428c-a7f1-4b7a8a3a55f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:14.701813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-37d0a32e-48af-428c-a7f1-4b7a8a3a55f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Aug 18 22:02:14.702372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 638/1278] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:14.847385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eb2295b6-0cfd-4abe-abd9-93640709bbcc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:14.849521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eb2295b6-0cfd-4abe-abd9-93640709bbcc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:14.855834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb2295b6-0cfd-4abe-abd9-93640709bbcc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:14.856313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb2295b6-0cfd-4abe-abd9-93640709bbcc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:14.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb2295b6-0cfd-4abe-abd9-93640709bbcc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:14.857444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb2295b6-0cfd-4abe-abd9-93640709bbcc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:14.857923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb2295b6-0cfd-4abe-abd9-93640709bbcc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:14.858354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb2295b6-0cfd-4abe-abd9-93640709bbcc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:14.887936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eb2295b6-0cfd-4abe-abd9-93640709bbcc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Aug 18 22:02:14.888492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 641/1279] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:14.914669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a4bae55a-8542-4bdd-adff-0f6ff26f2918 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:14.917298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a4bae55a-8542-4bdd-adff-0f6ff26f2918 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:14.925441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4bae55a-8542-4bdd-adff-0f6ff26f2918 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:14.925957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4bae55a-8542-4bdd-adff-0f6ff26f2918 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:14.926388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4bae55a-8542-4bdd-adff-0f6ff26f2918 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:14.927083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4bae55a-8542-4bdd-adff-0f6ff26f2918 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:14.927537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4bae55a-8542-4bdd-adff-0f6ff26f2918 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:14.927957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4bae55a-8542-4bdd-adff-0f6ff26f2918 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:14.958749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a4bae55a-8542-4bdd-adff-0f6ff26f2918 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048249 Aug 18 22:02:14.959296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 639/1280] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:14 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:15.433125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2ee7656a-c520-472d-b9bd-f262f622879b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:15.435284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2ee7656a-c520-472d-b9bd-f262f622879b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:15.441180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ee7656a-c520-472d-b9bd-f262f622879b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:15.441701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ee7656a-c520-472d-b9bd-f262f622879b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:15.442142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ee7656a-c520-472d-b9bd-f262f622879b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:15.442842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ee7656a-c520-472d-b9bd-f262f622879b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:15.443298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ee7656a-c520-472d-b9bd-f262f622879b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:15.443727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ee7656a-c520-472d-b9bd-f262f622879b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:15.472339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2ee7656a-c520-472d-b9bd-f262f622879b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043375 Aug 18 22:02:15.472896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 642/1281] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:15.714580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7f0da989-7f01-433b-9ce8-03a2834ff52d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:15.716598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7f0da989-7f01-433b-9ce8-03a2834ff52d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:15.723519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f0da989-7f01-433b-9ce8-03a2834ff52d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:15.723994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f0da989-7f01-433b-9ce8-03a2834ff52d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:15.724441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f0da989-7f01-433b-9ce8-03a2834ff52d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:15.725106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f0da989-7f01-433b-9ce8-03a2834ff52d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:15.725550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f0da989-7f01-433b-9ce8-03a2834ff52d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:15.725997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f0da989-7f01-433b-9ce8-03a2834ff52d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:15.754023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7f0da989-7f01-433b-9ce8-03a2834ff52d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043453 Aug 18 22:02:15.754567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 640/1282] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:15 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:15.900422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aa41d7b6-7c16-4e26-b7fa-d110e7508537 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:15.902575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aa41d7b6-7c16-4e26-b7fa-d110e7508537 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:15.909001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa41d7b6-7c16-4e26-b7fa-d110e7508537 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:15.909474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa41d7b6-7c16-4e26-b7fa-d110e7508537 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:15.909934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa41d7b6-7c16-4e26-b7fa-d110e7508537 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:15.910624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa41d7b6-7c16-4e26-b7fa-d110e7508537 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:15.911071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa41d7b6-7c16-4e26-b7fa-d110e7508537 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:15.911492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa41d7b6-7c16-4e26-b7fa-d110e7508537 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:15.913808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:15.941916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aa41d7b6-7c16-4e26-b7fa-d110e7508537 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045416 Aug 18 22:02:15.942480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 643/1283] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:15 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:15.971583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e3973643-8bf5-419a-b220-a5aa9e946c9f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:15.974174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e3973643-8bf5-419a-b220-a5aa9e946c9f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:15.980240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3973643-8bf5-419a-b220-a5aa9e946c9f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:15.980726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3973643-8bf5-419a-b220-a5aa9e946c9f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:15.981166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3973643-8bf5-419a-b220-a5aa9e946c9f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:15.981891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3973643-8bf5-419a-b220-a5aa9e946c9f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:15.982354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3973643-8bf5-419a-b220-a5aa9e946c9f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:15.982784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3973643-8bf5-419a-b220-a5aa9e946c9f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:16.011470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e3973643-8bf5-419a-b220-a5aa9e946c9f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Aug 18 22:02:16.012034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 641/1284] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:15 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:16.484363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dd499ce8-45c1-42f9-ac41-6ab438e171f5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:16.487005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dd499ce8-45c1-42f9-ac41-6ab438e171f5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:16.493292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd499ce8-45c1-42f9-ac41-6ab438e171f5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:16.493810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd499ce8-45c1-42f9-ac41-6ab438e171f5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:16.494241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd499ce8-45c1-42f9-ac41-6ab438e171f5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:16.494925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd499ce8-45c1-42f9-ac41-6ab438e171f5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:16.495372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd499ce8-45c1-42f9-ac41-6ab438e171f5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:16.495821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd499ce8-45c1-42f9-ac41-6ab438e171f5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:16.524313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dd499ce8-45c1-42f9-ac41-6ab438e171f5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043914 Aug 18 22:02:16.524859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 644/1285] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:16.767366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bc4eeb4f-0479-4763-aeda-42f75d10a897 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:16.769411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bc4eeb4f-0479-4763-aeda-42f75d10a897 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:16.775818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc4eeb4f-0479-4763-aeda-42f75d10a897 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:16.776291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc4eeb4f-0479-4763-aeda-42f75d10a897 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:16.776723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc4eeb4f-0479-4763-aeda-42f75d10a897 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:16.777410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc4eeb4f-0479-4763-aeda-42f75d10a897 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:16.777887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc4eeb4f-0479-4763-aeda-42f75d10a897 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:16.778320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc4eeb4f-0479-4763-aeda-42f75d10a897 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:16.808440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bc4eeb4f-0479-4763-aeda-42f75d10a897 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045044 Aug 18 22:02:16.808993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 642/1286] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:16.954325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1e780ad4-8962-4738-8ded-db34492c3927 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:16.956498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1e780ad4-8962-4738-8ded-db34492c3927 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:16.962351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e780ad4-8962-4738-8ded-db34492c3927 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:16.962819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e780ad4-8962-4738-8ded-db34492c3927 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:16.963253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e780ad4-8962-4738-8ded-db34492c3927 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:16.963933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e780ad4-8962-4738-8ded-db34492c3927 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:16.964382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e780ad4-8962-4738-8ded-db34492c3927 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:16.964799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e780ad4-8962-4738-8ded-db34492c3927 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:16.995173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1e780ad4-8962-4738-8ded-db34492c3927 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Aug 18 22:02:16.995741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 645/1287] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:16 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:17.023867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7320f83f-257b-4a08-befa-8b0dfa21e72b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:17.035417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7320f83f-257b-4a08-befa-8b0dfa21e72b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:17.041457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7320f83f-257b-4a08-befa-8b0dfa21e72b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:17.041976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7320f83f-257b-4a08-befa-8b0dfa21e72b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:17.042468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7320f83f-257b-4a08-befa-8b0dfa21e72b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:17.043121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7320f83f-257b-4a08-befa-8b0dfa21e72b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:17.043572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7320f83f-257b-4a08-befa-8b0dfa21e72b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:17.044000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7320f83f-257b-4a08-befa-8b0dfa21e72b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:17.048120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:17.073955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7320f83f-257b-4a08-befa-8b0dfa21e72b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053799 Aug 18 22:02:17.074513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 643/1288] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:17 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:17.537119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c5bc227-3709-448d-9cf0-91f8da64e5a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:17.539325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c5bc227-3709-448d-9cf0-91f8da64e5a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:17.546813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c5bc227-3709-448d-9cf0-91f8da64e5a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:17.547751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c5bc227-3709-448d-9cf0-91f8da64e5a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:17.548993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c5bc227-3709-448d-9cf0-91f8da64e5a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:17.549746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c5bc227-3709-448d-9cf0-91f8da64e5a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:17.550235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c5bc227-3709-448d-9cf0-91f8da64e5a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:17.550849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c5bc227-3709-448d-9cf0-91f8da64e5a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:17.581604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c5bc227-3709-448d-9cf0-91f8da64e5a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049160 Aug 18 22:02:17.582171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 646/1289] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:17.821082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-558a2225-4cee-4226-93a5-6f0ffa0ad2a9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:17.823153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-558a2225-4cee-4226-93a5-6f0ffa0ad2a9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:17.829490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-558a2225-4cee-4226-93a5-6f0ffa0ad2a9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:17.830566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-558a2225-4cee-4226-93a5-6f0ffa0ad2a9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:17.831002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-558a2225-4cee-4226-93a5-6f0ffa0ad2a9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:17.831693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-558a2225-4cee-4226-93a5-6f0ffa0ad2a9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:17.832144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-558a2225-4cee-4226-93a5-6f0ffa0ad2a9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:17.832575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-558a2225-4cee-4226-93a5-6f0ffa0ad2a9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:17.860299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-558a2225-4cee-4226-93a5-6f0ffa0ad2a9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043235 Aug 18 22:02:17.860814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 644/1290] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:18.007176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d0aa3f6-c765-4b13-a02c-5a21a56e9df9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:18.009309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7d0aa3f6-c765-4b13-a02c-5a21a56e9df9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:18.015179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d0aa3f6-c765-4b13-a02c-5a21a56e9df9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:18.015681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d0aa3f6-c765-4b13-a02c-5a21a56e9df9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:18.016116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d0aa3f6-c765-4b13-a02c-5a21a56e9df9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:18.016805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d0aa3f6-c765-4b13-a02c-5a21a56e9df9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:18.017258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d0aa3f6-c765-4b13-a02c-5a21a56e9df9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:18.017710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d0aa3f6-c765-4b13-a02c-5a21a56e9df9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:18.046145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d0aa3f6-c765-4b13-a02c-5a21a56e9df9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042804 Aug 18 22:02:18.046690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 647/1291] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:18 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:18.086425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f339ef37-066d-4e4b-b0ae-57d4c1d67bc9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:18.088854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f339ef37-066d-4e4b-b0ae-57d4c1d67bc9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:18.095187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f339ef37-066d-4e4b-b0ae-57d4c1d67bc9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:18.096257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f339ef37-066d-4e4b-b0ae-57d4c1d67bc9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:18.096447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f339ef37-066d-4e4b-b0ae-57d4c1d67bc9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:18.098240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f339ef37-066d-4e4b-b0ae-57d4c1d67bc9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:18.098837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f339ef37-066d-4e4b-b0ae-57d4c1d67bc9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:18.099266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f339ef37-066d-4e4b-b0ae-57d4c1d67bc9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:18.132417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f339ef37-066d-4e4b-b0ae-57d4c1d67bc9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050036 Aug 18 22:02:18.132986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 645/1292] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:18 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:18.594001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-86d5b881-20b0-4b3f-8d46-6c7a9d050035 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:18.596782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-86d5b881-20b0-4b3f-8d46-6c7a9d050035 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:18.603142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86d5b881-20b0-4b3f-8d46-6c7a9d050035 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:18.603615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86d5b881-20b0-4b3f-8d46-6c7a9d050035 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:18.604046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86d5b881-20b0-4b3f-8d46-6c7a9d050035 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:18.604738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86d5b881-20b0-4b3f-8d46-6c7a9d050035 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:18.605190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86d5b881-20b0-4b3f-8d46-6c7a9d050035 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:18.605629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86d5b881-20b0-4b3f-8d46-6c7a9d050035 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:18.636401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-86d5b881-20b0-4b3f-8d46-6c7a9d050035 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046402 Aug 18 22:02:18.636958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 648/1293] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:18 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:18.872468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-98ff7c57-d7a3-442a-8f21-1dde7d7f5b81 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:18.874581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-98ff7c57-d7a3-442a-8f21-1dde7d7f5b81 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:18.880984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98ff7c57-d7a3-442a-8f21-1dde7d7f5b81 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:18.881464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98ff7c57-d7a3-442a-8f21-1dde7d7f5b81 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:18.881927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98ff7c57-d7a3-442a-8f21-1dde7d7f5b81 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:18.882615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98ff7c57-d7a3-442a-8f21-1dde7d7f5b81 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:18.883068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98ff7c57-d7a3-442a-8f21-1dde7d7f5b81 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:18.883493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98ff7c57-d7a3-442a-8f21-1dde7d7f5b81 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:18.912962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-98ff7c57-d7a3-442a-8f21-1dde7d7f5b81 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Aug 18 22:02:18.913510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 646/1294] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:19.059123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-21baba3c-4357-48a1-9d35-b3893ab68ec2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:19.061264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-21baba3c-4357-48a1-9d35-b3893ab68ec2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:19.067307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21baba3c-4357-48a1-9d35-b3893ab68ec2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:19.067782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21baba3c-4357-48a1-9d35-b3893ab68ec2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:19.068216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21baba3c-4357-48a1-9d35-b3893ab68ec2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:19.068907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21baba3c-4357-48a1-9d35-b3893ab68ec2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:19.069358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21baba3c-4357-48a1-9d35-b3893ab68ec2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:19.069835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21baba3c-4357-48a1-9d35-b3893ab68ec2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:19.099152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-21baba3c-4357-48a1-9d35-b3893ab68ec2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043935 Aug 18 22:02:19.099708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 649/1295] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:19 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:19.146302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-65db308a-ab50-4b46-877d-7c9c4305d2a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:19.148504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-65db308a-ab50-4b46-877d-7c9c4305d2a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:19.155314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65db308a-ab50-4b46-877d-7c9c4305d2a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:19.155867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65db308a-ab50-4b46-877d-7c9c4305d2a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:19.156309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65db308a-ab50-4b46-877d-7c9c4305d2a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:19.157017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65db308a-ab50-4b46-877d-7c9c4305d2a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:19.157467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65db308a-ab50-4b46-877d-7c9c4305d2a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:19.158106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65db308a-ab50-4b46-877d-7c9c4305d2a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:19.338324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-65db308a-ab50-4b46-877d-7c9c4305d2a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197153 Aug 18 22:02:19.338924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 647/1296] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:19 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:19.649005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-909eb4fa-85a5-427e-a418-ebf36397e2d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:19.651310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-909eb4fa-85a5-427e-a418-ebf36397e2d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:19.657902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-909eb4fa-85a5-427e-a418-ebf36397e2d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:19.658384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-909eb4fa-85a5-427e-a418-ebf36397e2d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:19.658820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-909eb4fa-85a5-427e-a418-ebf36397e2d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:19.659523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-909eb4fa-85a5-427e-a418-ebf36397e2d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:19.659973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-909eb4fa-85a5-427e-a418-ebf36397e2d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:19.660395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-909eb4fa-85a5-427e-a418-ebf36397e2d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:19.692535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-909eb4fa-85a5-427e-a418-ebf36397e2d9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047823 Aug 18 22:02:19.693125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 650/1297] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:19.925449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d446aa5e-464d-4154-9017-f000196d4509 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:19.927491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d446aa5e-464d-4154-9017-f000196d4509 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:19.933964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d446aa5e-464d-4154-9017-f000196d4509 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:19.934453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d446aa5e-464d-4154-9017-f000196d4509 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:19.934893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d446aa5e-464d-4154-9017-f000196d4509 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:19.935592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d446aa5e-464d-4154-9017-f000196d4509 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:19.936052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d446aa5e-464d-4154-9017-f000196d4509 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:19.936485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d446aa5e-464d-4154-9017-f000196d4509 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:19.964566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d446aa5e-464d-4154-9017-f000196d4509 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Aug 18 22:02:19.965139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 648/1298] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:19 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:20.111101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b5a299a4-ff24-4c89-ae46-54731eaa43bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:20.113926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b5a299a4-ff24-4c89-ae46-54731eaa43bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:20.119888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5a299a4-ff24-4c89-ae46-54731eaa43bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:20.120361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5a299a4-ff24-4c89-ae46-54731eaa43bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:20.120790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5a299a4-ff24-4c89-ae46-54731eaa43bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:20.121505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5a299a4-ff24-4c89-ae46-54731eaa43bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:20.121985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5a299a4-ff24-4c89-ae46-54731eaa43bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:20.122404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5a299a4-ff24-4c89-ae46-54731eaa43bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:20.150502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b5a299a4-ff24-4c89-ae46-54731eaa43bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043354 Aug 18 22:02:20.151050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 651/1299] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:20.351177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-538219c8-668c-4215-9fce-72f5c8467137 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:20.353274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-538219c8-668c-4215-9fce-72f5c8467137 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:20.359118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-538219c8-668c-4215-9fce-72f5c8467137 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:20.359594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-538219c8-668c-4215-9fce-72f5c8467137 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:20.360052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-538219c8-668c-4215-9fce-72f5c8467137 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:20.360776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-538219c8-668c-4215-9fce-72f5c8467137 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:20.361223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-538219c8-668c-4215-9fce-72f5c8467137 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:20.361669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-538219c8-668c-4215-9fce-72f5c8467137 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:20.390272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-538219c8-668c-4215-9fce-72f5c8467137 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042901 Aug 18 22:02:20.390815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 649/1300] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:20 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:20.704529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-68c19f3e-b69b-413d-83bd-1de3d4255aa6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:20.707222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-68c19f3e-b69b-413d-83bd-1de3d4255aa6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:20.713715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68c19f3e-b69b-413d-83bd-1de3d4255aa6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:20.714204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68c19f3e-b69b-413d-83bd-1de3d4255aa6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:20.714639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68c19f3e-b69b-413d-83bd-1de3d4255aa6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:20.715350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68c19f3e-b69b-413d-83bd-1de3d4255aa6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:20.715829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68c19f3e-b69b-413d-83bd-1de3d4255aa6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:20.716255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68c19f3e-b69b-413d-83bd-1de3d4255aa6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:20.745316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-68c19f3e-b69b-413d-83bd-1de3d4255aa6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044826 Aug 18 22:02:20.745920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 652/1301] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:20 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:20.977031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-61a30da4-3eb4-4280-b78c-dc71f508325f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:20.979141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-61a30da4-3eb4-4280-b78c-dc71f508325f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:20.986219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61a30da4-3eb4-4280-b78c-dc71f508325f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:20.986806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61a30da4-3eb4-4280-b78c-dc71f508325f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:20.987190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61a30da4-3eb4-4280-b78c-dc71f508325f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:20.987894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61a30da4-3eb4-4280-b78c-dc71f508325f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:20.988358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61a30da4-3eb4-4280-b78c-dc71f508325f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:20.988800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61a30da4-3eb4-4280-b78c-dc71f508325f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:21.017909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-61a30da4-3eb4-4280-b78c-dc71f508325f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 Aug 18 22:02:21.018461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 650/1302] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:20 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:21.163329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5048041b-293e-477c-b330-ca4a0a37beeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:21.165512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5048041b-293e-477c-b330-ca4a0a37beeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:21.171354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5048041b-293e-477c-b330-ca4a0a37beeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:21.171828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5048041b-293e-477c-b330-ca4a0a37beeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:21.172276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5048041b-293e-477c-b330-ca4a0a37beeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:21.173727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5048041b-293e-477c-b330-ca4a0a37beeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:21.174162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5048041b-293e-477c-b330-ca4a0a37beeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:21.174580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5048041b-293e-477c-b330-ca4a0a37beeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:21.203009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5048041b-293e-477c-b330-ca4a0a37beeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Aug 18 22:02:21.203552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 653/1303] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:21.402977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eff72000-ed8e-4561-8513-b05c98aa3051 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:21.405101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eff72000-ed8e-4561-8513-b05c98aa3051 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:21.411569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff72000-ed8e-4561-8513-b05c98aa3051 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:21.412052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff72000-ed8e-4561-8513-b05c98aa3051 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:21.412491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff72000-ed8e-4561-8513-b05c98aa3051 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:21.413184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff72000-ed8e-4561-8513-b05c98aa3051 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:21.413669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff72000-ed8e-4561-8513-b05c98aa3051 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:21.414105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff72000-ed8e-4561-8513-b05c98aa3051 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:21.443620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eff72000-ed8e-4561-8513-b05c98aa3051 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044672 Aug 18 22:02:21.444166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 651/1304] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:21 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:21.756822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-01e12a69-6ed0-4cf5-8566-deb72db7ad8b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:21.758993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-01e12a69-6ed0-4cf5-8566-deb72db7ad8b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:21.761362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:21.766456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01e12a69-6ed0-4cf5-8566-deb72db7ad8b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:21.767407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01e12a69-6ed0-4cf5-8566-deb72db7ad8b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:21.767846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01e12a69-6ed0-4cf5-8566-deb72db7ad8b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:21.768541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01e12a69-6ed0-4cf5-8566-deb72db7ad8b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:21.768987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01e12a69-6ed0-4cf5-8566-deb72db7ad8b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:21.769405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01e12a69-6ed0-4cf5-8566-deb72db7ad8b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:21.799425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-01e12a69-6ed0-4cf5-8566-deb72db7ad8b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046548 Aug 18 22:02:21.799984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 654/1305] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:22.029511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7f78a4f0-feca-4161-bc60-6564fc69a73a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:22.031781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7f78a4f0-feca-4161-bc60-6564fc69a73a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:22.039304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f78a4f0-feca-4161-bc60-6564fc69a73a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:22.039783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f78a4f0-feca-4161-bc60-6564fc69a73a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:22.040219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f78a4f0-feca-4161-bc60-6564fc69a73a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:22.040921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f78a4f0-feca-4161-bc60-6564fc69a73a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:22.041422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f78a4f0-feca-4161-bc60-6564fc69a73a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:22.041870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7f78a4f0-feca-4161-bc60-6564fc69a73a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:22.070046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7f78a4f0-feca-4161-bc60-6564fc69a73a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Aug 18 22:02:22.070596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 652/1306] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:22 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:22.215360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-53ffd2fd-42e0-43af-aad4-4da87f70f086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:22.217515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-53ffd2fd-42e0-43af-aad4-4da87f70f086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:22.223450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ffd2fd-42e0-43af-aad4-4da87f70f086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:22.223932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ffd2fd-42e0-43af-aad4-4da87f70f086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:22.224371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ffd2fd-42e0-43af-aad4-4da87f70f086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:22.225064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ffd2fd-42e0-43af-aad4-4da87f70f086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:22.225520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ffd2fd-42e0-43af-aad4-4da87f70f086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:22.225974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53ffd2fd-42e0-43af-aad4-4da87f70f086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:22.255129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-53ffd2fd-42e0-43af-aad4-4da87f70f086 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043803 Aug 18 22:02:22.255677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 655/1307] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:22 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:22.456468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dc6ab571-a34f-4c69-b4bc-d7051b6b9e34 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:22.458655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dc6ab571-a34f-4c69-b4bc-d7051b6b9e34 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:22.464574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6ab571-a34f-4c69-b4bc-d7051b6b9e34 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:22.465050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6ab571-a34f-4c69-b4bc-d7051b6b9e34 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:22.465483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6ab571-a34f-4c69-b4bc-d7051b6b9e34 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:22.466198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6ab571-a34f-4c69-b4bc-d7051b6b9e34 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:22.466651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6ab571-a34f-4c69-b4bc-d7051b6b9e34 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:22.467079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6ab571-a34f-4c69-b4bc-d7051b6b9e34 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:22.496753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dc6ab571-a34f-4c69-b4bc-d7051b6b9e34 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Aug 18 22:02:22.497298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 653/1308] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:22.810932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-639266d5-8dc5-429d-b723-898a8e0adf49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:22.813127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-639266d5-8dc5-429d-b723-898a8e0adf49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:22.820151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-639266d5-8dc5-429d-b723-898a8e0adf49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:22.820623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-639266d5-8dc5-429d-b723-898a8e0adf49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:22.821056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-639266d5-8dc5-429d-b723-898a8e0adf49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:22.821778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-639266d5-8dc5-429d-b723-898a8e0adf49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:22.822226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-639266d5-8dc5-429d-b723-898a8e0adf49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:22.822648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-639266d5-8dc5-429d-b723-898a8e0adf49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:22.850909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-639266d5-8dc5-429d-b723-898a8e0adf49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043918 Aug 18 22:02:22.851457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 656/1309] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:23.082385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-60282ae3-3f78-4a99-ab7e-f487f4cdff75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:23.084543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-60282ae3-3f78-4a99-ab7e-f487f4cdff75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:23.091100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60282ae3-3f78-4a99-ab7e-f487f4cdff75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:23.091584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60282ae3-3f78-4a99-ab7e-f487f4cdff75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:23.092025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60282ae3-3f78-4a99-ab7e-f487f4cdff75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:23.092726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60282ae3-3f78-4a99-ab7e-f487f4cdff75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:23.093180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60282ae3-3f78-4a99-ab7e-f487f4cdff75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:23.093615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60282ae3-3f78-4a99-ab7e-f487f4cdff75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:23.122726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-60282ae3-3f78-4a99-ab7e-f487f4cdff75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044307 Aug 18 22:02:23.123308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 654/1310] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:23 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:23.268015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-22f67ee6-fa75-4dfa-a5ed-e526959efda1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:23.270192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-22f67ee6-fa75-4dfa-a5ed-e526959efda1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:23.276110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22f67ee6-fa75-4dfa-a5ed-e526959efda1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:23.276590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22f67ee6-fa75-4dfa-a5ed-e526959efda1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:23.277024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22f67ee6-fa75-4dfa-a5ed-e526959efda1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:23.277746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22f67ee6-fa75-4dfa-a5ed-e526959efda1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:23.278202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22f67ee6-fa75-4dfa-a5ed-e526959efda1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:23.278663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22f67ee6-fa75-4dfa-a5ed-e526959efda1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:23.307810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-22f67ee6-fa75-4dfa-a5ed-e526959efda1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Aug 18 22:02:23.308361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 657/1311] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:23 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:23.508862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bac278b7-6263-44ad-bb12-53319b25ff26 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:23.511045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bac278b7-6263-44ad-bb12-53319b25ff26 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:23.517493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bac278b7-6263-44ad-bb12-53319b25ff26 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:23.518007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bac278b7-6263-44ad-bb12-53319b25ff26 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:23.518447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bac278b7-6263-44ad-bb12-53319b25ff26 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:23.519142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bac278b7-6263-44ad-bb12-53319b25ff26 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:23.519601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bac278b7-6263-44ad-bb12-53319b25ff26 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:23.520032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bac278b7-6263-44ad-bb12-53319b25ff26 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:23.549259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bac278b7-6263-44ad-bb12-53319b25ff26 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044379 Aug 18 22:02:23.549840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 655/1312] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:23 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:23.863124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-92250583-a95e-41ee-81c9-b4d4c1f6838d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:23.865287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-92250583-a95e-41ee-81c9-b4d4c1f6838d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:23.872095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92250583-a95e-41ee-81c9-b4d4c1f6838d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:23.872584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92250583-a95e-41ee-81c9-b4d4c1f6838d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:23.873022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92250583-a95e-41ee-81c9-b4d4c1f6838d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:23.873754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92250583-a95e-41ee-81c9-b4d4c1f6838d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:23.874213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92250583-a95e-41ee-81c9-b4d4c1f6838d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:23.874642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92250583-a95e-41ee-81c9-b4d4c1f6838d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:23.903932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-92250583-a95e-41ee-81c9-b4d4c1f6838d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044799 Aug 18 22:02:23.904478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 658/1313] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:24.136982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3b951422-1e30-4a7b-ad2c-5b33c574c95b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:24.139132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3b951422-1e30-4a7b-ad2c-5b33c574c95b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:24.145559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b951422-1e30-4a7b-ad2c-5b33c574c95b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:24.146076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b951422-1e30-4a7b-ad2c-5b33c574c95b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:24.146512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b951422-1e30-4a7b-ad2c-5b33c574c95b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:24.147207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b951422-1e30-4a7b-ad2c-5b33c574c95b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:24.147663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b951422-1e30-4a7b-ad2c-5b33c574c95b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:24.148092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b951422-1e30-4a7b-ad2c-5b33c574c95b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:24.176798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3b951422-1e30-4a7b-ad2c-5b33c574c95b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043754 Aug 18 22:02:24.177346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 656/1314] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:24.320638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6672b0f9-9911-49a3-a110-f9fa6aecd6a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:24.322930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6672b0f9-9911-49a3-a110-f9fa6aecd6a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:24.328833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6672b0f9-9911-49a3-a110-f9fa6aecd6a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:24.329305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6672b0f9-9911-49a3-a110-f9fa6aecd6a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:24.329774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6672b0f9-9911-49a3-a110-f9fa6aecd6a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:24.330456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6672b0f9-9911-49a3-a110-f9fa6aecd6a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:24.330901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6672b0f9-9911-49a3-a110-f9fa6aecd6a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:24.331324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6672b0f9-9911-49a3-a110-f9fa6aecd6a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:24.354910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:24.361187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6672b0f9-9911-49a3-a110-f9fa6aecd6a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 Aug 18 22:02:24.361415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 659/1315] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:24 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:24.561354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-34eee088-5e5f-4248-afe5-b2ab5ed748de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:24.563535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-34eee088-5e5f-4248-afe5-b2ab5ed748de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:24.569496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-34eee088-5e5f-4248-afe5-b2ab5ed748de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:24.570011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-34eee088-5e5f-4248-afe5-b2ab5ed748de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:24.570454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-34eee088-5e5f-4248-afe5-b2ab5ed748de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:24.571140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-34eee088-5e5f-4248-afe5-b2ab5ed748de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:24.571598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-34eee088-5e5f-4248-afe5-b2ab5ed748de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:24.572026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-34eee088-5e5f-4248-afe5-b2ab5ed748de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:24.600605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-34eee088-5e5f-4248-afe5-b2ab5ed748de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043161 Aug 18 22:02:24.601153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 657/1316] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:24 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:24.916419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c27003af-0abd-4f7c-b78e-529aa5d19671 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:24.918575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c27003af-0abd-4f7c-b78e-529aa5d19671 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:24.925517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c27003af-0abd-4f7c-b78e-529aa5d19671 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:24.926027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c27003af-0abd-4f7c-b78e-529aa5d19671 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:24.926462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c27003af-0abd-4f7c-b78e-529aa5d19671 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:24.927154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c27003af-0abd-4f7c-b78e-529aa5d19671 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:24.927606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c27003af-0abd-4f7c-b78e-529aa5d19671 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:24.928029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c27003af-0abd-4f7c-b78e-529aa5d19671 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:24.957106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c27003af-0abd-4f7c-b78e-529aa5d19671 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044600 Aug 18 22:02:24.957590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 660/1317] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:24 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:25.189359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5ea7352a-7079-48f6-b0df-132c60389961 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:25.191525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5ea7352a-7079-48f6-b0df-132c60389961 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:25.197948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ea7352a-7079-48f6-b0df-132c60389961 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:25.198430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ea7352a-7079-48f6-b0df-132c60389961 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:25.198868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ea7352a-7079-48f6-b0df-132c60389961 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:25.199557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ea7352a-7079-48f6-b0df-132c60389961 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:25.200015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ea7352a-7079-48f6-b0df-132c60389961 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:25.200440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ea7352a-7079-48f6-b0df-132c60389961 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:25.229301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5ea7352a-7079-48f6-b0df-132c60389961 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Aug 18 22:02:25.229801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 658/1318] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:25 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:25.372156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb7206ce-7d93-48dd-b6bc-e91c101710da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:25.374370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fb7206ce-7d93-48dd-b6bc-e91c101710da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:25.380780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb7206ce-7d93-48dd-b6bc-e91c101710da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:25.381258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb7206ce-7d93-48dd-b6bc-e91c101710da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:25.381730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb7206ce-7d93-48dd-b6bc-e91c101710da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:25.382420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb7206ce-7d93-48dd-b6bc-e91c101710da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:25.382872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb7206ce-7d93-48dd-b6bc-e91c101710da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:25.383296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb7206ce-7d93-48dd-b6bc-e91c101710da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:25.411897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fb7206ce-7d93-48dd-b6bc-e91c101710da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Aug 18 22:02:25.412448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 661/1319] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:25 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:25.612611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8725ba5c-338f-4c0e-908a-1f609163056b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:25.614768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8725ba5c-338f-4c0e-908a-1f609163056b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:25.620715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8725ba5c-338f-4c0e-908a-1f609163056b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:25.621195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8725ba5c-338f-4c0e-908a-1f609163056b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:25.621653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8725ba5c-338f-4c0e-908a-1f609163056b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:25.622343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8725ba5c-338f-4c0e-908a-1f609163056b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:25.622796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8725ba5c-338f-4c0e-908a-1f609163056b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:25.623219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8725ba5c-338f-4c0e-908a-1f609163056b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:25.647967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:25.653504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8725ba5c-338f-4c0e-908a-1f609163056b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045335 Aug 18 22:02:25.654092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 659/1320] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:25.969530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4409518e-0320-4c29-9069-766ee408723d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:25.972235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4409518e-0320-4c29-9069-766ee408723d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:25.978218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4409518e-0320-4c29-9069-766ee408723d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:25.978693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4409518e-0320-4c29-9069-766ee408723d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:25.979130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4409518e-0320-4c29-9069-766ee408723d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:25.979821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4409518e-0320-4c29-9069-766ee408723d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:25.980271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4409518e-0320-4c29-9069-766ee408723d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:25.980695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4409518e-0320-4c29-9069-766ee408723d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:26.009609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4409518e-0320-4c29-9069-766ee408723d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044026 Aug 18 22:02:26.010180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 662/1321] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:25 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:26.242155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-86736d1f-736b-421c-8d75-4b15453d2bb6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:26.244176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-86736d1f-736b-421c-8d75-4b15453d2bb6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:26.250564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86736d1f-736b-421c-8d75-4b15453d2bb6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:26.251040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86736d1f-736b-421c-8d75-4b15453d2bb6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:26.251472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86736d1f-736b-421c-8d75-4b15453d2bb6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:26.252159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86736d1f-736b-421c-8d75-4b15453d2bb6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:26.252607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86736d1f-736b-421c-8d75-4b15453d2bb6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:26.253028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86736d1f-736b-421c-8d75-4b15453d2bb6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:26.281000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-86736d1f-736b-421c-8d75-4b15453d2bb6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042951 Aug 18 22:02:26.281545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 660/1322] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:26 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:26.424146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2896ba5c-5885-4733-99f2-181e08e1a269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:26.426313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2896ba5c-5885-4733-99f2-181e08e1a269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:26.432120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2896ba5c-5885-4733-99f2-181e08e1a269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:26.432586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2896ba5c-5885-4733-99f2-181e08e1a269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:26.433012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2896ba5c-5885-4733-99f2-181e08e1a269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:26.433736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2896ba5c-5885-4733-99f2-181e08e1a269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:26.434184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2896ba5c-5885-4733-99f2-181e08e1a269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:26.434603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2896ba5c-5885-4733-99f2-181e08e1a269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:26.462904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2896ba5c-5885-4733-99f2-181e08e1a269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043035 Aug 18 22:02:26.463442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 663/1323] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:26 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:02:26.665896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-47d319ed-fae5-4c1b-b233-3b6bca08c375 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:26.668079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-47d319ed-fae5-4c1b-b233-3b6bca08c375 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:26.674243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d319ed-fae5-4c1b-b233-3b6bca08c375 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:26.674723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d319ed-fae5-4c1b-b233-3b6bca08c375 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:26.675156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d319ed-fae5-4c1b-b233-3b6bca08c375 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:26.675848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d319ed-fae5-4c1b-b233-3b6bca08c375 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:26.676303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d319ed-fae5-4c1b-b233-3b6bca08c375 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:26.676730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d319ed-fae5-4c1b-b233-3b6bca08c375 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:26.706736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-47d319ed-fae5-4c1b-b233-3b6bca08c375 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044750 Aug 18 22:02:26.707295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 661/1324] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:26 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:27.022216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7130934c-860e-43f8-bb99-29421e3abea5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:27.024338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7130934c-860e-43f8-bb99-29421e3abea5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:27.030870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7130934c-860e-43f8-bb99-29421e3abea5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:27.031342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7130934c-860e-43f8-bb99-29421e3abea5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:27.031775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7130934c-860e-43f8-bb99-29421e3abea5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:27.032480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7130934c-860e-43f8-bb99-29421e3abea5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:27.033015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7130934c-860e-43f8-bb99-29421e3abea5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:27.033441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7130934c-860e-43f8-bb99-29421e3abea5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:27.062909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7130934c-860e-43f8-bb99-29421e3abea5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044616 Aug 18 22:02:27.063442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 664/1325] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:27 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:27.293795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ceee9a79-ec7a-486b-a005-bd0136d0f91e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:27.295905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ceee9a79-ec7a-486b-a005-bd0136d0f91e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:27.303009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ceee9a79-ec7a-486b-a005-bd0136d0f91e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:27.303492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ceee9a79-ec7a-486b-a005-bd0136d0f91e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:27.303925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ceee9a79-ec7a-486b-a005-bd0136d0f91e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:27.304606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ceee9a79-ec7a-486b-a005-bd0136d0f91e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:27.305052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ceee9a79-ec7a-486b-a005-bd0136d0f91e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:27.305473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ceee9a79-ec7a-486b-a005-bd0136d0f91e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:27.333717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ceee9a79-ec7a-486b-a005-bd0136d0f91e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043790 Aug 18 22:02:27.334198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 662/1326] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:27 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:27.475664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-53c90951-8681-4b4f-857a-76be32d20e63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:27.477912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-53c90951-8681-4b4f-857a-76be32d20e63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:27.483803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53c90951-8681-4b4f-857a-76be32d20e63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:27.484286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53c90951-8681-4b4f-857a-76be32d20e63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:27.484725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53c90951-8681-4b4f-857a-76be32d20e63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:27.485514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53c90951-8681-4b4f-857a-76be32d20e63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:27.486567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53c90951-8681-4b4f-857a-76be32d20e63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:27.486996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53c90951-8681-4b4f-857a-76be32d20e63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:27.515479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-53c90951-8681-4b4f-857a-76be32d20e63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043788 Aug 18 22:02:27.516034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 665/1327] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:27 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:27.718947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2af528b4-766f-47fd-a349-f1ea2e182627 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:27.721535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2af528b4-766f-47fd-a349-f1ea2e182627 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:27.727496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2af528b4-766f-47fd-a349-f1ea2e182627 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:27.727988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2af528b4-766f-47fd-a349-f1ea2e182627 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:27.728437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2af528b4-766f-47fd-a349-f1ea2e182627 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:27.729138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2af528b4-766f-47fd-a349-f1ea2e182627 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:27.729627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2af528b4-766f-47fd-a349-f1ea2e182627 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:27.730062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2af528b4-766f-47fd-a349-f1ea2e182627 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:27.768681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2af528b4-766f-47fd-a349-f1ea2e182627 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053639 Aug 18 22:02:27.769443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 663/1328] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:28.075090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7f4302bd-03ba-4638-8bff-38fc89620116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:28.077270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7f4302bd-03ba-4638-8bff-38fc89620116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:28.084712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f4302bd-03ba-4638-8bff-38fc89620116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:28.085181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f4302bd-03ba-4638-8bff-38fc89620116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:28.085640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f4302bd-03ba-4638-8bff-38fc89620116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:28.086330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f4302bd-03ba-4638-8bff-38fc89620116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:28.086777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f4302bd-03ba-4638-8bff-38fc89620116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:28.087205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f4302bd-03ba-4638-8bff-38fc89620116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:28.116651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7f4302bd-03ba-4638-8bff-38fc89620116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045563 Aug 18 22:02:28.117206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 666/1329] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:28.345953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a39ead5a-ebda-43fc-8f17-1a61ecff50d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:28.348002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a39ead5a-ebda-43fc-8f17-1a61ecff50d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:28.354308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a39ead5a-ebda-43fc-8f17-1a61ecff50d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:28.354793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a39ead5a-ebda-43fc-8f17-1a61ecff50d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:28.355239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a39ead5a-ebda-43fc-8f17-1a61ecff50d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:28.355935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a39ead5a-ebda-43fc-8f17-1a61ecff50d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:28.356394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a39ead5a-ebda-43fc-8f17-1a61ecff50d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:28.356824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a39ead5a-ebda-43fc-8f17-1a61ecff50d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:28.385157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a39ead5a-ebda-43fc-8f17-1a61ecff50d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043282 Aug 18 22:02:28.385735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 664/1330] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:28 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:28.527233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-855afeee-5761-4270-8733-b8b31ccc2aa4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:28.529357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-855afeee-5761-4270-8733-b8b31ccc2aa4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:28.535279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-855afeee-5761-4270-8733-b8b31ccc2aa4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:28.535762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-855afeee-5761-4270-8733-b8b31ccc2aa4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:28.536196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-855afeee-5761-4270-8733-b8b31ccc2aa4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:28.536892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-855afeee-5761-4270-8733-b8b31ccc2aa4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:28.537350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-855afeee-5761-4270-8733-b8b31ccc2aa4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:28.537818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-855afeee-5761-4270-8733-b8b31ccc2aa4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:28.568673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-855afeee-5761-4270-8733-b8b31ccc2aa4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045368 Aug 18 22:02:28.569228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 667/1331] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:28 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:28.780448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1a6b560d-d434-4a2c-bd4e-5a00cce65668 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:28.782619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1a6b560d-d434-4a2c-bd4e-5a00cce65668 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:28.788561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a6b560d-d434-4a2c-bd4e-5a00cce65668 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:28.789039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a6b560d-d434-4a2c-bd4e-5a00cce65668 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:28.789471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a6b560d-d434-4a2c-bd4e-5a00cce65668 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:28.790184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a6b560d-d434-4a2c-bd4e-5a00cce65668 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:28.790631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a6b560d-d434-4a2c-bd4e-5a00cce65668 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:28.791052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a6b560d-d434-4a2c-bd4e-5a00cce65668 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:28.821230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1a6b560d-d434-4a2c-bd4e-5a00cce65668 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044650 Aug 18 22:02:28.821879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 665/1332] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:29.128317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f082368a-3ce8-43e8-9d10-5deb7be56a7b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:29.130493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f082368a-3ce8-43e8-9d10-5deb7be56a7b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:29.136855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f082368a-3ce8-43e8-9d10-5deb7be56a7b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:29.137334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f082368a-3ce8-43e8-9d10-5deb7be56a7b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:29.137808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f082368a-3ce8-43e8-9d10-5deb7be56a7b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:29.138507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f082368a-3ce8-43e8-9d10-5deb7be56a7b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:29.138964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f082368a-3ce8-43e8-9d10-5deb7be56a7b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:29.139392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f082368a-3ce8-43e8-9d10-5deb7be56a7b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:29.167960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f082368a-3ce8-43e8-9d10-5deb7be56a7b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043652 Aug 18 22:02:29.168510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 668/1333] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:29.397907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c3e3d183-6b51-4d47-983b-68898ccf4ef8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:29.399992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c3e3d183-6b51-4d47-983b-68898ccf4ef8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:29.406416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3e3d183-6b51-4d47-983b-68898ccf4ef8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:29.406903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3e3d183-6b51-4d47-983b-68898ccf4ef8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:29.407341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3e3d183-6b51-4d47-983b-68898ccf4ef8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:29.408038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3e3d183-6b51-4d47-983b-68898ccf4ef8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:29.408497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3e3d183-6b51-4d47-983b-68898ccf4ef8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:29.409590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3e3d183-6b51-4d47-983b-68898ccf4ef8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:29.437512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c3e3d183-6b51-4d47-983b-68898ccf4ef8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044126 Aug 18 22:02:29.438094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 666/1334] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:29 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:29.580993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ee57c3df-b8eb-445d-97c4-c20cfbccf24f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:29.583201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ee57c3df-b8eb-445d-97c4-c20cfbccf24f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:29.589163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee57c3df-b8eb-445d-97c4-c20cfbccf24f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:29.589685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee57c3df-b8eb-445d-97c4-c20cfbccf24f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:29.590122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee57c3df-b8eb-445d-97c4-c20cfbccf24f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:29.590814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee57c3df-b8eb-445d-97c4-c20cfbccf24f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:29.591273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee57c3df-b8eb-445d-97c4-c20cfbccf24f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:29.591698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee57c3df-b8eb-445d-97c4-c20cfbccf24f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:29.620413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ee57c3df-b8eb-445d-97c4-c20cfbccf24f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043845 Aug 18 22:02:29.620961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 669/1335] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:29 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:29.834145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-94a5f5c0-7eb4-4acc-9b51-1bba2e79c555 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:29.836290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-94a5f5c0-7eb4-4acc-9b51-1bba2e79c555 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:29.842164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94a5f5c0-7eb4-4acc-9b51-1bba2e79c555 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:29.842637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94a5f5c0-7eb4-4acc-9b51-1bba2e79c555 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:29.843067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94a5f5c0-7eb4-4acc-9b51-1bba2e79c555 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:29.843744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94a5f5c0-7eb4-4acc-9b51-1bba2e79c555 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:29.844192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94a5f5c0-7eb4-4acc-9b51-1bba2e79c555 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:29.844612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94a5f5c0-7eb4-4acc-9b51-1bba2e79c555 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:29.873007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-94a5f5c0-7eb4-4acc-9b51-1bba2e79c555 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043384 Aug 18 22:02:29.873552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 667/1336] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:29 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:30.180470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-abf5e3b4-2526-4508-a134-e887ca7a4bbd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:30.182649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-abf5e3b4-2526-4508-a134-e887ca7a4bbd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:30.189074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abf5e3b4-2526-4508-a134-e887ca7a4bbd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:30.189550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abf5e3b4-2526-4508-a134-e887ca7a4bbd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:30.190654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abf5e3b4-2526-4508-a134-e887ca7a4bbd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:30.191356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abf5e3b4-2526-4508-a134-e887ca7a4bbd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:30.191813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abf5e3b4-2526-4508-a134-e887ca7a4bbd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:30.192244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abf5e3b4-2526-4508-a134-e887ca7a4bbd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:30.220556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-abf5e3b4-2526-4508-a134-e887ca7a4bbd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044044 Aug 18 22:02:30.221122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 670/1337] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:30.449883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0a9f89d5-f112-47b6-8e6a-5b8bb4a0b0e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:30.452001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0a9f89d5-f112-47b6-8e6a-5b8bb4a0b0e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:30.458451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a9f89d5-f112-47b6-8e6a-5b8bb4a0b0e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:30.458938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a9f89d5-f112-47b6-8e6a-5b8bb4a0b0e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:30.459376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a9f89d5-f112-47b6-8e6a-5b8bb4a0b0e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:30.460078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a9f89d5-f112-47b6-8e6a-5b8bb4a0b0e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:30.460543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a9f89d5-f112-47b6-8e6a-5b8bb4a0b0e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:30.460973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a9f89d5-f112-47b6-8e6a-5b8bb4a0b0e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:30.490182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0a9f89d5-f112-47b6-8e6a-5b8bb4a0b0e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Aug 18 22:02:30.490729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 668/1338] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:30.632533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64a30fe8-4c05-4549-9aae-0b482ee682d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:30.634770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64a30fe8-4c05-4549-9aae-0b482ee682d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:30.640636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a30fe8-4c05-4549-9aae-0b482ee682d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:30.641113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a30fe8-4c05-4549-9aae-0b482ee682d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:30.641546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a30fe8-4c05-4549-9aae-0b482ee682d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:30.642263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a30fe8-4c05-4549-9aae-0b482ee682d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:30.642716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a30fe8-4c05-4549-9aae-0b482ee682d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:30.643142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a30fe8-4c05-4549-9aae-0b482ee682d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:30.671547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64a30fe8-4c05-4549-9aae-0b482ee682d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042936 Aug 18 22:02:30.672094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 671/1339] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:30 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:30.885099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fc732d0b-1c87-4c77-b967-1cb19dee27ae tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:30.887253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fc732d0b-1c87-4c77-b967-1cb19dee27ae tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:30.893689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc732d0b-1c87-4c77-b967-1cb19dee27ae tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:30.894174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc732d0b-1c87-4c77-b967-1cb19dee27ae tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:30.894614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc732d0b-1c87-4c77-b967-1cb19dee27ae tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:30.895305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc732d0b-1c87-4c77-b967-1cb19dee27ae tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:30.895790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc732d0b-1c87-4c77-b967-1cb19dee27ae tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:30.896226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc732d0b-1c87-4c77-b967-1cb19dee27ae tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:30.925407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fc732d0b-1c87-4c77-b967-1cb19dee27ae tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044233 Aug 18 22:02:30.926000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 669/1340] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:30 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:31.232412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bb9ca8c7-954c-40e8-ab3d-0a772ec3539f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:31.234564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bb9ca8c7-954c-40e8-ab3d-0a772ec3539f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:31.240867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb9ca8c7-954c-40e8-ab3d-0a772ec3539f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:31.241344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb9ca8c7-954c-40e8-ab3d-0a772ec3539f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:31.241822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb9ca8c7-954c-40e8-ab3d-0a772ec3539f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:31.242517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb9ca8c7-954c-40e8-ab3d-0a772ec3539f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:31.242971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb9ca8c7-954c-40e8-ab3d-0a772ec3539f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:31.243394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb9ca8c7-954c-40e8-ab3d-0a772ec3539f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:31.272605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bb9ca8c7-954c-40e8-ab3d-0a772ec3539f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044114 Aug 18 22:02:31.273154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 672/1341] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:31 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:31.503123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e683f828-9ce7-4177-a374-2cdef58431f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:31.505904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e683f828-9ce7-4177-a374-2cdef58431f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:31.512369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e683f828-9ce7-4177-a374-2cdef58431f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:31.512846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e683f828-9ce7-4177-a374-2cdef58431f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:31.513319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e683f828-9ce7-4177-a374-2cdef58431f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:31.514037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e683f828-9ce7-4177-a374-2cdef58431f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:31.514518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e683f828-9ce7-4177-a374-2cdef58431f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:31.514945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e683f828-9ce7-4177-a374-2cdef58431f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:31.542709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e683f828-9ce7-4177-a374-2cdef58431f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044177 Aug 18 22:02:31.543254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 670/1342] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:31 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:31.684349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ce6fd1c4-fe22-4da4-927c-eb65ffa3e03f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:31.686567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ce6fd1c4-fe22-4da4-927c-eb65ffa3e03f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:31.693361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce6fd1c4-fe22-4da4-927c-eb65ffa3e03f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:31.693872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce6fd1c4-fe22-4da4-927c-eb65ffa3e03f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:31.694319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce6fd1c4-fe22-4da4-927c-eb65ffa3e03f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:31.695025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce6fd1c4-fe22-4da4-927c-eb65ffa3e03f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:31.695485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce6fd1c4-fe22-4da4-927c-eb65ffa3e03f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:31.695915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce6fd1c4-fe22-4da4-927c-eb65ffa3e03f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:31.724861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ce6fd1c4-fe22-4da4-927c-eb65ffa3e03f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044403 Aug 18 22:02:31.725413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 673/1343] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:31.937496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-71c762eb-33e6-4d75-b6e5-fd1c6332fdc3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:31.939651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-71c762eb-33e6-4d75-b6e5-fd1c6332fdc3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:31.945520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71c762eb-33e6-4d75-b6e5-fd1c6332fdc3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:31.946034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71c762eb-33e6-4d75-b6e5-fd1c6332fdc3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:31.946472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71c762eb-33e6-4d75-b6e5-fd1c6332fdc3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:31.947178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71c762eb-33e6-4d75-b6e5-fd1c6332fdc3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:31.947634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71c762eb-33e6-4d75-b6e5-fd1c6332fdc3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:31.948067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71c762eb-33e6-4d75-b6e5-fd1c6332fdc3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:31.977378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-71c762eb-33e6-4d75-b6e5-fd1c6332fdc3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043823 Aug 18 22:02:31.977959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 671/1344] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:31 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:32.284464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b255edff-0dc5-4203-8599-e773b1e4631f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:32.287300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b255edff-0dc5-4203-8599-e773b1e4631f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:32.293749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b255edff-0dc5-4203-8599-e773b1e4631f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:32.294224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b255edff-0dc5-4203-8599-e773b1e4631f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:32.294656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b255edff-0dc5-4203-8599-e773b1e4631f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:32.295354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b255edff-0dc5-4203-8599-e773b1e4631f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:32.295809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b255edff-0dc5-4203-8599-e773b1e4631f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:32.296231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b255edff-0dc5-4203-8599-e773b1e4631f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:32.324469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b255edff-0dc5-4203-8599-e773b1e4631f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044033 Aug 18 22:02:32.325012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 674/1345] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:32.554792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bbd1e228-ed20-4090-a71d-27e25878a968 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:32.556852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bbd1e228-ed20-4090-a71d-27e25878a968 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:32.563172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbd1e228-ed20-4090-a71d-27e25878a968 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:32.563644 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbd1e228-ed20-4090-a71d-27e25878a968 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:32.564071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbd1e228-ed20-4090-a71d-27e25878a968 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:32.564760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbd1e228-ed20-4090-a71d-27e25878a968 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:32.565207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbd1e228-ed20-4090-a71d-27e25878a968 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:32.565649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbd1e228-ed20-4090-a71d-27e25878a968 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:32.594199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bbd1e228-ed20-4090-a71d-27e25878a968 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043336 Aug 18 22:02:32.594750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 672/1346] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:32.736345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-82e3eea7-d97a-487b-b2cc-43f3a9c38b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:32.738512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-82e3eea7-d97a-487b-b2cc-43f3a9c38b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:32.744437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82e3eea7-d97a-487b-b2cc-43f3a9c38b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:32.744918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82e3eea7-d97a-487b-b2cc-43f3a9c38b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:32.745360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82e3eea7-d97a-487b-b2cc-43f3a9c38b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:32.746084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82e3eea7-d97a-487b-b2cc-43f3a9c38b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:32.746544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82e3eea7-d97a-487b-b2cc-43f3a9c38b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:32.746974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82e3eea7-d97a-487b-b2cc-43f3a9c38b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:32.776132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-82e3eea7-d97a-487b-b2cc-43f3a9c38b70 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043719 Aug 18 22:02:32.776861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 675/1347] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:32 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:32.991265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-02fe062c-7a15-4519-b4e2-a462a3bd8ffa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:32.993414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-02fe062c-7a15-4519-b4e2-a462a3bd8ffa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:32.999265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02fe062c-7a15-4519-b4e2-a462a3bd8ffa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:32.999749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02fe062c-7a15-4519-b4e2-a462a3bd8ffa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:33.000179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02fe062c-7a15-4519-b4e2-a462a3bd8ffa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:33.000862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02fe062c-7a15-4519-b4e2-a462a3bd8ffa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:33.001306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02fe062c-7a15-4519-b4e2-a462a3bd8ffa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:33.001753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02fe062c-7a15-4519-b4e2-a462a3bd8ffa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:33.030164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-02fe062c-7a15-4519-b4e2-a462a3bd8ffa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Aug 18 22:02:33.030705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 673/1348] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:32 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:33.336780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9a8e19fb-98a1-4eb1-bbb9-cfe053b279ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:33.338928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9a8e19fb-98a1-4eb1-bbb9-cfe053b279ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:33.345257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a8e19fb-98a1-4eb1-bbb9-cfe053b279ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:33.345763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a8e19fb-98a1-4eb1-bbb9-cfe053b279ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:33.346694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a8e19fb-98a1-4eb1-bbb9-cfe053b279ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:33.347388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a8e19fb-98a1-4eb1-bbb9-cfe053b279ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:33.347838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a8e19fb-98a1-4eb1-bbb9-cfe053b279ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:33.348261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a8e19fb-98a1-4eb1-bbb9-cfe053b279ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:33.361410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:33.377585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9a8e19fb-98a1-4eb1-bbb9-cfe053b279ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044833 Aug 18 22:02:33.378160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 676/1349] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:33 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:33.607255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-352657c1-7870-46b8-ac1d-a15dda70e3d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:33.609320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-352657c1-7870-46b8-ac1d-a15dda70e3d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:33.616678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-352657c1-7870-46b8-ac1d-a15dda70e3d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:33.617151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-352657c1-7870-46b8-ac1d-a15dda70e3d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:33.617581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-352657c1-7870-46b8-ac1d-a15dda70e3d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:33.618287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-352657c1-7870-46b8-ac1d-a15dda70e3d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:33.618737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-352657c1-7870-46b8-ac1d-a15dda70e3d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:33.619157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-352657c1-7870-46b8-ac1d-a15dda70e3d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:33.646992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-352657c1-7870-46b8-ac1d-a15dda70e3d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043787 Aug 18 22:02:33.647545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 674/1350] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:33 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:33.788678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cdcba05b-c19e-4b20-afcb-4abb9e4a929a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:33.790832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cdcba05b-c19e-4b20-afcb-4abb9e4a929a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:33.796723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdcba05b-c19e-4b20-afcb-4abb9e4a929a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:33.797199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdcba05b-c19e-4b20-afcb-4abb9e4a929a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:33.797661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdcba05b-c19e-4b20-afcb-4abb9e4a929a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:33.798606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdcba05b-c19e-4b20-afcb-4abb9e4a929a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:33.799055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdcba05b-c19e-4b20-afcb-4abb9e4a929a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:33.799525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdcba05b-c19e-4b20-afcb-4abb9e4a929a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:33.827822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cdcba05b-c19e-4b20-afcb-4abb9e4a929a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Aug 18 22:02:33.828369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 677/1351] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:34.042246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2735d7d9-a4ce-4d43-96cf-881f1e3479f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:34.044426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2735d7d9-a4ce-4d43-96cf-881f1e3479f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:34.050604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2735d7d9-a4ce-4d43-96cf-881f1e3479f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:34.051092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2735d7d9-a4ce-4d43-96cf-881f1e3479f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:34.051529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2735d7d9-a4ce-4d43-96cf-881f1e3479f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:34.052228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2735d7d9-a4ce-4d43-96cf-881f1e3479f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:34.052690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2735d7d9-a4ce-4d43-96cf-881f1e3479f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:34.053125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2735d7d9-a4ce-4d43-96cf-881f1e3479f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:34.082263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2735d7d9-a4ce-4d43-96cf-881f1e3479f6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Aug 18 22:02:34.082815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 675/1352] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:34 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:34.389823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cd7855a2-3753-4de1-9051-ac2a13d0067d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:34.391944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cd7855a2-3753-4de1-9051-ac2a13d0067d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:34.398917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd7855a2-3753-4de1-9051-ac2a13d0067d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:34.399388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd7855a2-3753-4de1-9051-ac2a13d0067d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:34.399816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd7855a2-3753-4de1-9051-ac2a13d0067d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:34.400502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd7855a2-3753-4de1-9051-ac2a13d0067d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:34.400950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd7855a2-3753-4de1-9051-ac2a13d0067d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:34.401368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd7855a2-3753-4de1-9051-ac2a13d0067d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:34.429536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cd7855a2-3753-4de1-9051-ac2a13d0067d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043667 Aug 18 22:02:34.430110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 678/1353] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:34.659465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1173b31d-a5bd-4bde-b94a-9a7290943076 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:34.661526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1173b31d-a5bd-4bde-b94a-9a7290943076 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:34.667995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1173b31d-a5bd-4bde-b94a-9a7290943076 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:34.668480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1173b31d-a5bd-4bde-b94a-9a7290943076 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:34.668949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1173b31d-a5bd-4bde-b94a-9a7290943076 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:34.669676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1173b31d-a5bd-4bde-b94a-9a7290943076 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:34.670134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1173b31d-a5bd-4bde-b94a-9a7290943076 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:34.670566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1173b31d-a5bd-4bde-b94a-9a7290943076 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:34.687581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:34.702128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1173b31d-a5bd-4bde-b94a-9a7290943076 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046704 Aug 18 22:02:34.702690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 676/1354] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:34 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:34.840836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f0ca461f-8c67-4d70-b2cc-a4bec9d8944a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:34.843005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f0ca461f-8c67-4d70-b2cc-a4bec9d8944a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:34.849494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0ca461f-8c67-4d70-b2cc-a4bec9d8944a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:34.850018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0ca461f-8c67-4d70-b2cc-a4bec9d8944a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:34.850456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0ca461f-8c67-4d70-b2cc-a4bec9d8944a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:34.851154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0ca461f-8c67-4d70-b2cc-a4bec9d8944a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:34.851610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0ca461f-8c67-4d70-b2cc-a4bec9d8944a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:34.852038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0ca461f-8c67-4d70-b2cc-a4bec9d8944a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:34.881924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f0ca461f-8c67-4d70-b2cc-a4bec9d8944a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045120 Aug 18 22:02:34.882480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 679/1355] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:35.094429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-92880dcb-7869-462b-88bc-1e0f3c7cd332 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:35.096661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-92880dcb-7869-462b-88bc-1e0f3c7cd332 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:35.102659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92880dcb-7869-462b-88bc-1e0f3c7cd332 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:35.103157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92880dcb-7869-462b-88bc-1e0f3c7cd332 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:35.103597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92880dcb-7869-462b-88bc-1e0f3c7cd332 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:35.104289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92880dcb-7869-462b-88bc-1e0f3c7cd332 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:35.104747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92880dcb-7869-462b-88bc-1e0f3c7cd332 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:35.105178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92880dcb-7869-462b-88bc-1e0f3c7cd332 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:35.135234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-92880dcb-7869-462b-88bc-1e0f3c7cd332 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044709 Aug 18 22:02:35.135792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 677/1356] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:35.443282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0cf85084-a7a8-45b1-a7ed-cdab00f94ef4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:35.445453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0cf85084-a7a8-45b1-a7ed-cdab00f94ef4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:35.451341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cf85084-a7a8-45b1-a7ed-cdab00f94ef4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:35.451823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cf85084-a7a8-45b1-a7ed-cdab00f94ef4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:35.452257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cf85084-a7a8-45b1-a7ed-cdab00f94ef4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:35.452954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cf85084-a7a8-45b1-a7ed-cdab00f94ef4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:35.453413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cf85084-a7a8-45b1-a7ed-cdab00f94ef4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:35.453869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cf85084-a7a8-45b1-a7ed-cdab00f94ef4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:35.482832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0cf85084-a7a8-45b1-a7ed-cdab00f94ef4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044856 Aug 18 22:02:35.483388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 680/1357] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:35.715000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9416b799-58f1-4111-9231-df36fb50a29e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:35.717131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9416b799-58f1-4111-9231-df36fb50a29e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:35.724293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9416b799-58f1-4111-9231-df36fb50a29e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:35.724777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9416b799-58f1-4111-9231-df36fb50a29e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:35.725219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9416b799-58f1-4111-9231-df36fb50a29e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:35.725955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9416b799-58f1-4111-9231-df36fb50a29e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:35.726418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9416b799-58f1-4111-9231-df36fb50a29e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:35.726845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9416b799-58f1-4111-9231-df36fb50a29e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:35.758809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9416b799-58f1-4111-9231-df36fb50a29e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047384 Aug 18 22:02:35.759839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 678/1358] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:35 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:35.894098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4b515ad0-8461-4c01-9a12-1fc1366a5a8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:35.896259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4b515ad0-8461-4c01-9a12-1fc1366a5a8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:35.902156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b515ad0-8461-4c01-9a12-1fc1366a5a8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:35.902624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b515ad0-8461-4c01-9a12-1fc1366a5a8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:35.903051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b515ad0-8461-4c01-9a12-1fc1366a5a8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:35.903733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b515ad0-8461-4c01-9a12-1fc1366a5a8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:35.904178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b515ad0-8461-4c01-9a12-1fc1366a5a8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:35.904597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b515ad0-8461-4c01-9a12-1fc1366a5a8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:35.933805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4b515ad0-8461-4c01-9a12-1fc1366a5a8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Aug 18 22:02:35.934359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 681/1359] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:35 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:36.149784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-46930c44-bc47-40eb-9dc8-6acba0590e12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:36.151929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46930c44-bc47-40eb-9dc8-6acba0590e12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:36.158234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46930c44-bc47-40eb-9dc8-6acba0590e12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:36.159376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46930c44-bc47-40eb-9dc8-6acba0590e12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:36.159818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46930c44-bc47-40eb-9dc8-6acba0590e12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:36.160519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46930c44-bc47-40eb-9dc8-6acba0590e12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:36.160984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46930c44-bc47-40eb-9dc8-6acba0590e12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:36.161415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46930c44-bc47-40eb-9dc8-6acba0590e12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:36.189846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-46930c44-bc47-40eb-9dc8-6acba0590e12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044021 Aug 18 22:02:36.190403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 679/1360] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:36 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:36.495001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2beb36fc-61db-462b-9811-8f0cf295e3fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:36.497264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2beb36fc-61db-462b-9811-8f0cf295e3fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:36.504402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2beb36fc-61db-462b-9811-8f0cf295e3fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:36.504882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2beb36fc-61db-462b-9811-8f0cf295e3fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:36.505317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2beb36fc-61db-462b-9811-8f0cf295e3fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:36.506041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2beb36fc-61db-462b-9811-8f0cf295e3fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:36.506494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2beb36fc-61db-462b-9811-8f0cf295e3fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:36.506917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2beb36fc-61db-462b-9811-8f0cf295e3fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:36.535499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2beb36fc-61db-462b-9811-8f0cf295e3fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044493 Aug 18 22:02:36.536049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 682/1361] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:36.772013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7e159d1-e78d-4875-866b-69c80c28d939 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:36.774184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f7e159d1-e78d-4875-866b-69c80c28d939 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:36.780513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7e159d1-e78d-4875-866b-69c80c28d939 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:36.780999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7e159d1-e78d-4875-866b-69c80c28d939 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:36.781444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7e159d1-e78d-4875-866b-69c80c28d939 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:36.782256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7e159d1-e78d-4875-866b-69c80c28d939 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:36.782717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7e159d1-e78d-4875-866b-69c80c28d939 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:36.783146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7e159d1-e78d-4875-866b-69c80c28d939 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:36.812422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f7e159d1-e78d-4875-866b-69c80c28d939 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044386 Aug 18 22:02:36.812985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 680/1362] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:36 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:36.946592 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ff23411f-6b0c-4932-af27-3c29d3d24917 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:36.948720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ff23411f-6b0c-4932-af27-3c29d3d24917 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:36.954678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff23411f-6b0c-4932-af27-3c29d3d24917 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:36.955160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff23411f-6b0c-4932-af27-3c29d3d24917 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:36.955588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff23411f-6b0c-4932-af27-3c29d3d24917 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:36.956265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff23411f-6b0c-4932-af27-3c29d3d24917 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:36.956712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff23411f-6b0c-4932-af27-3c29d3d24917 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:36.957129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff23411f-6b0c-4932-af27-3c29d3d24917 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:36.985307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ff23411f-6b0c-4932-af27-3c29d3d24917 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042656 Aug 18 22:02:36.985870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 683/1363] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:36 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:37.202212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6ec252cb-f13a-4313-bd9f-e0819841d043 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:37.204407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6ec252cb-f13a-4313-bd9f-e0819841d043 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:37.210483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ec252cb-f13a-4313-bd9f-e0819841d043 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:37.210971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ec252cb-f13a-4313-bd9f-e0819841d043 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:37.211414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ec252cb-f13a-4313-bd9f-e0819841d043 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:37.212101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ec252cb-f13a-4313-bd9f-e0819841d043 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:37.212562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ec252cb-f13a-4313-bd9f-e0819841d043 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:37.212990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ec252cb-f13a-4313-bd9f-e0819841d043 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:37.243223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6ec252cb-f13a-4313-bd9f-e0819841d043 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044950 Aug 18 22:02:37.243791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 681/1364] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:37 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:37.548867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b3c7d28d-05a6-4741-9888-f5782fa5cb2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:37.551149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b3c7d28d-05a6-4741-9888-f5782fa5cb2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:37.557774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3c7d28d-05a6-4741-9888-f5782fa5cb2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:37.558312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3c7d28d-05a6-4741-9888-f5782fa5cb2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:37.559194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3c7d28d-05a6-4741-9888-f5782fa5cb2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:37.559629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3c7d28d-05a6-4741-9888-f5782fa5cb2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:37.560069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3c7d28d-05a6-4741-9888-f5782fa5cb2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:37.560548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3c7d28d-05a6-4741-9888-f5782fa5cb2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:37.591272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b3c7d28d-05a6-4741-9888-f5782fa5cb2c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047310 Aug 18 22:02:37.591870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 684/1365] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:37.824492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9ba7bbeb-9eef-41c2-8018-b215d42f8205 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:37.826592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9ba7bbeb-9eef-41c2-8018-b215d42f8205 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:37.833475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ba7bbeb-9eef-41c2-8018-b215d42f8205 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:37.833993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ba7bbeb-9eef-41c2-8018-b215d42f8205 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:37.834431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ba7bbeb-9eef-41c2-8018-b215d42f8205 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:37.835129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ba7bbeb-9eef-41c2-8018-b215d42f8205 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:37.835589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ba7bbeb-9eef-41c2-8018-b215d42f8205 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:37.836021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ba7bbeb-9eef-41c2-8018-b215d42f8205 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:37.864653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9ba7bbeb-9eef-41c2-8018-b215d42f8205 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044154 Aug 18 22:02:37.865209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 682/1366] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:37 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:37.999441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-00e72f78-5639-423f-be11-b05c9bf5c957 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:38.001578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-00e72f78-5639-423f-be11-b05c9bf5c957 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:38.007938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00e72f78-5639-423f-be11-b05c9bf5c957 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:38.008418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00e72f78-5639-423f-be11-b05c9bf5c957 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:38.008856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00e72f78-5639-423f-be11-b05c9bf5c957 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:38.009545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00e72f78-5639-423f-be11-b05c9bf5c957 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:38.010022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00e72f78-5639-423f-be11-b05c9bf5c957 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:38.010448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00e72f78-5639-423f-be11-b05c9bf5c957 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:38.039339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-00e72f78-5639-423f-be11-b05c9bf5c957 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043935 Aug 18 22:02:38.039885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 685/1367] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:37 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:38.255891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a5485b6c-ccd8-499d-a472-584188656b4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:38.258984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a5485b6c-ccd8-499d-a472-584188656b4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:38.264383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5485b6c-ccd8-499d-a472-584188656b4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:38.264869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5485b6c-ccd8-499d-a472-584188656b4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:38.265308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5485b6c-ccd8-499d-a472-584188656b4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:38.266039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5485b6c-ccd8-499d-a472-584188656b4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:38.266496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5485b6c-ccd8-499d-a472-584188656b4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:38.266928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5485b6c-ccd8-499d-a472-584188656b4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:38.295611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a5485b6c-ccd8-499d-a472-584188656b4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044176 Aug 18 22:02:38.296172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 683/1368] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:38 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:38.603402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-778cc775-66af-4dd4-81aa-9d789fc7e46f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:38.605654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-778cc775-66af-4dd4-81aa-9d789fc7e46f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:38.612820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-778cc775-66af-4dd4-81aa-9d789fc7e46f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:38.613375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-778cc775-66af-4dd4-81aa-9d789fc7e46f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:38.613815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-778cc775-66af-4dd4-81aa-9d789fc7e46f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:38.614554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-778cc775-66af-4dd4-81aa-9d789fc7e46f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:38.615010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-778cc775-66af-4dd4-81aa-9d789fc7e46f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:38.615447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-778cc775-66af-4dd4-81aa-9d789fc7e46f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:38.644639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-778cc775-66af-4dd4-81aa-9d789fc7e46f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045220 Aug 18 22:02:38.645184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 686/1369] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:38 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:38.876206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-06457d2d-1d81-4e57-828e-b22dee9cc10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:38.878317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-06457d2d-1d81-4e57-828e-b22dee9cc10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:38.884640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06457d2d-1d81-4e57-828e-b22dee9cc10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:38.885116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06457d2d-1d81-4e57-828e-b22dee9cc10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:38.885546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06457d2d-1d81-4e57-828e-b22dee9cc10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:38.886284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06457d2d-1d81-4e57-828e-b22dee9cc10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:38.886734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06457d2d-1d81-4e57-828e-b22dee9cc10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:38.887157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06457d2d-1d81-4e57-828e-b22dee9cc10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:38.915506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-06457d2d-1d81-4e57-828e-b22dee9cc10a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043285 Aug 18 22:02:38.916069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 684/1370] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:38 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:39.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-90aacb74-3294-46ff-9220-5daa8c83adba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:39.053982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-90aacb74-3294-46ff-9220-5daa8c83adba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:39.059889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90aacb74-3294-46ff-9220-5daa8c83adba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:39.060368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90aacb74-3294-46ff-9220-5daa8c83adba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:39.060808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90aacb74-3294-46ff-9220-5daa8c83adba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:39.061501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90aacb74-3294-46ff-9220-5daa8c83adba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:39.061986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90aacb74-3294-46ff-9220-5daa8c83adba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:39.062415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90aacb74-3294-46ff-9220-5daa8c83adba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:39.091950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-90aacb74-3294-46ff-9220-5daa8c83adba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Aug 18 22:02:39.092518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 687/1371] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:39 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:39.308331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-375dde64-0667-4b0c-bee6-da1d0fb8d044 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:39.310506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-375dde64-0667-4b0c-bee6-da1d0fb8d044 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:39.316782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375dde64-0667-4b0c-bee6-da1d0fb8d044 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:39.317267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375dde64-0667-4b0c-bee6-da1d0fb8d044 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:39.317804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375dde64-0667-4b0c-bee6-da1d0fb8d044 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:39.318499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375dde64-0667-4b0c-bee6-da1d0fb8d044 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:39.318953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375dde64-0667-4b0c-bee6-da1d0fb8d044 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:39.319380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375dde64-0667-4b0c-bee6-da1d0fb8d044 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:39.349071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-375dde64-0667-4b0c-bee6-da1d0fb8d044 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044676 Aug 18 22:02:39.349642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 685/1372] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:39.656941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d485eb0b-4f29-4ba4-8864-df9ffa8f8303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:39.659123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d485eb0b-4f29-4ba4-8864-df9ffa8f8303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:39.665451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d485eb0b-4f29-4ba4-8864-df9ffa8f8303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:39.665963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d485eb0b-4f29-4ba4-8864-df9ffa8f8303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:39.666399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d485eb0b-4f29-4ba4-8864-df9ffa8f8303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:39.667091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d485eb0b-4f29-4ba4-8864-df9ffa8f8303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:39.667542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d485eb0b-4f29-4ba4-8864-df9ffa8f8303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:39.667996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d485eb0b-4f29-4ba4-8864-df9ffa8f8303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:39.697274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d485eb0b-4f29-4ba4-8864-df9ffa8f8303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044322 Aug 18 22:02:39.697878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 688/1373] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:39.928619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-013631a1-1564-4259-90d6-49e24be2de3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:39.930735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-013631a1-1564-4259-90d6-49e24be2de3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:39.933152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:39.938484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-013631a1-1564-4259-90d6-49e24be2de3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:39.938971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-013631a1-1564-4259-90d6-49e24be2de3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:39.939411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-013631a1-1564-4259-90d6-49e24be2de3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:39.940739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-013631a1-1564-4259-90d6-49e24be2de3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:39.941198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-013631a1-1564-4259-90d6-49e24be2de3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:39.941651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-013631a1-1564-4259-90d6-49e24be2de3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:39.969876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-013631a1-1564-4259-90d6-49e24be2de3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045719 Aug 18 22:02:39.970437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 686/1374] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:39 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:40.104457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cac6b8dc-762e-42b6-980d-a8f8becfd621 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:40.106608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cac6b8dc-762e-42b6-980d-a8f8becfd621 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:40.113268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac6b8dc-762e-42b6-980d-a8f8becfd621 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:40.113782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac6b8dc-762e-42b6-980d-a8f8becfd621 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:40.114222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac6b8dc-762e-42b6-980d-a8f8becfd621 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:40.114927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac6b8dc-762e-42b6-980d-a8f8becfd621 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:40.115410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac6b8dc-762e-42b6-980d-a8f8becfd621 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:40.115836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac6b8dc-762e-42b6-980d-a8f8becfd621 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:40.144335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cac6b8dc-762e-42b6-980d-a8f8becfd621 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043782 Aug 18 22:02:40.144888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 689/1375] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:40.361369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ffe2de95-3003-4e5d-9529-cab0476b35d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:40.364215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ffe2de95-3003-4e5d-9529-cab0476b35d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:40.370239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe2de95-3003-4e5d-9529-cab0476b35d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:40.370757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe2de95-3003-4e5d-9529-cab0476b35d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:40.371165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe2de95-3003-4e5d-9529-cab0476b35d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:40.371859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe2de95-3003-4e5d-9529-cab0476b35d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:40.372318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe2de95-3003-4e5d-9529-cab0476b35d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:40.372748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe2de95-3003-4e5d-9529-cab0476b35d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:40.400940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ffe2de95-3003-4e5d-9529-cab0476b35d6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 Aug 18 22:02:40.401488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 687/1376] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:40 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:40.710615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2b1c7691-e580-4ca6-992e-cb2ef8b5176c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:40.712765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2b1c7691-e580-4ca6-992e-cb2ef8b5176c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:40.719308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b1c7691-e580-4ca6-992e-cb2ef8b5176c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:40.719723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b1c7691-e580-4ca6-992e-cb2ef8b5176c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:40.720188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b1c7691-e580-4ca6-992e-cb2ef8b5176c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:40.720873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b1c7691-e580-4ca6-992e-cb2ef8b5176c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:40.721924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b1c7691-e580-4ca6-992e-cb2ef8b5176c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:40.722356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b1c7691-e580-4ca6-992e-cb2ef8b5176c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:40.750689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2b1c7691-e580-4ca6-992e-cb2ef8b5176c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044128 Aug 18 22:02:40.751237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 690/1377] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:40.982220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-12a0a927-9cf8-4ccb-ac79-013232bfa650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:40.984292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-12a0a927-9cf8-4ccb-ac79-013232bfa650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:40.990816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12a0a927-9cf8-4ccb-ac79-013232bfa650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:40.991301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12a0a927-9cf8-4ccb-ac79-013232bfa650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:40.991747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12a0a927-9cf8-4ccb-ac79-013232bfa650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:40.992446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12a0a927-9cf8-4ccb-ac79-013232bfa650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:40.992904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12a0a927-9cf8-4ccb-ac79-013232bfa650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:40.993338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12a0a927-9cf8-4ccb-ac79-013232bfa650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:41.022327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-12a0a927-9cf8-4ccb-ac79-013232bfa650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Aug 18 22:02:41.022884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 688/1378] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:40 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:41.155743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5c30d1f5-9eb8-4312-9f8e-dedf86c4bafc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:41.157891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5c30d1f5-9eb8-4312-9f8e-dedf86c4bafc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:41.163873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c30d1f5-9eb8-4312-9f8e-dedf86c4bafc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:41.164348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c30d1f5-9eb8-4312-9f8e-dedf86c4bafc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:41.164782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c30d1f5-9eb8-4312-9f8e-dedf86c4bafc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:41.165472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c30d1f5-9eb8-4312-9f8e-dedf86c4bafc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:41.165949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c30d1f5-9eb8-4312-9f8e-dedf86c4bafc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:41.166376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c30d1f5-9eb8-4312-9f8e-dedf86c4bafc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:41.195960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5c30d1f5-9eb8-4312-9f8e-dedf86c4bafc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Aug 18 22:02:41.196512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 691/1379] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:41.413148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7d5b97b9-765a-46bb-858f-337054a9ceed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:41.415327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7d5b97b9-765a-46bb-858f-337054a9ceed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:41.421357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d5b97b9-765a-46bb-858f-337054a9ceed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:41.421877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d5b97b9-765a-46bb-858f-337054a9ceed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:41.422369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d5b97b9-765a-46bb-858f-337054a9ceed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:41.423365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d5b97b9-765a-46bb-858f-337054a9ceed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:41.423823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d5b97b9-765a-46bb-858f-337054a9ceed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:41.424767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d5b97b9-765a-46bb-858f-337054a9ceed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:41.454214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7d5b97b9-765a-46bb-858f-337054a9ceed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045006 Aug 18 22:02:41.454772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 689/1380] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:41 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:41.763081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-be32e6b5-2194-4653-a96a-ad039297caee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:41.765190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-be32e6b5-2194-4653-a96a-ad039297caee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:41.771556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be32e6b5-2194-4653-a96a-ad039297caee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:41.772030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be32e6b5-2194-4653-a96a-ad039297caee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:41.772460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be32e6b5-2194-4653-a96a-ad039297caee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:41.773144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be32e6b5-2194-4653-a96a-ad039297caee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:41.773590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be32e6b5-2194-4653-a96a-ad039297caee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:41.774028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be32e6b5-2194-4653-a96a-ad039297caee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:41.803136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-be32e6b5-2194-4653-a96a-ad039297caee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044047 Aug 18 22:02:41.803682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 692/1381] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:42.034678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b39fe223-e14e-447b-8be2-13f21955c31d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:42.036847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b39fe223-e14e-447b-8be2-13f21955c31d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:42.043308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b39fe223-e14e-447b-8be2-13f21955c31d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:42.043793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b39fe223-e14e-447b-8be2-13f21955c31d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:42.044234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b39fe223-e14e-447b-8be2-13f21955c31d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:42.044928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b39fe223-e14e-447b-8be2-13f21955c31d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:42.045381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b39fe223-e14e-447b-8be2-13f21955c31d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:42.045831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b39fe223-e14e-447b-8be2-13f21955c31d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:42.074959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b39fe223-e14e-447b-8be2-13f21955c31d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Aug 18 22:02:42.075504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 690/1382] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:42 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:42.208887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e4287245-2914-4095-b0e7-49409a99fd09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:42.211143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e4287245-2914-4095-b0e7-49409a99fd09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:42.217003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4287245-2914-4095-b0e7-49409a99fd09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:42.217489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4287245-2914-4095-b0e7-49409a99fd09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:42.217960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4287245-2914-4095-b0e7-49409a99fd09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:42.218658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4287245-2914-4095-b0e7-49409a99fd09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:42.219117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4287245-2914-4095-b0e7-49409a99fd09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:42.219836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4287245-2914-4095-b0e7-49409a99fd09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:42.224159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:42.249290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e4287245-2914-4095-b0e7-49409a99fd09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044930 Aug 18 22:02:42.249890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 693/1383] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:42 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:42.466272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-710a9f92-9672-4195-837f-c78e68e82cf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:42.468441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-710a9f92-9672-4195-837f-c78e68e82cf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:42.474366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-710a9f92-9672-4195-837f-c78e68e82cf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:42.474851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-710a9f92-9672-4195-837f-c78e68e82cf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:42.475289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-710a9f92-9672-4195-837f-c78e68e82cf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:42.475986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-710a9f92-9672-4195-837f-c78e68e82cf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:42.476443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-710a9f92-9672-4195-837f-c78e68e82cf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:42.476874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-710a9f92-9672-4195-837f-c78e68e82cf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:42.506140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-710a9f92-9672-4195-837f-c78e68e82cf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043742 Aug 18 22:02:42.506690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 691/1384] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:42.815988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-966367b9-d452-4b8d-9130-6f8a8f3c51c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:42.818131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-966367b9-d452-4b8d-9130-6f8a8f3c51c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:42.826063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-966367b9-d452-4b8d-9130-6f8a8f3c51c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:42.826918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-966367b9-d452-4b8d-9130-6f8a8f3c51c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:42.827684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-966367b9-d452-4b8d-9130-6f8a8f3c51c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:42.828914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-966367b9-d452-4b8d-9130-6f8a8f3c51c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:42.829752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-966367b9-d452-4b8d-9130-6f8a8f3c51c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:42.830562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-966367b9-d452-4b8d-9130-6f8a8f3c51c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:42.861477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-966367b9-d452-4b8d-9130-6f8a8f3c51c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050035 Aug 18 22:02:42.862579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 694/1385] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:43.087296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c3a229ce-e519-4fe9-a79f-2c5f08afcf75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:43.089457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c3a229ce-e519-4fe9-a79f-2c5f08afcf75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:43.096865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3a229ce-e519-4fe9-a79f-2c5f08afcf75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:43.097345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3a229ce-e519-4fe9-a79f-2c5f08afcf75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:43.097808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3a229ce-e519-4fe9-a79f-2c5f08afcf75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:43.098507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3a229ce-e519-4fe9-a79f-2c5f08afcf75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:43.098958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3a229ce-e519-4fe9-a79f-2c5f08afcf75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:43.099380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3a229ce-e519-4fe9-a79f-2c5f08afcf75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:43.130199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c3a229ce-e519-4fe9-a79f-2c5f08afcf75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046862 Aug 18 22:02:43.130772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 692/1386] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:43 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:43.261613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bde34960-302a-4400-962c-b659e516d8d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:43.263771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bde34960-302a-4400-962c-b659e516d8d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:43.270063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bde34960-302a-4400-962c-b659e516d8d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:43.270542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bde34960-302a-4400-962c-b659e516d8d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:43.271008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bde34960-302a-4400-962c-b659e516d8d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:43.271697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bde34960-302a-4400-962c-b659e516d8d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:43.272153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bde34960-302a-4400-962c-b659e516d8d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:43.272579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bde34960-302a-4400-962c-b659e516d8d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:43.302446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bde34960-302a-4400-962c-b659e516d8d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Aug 18 22:02:43.302997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 695/1387] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:43 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:43.519598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8bdd550c-6d7b-4f90-9838-a6d101460f59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:43.521808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8bdd550c-6d7b-4f90-9838-a6d101460f59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:43.527718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8bdd550c-6d7b-4f90-9838-a6d101460f59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:43.528195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8bdd550c-6d7b-4f90-9838-a6d101460f59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:43.528629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8bdd550c-6d7b-4f90-9838-a6d101460f59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:43.529318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8bdd550c-6d7b-4f90-9838-a6d101460f59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:43.529809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8bdd550c-6d7b-4f90-9838-a6d101460f59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:43.530234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8bdd550c-6d7b-4f90-9838-a6d101460f59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:43.534498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:43.559582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8bdd550c-6d7b-4f90-9838-a6d101460f59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Aug 18 22:02:43.560134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 693/1388] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:43 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:43.874370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-215e13bd-fb33-4115-a7cc-34f1c331b38b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:43.876588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-215e13bd-fb33-4115-a7cc-34f1c331b38b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:43.883553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-215e13bd-fb33-4115-a7cc-34f1c331b38b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:43.884033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-215e13bd-fb33-4115-a7cc-34f1c331b38b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:43.884467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-215e13bd-fb33-4115-a7cc-34f1c331b38b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:43.885169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-215e13bd-fb33-4115-a7cc-34f1c331b38b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:43.885645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-215e13bd-fb33-4115-a7cc-34f1c331b38b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:43.886075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-215e13bd-fb33-4115-a7cc-34f1c331b38b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:43.915197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-215e13bd-fb33-4115-a7cc-34f1c331b38b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044941 Aug 18 22:02:43.915751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 696/1389] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:44.142634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-98408c47-24c1-4c72-aaf5-703b9b8f5db4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:44.145359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-98408c47-24c1-4c72-aaf5-703b9b8f5db4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:44.151926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98408c47-24c1-4c72-aaf5-703b9b8f5db4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:44.152403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98408c47-24c1-4c72-aaf5-703b9b8f5db4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:44.152837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98408c47-24c1-4c72-aaf5-703b9b8f5db4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:44.153522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98408c47-24c1-4c72-aaf5-703b9b8f5db4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:44.154009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98408c47-24c1-4c72-aaf5-703b9b8f5db4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:44.154435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98408c47-24c1-4c72-aaf5-703b9b8f5db4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:44.183072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-98408c47-24c1-4c72-aaf5-703b9b8f5db4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044342 Aug 18 22:02:44.183618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 694/1390] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:44.314662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dcfc03ce-7f2f-4217-9e29-e439b1116558 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:44.317435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dcfc03ce-7f2f-4217-9e29-e439b1116558 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:44.323353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dcfc03ce-7f2f-4217-9e29-e439b1116558 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:44.323836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dcfc03ce-7f2f-4217-9e29-e439b1116558 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:44.324276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dcfc03ce-7f2f-4217-9e29-e439b1116558 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:44.324968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dcfc03ce-7f2f-4217-9e29-e439b1116558 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:44.325426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dcfc03ce-7f2f-4217-9e29-e439b1116558 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:44.325881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dcfc03ce-7f2f-4217-9e29-e439b1116558 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:44.353990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dcfc03ce-7f2f-4217-9e29-e439b1116558 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043289 Aug 18 22:02:44.354533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 697/1391] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:44 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:44.571974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1d39f0d8-5125-4cef-a5e4-c84045dd3682 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:44.574135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1d39f0d8-5125-4cef-a5e4-c84045dd3682 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:44.580028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d39f0d8-5125-4cef-a5e4-c84045dd3682 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:44.580530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d39f0d8-5125-4cef-a5e4-c84045dd3682 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:44.580964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d39f0d8-5125-4cef-a5e4-c84045dd3682 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:44.581681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d39f0d8-5125-4cef-a5e4-c84045dd3682 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:44.582136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d39f0d8-5125-4cef-a5e4-c84045dd3682 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:44.582561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d39f0d8-5125-4cef-a5e4-c84045dd3682 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:44.611090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1d39f0d8-5125-4cef-a5e4-c84045dd3682 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042990 Aug 18 22:02:44.612246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 695/1392] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:44 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:44.928337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fc05d626-89d5-4a95-8a2f-d80d64591b07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:44.931153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fc05d626-89d5-4a95-8a2f-d80d64591b07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:44.937494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc05d626-89d5-4a95-8a2f-d80d64591b07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:44.937994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc05d626-89d5-4a95-8a2f-d80d64591b07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:44.938421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc05d626-89d5-4a95-8a2f-d80d64591b07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:44.939104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc05d626-89d5-4a95-8a2f-d80d64591b07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:44.939552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc05d626-89d5-4a95-8a2f-d80d64591b07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:44.939995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc05d626-89d5-4a95-8a2f-d80d64591b07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:44.968666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fc05d626-89d5-4a95-8a2f-d80d64591b07 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044321 Aug 18 22:02:44.969254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 698/1393] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:45.195391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c25d8f0d-fbcb-4bdf-92b7-4a969b3fbad0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:45.197470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c25d8f0d-fbcb-4bdf-92b7-4a969b3fbad0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:45.203872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c25d8f0d-fbcb-4bdf-92b7-4a969b3fbad0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:45.204349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c25d8f0d-fbcb-4bdf-92b7-4a969b3fbad0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:45.204780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c25d8f0d-fbcb-4bdf-92b7-4a969b3fbad0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:45.206002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c25d8f0d-fbcb-4bdf-92b7-4a969b3fbad0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:45.206429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c25d8f0d-fbcb-4bdf-92b7-4a969b3fbad0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:45.206849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c25d8f0d-fbcb-4bdf-92b7-4a969b3fbad0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:45.235251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c25d8f0d-fbcb-4bdf-92b7-4a969b3fbad0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043858 Aug 18 22:02:45.235802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 696/1394] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:45 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:45.366370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-46b03f28-4a01-4441-aa42-1b8eeb8a5f53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:45.368518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-46b03f28-4a01-4441-aa42-1b8eeb8a5f53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:45.374565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46b03f28-4a01-4441-aa42-1b8eeb8a5f53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:45.375042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46b03f28-4a01-4441-aa42-1b8eeb8a5f53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:45.375572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46b03f28-4a01-4441-aa42-1b8eeb8a5f53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:45.376264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46b03f28-4a01-4441-aa42-1b8eeb8a5f53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:45.376712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46b03f28-4a01-4441-aa42-1b8eeb8a5f53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:45.377639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46b03f28-4a01-4441-aa42-1b8eeb8a5f53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:45.406538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-46b03f28-4a01-4441-aa42-1b8eeb8a5f53 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044221 Aug 18 22:02:45.407085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 699/1395] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:45 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:45.623750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-892ae4ec-18aa-4533-b338-07d203e13b2e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:45.625947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-892ae4ec-18aa-4533-b338-07d203e13b2e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:45.632440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-892ae4ec-18aa-4533-b338-07d203e13b2e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:45.632923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-892ae4ec-18aa-4533-b338-07d203e13b2e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:45.633367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-892ae4ec-18aa-4533-b338-07d203e13b2e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:45.634093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-892ae4ec-18aa-4533-b338-07d203e13b2e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:45.634549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-892ae4ec-18aa-4533-b338-07d203e13b2e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:45.634975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-892ae4ec-18aa-4533-b338-07d203e13b2e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:45.663792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-892ae4ec-18aa-4533-b338-07d203e13b2e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Aug 18 22:02:45.664337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 697/1396] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:45 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:02:45.981831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8a58c051-96d3-472a-8a0f-b1f38e5c3674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:45.983893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8a58c051-96d3-472a-8a0f-b1f38e5c3674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:45.990380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a58c051-96d3-472a-8a0f-b1f38e5c3674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:45.990862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a58c051-96d3-472a-8a0f-b1f38e5c3674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:45.991309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a58c051-96d3-472a-8a0f-b1f38e5c3674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:45.992006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a58c051-96d3-472a-8a0f-b1f38e5c3674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:45.992461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a58c051-96d3-472a-8a0f-b1f38e5c3674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:45.992893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a58c051-96d3-472a-8a0f-b1f38e5c3674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:46.021775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8a58c051-96d3-472a-8a0f-b1f38e5c3674 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044000 Aug 18 22:02:46.022325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 700/1397] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:45 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:46.247682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fe724978-aa99-4470-9714-caad3f9228ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:46.249777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fe724978-aa99-4470-9714-caad3f9228ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:46.256205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe724978-aa99-4470-9714-caad3f9228ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:46.256686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe724978-aa99-4470-9714-caad3f9228ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:46.257125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe724978-aa99-4470-9714-caad3f9228ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:46.257859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe724978-aa99-4470-9714-caad3f9228ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:46.258323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe724978-aa99-4470-9714-caad3f9228ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:46.258752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe724978-aa99-4470-9714-caad3f9228ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:46.287374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fe724978-aa99-4470-9714-caad3f9228ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 Aug 18 22:02:46.287925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 698/1398] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:46 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:46.418038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-51b75916-0174-4599-9a9e-8f9be3fac949 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:46.420156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-51b75916-0174-4599-9a9e-8f9be3fac949 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:46.427378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51b75916-0174-4599-9a9e-8f9be3fac949 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:46.427848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51b75916-0174-4599-9a9e-8f9be3fac949 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:46.428280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51b75916-0174-4599-9a9e-8f9be3fac949 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:46.428964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51b75916-0174-4599-9a9e-8f9be3fac949 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:46.429413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51b75916-0174-4599-9a9e-8f9be3fac949 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:46.429862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-51b75916-0174-4599-9a9e-8f9be3fac949 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:46.457927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-51b75916-0174-4599-9a9e-8f9be3fac949 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043783 Aug 18 22:02:46.458470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 701/1399] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:46.676125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3e8d1535-8445-4c7a-8802-e0b3eb92ecf2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:46.678314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3e8d1535-8445-4c7a-8802-e0b3eb92ecf2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:46.684173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e8d1535-8445-4c7a-8802-e0b3eb92ecf2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:46.684657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e8d1535-8445-4c7a-8802-e0b3eb92ecf2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:46.685096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e8d1535-8445-4c7a-8802-e0b3eb92ecf2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:46.685818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e8d1535-8445-4c7a-8802-e0b3eb92ecf2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:46.686279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e8d1535-8445-4c7a-8802-e0b3eb92ecf2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:46.686707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e8d1535-8445-4c7a-8802-e0b3eb92ecf2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:46.716289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3e8d1535-8445-4c7a-8802-e0b3eb92ecf2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Aug 18 22:02:46.716868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 699/1400] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:46 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:47.034294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-34291c6b-e8c7-455f-9beb-57eb66c3940c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:47.036445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-34291c6b-e8c7-455f-9beb-57eb66c3940c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:47.042392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34291c6b-e8c7-455f-9beb-57eb66c3940c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:47.042866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34291c6b-e8c7-455f-9beb-57eb66c3940c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:47.043298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34291c6b-e8c7-455f-9beb-57eb66c3940c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:47.043981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34291c6b-e8c7-455f-9beb-57eb66c3940c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:47.044429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34291c6b-e8c7-455f-9beb-57eb66c3940c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:47.044849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34291c6b-e8c7-455f-9beb-57eb66c3940c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:47.074769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-34291c6b-e8c7-455f-9beb-57eb66c3940c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044420 Aug 18 22:02:47.075318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 702/1401] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:47 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:47.300535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-301b92ac-2895-4965-859c-e27d3f627399 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:47.302645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-301b92ac-2895-4965-859c-e27d3f627399 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:47.309004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-301b92ac-2895-4965-859c-e27d3f627399 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:47.309489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-301b92ac-2895-4965-859c-e27d3f627399 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:47.309969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-301b92ac-2895-4965-859c-e27d3f627399 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:47.310667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-301b92ac-2895-4965-859c-e27d3f627399 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:47.311127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-301b92ac-2895-4965-859c-e27d3f627399 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:47.311567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-301b92ac-2895-4965-859c-e27d3f627399 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:47.342513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-301b92ac-2895-4965-859c-e27d3f627399 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046840 Aug 18 22:02:47.343076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 700/1402] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:47 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:47.470016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-27214c07-dea5-48e8-a8d3-1d16fcecdd9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:47.472177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-27214c07-dea5-48e8-a8d3-1d16fcecdd9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:47.478534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27214c07-dea5-48e8-a8d3-1d16fcecdd9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:47.479012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27214c07-dea5-48e8-a8d3-1d16fcecdd9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:47.479450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27214c07-dea5-48e8-a8d3-1d16fcecdd9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:47.480142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27214c07-dea5-48e8-a8d3-1d16fcecdd9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:47.480595 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27214c07-dea5-48e8-a8d3-1d16fcecdd9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:47.481020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27214c07-dea5-48e8-a8d3-1d16fcecdd9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:47.511413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-27214c07-dea5-48e8-a8d3-1d16fcecdd9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Aug 18 22:02:47.511964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 703/1403] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:47.728257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4457a34f-1f98-46af-8450-f36d36304cf4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:47.730439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4457a34f-1f98-46af-8450-f36d36304cf4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:47.737216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4457a34f-1f98-46af-8450-f36d36304cf4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:47.737780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4457a34f-1f98-46af-8450-f36d36304cf4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:47.738221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4457a34f-1f98-46af-8450-f36d36304cf4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:47.738926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4457a34f-1f98-46af-8450-f36d36304cf4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:47.739371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4457a34f-1f98-46af-8450-f36d36304cf4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:47.739795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4457a34f-1f98-46af-8450-f36d36304cf4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:47.768354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4457a34f-1f98-46af-8450-f36d36304cf4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044044 Aug 18 22:02:47.768909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 701/1404] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:47 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:48.087520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-66c232a3-774d-48cc-a590-5fc97abf9a5a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:48.089705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-66c232a3-774d-48cc-a590-5fc97abf9a5a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:48.091588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:48.097766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-66c232a3-774d-48cc-a590-5fc97abf9a5a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:48.098249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-66c232a3-774d-48cc-a590-5fc97abf9a5a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:48.098707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-66c232a3-774d-48cc-a590-5fc97abf9a5a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:48.099407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-66c232a3-774d-48cc-a590-5fc97abf9a5a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:48.099864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-66c232a3-774d-48cc-a590-5fc97abf9a5a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:48.100292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-66c232a3-774d-48cc-a590-5fc97abf9a5a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:48.128437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-66c232a3-774d-48cc-a590-5fc97abf9a5a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044876 Aug 18 22:02:48.128990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 704/1405] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:48.355075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-af3034c0-a091-4d0f-b60e-ff505f07aa0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:48.357136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-af3034c0-a091-4d0f-b60e-ff505f07aa0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:48.363607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af3034c0-a091-4d0f-b60e-ff505f07aa0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:48.364079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af3034c0-a091-4d0f-b60e-ff505f07aa0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:48.364506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af3034c0-a091-4d0f-b60e-ff505f07aa0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:48.365188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af3034c0-a091-4d0f-b60e-ff505f07aa0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:48.365654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af3034c0-a091-4d0f-b60e-ff505f07aa0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:48.366105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af3034c0-a091-4d0f-b60e-ff505f07aa0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:48.394965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-af3034c0-a091-4d0f-b60e-ff505f07aa0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Aug 18 22:02:48.395525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 702/1406] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:48 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:48.524257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f1a38e1e-9b67-4aaa-b35b-b1dd2435a34c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:48.526440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f1a38e1e-9b67-4aaa-b35b-b1dd2435a34c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:48.532717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1a38e1e-9b67-4aaa-b35b-b1dd2435a34c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:48.533198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1a38e1e-9b67-4aaa-b35b-b1dd2435a34c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:48.533653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1a38e1e-9b67-4aaa-b35b-b1dd2435a34c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:48.534349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1a38e1e-9b67-4aaa-b35b-b1dd2435a34c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:48.534804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1a38e1e-9b67-4aaa-b35b-b1dd2435a34c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:48.535230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1a38e1e-9b67-4aaa-b35b-b1dd2435a34c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:48.565303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f1a38e1e-9b67-4aaa-b35b-b1dd2435a34c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044410 Aug 18 22:02:48.565877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 705/1407] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:48 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:48.780197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a1ff67d1-48a2-4126-bac2-e95347e8279b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:48.782379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a1ff67d1-48a2-4126-bac2-e95347e8279b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:48.788297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1ff67d1-48a2-4126-bac2-e95347e8279b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:48.788780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1ff67d1-48a2-4126-bac2-e95347e8279b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:48.789218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1ff67d1-48a2-4126-bac2-e95347e8279b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:48.789933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1ff67d1-48a2-4126-bac2-e95347e8279b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:48.790390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1ff67d1-48a2-4126-bac2-e95347e8279b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:48.790821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1ff67d1-48a2-4126-bac2-e95347e8279b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:48.821069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a1ff67d1-48a2-4126-bac2-e95347e8279b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044696 Aug 18 22:02:48.821761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 703/1408] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:48 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:49.142346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-56280ffc-6d78-4eb9-858c-15697c167cb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:49.144479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-56280ffc-6d78-4eb9-858c-15697c167cb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:49.150605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56280ffc-6d78-4eb9-858c-15697c167cb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:49.151084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56280ffc-6d78-4eb9-858c-15697c167cb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:49.151523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56280ffc-6d78-4eb9-858c-15697c167cb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:49.152221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56280ffc-6d78-4eb9-858c-15697c167cb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:49.152677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56280ffc-6d78-4eb9-858c-15697c167cb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:49.153108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56280ffc-6d78-4eb9-858c-15697c167cb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:49.184560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-56280ffc-6d78-4eb9-858c-15697c167cb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046101 Aug 18 22:02:49.185134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 706/1409] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:49.407475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c27e664c-2108-402a-a301-a2631fae3ff7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:49.410127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c27e664c-2108-402a-a301-a2631fae3ff7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:49.416500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c27e664c-2108-402a-a301-a2631fae3ff7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:49.416973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c27e664c-2108-402a-a301-a2631fae3ff7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:49.417403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c27e664c-2108-402a-a301-a2631fae3ff7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:49.418126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c27e664c-2108-402a-a301-a2631fae3ff7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:49.418575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c27e664c-2108-402a-a301-a2631fae3ff7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:49.418998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c27e664c-2108-402a-a301-a2631fae3ff7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:49.447240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c27e664c-2108-402a-a301-a2631fae3ff7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043898 Aug 18 22:02:49.447780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 704/1410] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:49 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:49.577580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-08be760f-e80d-431b-a30f-1e5c611d1d78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:49.580067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-08be760f-e80d-431b-a30f-1e5c611d1d78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:49.587039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-08be760f-e80d-431b-a30f-1e5c611d1d78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:49.587523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-08be760f-e80d-431b-a30f-1e5c611d1d78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:49.587966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-08be760f-e80d-431b-a30f-1e5c611d1d78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:49.588668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-08be760f-e80d-431b-a30f-1e5c611d1d78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:49.589176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-08be760f-e80d-431b-a30f-1e5c611d1d78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:49.589589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-08be760f-e80d-431b-a30f-1e5c611d1d78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:49.619405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-08be760f-e80d-431b-a30f-1e5c611d1d78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045688 Aug 18 22:02:49.620014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 707/1411] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:49 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:49.833463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2f0f484f-db41-4986-8b89-dc261d0dcf6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:49.835740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2f0f484f-db41-4986-8b89-dc261d0dcf6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:49.841647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f0f484f-db41-4986-8b89-dc261d0dcf6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:49.842141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f0f484f-db41-4986-8b89-dc261d0dcf6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:49.842579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f0f484f-db41-4986-8b89-dc261d0dcf6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:49.843275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f0f484f-db41-4986-8b89-dc261d0dcf6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:49.843735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f0f484f-db41-4986-8b89-dc261d0dcf6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:49.844171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f0f484f-db41-4986-8b89-dc261d0dcf6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:49.873002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2f0f484f-db41-4986-8b89-dc261d0dcf6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Aug 18 22:02:49.873555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 705/1412] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:49 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:50.196980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-908945a3-456f-4b64-8e13-18c648d355cd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:50.199315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-908945a3-456f-4b64-8e13-18c648d355cd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:50.206150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-908945a3-456f-4b64-8e13-18c648d355cd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:50.207358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-908945a3-456f-4b64-8e13-18c648d355cd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:50.207800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-908945a3-456f-4b64-8e13-18c648d355cd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:50.208508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-908945a3-456f-4b64-8e13-18c648d355cd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:50.208959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-908945a3-456f-4b64-8e13-18c648d355cd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:50.209382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-908945a3-456f-4b64-8e13-18c648d355cd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:50.237889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-908945a3-456f-4b64-8e13-18c648d355cd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044868 Aug 18 22:02:50.238438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 708/1413] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:50.459727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3824cee9-e76b-443b-b6fa-55baa171c0e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:50.461841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3824cee9-e76b-443b-b6fa-55baa171c0e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:50.468220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3824cee9-e76b-443b-b6fa-55baa171c0e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:50.468702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3824cee9-e76b-443b-b6fa-55baa171c0e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:50.469135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3824cee9-e76b-443b-b6fa-55baa171c0e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:50.469852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3824cee9-e76b-443b-b6fa-55baa171c0e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:50.470312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3824cee9-e76b-443b-b6fa-55baa171c0e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:50.470739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3824cee9-e76b-443b-b6fa-55baa171c0e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:50.499139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3824cee9-e76b-443b-b6fa-55baa171c0e2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043493 Aug 18 22:02:50.499703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 706/1414] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:50.631723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7b31f96f-17ff-4a83-94c1-869d024ab2d0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:50.633942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7b31f96f-17ff-4a83-94c1-869d024ab2d0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:50.640229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b31f96f-17ff-4a83-94c1-869d024ab2d0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:50.640710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b31f96f-17ff-4a83-94c1-869d024ab2d0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:50.641145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b31f96f-17ff-4a83-94c1-869d024ab2d0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:50.641870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b31f96f-17ff-4a83-94c1-869d024ab2d0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:50.642323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b31f96f-17ff-4a83-94c1-869d024ab2d0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:50.642747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b31f96f-17ff-4a83-94c1-869d024ab2d0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:50.666938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:50.672138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7b31f96f-17ff-4a83-94c1-869d024ab2d0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044526 Aug 18 22:02:50.672687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 709/1415] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:50 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:50.885296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-be977876-7cfb-484c-bc17-85450513dcb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:50.887451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-be977876-7cfb-484c-bc17-85450513dcb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:50.893443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be977876-7cfb-484c-bc17-85450513dcb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:50.894149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be977876-7cfb-484c-bc17-85450513dcb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:50.894386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be977876-7cfb-484c-bc17-85450513dcb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:50.895075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be977876-7cfb-484c-bc17-85450513dcb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:50.895521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be977876-7cfb-484c-bc17-85450513dcb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:50.895940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-be977876-7cfb-484c-bc17-85450513dcb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:50.925487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-be977876-7cfb-484c-bc17-85450513dcb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044099 Aug 18 22:02:50.926069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 707/1416] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:50 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:51.250846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6ea24cc1-6476-4ebb-8fca-8fa36756cf0c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:51.252987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6ea24cc1-6476-4ebb-8fca-8fa36756cf0c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:51.258817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ea24cc1-6476-4ebb-8fca-8fa36756cf0c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:51.259307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ea24cc1-6476-4ebb-8fca-8fa36756cf0c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:51.259717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ea24cc1-6476-4ebb-8fca-8fa36756cf0c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:51.260399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ea24cc1-6476-4ebb-8fca-8fa36756cf0c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:51.260845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ea24cc1-6476-4ebb-8fca-8fa36756cf0c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:51.261263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ea24cc1-6476-4ebb-8fca-8fa36756cf0c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:51.290202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6ea24cc1-6476-4ebb-8fca-8fa36756cf0c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043618 Aug 18 22:02:51.290743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 710/1417] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:51 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:51.512192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-38f2e6d6-835e-48b9-b4c2-34e5c5bde163 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:51.514311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-38f2e6d6-835e-48b9-b4c2-34e5c5bde163 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:51.521386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38f2e6d6-835e-48b9-b4c2-34e5c5bde163 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:51.521897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38f2e6d6-835e-48b9-b4c2-34e5c5bde163 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:51.522340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38f2e6d6-835e-48b9-b4c2-34e5c5bde163 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:51.523031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38f2e6d6-835e-48b9-b4c2-34e5c5bde163 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:51.523487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38f2e6d6-835e-48b9-b4c2-34e5c5bde163 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:51.523915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38f2e6d6-835e-48b9-b4c2-34e5c5bde163 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:51.552273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-38f2e6d6-835e-48b9-b4c2-34e5c5bde163 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044233 Aug 18 22:02:51.552821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 708/1418] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:51.685325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cb310cb3-278c-4735-9707-ba61aee5b629 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:51.687494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cb310cb3-278c-4735-9707-ba61aee5b629 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:51.694532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb310cb3-278c-4735-9707-ba61aee5b629 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:51.695012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb310cb3-278c-4735-9707-ba61aee5b629 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:51.695449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb310cb3-278c-4735-9707-ba61aee5b629 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:51.696148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb310cb3-278c-4735-9707-ba61aee5b629 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:51.696604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb310cb3-278c-4735-9707-ba61aee5b629 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:51.697020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb310cb3-278c-4735-9707-ba61aee5b629 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:51.726493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cb310cb3-278c-4735-9707-ba61aee5b629 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Aug 18 22:02:51.727049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 711/1419] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:51 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:51.937287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4a541853-7147-4b1d-8329-1127eb677f79 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:51.940253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4a541853-7147-4b1d-8329-1127eb677f79 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:51.946435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a541853-7147-4b1d-8329-1127eb677f79 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:51.946939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a541853-7147-4b1d-8329-1127eb677f79 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:51.947381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a541853-7147-4b1d-8329-1127eb677f79 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:51.948090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a541853-7147-4b1d-8329-1127eb677f79 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:51.948550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a541853-7147-4b1d-8329-1127eb677f79 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:51.948981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a541853-7147-4b1d-8329-1127eb677f79 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:51.973217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:51.978629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4a541853-7147-4b1d-8329-1127eb677f79 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045429 Aug 18 22:02:51.979191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 709/1420] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:51 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:52.303451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5402257d-89c7-4595-8de3-c1e586d5fcab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:52.305632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5402257d-89c7-4595-8de3-c1e586d5fcab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:52.311496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5402257d-89c7-4595-8de3-c1e586d5fcab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:52.311972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5402257d-89c7-4595-8de3-c1e586d5fcab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:52.312401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5402257d-89c7-4595-8de3-c1e586d5fcab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:52.313091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5402257d-89c7-4595-8de3-c1e586d5fcab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:52.313538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5402257d-89c7-4595-8de3-c1e586d5fcab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:52.313979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5402257d-89c7-4595-8de3-c1e586d5fcab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:52.341846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5402257d-89c7-4595-8de3-c1e586d5fcab tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042877 Aug 18 22:02:52.342402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 712/1421] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:52 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:52.564647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1fcf0529-0325-4747-b050-0e36dbdeacf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:52.566784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1fcf0529-0325-4747-b050-0e36dbdeacf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:52.573044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fcf0529-0325-4747-b050-0e36dbdeacf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:52.573515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fcf0529-0325-4747-b050-0e36dbdeacf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:52.573980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fcf0529-0325-4747-b050-0e36dbdeacf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:52.574663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fcf0529-0325-4747-b050-0e36dbdeacf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:52.575141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fcf0529-0325-4747-b050-0e36dbdeacf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:52.575568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fcf0529-0325-4747-b050-0e36dbdeacf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:52.604382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1fcf0529-0325-4747-b050-0e36dbdeacf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Aug 18 22:02:52.604933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 710/1422] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:52.738851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-19d716a9-53fa-4ee1-afa6-5e3786a12d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:52.740984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-19d716a9-53fa-4ee1-afa6-5e3786a12d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:52.747377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19d716a9-53fa-4ee1-afa6-5e3786a12d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:52.747858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19d716a9-53fa-4ee1-afa6-5e3786a12d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:52.748301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19d716a9-53fa-4ee1-afa6-5e3786a12d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:52.748997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19d716a9-53fa-4ee1-afa6-5e3786a12d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:52.749473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19d716a9-53fa-4ee1-afa6-5e3786a12d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:52.749937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19d716a9-53fa-4ee1-afa6-5e3786a12d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:52.778701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-19d716a9-53fa-4ee1-afa6-5e3786a12d8e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043803 Aug 18 22:02:52.779274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 713/1423] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:52.991570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c0b1a56b-6495-46ce-ac45-22523fceec0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:52.993729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c0b1a56b-6495-46ce-ac45-22523fceec0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:52.999642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0b1a56b-6495-46ce-ac45-22523fceec0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:53.000122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0b1a56b-6495-46ce-ac45-22523fceec0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:53.000557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0b1a56b-6495-46ce-ac45-22523fceec0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:53.001249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0b1a56b-6495-46ce-ac45-22523fceec0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:53.001747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0b1a56b-6495-46ce-ac45-22523fceec0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:53.002633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0b1a56b-6495-46ce-ac45-22523fceec0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:53.031894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c0b1a56b-6495-46ce-ac45-22523fceec0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Aug 18 22:02:53.032442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 711/1424] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:52 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:53.354284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-28ac3980-1336-4b7e-80c2-a20195e80782 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:53.356327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-28ac3980-1336-4b7e-80c2-a20195e80782 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:53.362398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28ac3980-1336-4b7e-80c2-a20195e80782 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:53.363365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28ac3980-1336-4b7e-80c2-a20195e80782 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:53.363801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28ac3980-1336-4b7e-80c2-a20195e80782 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:53.364485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28ac3980-1336-4b7e-80c2-a20195e80782 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:53.364932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28ac3980-1336-4b7e-80c2-a20195e80782 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:53.365359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28ac3980-1336-4b7e-80c2-a20195e80782 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:53.396231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-28ac3980-1336-4b7e-80c2-a20195e80782 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046043 Aug 18 22:02:53.396776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 714/1425] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:53 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:53.617271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a957939d-646a-4bec-9075-4be2504cbd72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:53.619426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a957939d-646a-4bec-9075-4be2504cbd72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:53.625861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a957939d-646a-4bec-9075-4be2504cbd72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:53.626343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a957939d-646a-4bec-9075-4be2504cbd72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:53.626786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a957939d-646a-4bec-9075-4be2504cbd72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:53.627481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a957939d-646a-4bec-9075-4be2504cbd72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:53.627940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a957939d-646a-4bec-9075-4be2504cbd72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:53.628372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a957939d-646a-4bec-9075-4be2504cbd72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:53.656325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a957939d-646a-4bec-9075-4be2504cbd72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043761 Aug 18 22:02:53.657248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 712/1426] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:53 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:53.793418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1e8228fe-1730-48ea-884d-7b3e98d4d9db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:53.796023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1e8228fe-1730-48ea-884d-7b3e98d4d9db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:53.803373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e8228fe-1730-48ea-884d-7b3e98d4d9db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:53.803858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e8228fe-1730-48ea-884d-7b3e98d4d9db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:53.804295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e8228fe-1730-48ea-884d-7b3e98d4d9db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:53.804993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e8228fe-1730-48ea-884d-7b3e98d4d9db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:53.805447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e8228fe-1730-48ea-884d-7b3e98d4d9db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:53.805899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e8228fe-1730-48ea-884d-7b3e98d4d9db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:53.834216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1e8228fe-1730-48ea-884d-7b3e98d4d9db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046734 Aug 18 22:02:53.834760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 715/1427] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:54.045127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5b1825d8-cb9a-452a-bc97-7bf41c6f1712 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:54.047372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5b1825d8-cb9a-452a-bc97-7bf41c6f1712 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:54.053863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b1825d8-cb9a-452a-bc97-7bf41c6f1712 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:54.054222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b1825d8-cb9a-452a-bc97-7bf41c6f1712 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:54.054701 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b1825d8-cb9a-452a-bc97-7bf41c6f1712 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:54.055367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b1825d8-cb9a-452a-bc97-7bf41c6f1712 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:54.055823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b1825d8-cb9a-452a-bc97-7bf41c6f1712 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:54.056255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b1825d8-cb9a-452a-bc97-7bf41c6f1712 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:54.089257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5b1825d8-cb9a-452a-bc97-7bf41c6f1712 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049197 Aug 18 22:02:54.089932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 713/1428] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:54 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:54.407994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0e943bbd-e980-49ae-bfe8-7754ee63ec1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:54.410138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0e943bbd-e980-49ae-bfe8-7754ee63ec1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:54.416094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e943bbd-e980-49ae-bfe8-7754ee63ec1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:54.416578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e943bbd-e980-49ae-bfe8-7754ee63ec1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:54.417001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e943bbd-e980-49ae-bfe8-7754ee63ec1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:54.417723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e943bbd-e980-49ae-bfe8-7754ee63ec1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:54.418177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e943bbd-e980-49ae-bfe8-7754ee63ec1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:54.418599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e943bbd-e980-49ae-bfe8-7754ee63ec1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:54.447380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0e943bbd-e980-49ae-bfe8-7754ee63ec1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043361 Aug 18 22:02:54.447928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 716/1429] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:54 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:54.669227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-17493bb0-b1fb-4403-90cb-03ff975cbb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:54.671347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-17493bb0-b1fb-4403-90cb-03ff975cbb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:54.678584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17493bb0-b1fb-4403-90cb-03ff975cbb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:54.679066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17493bb0-b1fb-4403-90cb-03ff975cbb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:54.679506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17493bb0-b1fb-4403-90cb-03ff975cbb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:54.680197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17493bb0-b1fb-4403-90cb-03ff975cbb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:54.680650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17493bb0-b1fb-4403-90cb-03ff975cbb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:54.681083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17493bb0-b1fb-4403-90cb-03ff975cbb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:54.711721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-17493bb0-b1fb-4403-90cb-03ff975cbb2a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046501 Aug 18 22:02:54.716160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 714/1430] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:54 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:54.846645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-09f25957-2484-4f5a-86c3-3c71596b468e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:54.848772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-09f25957-2484-4f5a-86c3-3c71596b468e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:54.855022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09f25957-2484-4f5a-86c3-3c71596b468e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:54.855513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09f25957-2484-4f5a-86c3-3c71596b468e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:54.855924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09f25957-2484-4f5a-86c3-3c71596b468e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:54.856609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09f25957-2484-4f5a-86c3-3c71596b468e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:54.857059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09f25957-2484-4f5a-86c3-3c71596b468e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:54.857477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-09f25957-2484-4f5a-86c3-3c71596b468e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:54.889727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-09f25957-2484-4f5a-86c3-3c71596b468e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Aug 18 22:02:54.890338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 717/1431] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:02:55.102168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eaa1c3e8-e89c-4274-8f28-0ce0957c26ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:55.104332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eaa1c3e8-e89c-4274-8f28-0ce0957c26ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:55.110226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eaa1c3e8-e89c-4274-8f28-0ce0957c26ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:55.110706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eaa1c3e8-e89c-4274-8f28-0ce0957c26ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:55.111140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eaa1c3e8-e89c-4274-8f28-0ce0957c26ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:55.111829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eaa1c3e8-e89c-4274-8f28-0ce0957c26ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:55.112282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eaa1c3e8-e89c-4274-8f28-0ce0957c26ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:55.113332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eaa1c3e8-e89c-4274-8f28-0ce0957c26ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:55.142730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eaa1c3e8-e89c-4274-8f28-0ce0957c26ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Aug 18 22:02:55.143315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 715/1432] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:55 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:55.460202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f12796f6-9fb0-4ab4-8bea-6ba19939098e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:55.462280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f12796f6-9fb0-4ab4-8bea-6ba19939098e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:55.468143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f12796f6-9fb0-4ab4-8bea-6ba19939098e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:55.468611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f12796f6-9fb0-4ab4-8bea-6ba19939098e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:55.469041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f12796f6-9fb0-4ab4-8bea-6ba19939098e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:55.469752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f12796f6-9fb0-4ab4-8bea-6ba19939098e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:55.470207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f12796f6-9fb0-4ab4-8bea-6ba19939098e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:55.470624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f12796f6-9fb0-4ab4-8bea-6ba19939098e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:55.499208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f12796f6-9fb0-4ab4-8bea-6ba19939098e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043556 Aug 18 22:02:55.499755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 718/1433] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:55.724750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9a4603e2-e146-47a4-a542-ada9391fe17a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:55.726986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9a4603e2-e146-47a4-a542-ada9391fe17a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:55.733419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a4603e2-e146-47a4-a542-ada9391fe17a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:55.733948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a4603e2-e146-47a4-a542-ada9391fe17a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:55.734388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a4603e2-e146-47a4-a542-ada9391fe17a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:55.735086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a4603e2-e146-47a4-a542-ada9391fe17a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:55.735545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a4603e2-e146-47a4-a542-ada9391fe17a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:55.735973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a4603e2-e146-47a4-a542-ada9391fe17a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:55.763843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9a4603e2-e146-47a4-a542-ada9391fe17a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043661 Aug 18 22:02:55.764396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 716/1434] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:55 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:55.902655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b925c26f-0f2a-4992-afed-e8e80c84cd93 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:55.904818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b925c26f-0f2a-4992-afed-e8e80c84cd93 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:55.911121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b925c26f-0f2a-4992-afed-e8e80c84cd93 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:55.911595 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b925c26f-0f2a-4992-afed-e8e80c84cd93 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:55.912025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b925c26f-0f2a-4992-afed-e8e80c84cd93 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:55.912712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b925c26f-0f2a-4992-afed-e8e80c84cd93 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:55.913160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b925c26f-0f2a-4992-afed-e8e80c84cd93 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:55.913582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b925c26f-0f2a-4992-afed-e8e80c84cd93 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:55.941511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b925c26f-0f2a-4992-afed-e8e80c84cd93 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042796 Aug 18 22:02:55.942086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 719/1435] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:55 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:56.154999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e66f4f0d-6523-47c0-b01c-cb7cacd84bb6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:56.157398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e66f4f0d-6523-47c0-b01c-cb7cacd84bb6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:56.163287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e66f4f0d-6523-47c0-b01c-cb7cacd84bb6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:56.163778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e66f4f0d-6523-47c0-b01c-cb7cacd84bb6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:56.164225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e66f4f0d-6523-47c0-b01c-cb7cacd84bb6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:56.164929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e66f4f0d-6523-47c0-b01c-cb7cacd84bb6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:56.165448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e66f4f0d-6523-47c0-b01c-cb7cacd84bb6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:56.165903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e66f4f0d-6523-47c0-b01c-cb7cacd84bb6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:56.195949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e66f4f0d-6523-47c0-b01c-cb7cacd84bb6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045016 Aug 18 22:02:56.196516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 717/1436] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:56 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:56.512330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c3043264-ca47-4c8e-b9a2-68002d3e56b6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:56.514401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c3043264-ca47-4c8e-b9a2-68002d3e56b6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:56.520292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3043264-ca47-4c8e-b9a2-68002d3e56b6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:56.520765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3043264-ca47-4c8e-b9a2-68002d3e56b6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:56.521209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3043264-ca47-4c8e-b9a2-68002d3e56b6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:56.521934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3043264-ca47-4c8e-b9a2-68002d3e56b6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:56.522366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3043264-ca47-4c8e-b9a2-68002d3e56b6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:56.522784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3043264-ca47-4c8e-b9a2-68002d3e56b6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:56.552406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c3043264-ca47-4c8e-b9a2-68002d3e56b6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043535 Aug 18 22:02:56.552988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 720/1437] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:56.776226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8ffb3ffa-83f6-4f99-ad48-5acf14dc1bd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:56.778409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8ffb3ffa-83f6-4f99-ad48-5acf14dc1bd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:56.784760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ffb3ffa-83f6-4f99-ad48-5acf14dc1bd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:56.785276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ffb3ffa-83f6-4f99-ad48-5acf14dc1bd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:56.785741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ffb3ffa-83f6-4f99-ad48-5acf14dc1bd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:56.786930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ffb3ffa-83f6-4f99-ad48-5acf14dc1bd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:56.787389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ffb3ffa-83f6-4f99-ad48-5acf14dc1bd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:56.787818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ffb3ffa-83f6-4f99-ad48-5acf14dc1bd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:56.817426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8ffb3ffa-83f6-4f99-ad48-5acf14dc1bd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045021 Aug 18 22:02:56.818018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 718/1438] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:56 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:56.953613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb807d85-8008-403e-b063-8a904af76ce9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:56.955750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fb807d85-8008-403e-b063-8a904af76ce9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:56.962522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb807d85-8008-403e-b063-8a904af76ce9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:56.962998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb807d85-8008-403e-b063-8a904af76ce9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:56.963432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb807d85-8008-403e-b063-8a904af76ce9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:56.964118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb807d85-8008-403e-b063-8a904af76ce9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:56.964567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb807d85-8008-403e-b063-8a904af76ce9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:56.964988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb807d85-8008-403e-b063-8a904af76ce9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:56.994424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fb807d85-8008-403e-b063-8a904af76ce9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044779 Aug 18 22:02:56.994963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 721/1439] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:56 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:57.209177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e3df7451-2c62-497e-ab5b-5431c263ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:57.211668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e3df7451-2c62-497e-ab5b-5431c263ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:57.217828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3df7451-2c62-497e-ab5b-5431c263ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:57.218312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3df7451-2c62-497e-ab5b-5431c263ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:57.218749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3df7451-2c62-497e-ab5b-5431c263ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:57.219449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3df7451-2c62-497e-ab5b-5431c263ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:57.219905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3df7451-2c62-497e-ab5b-5431c263ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:57.220329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3df7451-2c62-497e-ab5b-5431c263ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:57.249476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e3df7451-2c62-497e-ab5b-5431c263ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 Aug 18 22:02:57.250067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 719/1440] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:57 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:57.565015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6e7802ee-2ca6-4019-864c-c0e7bfb3d0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:57.567771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6e7802ee-2ca6-4019-864c-c0e7bfb3d0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:57.573679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e7802ee-2ca6-4019-864c-c0e7bfb3d0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:57.574175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e7802ee-2ca6-4019-864c-c0e7bfb3d0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:57.574618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e7802ee-2ca6-4019-864c-c0e7bfb3d0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:57.575327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e7802ee-2ca6-4019-864c-c0e7bfb3d0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:57.575808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e7802ee-2ca6-4019-864c-c0e7bfb3d0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:57.576222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e7802ee-2ca6-4019-864c-c0e7bfb3d0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:57.605400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6e7802ee-2ca6-4019-864c-c0e7bfb3d0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044506 Aug 18 22:02:57.605984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 722/1441] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:57.829927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-566c6c43-d647-4ffe-aa6b-f2258c548fdd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:57.831994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-566c6c43-d647-4ffe-aa6b-f2258c548fdd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:57.838174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-566c6c43-d647-4ffe-aa6b-f2258c548fdd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:57.838635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-566c6c43-d647-4ffe-aa6b-f2258c548fdd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:57.839144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-566c6c43-d647-4ffe-aa6b-f2258c548fdd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:57.839764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-566c6c43-d647-4ffe-aa6b-f2258c548fdd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:57.840221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-566c6c43-d647-4ffe-aa6b-f2258c548fdd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:57.840649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-566c6c43-d647-4ffe-aa6b-f2258c548fdd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:57.880756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-566c6c43-d647-4ffe-aa6b-f2258c548fdd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054221 Aug 18 22:02:57.881341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 720/1442] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:58.007063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-036a179a-35ab-49bf-8d58-2a364c6c0b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:58.009252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-036a179a-35ab-49bf-8d58-2a364c6c0b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:58.015733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-036a179a-35ab-49bf-8d58-2a364c6c0b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:58.016466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-036a179a-35ab-49bf-8d58-2a364c6c0b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:58.017186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-036a179a-35ab-49bf-8d58-2a364c6c0b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:58.017932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-036a179a-35ab-49bf-8d58-2a364c6c0b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:58.018401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-036a179a-35ab-49bf-8d58-2a364c6c0b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:58.018831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-036a179a-35ab-49bf-8d58-2a364c6c0b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:58.048726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-036a179a-35ab-49bf-8d58-2a364c6c0b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045890 Aug 18 22:02:58.049286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 723/1443] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:58.263024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-55ddb2f0-0e69-4288-a17f-668127fea0b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:58.265465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-55ddb2f0-0e69-4288-a17f-668127fea0b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:58.271911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55ddb2f0-0e69-4288-a17f-668127fea0b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:58.272516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55ddb2f0-0e69-4288-a17f-668127fea0b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:58.273264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55ddb2f0-0e69-4288-a17f-668127fea0b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:58.274053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55ddb2f0-0e69-4288-a17f-668127fea0b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:58.274622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55ddb2f0-0e69-4288-a17f-668127fea0b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:58.275160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55ddb2f0-0e69-4288-a17f-668127fea0b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:58.307129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-55ddb2f0-0e69-4288-a17f-668127fea0b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049022 Aug 18 22:02:58.307781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 721/1444] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:58 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:58.617215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6b820896-669a-4238-9c7a-cc35a51d0265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:58.619397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6b820896-669a-4238-9c7a-cc35a51d0265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:58.625721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b820896-669a-4238-9c7a-cc35a51d0265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:58.626341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b820896-669a-4238-9c7a-cc35a51d0265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:58.626805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b820896-669a-4238-9c7a-cc35a51d0265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:58.627614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b820896-669a-4238-9c7a-cc35a51d0265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:58.628160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b820896-669a-4238-9c7a-cc35a51d0265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:58.628690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b820896-669a-4238-9c7a-cc35a51d0265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:58.658192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6b820896-669a-4238-9c7a-cc35a51d0265 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045005 Aug 18 22:02:58.658758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 724/1445] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:58.892486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-734d9747-1b75-48fd-9d60-b6902a1a7da7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:58.894594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-734d9747-1b75-48fd-9d60-b6902a1a7da7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:58.901560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-734d9747-1b75-48fd-9d60-b6902a1a7da7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:58.902104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-734d9747-1b75-48fd-9d60-b6902a1a7da7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:58.902535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-734d9747-1b75-48fd-9d60-b6902a1a7da7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:58.903227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-734d9747-1b75-48fd-9d60-b6902a1a7da7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:58.903676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-734d9747-1b75-48fd-9d60-b6902a1a7da7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:58.904095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-734d9747-1b75-48fd-9d60-b6902a1a7da7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:58.932966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-734d9747-1b75-48fd-9d60-b6902a1a7da7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 Aug 18 22:02:58.933518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 722/1446] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:58 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:59.061734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1a9964b6-11ae-4a71-8749-3fcd2ec4a7fb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:59.063871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1a9964b6-11ae-4a71-8749-3fcd2ec4a7fb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:59.070835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a9964b6-11ae-4a71-8749-3fcd2ec4a7fb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:59.071319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a9964b6-11ae-4a71-8749-3fcd2ec4a7fb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:59.071760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a9964b6-11ae-4a71-8749-3fcd2ec4a7fb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:59.072470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a9964b6-11ae-4a71-8749-3fcd2ec4a7fb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:59.072926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a9964b6-11ae-4a71-8749-3fcd2ec4a7fb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:59.073352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a9964b6-11ae-4a71-8749-3fcd2ec4a7fb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:59.102437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1a9964b6-11ae-4a71-8749-3fcd2ec4a7fb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044692 Aug 18 22:02:59.102992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 725/1447] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:59 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:59.320129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cc659a58-b0c1-4677-83c3-85abf3fe3ebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:59.322519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cc659a58-b0c1-4677-83c3-85abf3fe3ebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:59.339155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc659a58-b0c1-4677-83c3-85abf3fe3ebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:59.339815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc659a58-b0c1-4677-83c3-85abf3fe3ebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:59.340254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc659a58-b0c1-4677-83c3-85abf3fe3ebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:59.340960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc659a58-b0c1-4677-83c3-85abf3fe3ebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:59.341418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc659a58-b0c1-4677-83c3-85abf3fe3ebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:59.342050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc659a58-b0c1-4677-83c3-85abf3fe3ebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:59.372488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cc659a58-b0c1-4677-83c3-85abf3fe3ebf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057209 Aug 18 22:02:59.373046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 723/1448] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:59 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:02:59.671279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab6c6881-533d-49a4-ab21-be74befbf116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:59.673653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab6c6881-533d-49a4-ab21-be74befbf116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:59.680701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab6c6881-533d-49a4-ab21-be74befbf116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:59.681188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab6c6881-533d-49a4-ab21-be74befbf116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:59.681654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab6c6881-533d-49a4-ab21-be74befbf116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:59.682394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab6c6881-533d-49a4-ab21-be74befbf116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:59.682853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab6c6881-533d-49a4-ab21-be74befbf116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:59.683282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab6c6881-533d-49a4-ab21-be74befbf116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:59.696930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:02:59.712875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab6c6881-533d-49a4-ab21-be74befbf116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045640 Aug 18 22:02:59.713439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 726/1449] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:02:59 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:02:59.944591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6d4175c1-6ef8-41c8-95ed-e656ebaa41cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:02:59.946689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6d4175c1-6ef8-41c8-95ed-e656ebaa41cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:02:59.953051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d4175c1-6ef8-41c8-95ed-e656ebaa41cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:59.953774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d4175c1-6ef8-41c8-95ed-e656ebaa41cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:59.953998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d4175c1-6ef8-41c8-95ed-e656ebaa41cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:59.954685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d4175c1-6ef8-41c8-95ed-e656ebaa41cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:02:59.955138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d4175c1-6ef8-41c8-95ed-e656ebaa41cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:02:59.955562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d4175c1-6ef8-41c8-95ed-e656ebaa41cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:02:59.984656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6d4175c1-6ef8-41c8-95ed-e656ebaa41cc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044143 Aug 18 22:02:59.985214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 724/1450] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:02:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:00.115215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab3dacb3-b0b6-4ad8-acb3-084bffa1347f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:00.117377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab3dacb3-b0b6-4ad8-acb3-084bffa1347f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:00.123672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab3dacb3-b0b6-4ad8-acb3-084bffa1347f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:00.124151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab3dacb3-b0b6-4ad8-acb3-084bffa1347f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:00.124616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab3dacb3-b0b6-4ad8-acb3-084bffa1347f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:00.125402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab3dacb3-b0b6-4ad8-acb3-084bffa1347f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:00.125896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab3dacb3-b0b6-4ad8-acb3-084bffa1347f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:00.126317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab3dacb3-b0b6-4ad8-acb3-084bffa1347f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:00.156366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab3dacb3-b0b6-4ad8-acb3-084bffa1347f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045126 Aug 18 22:03:00.157009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 727/1451] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:00 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:00.385105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-55a3a789-5c1d-4570-935b-7967f1724236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:00.387323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-55a3a789-5c1d-4570-935b-7967f1724236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:00.393385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55a3a789-5c1d-4570-935b-7967f1724236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:00.393903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55a3a789-5c1d-4570-935b-7967f1724236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:00.394351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55a3a789-5c1d-4570-935b-7967f1724236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:00.395052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55a3a789-5c1d-4570-935b-7967f1724236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:00.396105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55a3a789-5c1d-4570-935b-7967f1724236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:00.396531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55a3a789-5c1d-4570-935b-7967f1724236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:00.426322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-55a3a789-5c1d-4570-935b-7967f1724236 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Aug 18 22:03:00.426875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 725/1452] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:00 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:00.724771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a6eb6fd-ad73-426a-be07-fcb743db8194 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:00.727021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0a6eb6fd-ad73-426a-be07-fcb743db8194 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:00.732993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a6eb6fd-ad73-426a-be07-fcb743db8194 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:00.733483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a6eb6fd-ad73-426a-be07-fcb743db8194 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:00.733970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a6eb6fd-ad73-426a-be07-fcb743db8194 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:00.734709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a6eb6fd-ad73-426a-be07-fcb743db8194 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:00.735166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a6eb6fd-ad73-426a-be07-fcb743db8194 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:00.735596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a6eb6fd-ad73-426a-be07-fcb743db8194 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:00.765428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a6eb6fd-ad73-426a-be07-fcb743db8194 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044682 Aug 18 22:03:00.769347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 728/1453] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:00 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:00.996922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fb053a0a-abb9-4794-b839-439b2d497102 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:00.999211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fb053a0a-abb9-4794-b839-439b2d497102 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:01.006318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb053a0a-abb9-4794-b839-439b2d497102 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:01.006798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb053a0a-abb9-4794-b839-439b2d497102 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:01.007230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb053a0a-abb9-4794-b839-439b2d497102 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:01.007923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb053a0a-abb9-4794-b839-439b2d497102 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:01.008374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb053a0a-abb9-4794-b839-439b2d497102 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:01.008793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb053a0a-abb9-4794-b839-439b2d497102 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:01.025950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:01.039797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fb053a0a-abb9-4794-b839-439b2d497102 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046760 Aug 18 22:03:01.040363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 726/1454] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:00 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:01.170178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a58eac80-cd7e-4b7e-9359-20242d48d70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:01.172388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a58eac80-cd7e-4b7e-9359-20242d48d70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:01.179423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a58eac80-cd7e-4b7e-9359-20242d48d70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:01.179909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a58eac80-cd7e-4b7e-9359-20242d48d70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:01.180347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a58eac80-cd7e-4b7e-9359-20242d48d70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:01.181051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a58eac80-cd7e-4b7e-9359-20242d48d70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:01.181504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a58eac80-cd7e-4b7e-9359-20242d48d70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:01.181957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a58eac80-cd7e-4b7e-9359-20242d48d70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:01.211240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a58eac80-cd7e-4b7e-9359-20242d48d70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045570 Aug 18 22:03:01.212004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 729/1455] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:01 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:01.438705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b68414fd-21ec-4deb-8015-447c3a373ca5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:01.452641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b68414fd-21ec-4deb-8015-447c3a373ca5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:01.452641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b68414fd-21ec-4deb-8015-447c3a373ca5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:01.452641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b68414fd-21ec-4deb-8015-447c3a373ca5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:01.452641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b68414fd-21ec-4deb-8015-447c3a373ca5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:01.452997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b68414fd-21ec-4deb-8015-447c3a373ca5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:01.452997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b68414fd-21ec-4deb-8015-447c3a373ca5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:01.452997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b68414fd-21ec-4deb-8015-447c3a373ca5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:01.480482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b68414fd-21ec-4deb-8015-447c3a373ca5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 Aug 18 22:03:01.481033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 727/1456] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:01 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:01.777769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b4aced2a-ffe7-4667-b8d0-5219ff7cb635 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:01.779932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b4aced2a-ffe7-4667-b8d0-5219ff7cb635 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:01.785896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4aced2a-ffe7-4667-b8d0-5219ff7cb635 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:01.786990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4aced2a-ffe7-4667-b8d0-5219ff7cb635 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:01.787427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4aced2a-ffe7-4667-b8d0-5219ff7cb635 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:01.788121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4aced2a-ffe7-4667-b8d0-5219ff7cb635 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:01.788573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4aced2a-ffe7-4667-b8d0-5219ff7cb635 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:01.788998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4aced2a-ffe7-4667-b8d0-5219ff7cb635 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:01.818091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b4aced2a-ffe7-4667-b8d0-5219ff7cb635 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043835 Aug 18 22:03:01.818655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 730/1457] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:02.051461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-510c476d-da81-4c23-90c2-f5c16bdcf453 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:02.053662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-510c476d-da81-4c23-90c2-f5c16bdcf453 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:02.060329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-510c476d-da81-4c23-90c2-f5c16bdcf453 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:02.060621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-510c476d-da81-4c23-90c2-f5c16bdcf453 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:02.061064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-510c476d-da81-4c23-90c2-f5c16bdcf453 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:02.061795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-510c476d-da81-4c23-90c2-f5c16bdcf453 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:02.062257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-510c476d-da81-4c23-90c2-f5c16bdcf453 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:02.062696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-510c476d-da81-4c23-90c2-f5c16bdcf453 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:02.092507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-510c476d-da81-4c23-90c2-f5c16bdcf453 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045202 Aug 18 22:03:02.093063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 728/1458] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:02 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:02.223176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-93acaa3f-9aa1-4aa4-ad5e-2b29ba5062ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:02.225356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-93acaa3f-9aa1-4aa4-ad5e-2b29ba5062ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:02.231752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93acaa3f-9aa1-4aa4-ad5e-2b29ba5062ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:02.232231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93acaa3f-9aa1-4aa4-ad5e-2b29ba5062ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:02.232668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93acaa3f-9aa1-4aa4-ad5e-2b29ba5062ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:02.233366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93acaa3f-9aa1-4aa4-ad5e-2b29ba5062ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:02.233857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93acaa3f-9aa1-4aa4-ad5e-2b29ba5062ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:02.234303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93acaa3f-9aa1-4aa4-ad5e-2b29ba5062ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:02.263699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-93acaa3f-9aa1-4aa4-ad5e-2b29ba5062ca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Aug 18 22:03:02.264251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 731/1459] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:02 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:02.492986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a10d1c5d-b29a-46ef-b658-9b8da52c5d37 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:02.495219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a10d1c5d-b29a-46ef-b658-9b8da52c5d37 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:02.501191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a10d1c5d-b29a-46ef-b658-9b8da52c5d37 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:02.501712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a10d1c5d-b29a-46ef-b658-9b8da52c5d37 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:02.502154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a10d1c5d-b29a-46ef-b658-9b8da52c5d37 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:02.502849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a10d1c5d-b29a-46ef-b658-9b8da52c5d37 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:02.503304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a10d1c5d-b29a-46ef-b658-9b8da52c5d37 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:02.503734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a10d1c5d-b29a-46ef-b658-9b8da52c5d37 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:02.534188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a10d1c5d-b29a-46ef-b658-9b8da52c5d37 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045413 Aug 18 22:03:02.535119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 729/1460] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:02 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:02.830419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-32e419b3-05f6-4765-a837-7d8e913c01ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:02.832551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-32e419b3-05f6-4765-a837-7d8e913c01ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:02.838459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32e419b3-05f6-4765-a837-7d8e913c01ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:02.838941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32e419b3-05f6-4765-a837-7d8e913c01ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:02.839376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32e419b3-05f6-4765-a837-7d8e913c01ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:02.840065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32e419b3-05f6-4765-a837-7d8e913c01ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:02.840526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32e419b3-05f6-4765-a837-7d8e913c01ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:02.840953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32e419b3-05f6-4765-a837-7d8e913c01ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:02.870226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-32e419b3-05f6-4765-a837-7d8e913c01ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043805 Aug 18 22:03:02.870796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 732/1461] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:03.104986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a756ad5c-73f6-4b03-9130-656e37509041 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:03.107172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a756ad5c-73f6-4b03-9130-656e37509041 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:03.113528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a756ad5c-73f6-4b03-9130-656e37509041 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:03.114061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a756ad5c-73f6-4b03-9130-656e37509041 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:03.114497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a756ad5c-73f6-4b03-9130-656e37509041 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:03.115181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a756ad5c-73f6-4b03-9130-656e37509041 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:03.115632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a756ad5c-73f6-4b03-9130-656e37509041 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:03.116055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a756ad5c-73f6-4b03-9130-656e37509041 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:03.143667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a756ad5c-73f6-4b03-9130-656e37509041 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042658 Aug 18 22:03:03.144213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 730/1462] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:03 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:03.276679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cf6228b4-0dd1-4952-a449-e0e0cafe12a8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:03.278968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cf6228b4-0dd1-4952-a449-e0e0cafe12a8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:03.285314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf6228b4-0dd1-4952-a449-e0e0cafe12a8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:03.285832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf6228b4-0dd1-4952-a449-e0e0cafe12a8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:03.286979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf6228b4-0dd1-4952-a449-e0e0cafe12a8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:03.287675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf6228b4-0dd1-4952-a449-e0e0cafe12a8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:03.288129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf6228b4-0dd1-4952-a449-e0e0cafe12a8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:03.288557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf6228b4-0dd1-4952-a449-e0e0cafe12a8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:03.317001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cf6228b4-0dd1-4952-a449-e0e0cafe12a8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 Aug 18 22:03:03.318101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 733/1463] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:03 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:03.547189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fcbd0b76-d49e-4741-913b-81d16307df5f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:03.549574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fcbd0b76-d49e-4741-913b-81d16307df5f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:03.555457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcbd0b76-d49e-4741-913b-81d16307df5f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:03.555939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcbd0b76-d49e-4741-913b-81d16307df5f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:03.556374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcbd0b76-d49e-4741-913b-81d16307df5f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:03.557069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcbd0b76-d49e-4741-913b-81d16307df5f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:03.557521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcbd0b76-d49e-4741-913b-81d16307df5f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:03.557985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcbd0b76-d49e-4741-913b-81d16307df5f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:03.589887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fcbd0b76-d49e-4741-913b-81d16307df5f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046447 Aug 18 22:03:03.590444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 731/1464] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:03 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:03.882769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c8f0e50b-2bf5-4abe-9125-a0179d84de38 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:03.884984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c8f0e50b-2bf5-4abe-9125-a0179d84de38 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:03.891001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8f0e50b-2bf5-4abe-9125-a0179d84de38 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:03.891475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8f0e50b-2bf5-4abe-9125-a0179d84de38 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:03.891906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8f0e50b-2bf5-4abe-9125-a0179d84de38 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:03.892591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8f0e50b-2bf5-4abe-9125-a0179d84de38 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:03.893039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8f0e50b-2bf5-4abe-9125-a0179d84de38 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:03.893460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8f0e50b-2bf5-4abe-9125-a0179d84de38 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:03.922988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c8f0e50b-2bf5-4abe-9125-a0179d84de38 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044635 Aug 18 22:03:03.923808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 734/1465] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:04.156692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-97f0f6ae-8be6-4838-b752-c4b047af2fa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:04.158794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-97f0f6ae-8be6-4838-b752-c4b047af2fa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:04.165732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97f0f6ae-8be6-4838-b752-c4b047af2fa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:04.166218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97f0f6ae-8be6-4838-b752-c4b047af2fa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:04.166656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97f0f6ae-8be6-4838-b752-c4b047af2fa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:04.167351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97f0f6ae-8be6-4838-b752-c4b047af2fa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:04.167812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97f0f6ae-8be6-4838-b752-c4b047af2fa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:04.168245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97f0f6ae-8be6-4838-b752-c4b047af2fa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:04.197542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-97f0f6ae-8be6-4838-b752-c4b047af2fa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045090 Aug 18 22:03:04.198123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 732/1466] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:04.329332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-00adf8f6-a476-4a87-8d2a-00ddfa567a11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:04.331510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-00adf8f6-a476-4a87-8d2a-00ddfa567a11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:04.337886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00adf8f6-a476-4a87-8d2a-00ddfa567a11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:04.338358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00adf8f6-a476-4a87-8d2a-00ddfa567a11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:04.338798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00adf8f6-a476-4a87-8d2a-00ddfa567a11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:04.339505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00adf8f6-a476-4a87-8d2a-00ddfa567a11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:04.339964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00adf8f6-a476-4a87-8d2a-00ddfa567a11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:04.340395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00adf8f6-a476-4a87-8d2a-00ddfa567a11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:04.370335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-00adf8f6-a476-4a87-8d2a-00ddfa567a11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 Aug 18 22:03:04.370890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 735/1467] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:04 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:04.602576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-72bf621d-eeae-4d60-845e-26b7b6cfde95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:04.604754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-72bf621d-eeae-4d60-845e-26b7b6cfde95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:04.610663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72bf621d-eeae-4d60-845e-26b7b6cfde95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:04.611156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72bf621d-eeae-4d60-845e-26b7b6cfde95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:04.611597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72bf621d-eeae-4d60-845e-26b7b6cfde95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:04.612293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72bf621d-eeae-4d60-845e-26b7b6cfde95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:04.612753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72bf621d-eeae-4d60-845e-26b7b6cfde95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:04.613185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72bf621d-eeae-4d60-845e-26b7b6cfde95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:04.642341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-72bf621d-eeae-4d60-845e-26b7b6cfde95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 Aug 18 22:03:04.643075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 733/1468] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:04 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:04.936290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-65958b7b-95d0-48a3-86c1-24c200bb9b14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:04.938419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-65958b7b-95d0-48a3-86c1-24c200bb9b14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:04.944847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65958b7b-95d0-48a3-86c1-24c200bb9b14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:04.945331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65958b7b-95d0-48a3-86c1-24c200bb9b14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:04.945811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65958b7b-95d0-48a3-86c1-24c200bb9b14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:04.946515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65958b7b-95d0-48a3-86c1-24c200bb9b14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:04.946974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65958b7b-95d0-48a3-86c1-24c200bb9b14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:04.947406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65958b7b-95d0-48a3-86c1-24c200bb9b14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:04.976305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-65958b7b-95d0-48a3-86c1-24c200bb9b14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044152 Aug 18 22:03:04.976858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 736/1469] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:05.209955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-47d48de4-6724-4437-afd3-0d17c0cd2b18 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:05.212069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-47d48de4-6724-4437-afd3-0d17c0cd2b18 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:05.218627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d48de4-6724-4437-afd3-0d17c0cd2b18 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:05.219121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d48de4-6724-4437-afd3-0d17c0cd2b18 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:05.219601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d48de4-6724-4437-afd3-0d17c0cd2b18 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:05.220293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d48de4-6724-4437-afd3-0d17c0cd2b18 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:05.220745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d48de4-6724-4437-afd3-0d17c0cd2b18 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:05.221169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47d48de4-6724-4437-afd3-0d17c0cd2b18 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:05.249889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-47d48de4-6724-4437-afd3-0d17c0cd2b18 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044085 Aug 18 22:03:05.250444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 734/1470] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:05 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:05.383371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a49a02e6-899a-4a5c-be96-17f0f7bae78f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:05.385521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a49a02e6-899a-4a5c-be96-17f0f7bae78f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:05.391847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49a02e6-899a-4a5c-be96-17f0f7bae78f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:05.392325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49a02e6-899a-4a5c-be96-17f0f7bae78f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:05.392759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49a02e6-899a-4a5c-be96-17f0f7bae78f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:05.393459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49a02e6-899a-4a5c-be96-17f0f7bae78f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:05.393942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49a02e6-899a-4a5c-be96-17f0f7bae78f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:05.394376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49a02e6-899a-4a5c-be96-17f0f7bae78f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:05.422675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a49a02e6-899a-4a5c-be96-17f0f7bae78f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043817 Aug 18 22:03:05.423223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 737/1471] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:05 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:03:05.654439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-356a23b8-ddf2-41d3-b76d-93c8bbd59ee6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:05.656582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-356a23b8-ddf2-41d3-b76d-93c8bbd59ee6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:05.663103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-356a23b8-ddf2-41d3-b76d-93c8bbd59ee6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:05.663593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-356a23b8-ddf2-41d3-b76d-93c8bbd59ee6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:05.664032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-356a23b8-ddf2-41d3-b76d-93c8bbd59ee6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:05.664734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-356a23b8-ddf2-41d3-b76d-93c8bbd59ee6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:05.665191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-356a23b8-ddf2-41d3-b76d-93c8bbd59ee6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:05.665635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-356a23b8-ddf2-41d3-b76d-93c8bbd59ee6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:05.698577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-356a23b8-ddf2-41d3-b76d-93c8bbd59ee6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047953 Aug 18 22:03:05.699151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 735/1472] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:05 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:05.988597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-71a00324-258b-41f2-92d2-ed855913bff2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:05.990764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-71a00324-258b-41f2-92d2-ed855913bff2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:05.996642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71a00324-258b-41f2-92d2-ed855913bff2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:05.997121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71a00324-258b-41f2-92d2-ed855913bff2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:05.997554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71a00324-258b-41f2-92d2-ed855913bff2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:05.998270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71a00324-258b-41f2-92d2-ed855913bff2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:05.998723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71a00324-258b-41f2-92d2-ed855913bff2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:05.999155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71a00324-258b-41f2-92d2-ed855913bff2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:06.027729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-71a00324-258b-41f2-92d2-ed855913bff2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043217 Aug 18 22:03:06.028277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 738/1473] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:06.262208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b0131672-72c3-4e2e-b562-d156127e62d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:06.264308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b0131672-72c3-4e2e-b562-d156127e62d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:06.266632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:06.272680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0131672-72c3-4e2e-b562-d156127e62d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:06.273159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0131672-72c3-4e2e-b562-d156127e62d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:06.273608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0131672-72c3-4e2e-b562-d156127e62d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:06.274304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0131672-72c3-4e2e-b562-d156127e62d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:06.274753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0131672-72c3-4e2e-b562-d156127e62d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:06.275172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0131672-72c3-4e2e-b562-d156127e62d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:06.304003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b0131672-72c3-4e2e-b562-d156127e62d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045772 Aug 18 22:03:06.304555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 736/1474] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:06 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:06.435633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-411aabdb-5e33-44bb-aa68-9f1a07fd62b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:06.437789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-411aabdb-5e33-44bb-aa68-9f1a07fd62b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:06.444578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-411aabdb-5e33-44bb-aa68-9f1a07fd62b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:06.445053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-411aabdb-5e33-44bb-aa68-9f1a07fd62b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:06.445496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-411aabdb-5e33-44bb-aa68-9f1a07fd62b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:06.446213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-411aabdb-5e33-44bb-aa68-9f1a07fd62b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:06.446668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-411aabdb-5e33-44bb-aa68-9f1a07fd62b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:06.447093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-411aabdb-5e33-44bb-aa68-9f1a07fd62b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:06.476750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-411aabdb-5e33-44bb-aa68-9f1a07fd62b8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045044 Aug 18 22:03:06.477308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 739/1475] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:06 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:06.710735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5190904a-16b1-4457-9ef5-53011433c489 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:06.712878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5190904a-16b1-4457-9ef5-53011433c489 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:06.719123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5190904a-16b1-4457-9ef5-53011433c489 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:06.719994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5190904a-16b1-4457-9ef5-53011433c489 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:06.720116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5190904a-16b1-4457-9ef5-53011433c489 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:06.720765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5190904a-16b1-4457-9ef5-53011433c489 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:06.721220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5190904a-16b1-4457-9ef5-53011433c489 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:06.721677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5190904a-16b1-4457-9ef5-53011433c489 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:06.752442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5190904a-16b1-4457-9ef5-53011433c489 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045721 Aug 18 22:03:06.753010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 737/1476] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:06 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:07.040666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a49cad30-9530-4405-b49f-10590ed313d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:07.042963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a49cad30-9530-4405-b49f-10590ed313d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:07.049195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49cad30-9530-4405-b49f-10590ed313d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:07.049723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49cad30-9530-4405-b49f-10590ed313d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:07.050166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49cad30-9530-4405-b49f-10590ed313d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:07.050872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49cad30-9530-4405-b49f-10590ed313d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:07.051329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49cad30-9530-4405-b49f-10590ed313d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:07.052366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a49cad30-9530-4405-b49f-10590ed313d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:07.084068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a49cad30-9530-4405-b49f-10590ed313d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047828 Aug 18 22:03:07.084640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 740/1477] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:07.316497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d58b4561-c8dd-421b-8ecb-140042d173fb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:07.318583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d58b4561-c8dd-421b-8ecb-140042d173fb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:07.325105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d58b4561-c8dd-421b-8ecb-140042d173fb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:07.325589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d58b4561-c8dd-421b-8ecb-140042d173fb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:07.326059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d58b4561-c8dd-421b-8ecb-140042d173fb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:07.326763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d58b4561-c8dd-421b-8ecb-140042d173fb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:07.327212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d58b4561-c8dd-421b-8ecb-140042d173fb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:07.327636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d58b4561-c8dd-421b-8ecb-140042d173fb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:07.356692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d58b4561-c8dd-421b-8ecb-140042d173fb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044236 Aug 18 22:03:07.357249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 738/1478] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:07.488921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-404ad2a0-4078-453a-ac2c-8a84003bcf68 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:07.491078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-404ad2a0-4078-453a-ac2c-8a84003bcf68 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:07.497421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-404ad2a0-4078-453a-ac2c-8a84003bcf68 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:07.497951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-404ad2a0-4078-453a-ac2c-8a84003bcf68 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:07.498396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-404ad2a0-4078-453a-ac2c-8a84003bcf68 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:07.499095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-404ad2a0-4078-453a-ac2c-8a84003bcf68 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:07.499557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-404ad2a0-4078-453a-ac2c-8a84003bcf68 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:07.499991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-404ad2a0-4078-453a-ac2c-8a84003bcf68 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:07.528923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-404ad2a0-4078-453a-ac2c-8a84003bcf68 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043945 Aug 18 22:03:07.529471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 741/1479] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:07 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:07.764605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b180f543-e7cc-48b8-a9aa-bed65a79df41 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:07.766952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b180f543-e7cc-48b8-a9aa-bed65a79df41 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:07.773792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b180f543-e7cc-48b8-a9aa-bed65a79df41 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:07.774286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b180f543-e7cc-48b8-a9aa-bed65a79df41 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:07.774727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b180f543-e7cc-48b8-a9aa-bed65a79df41 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:07.775435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b180f543-e7cc-48b8-a9aa-bed65a79df41 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:07.775951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b180f543-e7cc-48b8-a9aa-bed65a79df41 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:07.776311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b180f543-e7cc-48b8-a9aa-bed65a79df41 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:07.818813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b180f543-e7cc-48b8-a9aa-bed65a79df41 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058070 Aug 18 22:03:07.819486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 739/1480] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:07 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:08.096468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7151de5c-c4ea-445e-b5de-6bc4b8b16034 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:08.098621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7151de5c-c4ea-445e-b5de-6bc4b8b16034 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:08.104465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7151de5c-c4ea-445e-b5de-6bc4b8b16034 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:08.104937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7151de5c-c4ea-445e-b5de-6bc4b8b16034 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:08.105367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7151de5c-c4ea-445e-b5de-6bc4b8b16034 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:08.106077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7151de5c-c4ea-445e-b5de-6bc4b8b16034 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:08.106533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7151de5c-c4ea-445e-b5de-6bc4b8b16034 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:08.106959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7151de5c-c4ea-445e-b5de-6bc4b8b16034 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:08.135839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7151de5c-c4ea-445e-b5de-6bc4b8b16034 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043300 Aug 18 22:03:08.136394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 742/1481] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:08.369979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0fb3b743-6fd6-403c-8a30-3b8d03ecc864 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:08.372094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0fb3b743-6fd6-403c-8a30-3b8d03ecc864 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:08.378480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fb3b743-6fd6-403c-8a30-3b8d03ecc864 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:08.378954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fb3b743-6fd6-403c-8a30-3b8d03ecc864 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:08.379387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fb3b743-6fd6-403c-8a30-3b8d03ecc864 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:08.380726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fb3b743-6fd6-403c-8a30-3b8d03ecc864 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:08.381173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fb3b743-6fd6-403c-8a30-3b8d03ecc864 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:08.381625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fb3b743-6fd6-403c-8a30-3b8d03ecc864 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:08.410284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0fb3b743-6fd6-403c-8a30-3b8d03ecc864 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 Aug 18 22:03:08.410847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 740/1482] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:08 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:08.540922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-289a8bc7-16d8-416a-897e-9aa246c425fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:08.543165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-289a8bc7-16d8-416a-897e-9aa246c425fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:08.549780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-289a8bc7-16d8-416a-897e-9aa246c425fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:08.550263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-289a8bc7-16d8-416a-897e-9aa246c425fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:08.550704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-289a8bc7-16d8-416a-897e-9aa246c425fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:08.551402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-289a8bc7-16d8-416a-897e-9aa246c425fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:08.552449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-289a8bc7-16d8-416a-897e-9aa246c425fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:08.552880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-289a8bc7-16d8-416a-897e-9aa246c425fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:08.556445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:08.581711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-289a8bc7-16d8-416a-897e-9aa246c425fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Aug 18 22:03:08.582277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 743/1483] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:08 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:08.830877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a8764160-779f-4101-9559-6859185d8f93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:08.832999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a8764160-779f-4101-9559-6859185d8f93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:08.838896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8764160-779f-4101-9559-6859185d8f93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:08.839374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8764160-779f-4101-9559-6859185d8f93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:08.839809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8764160-779f-4101-9559-6859185d8f93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:08.840495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8764160-779f-4101-9559-6859185d8f93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:08.840943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8764160-779f-4101-9559-6859185d8f93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:08.841364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8764160-779f-4101-9559-6859185d8f93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:08.871717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a8764160-779f-4101-9559-6859185d8f93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Aug 18 22:03:08.872279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 741/1484] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:08 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:09.149038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d8b4110e-83b1-45b9-9f4a-9d7d4d667616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:09.152384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d8b4110e-83b1-45b9-9f4a-9d7d4d667616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:09.160104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8b4110e-83b1-45b9-9f4a-9d7d4d667616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:09.160596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8b4110e-83b1-45b9-9f4a-9d7d4d667616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:09.161706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8b4110e-83b1-45b9-9f4a-9d7d4d667616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:09.162426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8b4110e-83b1-45b9-9f4a-9d7d4d667616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:09.162884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8b4110e-83b1-45b9-9f4a-9d7d4d667616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:09.163316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8b4110e-83b1-45b9-9f4a-9d7d4d667616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:09.192133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d8b4110e-83b1-45b9-9f4a-9d7d4d667616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047958 Aug 18 22:03:09.192706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 744/1485] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:09.422309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6835eb4f-bff5-4490-b02d-0d8930a18a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:09.424680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6835eb4f-bff5-4490-b02d-0d8930a18a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:09.431102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6835eb4f-bff5-4490-b02d-0d8930a18a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:09.431590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6835eb4f-bff5-4490-b02d-0d8930a18a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:09.432031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6835eb4f-bff5-4490-b02d-0d8930a18a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:09.432731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6835eb4f-bff5-4490-b02d-0d8930a18a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:09.433198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6835eb4f-bff5-4490-b02d-0d8930a18a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:09.433640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6835eb4f-bff5-4490-b02d-0d8930a18a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:09.462752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6835eb4f-bff5-4490-b02d-0d8930a18a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044494 Aug 18 22:03:09.463310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 742/1486] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:09 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:09.593650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ef43f881-b5f4-4528-a2e2-830f9e209634 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:09.595773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ef43f881-b5f4-4528-a2e2-830f9e209634 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:09.602124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef43f881-b5f4-4528-a2e2-830f9e209634 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:09.602595 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef43f881-b5f4-4528-a2e2-830f9e209634 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:09.603028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef43f881-b5f4-4528-a2e2-830f9e209634 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:09.603714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef43f881-b5f4-4528-a2e2-830f9e209634 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:09.604165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef43f881-b5f4-4528-a2e2-830f9e209634 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:09.604582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef43f881-b5f4-4528-a2e2-830f9e209634 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:09.632673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ef43f881-b5f4-4528-a2e2-830f9e209634 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042989 Aug 18 22:03:09.633217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 745/1487] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:09 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:09.883671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4fdb9bbe-d95c-486d-9306-9de2407d5cfc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:09.885871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4fdb9bbe-d95c-486d-9306-9de2407d5cfc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:09.891740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fdb9bbe-d95c-486d-9306-9de2407d5cfc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:09.892212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fdb9bbe-d95c-486d-9306-9de2407d5cfc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:09.892639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fdb9bbe-d95c-486d-9306-9de2407d5cfc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:09.893676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fdb9bbe-d95c-486d-9306-9de2407d5cfc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:09.893798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fdb9bbe-d95c-486d-9306-9de2407d5cfc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:09.894225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fdb9bbe-d95c-486d-9306-9de2407d5cfc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:09.897970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:09.923905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4fdb9bbe-d95c-486d-9306-9de2407d5cfc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Aug 18 22:03:09.924465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 743/1488] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:09 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:10.204735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8663080f-b771-4c6e-9d1e-c9715ba4e0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:10.206934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8663080f-b771-4c6e-9d1e-c9715ba4e0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:10.212955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8663080f-b771-4c6e-9d1e-c9715ba4e0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:10.213440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8663080f-b771-4c6e-9d1e-c9715ba4e0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:10.213921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8663080f-b771-4c6e-9d1e-c9715ba4e0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:10.214624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8663080f-b771-4c6e-9d1e-c9715ba4e0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:10.215083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8663080f-b771-4c6e-9d1e-c9715ba4e0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:10.215513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8663080f-b771-4c6e-9d1e-c9715ba4e0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:10.245287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8663080f-b771-4c6e-9d1e-c9715ba4e0de tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044729 Aug 18 22:03:10.245873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 746/1489] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:10.475577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aeeae10f-66f0-4afb-b375-191eebbece0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:10.477644 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-aeeae10f-66f0-4afb-b375-191eebbece0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:10.483958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aeeae10f-66f0-4afb-b375-191eebbece0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:10.484432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aeeae10f-66f0-4afb-b375-191eebbece0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:10.484865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aeeae10f-66f0-4afb-b375-191eebbece0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:10.485549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aeeae10f-66f0-4afb-b375-191eebbece0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:10.486023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aeeae10f-66f0-4afb-b375-191eebbece0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:10.486443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aeeae10f-66f0-4afb-b375-191eebbece0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:10.515821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aeeae10f-66f0-4afb-b375-191eebbece0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044787 Aug 18 22:03:10.516383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 744/1490] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:10 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:10.644828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-54d3434d-d0cc-4c03-b1e0-379d7208f404 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:10.647490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-54d3434d-d0cc-4c03-b1e0-379d7208f404 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:10.653836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54d3434d-d0cc-4c03-b1e0-379d7208f404 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:10.654322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54d3434d-d0cc-4c03-b1e0-379d7208f404 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:10.654766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54d3434d-d0cc-4c03-b1e0-379d7208f404 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:10.655460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54d3434d-d0cc-4c03-b1e0-379d7208f404 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:10.655916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54d3434d-d0cc-4c03-b1e0-379d7208f404 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:10.656349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54d3434d-d0cc-4c03-b1e0-379d7208f404 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:10.685287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-54d3434d-d0cc-4c03-b1e0-379d7208f404 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044411 Aug 18 22:03:10.685867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 747/1491] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:10 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:10.936266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5ad93dd2-f2e8-4f62-9247-2f84256c1e7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:10.938522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5ad93dd2-f2e8-4f62-9247-2f84256c1e7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:10.945076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ad93dd2-f2e8-4f62-9247-2f84256c1e7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:10.945618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ad93dd2-f2e8-4f62-9247-2f84256c1e7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:10.946058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ad93dd2-f2e8-4f62-9247-2f84256c1e7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:10.946759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ad93dd2-f2e8-4f62-9247-2f84256c1e7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:10.947216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ad93dd2-f2e8-4f62-9247-2f84256c1e7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:10.947642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ad93dd2-f2e8-4f62-9247-2f84256c1e7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:10.977028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5ad93dd2-f2e8-4f62-9247-2f84256c1e7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044741 Aug 18 22:03:10.977770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 745/1492] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:10 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:11.258951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-033727bf-2eb2-4841-86b4-05d1936cf93d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:11.261098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-033727bf-2eb2-4841-86b4-05d1936cf93d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:11.267077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-033727bf-2eb2-4841-86b4-05d1936cf93d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:11.267551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-033727bf-2eb2-4841-86b4-05d1936cf93d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:11.267988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-033727bf-2eb2-4841-86b4-05d1936cf93d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:11.268671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-033727bf-2eb2-4841-86b4-05d1936cf93d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:11.269121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-033727bf-2eb2-4841-86b4-05d1936cf93d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:11.269539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-033727bf-2eb2-4841-86b4-05d1936cf93d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:11.297677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-033727bf-2eb2-4841-86b4-05d1936cf93d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043240 Aug 18 22:03:11.298229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 748/1493] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:11.528337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-184c1be8-8e05-4733-bb2f-ad8b9d4874ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:11.530489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-184c1be8-8e05-4733-bb2f-ad8b9d4874ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:11.537365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-184c1be8-8e05-4733-bb2f-ad8b9d4874ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:11.537873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-184c1be8-8e05-4733-bb2f-ad8b9d4874ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:11.538307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-184c1be8-8e05-4733-bb2f-ad8b9d4874ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:11.538991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-184c1be8-8e05-4733-bb2f-ad8b9d4874ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:11.539443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-184c1be8-8e05-4733-bb2f-ad8b9d4874ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:11.539864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-184c1be8-8e05-4733-bb2f-ad8b9d4874ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:11.568310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-184c1be8-8e05-4733-bb2f-ad8b9d4874ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043910 Aug 18 22:03:11.568857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 746/1494] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:11.697578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-72138615-e3d0-4e85-aa9a-d510421f0cd9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:11.699788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-72138615-e3d0-4e85-aa9a-d510421f0cd9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:11.706315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72138615-e3d0-4e85-aa9a-d510421f0cd9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:11.706799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72138615-e3d0-4e85-aa9a-d510421f0cd9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:11.707235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72138615-e3d0-4e85-aa9a-d510421f0cd9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:11.707935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72138615-e3d0-4e85-aa9a-d510421f0cd9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:11.708390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72138615-e3d0-4e85-aa9a-d510421f0cd9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:11.708819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72138615-e3d0-4e85-aa9a-d510421f0cd9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:11.738193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-72138615-e3d0-4e85-aa9a-d510421f0cd9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044584 Aug 18 22:03:11.738758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 749/1495] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:11.989305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-19ee9168-99e0-434b-8157-bf734184a83b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:11.991411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-19ee9168-99e0-434b-8157-bf734184a83b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:11.997443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19ee9168-99e0-434b-8157-bf734184a83b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:11.997966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19ee9168-99e0-434b-8157-bf734184a83b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:11.998408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19ee9168-99e0-434b-8157-bf734184a83b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:11.999117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19ee9168-99e0-434b-8157-bf734184a83b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:11.999571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19ee9168-99e0-434b-8157-bf734184a83b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:11.999996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19ee9168-99e0-434b-8157-bf734184a83b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:12.029387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-19ee9168-99e0-434b-8157-bf734184a83b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Aug 18 22:03:12.029981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 747/1496] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:11 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:12.310829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1611dd5d-b645-460a-9fbd-7b69bee90fe8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:12.312944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1611dd5d-b645-460a-9fbd-7b69bee90fe8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:12.319359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1611dd5d-b645-460a-9fbd-7b69bee90fe8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:12.319833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1611dd5d-b645-460a-9fbd-7b69bee90fe8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:12.320268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1611dd5d-b645-460a-9fbd-7b69bee90fe8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:12.320961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1611dd5d-b645-460a-9fbd-7b69bee90fe8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:12.321408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1611dd5d-b645-460a-9fbd-7b69bee90fe8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:12.321854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1611dd5d-b645-460a-9fbd-7b69bee90fe8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:12.350431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1611dd5d-b645-460a-9fbd-7b69bee90fe8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043551 Aug 18 22:03:12.350976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 750/1497] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:12 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:03:12.580394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ec37a654-6156-42ed-8020-1734c006edb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:12.582523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ec37a654-6156-42ed-8020-1734c006edb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:12.589521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec37a654-6156-42ed-8020-1734c006edb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:12.590048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec37a654-6156-42ed-8020-1734c006edb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:12.590490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec37a654-6156-42ed-8020-1734c006edb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:12.591188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec37a654-6156-42ed-8020-1734c006edb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:12.591647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec37a654-6156-42ed-8020-1734c006edb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:12.592083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec37a654-6156-42ed-8020-1734c006edb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:12.620238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ec37a654-6156-42ed-8020-1734c006edb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043897 Aug 18 22:03:12.620791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 748/1498] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:12 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:12.751146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2139ba80-f1a3-4e94-97a1-c50d94ce4bbd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:12.753281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2139ba80-f1a3-4e94-97a1-c50d94ce4bbd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:12.760272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2139ba80-f1a3-4e94-97a1-c50d94ce4bbd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:12.760750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2139ba80-f1a3-4e94-97a1-c50d94ce4bbd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:12.761188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2139ba80-f1a3-4e94-97a1-c50d94ce4bbd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:12.761917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2139ba80-f1a3-4e94-97a1-c50d94ce4bbd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:12.762380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2139ba80-f1a3-4e94-97a1-c50d94ce4bbd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:12.762807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2139ba80-f1a3-4e94-97a1-c50d94ce4bbd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:12.791483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2139ba80-f1a3-4e94-97a1-c50d94ce4bbd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044340 Aug 18 22:03:12.792037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 751/1499] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:12 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:13.041911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6f6e1db6-e1d9-4c27-af7f-864564c56838 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:13.044124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6f6e1db6-e1d9-4c27-af7f-864564c56838 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:13.050437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f6e1db6-e1d9-4c27-af7f-864564c56838 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:13.050924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f6e1db6-e1d9-4c27-af7f-864564c56838 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:13.051362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f6e1db6-e1d9-4c27-af7f-864564c56838 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:13.052647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f6e1db6-e1d9-4c27-af7f-864564c56838 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:13.053298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f6e1db6-e1d9-4c27-af7f-864564c56838 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:13.053732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f6e1db6-e1d9-4c27-af7f-864564c56838 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:13.084040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6f6e1db6-e1d9-4c27-af7f-864564c56838 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046084 Aug 18 22:03:13.084613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 749/1500] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:13 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:13.363034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-efef1049-cbe9-4c5c-aa89-28f34ac68657 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:13.365833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-efef1049-cbe9-4c5c-aa89-28f34ac68657 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:13.371722 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efef1049-cbe9-4c5c-aa89-28f34ac68657 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:13.372202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efef1049-cbe9-4c5c-aa89-28f34ac68657 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:13.372637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efef1049-cbe9-4c5c-aa89-28f34ac68657 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:13.373331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efef1049-cbe9-4c5c-aa89-28f34ac68657 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:13.373816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efef1049-cbe9-4c5c-aa89-28f34ac68657 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:13.374242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-efef1049-cbe9-4c5c-aa89-28f34ac68657 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:13.402751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-efef1049-cbe9-4c5c-aa89-28f34ac68657 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043819 Aug 18 22:03:13.403302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 752/1501] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:13 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:13.632639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-701dacb7-2384-47a6-bbec-83e0c00305c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:13.634729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-701dacb7-2384-47a6-bbec-83e0c00305c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:13.641080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-701dacb7-2384-47a6-bbec-83e0c00305c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:13.641552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-701dacb7-2384-47a6-bbec-83e0c00305c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:13.642010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-701dacb7-2384-47a6-bbec-83e0c00305c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:13.642693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-701dacb7-2384-47a6-bbec-83e0c00305c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:13.643142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-701dacb7-2384-47a6-bbec-83e0c00305c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:13.643561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-701dacb7-2384-47a6-bbec-83e0c00305c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:13.672396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-701dacb7-2384-47a6-bbec-83e0c00305c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Aug 18 22:03:13.672953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 750/1502] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:13 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:13.804186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2d9ac4e7-fa06-4d26-9371-90683ba4cd41 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:13.806363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2d9ac4e7-fa06-4d26-9371-90683ba4cd41 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:13.812872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d9ac4e7-fa06-4d26-9371-90683ba4cd41 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:13.813218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d9ac4e7-fa06-4d26-9371-90683ba4cd41 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:13.813756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d9ac4e7-fa06-4d26-9371-90683ba4cd41 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:13.814452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d9ac4e7-fa06-4d26-9371-90683ba4cd41 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:13.814909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d9ac4e7-fa06-4d26-9371-90683ba4cd41 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:13.815335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d9ac4e7-fa06-4d26-9371-90683ba4cd41 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:13.845069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2d9ac4e7-fa06-4d26-9371-90683ba4cd41 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Aug 18 22:03:13.845646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 753/1503] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:14.096316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-824ffd60-5d8b-4c9f-99ff-4ba850b10115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:14.098478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-824ffd60-5d8b-4c9f-99ff-4ba850b10115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:14.104708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-824ffd60-5d8b-4c9f-99ff-4ba850b10115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:14.104980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-824ffd60-5d8b-4c9f-99ff-4ba850b10115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:14.105414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-824ffd60-5d8b-4c9f-99ff-4ba850b10115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:14.106128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-824ffd60-5d8b-4c9f-99ff-4ba850b10115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:14.106580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-824ffd60-5d8b-4c9f-99ff-4ba850b10115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:14.107000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-824ffd60-5d8b-4c9f-99ff-4ba850b10115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:14.136476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-824ffd60-5d8b-4c9f-99ff-4ba850b10115 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Aug 18 22:03:14.137046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 751/1504] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:14 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:14.415262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-930e2543-7431-4a7a-ac0f-7965d36d5abe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:14.417352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-930e2543-7431-4a7a-ac0f-7965d36d5abe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:14.419304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:14.424901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-930e2543-7431-4a7a-ac0f-7965d36d5abe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:14.425374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-930e2543-7431-4a7a-ac0f-7965d36d5abe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:14.425834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-930e2543-7431-4a7a-ac0f-7965d36d5abe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:14.427093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-930e2543-7431-4a7a-ac0f-7965d36d5abe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:14.427546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-930e2543-7431-4a7a-ac0f-7965d36d5abe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:14.427997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-930e2543-7431-4a7a-ac0f-7965d36d5abe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:14.456939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-930e2543-7431-4a7a-ac0f-7965d36d5abe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045775 Aug 18 22:03:14.457485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 754/1505] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:14.684522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5f09b309-aea1-4491-bf64-b8a25358378a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:14.686682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5f09b309-aea1-4491-bf64-b8a25358378a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:14.693214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f09b309-aea1-4491-bf64-b8a25358378a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:14.693732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f09b309-aea1-4491-bf64-b8a25358378a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:14.694179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f09b309-aea1-4491-bf64-b8a25358378a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:14.694885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f09b309-aea1-4491-bf64-b8a25358378a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:14.695425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f09b309-aea1-4491-bf64-b8a25358378a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:14.695906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f09b309-aea1-4491-bf64-b8a25358378a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:14.725165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5f09b309-aea1-4491-bf64-b8a25358378a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044600 Aug 18 22:03:14.725762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 752/1506] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:14.857249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-28841c84-9645-4303-bf86-d1fba50b5cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:14.859444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-28841c84-9645-4303-bf86-d1fba50b5cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:14.866548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28841c84-9645-4303-bf86-d1fba50b5cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:14.867033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28841c84-9645-4303-bf86-d1fba50b5cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:14.867473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28841c84-9645-4303-bf86-d1fba50b5cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:14.868182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28841c84-9645-4303-bf86-d1fba50b5cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:14.868642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28841c84-9645-4303-bf86-d1fba50b5cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:14.869074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28841c84-9645-4303-bf86-d1fba50b5cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:14.898203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-28841c84-9645-4303-bf86-d1fba50b5cbe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045673 Aug 18 22:03:14.898762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 755/1507] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:03:15.148902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8c8d28be-6a91-487a-b71f-e6ce51e3e122 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:15.151057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8c8d28be-6a91-487a-b71f-e6ce51e3e122 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:15.156911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c8d28be-6a91-487a-b71f-e6ce51e3e122 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:15.157389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c8d28be-6a91-487a-b71f-e6ce51e3e122 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:15.157866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c8d28be-6a91-487a-b71f-e6ce51e3e122 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:15.158551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c8d28be-6a91-487a-b71f-e6ce51e3e122 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:15.159042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c8d28be-6a91-487a-b71f-e6ce51e3e122 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:15.159433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c8d28be-6a91-487a-b71f-e6ce51e3e122 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:15.189257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8c8d28be-6a91-487a-b71f-e6ce51e3e122 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Aug 18 22:03:15.189849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 753/1508] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:15 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:15.469315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6dcee057-2240-462d-8c31-e14ff18728ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:15.471414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6dcee057-2240-462d-8c31-e14ff18728ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:15.477576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dcee057-2240-462d-8c31-e14ff18728ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:15.478084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dcee057-2240-462d-8c31-e14ff18728ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:15.478524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dcee057-2240-462d-8c31-e14ff18728ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:15.479215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dcee057-2240-462d-8c31-e14ff18728ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:15.479673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dcee057-2240-462d-8c31-e14ff18728ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:15.480101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dcee057-2240-462d-8c31-e14ff18728ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:15.510038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6dcee057-2240-462d-8c31-e14ff18728ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044692 Aug 18 22:03:15.510607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 756/1509] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:15.736976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-de468517-dc35-4641-87b2-69217bf63c66 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:15.739613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-de468517-dc35-4641-87b2-69217bf63c66 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:15.746173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de468517-dc35-4641-87b2-69217bf63c66 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:15.746658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de468517-dc35-4641-87b2-69217bf63c66 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:15.747338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de468517-dc35-4641-87b2-69217bf63c66 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:15.748050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de468517-dc35-4641-87b2-69217bf63c66 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:15.748502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de468517-dc35-4641-87b2-69217bf63c66 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:15.748932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de468517-dc35-4641-87b2-69217bf63c66 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:15.777439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-de468517-dc35-4641-87b2-69217bf63c66 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044652 Aug 18 22:03:15.778019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 754/1510] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:15 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:15.910489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5fd429d6-9e8b-40ed-ac0e-59575cd80040 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:15.912614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5fd429d6-9e8b-40ed-ac0e-59575cd80040 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:15.918461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd429d6-9e8b-40ed-ac0e-59575cd80040 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:15.918934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd429d6-9e8b-40ed-ac0e-59575cd80040 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:15.919364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd429d6-9e8b-40ed-ac0e-59575cd80040 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:15.920046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd429d6-9e8b-40ed-ac0e-59575cd80040 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:15.920495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd429d6-9e8b-40ed-ac0e-59575cd80040 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:15.920915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5fd429d6-9e8b-40ed-ac0e-59575cd80040 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:15.950223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5fd429d6-9e8b-40ed-ac0e-59575cd80040 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 Aug 18 22:03:15.950777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 757/1511] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:15 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:16.201704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2a653f09-c194-454a-a0ff-58772c532751 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:16.203851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2a653f09-c194-454a-a0ff-58772c532751 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:16.209756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a653f09-c194-454a-a0ff-58772c532751 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:16.210240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a653f09-c194-454a-a0ff-58772c532751 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:16.210673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a653f09-c194-454a-a0ff-58772c532751 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:16.211363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a653f09-c194-454a-a0ff-58772c532751 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:16.211818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a653f09-c194-454a-a0ff-58772c532751 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:16.212243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a653f09-c194-454a-a0ff-58772c532751 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:16.242880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2a653f09-c194-454a-a0ff-58772c532751 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045098 Aug 18 22:03:16.243453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 755/1512] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:16 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:16.522925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-65faa94d-355b-4b0f-9f1b-a1d3df4c1341 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:16.525118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-65faa94d-355b-4b0f-9f1b-a1d3df4c1341 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:16.531552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65faa94d-355b-4b0f-9f1b-a1d3df4c1341 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:16.532024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65faa94d-355b-4b0f-9f1b-a1d3df4c1341 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:16.532457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65faa94d-355b-4b0f-9f1b-a1d3df4c1341 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:16.533154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65faa94d-355b-4b0f-9f1b-a1d3df4c1341 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:16.533627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65faa94d-355b-4b0f-9f1b-a1d3df4c1341 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:16.534124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65faa94d-355b-4b0f-9f1b-a1d3df4c1341 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:16.563194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-65faa94d-355b-4b0f-9f1b-a1d3df4c1341 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044656 Aug 18 22:03:16.563656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 758/1513] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:16.790540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e3a3284f-cb3a-48ce-9f35-db9a74cd49b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:16.792674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e3a3284f-cb3a-48ce-9f35-db9a74cd49b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:16.799346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3a3284f-cb3a-48ce-9f35-db9a74cd49b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:16.799830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3a3284f-cb3a-48ce-9f35-db9a74cd49b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:16.800268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3a3284f-cb3a-48ce-9f35-db9a74cd49b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:16.800964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3a3284f-cb3a-48ce-9f35-db9a74cd49b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:16.801425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3a3284f-cb3a-48ce-9f35-db9a74cd49b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:16.801896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3a3284f-cb3a-48ce-9f35-db9a74cd49b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:16.831057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e3a3284f-cb3a-48ce-9f35-db9a74cd49b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045147 Aug 18 22:03:16.831621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 756/1514] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:16.962783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3013107c-91b2-45cb-a147-ef06a7e8d9a4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:16.964910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3013107c-91b2-45cb-a147-ef06a7e8d9a4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:16.970836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3013107c-91b2-45cb-a147-ef06a7e8d9a4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:16.971315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3013107c-91b2-45cb-a147-ef06a7e8d9a4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:16.971757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3013107c-91b2-45cb-a147-ef06a7e8d9a4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:16.972447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3013107c-91b2-45cb-a147-ef06a7e8d9a4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:16.972899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3013107c-91b2-45cb-a147-ef06a7e8d9a4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:16.973327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3013107c-91b2-45cb-a147-ef06a7e8d9a4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:16.997002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:17.001812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3013107c-91b2-45cb-a147-ef06a7e8d9a4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043560 Aug 18 22:03:17.002393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 759/1515] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:16 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:17.018357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:03:17.018519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:03:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:03:17.255711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8cf03685-4f17-4a6d-a9e8-fc0679d10d96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:17.257875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8cf03685-4f17-4a6d-a9e8-fc0679d10d96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:17.263795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cf03685-4f17-4a6d-a9e8-fc0679d10d96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:17.264276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cf03685-4f17-4a6d-a9e8-fc0679d10d96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:17.264711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cf03685-4f17-4a6d-a9e8-fc0679d10d96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:17.265399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cf03685-4f17-4a6d-a9e8-fc0679d10d96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:17.265882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cf03685-4f17-4a6d-a9e8-fc0679d10d96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:17.266327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cf03685-4f17-4a6d-a9e8-fc0679d10d96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:17.296050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8cf03685-4f17-4a6d-a9e8-fc0679d10d96 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Aug 18 22:03:17.296618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 757/1516] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:17 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:17.432120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:03:17.432308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:03:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:03:17.574969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-34b4719b-6afb-47e7-870b-28729469eb4b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:17.577098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-34b4719b-6afb-47e7-870b-28729469eb4b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:17.583967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34b4719b-6afb-47e7-870b-28729469eb4b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:17.584453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34b4719b-6afb-47e7-870b-28729469eb4b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:17.584891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34b4719b-6afb-47e7-870b-28729469eb4b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:17.585588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34b4719b-6afb-47e7-870b-28729469eb4b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:17.586068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34b4719b-6afb-47e7-870b-28729469eb4b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:17.586496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34b4719b-6afb-47e7-870b-28729469eb4b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:17.616969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-34b4719b-6afb-47e7-870b-28729469eb4b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045922 Aug 18 22:03:17.617531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 760/1517] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:17.844072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fada8608-1291-4167-b9a1-76faf2f8c972 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:17.846266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fada8608-1291-4167-b9a1-76faf2f8c972 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:17.853190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fada8608-1291-4167-b9a1-76faf2f8c972 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:17.853699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fada8608-1291-4167-b9a1-76faf2f8c972 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:17.854139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fada8608-1291-4167-b9a1-76faf2f8c972 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:17.854838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fada8608-1291-4167-b9a1-76faf2f8c972 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:17.855293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fada8608-1291-4167-b9a1-76faf2f8c972 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:17.855720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fada8608-1291-4167-b9a1-76faf2f8c972 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:17.884628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fada8608-1291-4167-b9a1-76faf2f8c972 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044538 Aug 18 22:03:17.885179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 758/1518] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:18.014661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cac4eba8-8a2d-4c73-ba3e-da5c1a7e8779 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:18.016766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cac4eba8-8a2d-4c73-ba3e-da5c1a7e8779 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:18.023550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac4eba8-8a2d-4c73-ba3e-da5c1a7e8779 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:18.024041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac4eba8-8a2d-4c73-ba3e-da5c1a7e8779 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:18.024483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac4eba8-8a2d-4c73-ba3e-da5c1a7e8779 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:18.025308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac4eba8-8a2d-4c73-ba3e-da5c1a7e8779 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:18.025806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac4eba8-8a2d-4c73-ba3e-da5c1a7e8779 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:18.026241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac4eba8-8a2d-4c73-ba3e-da5c1a7e8779 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:18.055399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cac4eba8-8a2d-4c73-ba3e-da5c1a7e8779 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Aug 18 22:03:18.055962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 761/1519] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:18 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:18.308376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9780e27f-7642-44ca-8868-538f0ad0cddc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:18.310591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9780e27f-7642-44ca-8868-538f0ad0cddc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:18.316523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9780e27f-7642-44ca-8868-538f0ad0cddc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:18.317486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9780e27f-7642-44ca-8868-538f0ad0cddc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:18.317948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9780e27f-7642-44ca-8868-538f0ad0cddc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:18.318645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9780e27f-7642-44ca-8868-538f0ad0cddc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:18.319095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9780e27f-7642-44ca-8868-538f0ad0cddc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:18.319518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9780e27f-7642-44ca-8868-538f0ad0cddc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:18.344554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:18.350010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9780e27f-7642-44ca-8868-538f0ad0cddc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045561 Aug 18 22:03:18.350579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 759/1520] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:18 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:18.628719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eff88e04-776e-40d1-8d8a-0f9e682cc431 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:18.631359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eff88e04-776e-40d1-8d8a-0f9e682cc431 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:18.637956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff88e04-776e-40d1-8d8a-0f9e682cc431 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:18.638438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff88e04-776e-40d1-8d8a-0f9e682cc431 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:18.638874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff88e04-776e-40d1-8d8a-0f9e682cc431 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:18.639577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff88e04-776e-40d1-8d8a-0f9e682cc431 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:18.640032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff88e04-776e-40d1-8d8a-0f9e682cc431 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:18.640456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eff88e04-776e-40d1-8d8a-0f9e682cc431 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:18.669237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eff88e04-776e-40d1-8d8a-0f9e682cc431 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044625 Aug 18 22:03:18.669817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 762/1521] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:18 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:18.897324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-83a679cd-ea42-4284-ac81-2addb93f7f00 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:18.899470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-83a679cd-ea42-4284-ac81-2addb93f7f00 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:18.905820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83a679cd-ea42-4284-ac81-2addb93f7f00 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:18.906303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83a679cd-ea42-4284-ac81-2addb93f7f00 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:18.906743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83a679cd-ea42-4284-ac81-2addb93f7f00 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:18.907430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83a679cd-ea42-4284-ac81-2addb93f7f00 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:18.907882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83a679cd-ea42-4284-ac81-2addb93f7f00 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:18.908307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83a679cd-ea42-4284-ac81-2addb93f7f00 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:18.938076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-83a679cd-ea42-4284-ac81-2addb93f7f00 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045009 Aug 18 22:03:18.938625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 760/1522] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:19.068100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2132d74f-5113-455f-8af3-0b9ef8d252ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:19.070258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2132d74f-5113-455f-8af3-0b9ef8d252ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:19.076145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2132d74f-5113-455f-8af3-0b9ef8d252ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:19.076620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2132d74f-5113-455f-8af3-0b9ef8d252ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:19.077070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2132d74f-5113-455f-8af3-0b9ef8d252ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:19.077771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2132d74f-5113-455f-8af3-0b9ef8d252ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:19.078255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2132d74f-5113-455f-8af3-0b9ef8d252ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:19.078828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2132d74f-5113-455f-8af3-0b9ef8d252ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:19.107766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2132d74f-5113-455f-8af3-0b9ef8d252ec tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044109 Aug 18 22:03:19.108305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 763/1523] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:19 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:19.362166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-91c2aef0-576c-4b09-985b-0c74fb59bef5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:19.364286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-91c2aef0-576c-4b09-985b-0c74fb59bef5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:19.370294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91c2aef0-576c-4b09-985b-0c74fb59bef5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:19.370779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91c2aef0-576c-4b09-985b-0c74fb59bef5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:19.371213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91c2aef0-576c-4b09-985b-0c74fb59bef5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:19.371904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91c2aef0-576c-4b09-985b-0c74fb59bef5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:19.372357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91c2aef0-576c-4b09-985b-0c74fb59bef5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:19.372782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91c2aef0-576c-4b09-985b-0c74fb59bef5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:19.402848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-91c2aef0-576c-4b09-985b-0c74fb59bef5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044527 Aug 18 22:03:19.403510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 761/1524] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:19 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:19.682120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f2bd5d59-da30-4d16-b44e-c6b21af2d891 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:19.684176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f2bd5d59-da30-4d16-b44e-c6b21af2d891 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:19.690707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2bd5d59-da30-4d16-b44e-c6b21af2d891 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:19.691189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2bd5d59-da30-4d16-b44e-c6b21af2d891 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:19.691623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2bd5d59-da30-4d16-b44e-c6b21af2d891 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:19.692899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2bd5d59-da30-4d16-b44e-c6b21af2d891 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:19.693357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2bd5d59-da30-4d16-b44e-c6b21af2d891 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:19.693809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2bd5d59-da30-4d16-b44e-c6b21af2d891 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:19.723017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f2bd5d59-da30-4d16-b44e-c6b21af2d891 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044874 Aug 18 22:03:19.723556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 764/1525] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:19.950971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-826486a7-caa2-4f94-8db5-1dccb2fea553 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:19.953091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-826486a7-caa2-4f94-8db5-1dccb2fea553 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:19.959612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-826486a7-caa2-4f94-8db5-1dccb2fea553 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:19.960073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-826486a7-caa2-4f94-8db5-1dccb2fea553 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:19.960507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-826486a7-caa2-4f94-8db5-1dccb2fea553 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:19.961205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-826486a7-caa2-4f94-8db5-1dccb2fea553 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:19.961682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-826486a7-caa2-4f94-8db5-1dccb2fea553 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:19.962111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-826486a7-caa2-4f94-8db5-1dccb2fea553 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:19.991540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-826486a7-caa2-4f94-8db5-1dccb2fea553 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044536 Aug 18 22:03:19.992095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 762/1526] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:19 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:20.120821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7a866c39-2c57-4429-adaa-112699026906 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:20.122996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7a866c39-2c57-4429-adaa-112699026906 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:20.128851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a866c39-2c57-4429-adaa-112699026906 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:20.129350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a866c39-2c57-4429-adaa-112699026906 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:20.129859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a866c39-2c57-4429-adaa-112699026906 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:20.130564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a866c39-2c57-4429-adaa-112699026906 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:20.131023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a866c39-2c57-4429-adaa-112699026906 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:20.131454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a866c39-2c57-4429-adaa-112699026906 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:20.160091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7a866c39-2c57-4429-adaa-112699026906 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043288 Aug 18 22:03:20.160644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 765/1527] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:20.415634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-66706dab-a43e-441a-bc2b-094eb32f6804 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:20.417779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-66706dab-a43e-441a-bc2b-094eb32f6804 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:20.423964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66706dab-a43e-441a-bc2b-094eb32f6804 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:20.424442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66706dab-a43e-441a-bc2b-094eb32f6804 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:20.424869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66706dab-a43e-441a-bc2b-094eb32f6804 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:20.425549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66706dab-a43e-441a-bc2b-094eb32f6804 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:20.426032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66706dab-a43e-441a-bc2b-094eb32f6804 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:20.426455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-66706dab-a43e-441a-bc2b-094eb32f6804 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:20.455372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-66706dab-a43e-441a-bc2b-094eb32f6804 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 Aug 18 22:03:20.455946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 763/1528] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:20 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:20.735243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a527afa4-6eb0-43af-b1ea-41b63404b1e8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:20.737420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a527afa4-6eb0-43af-b1ea-41b63404b1e8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:20.743840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a527afa4-6eb0-43af-b1ea-41b63404b1e8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:20.744319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a527afa4-6eb0-43af-b1ea-41b63404b1e8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:20.744751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a527afa4-6eb0-43af-b1ea-41b63404b1e8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:20.745440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a527afa4-6eb0-43af-b1ea-41b63404b1e8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:20.745939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a527afa4-6eb0-43af-b1ea-41b63404b1e8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:20.746366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a527afa4-6eb0-43af-b1ea-41b63404b1e8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:20.777169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a527afa4-6eb0-43af-b1ea-41b63404b1e8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045809 Aug 18 22:03:20.777902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 766/1529] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:20 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:21.003755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b5377e00-3147-4747-8650-78837860296c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:21.006471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b5377e00-3147-4747-8650-78837860296c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:21.012851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5377e00-3147-4747-8650-78837860296c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:21.013333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5377e00-3147-4747-8650-78837860296c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:21.013816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5377e00-3147-4747-8650-78837860296c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:21.014518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5377e00-3147-4747-8650-78837860296c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:21.014977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5377e00-3147-4747-8650-78837860296c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:21.015402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b5377e00-3147-4747-8650-78837860296c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:21.043287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b5377e00-3147-4747-8650-78837860296c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043571 Aug 18 22:03:21.043838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 764/1530] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:20 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:21.173091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-786d67f9-41d9-4fb8-b482-383a255aa3f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:21.175591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-786d67f9-41d9-4fb8-b482-383a255aa3f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:21.182197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-786d67f9-41d9-4fb8-b482-383a255aa3f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:21.182795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-786d67f9-41d9-4fb8-b482-383a255aa3f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:21.183622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-786d67f9-41d9-4fb8-b482-383a255aa3f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:21.184622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-786d67f9-41d9-4fb8-b482-383a255aa3f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:21.185237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-786d67f9-41d9-4fb8-b482-383a255aa3f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:21.185922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-786d67f9-41d9-4fb8-b482-383a255aa3f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:21.215372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-786d67f9-41d9-4fb8-b482-383a255aa3f1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046295 Aug 18 22:03:21.215949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 767/1531] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:21.468454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6f90b751-c329-45d1-b06b-be8a65c8c4a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:21.470632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6f90b751-c329-45d1-b06b-be8a65c8c4a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:21.476972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f90b751-c329-45d1-b06b-be8a65c8c4a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:21.477450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f90b751-c329-45d1-b06b-be8a65c8c4a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:21.477921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f90b751-c329-45d1-b06b-be8a65c8c4a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:21.478605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f90b751-c329-45d1-b06b-be8a65c8c4a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:21.479057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f90b751-c329-45d1-b06b-be8a65c8c4a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:21.479478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f90b751-c329-45d1-b06b-be8a65c8c4a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:21.508655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6f90b751-c329-45d1-b06b-be8a65c8c4a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044138 Aug 18 22:03:21.509398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 765/1532] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:21 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:21.791009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b70ee3a6-39d3-4717-a06f-fefbd1c72c16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:21.793188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b70ee3a6-39d3-4717-a06f-fefbd1c72c16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:21.799736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b70ee3a6-39d3-4717-a06f-fefbd1c72c16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:21.800206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b70ee3a6-39d3-4717-a06f-fefbd1c72c16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:21.800637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b70ee3a6-39d3-4717-a06f-fefbd1c72c16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:21.801330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b70ee3a6-39d3-4717-a06f-fefbd1c72c16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:21.801818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b70ee3a6-39d3-4717-a06f-fefbd1c72c16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:21.802242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b70ee3a6-39d3-4717-a06f-fefbd1c72c16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:21.834583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b70ee3a6-39d3-4717-a06f-fefbd1c72c16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049143 Aug 18 22:03:21.835135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 768/1533] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:22.054936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a285aa48-7a42-4f5b-8325-6ae2d4a525d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:22.057030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a285aa48-7a42-4f5b-8325-6ae2d4a525d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:22.063494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a285aa48-7a42-4f5b-8325-6ae2d4a525d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:22.063972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a285aa48-7a42-4f5b-8325-6ae2d4a525d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:22.064410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a285aa48-7a42-4f5b-8325-6ae2d4a525d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:22.065101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a285aa48-7a42-4f5b-8325-6ae2d4a525d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:22.065557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a285aa48-7a42-4f5b-8325-6ae2d4a525d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:22.066016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a285aa48-7a42-4f5b-8325-6ae2d4a525d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:22.096457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a285aa48-7a42-4f5b-8325-6ae2d4a525d5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045498 Aug 18 22:03:22.097007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 766/1534] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:22 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:22.228552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b801cf7-ddf5-42d1-aa1b-fba2a4d0c590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:22.230759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5b801cf7-ddf5-42d1-aa1b-fba2a4d0c590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:22.236838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b801cf7-ddf5-42d1-aa1b-fba2a4d0c590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:22.237329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b801cf7-ddf5-42d1-aa1b-fba2a4d0c590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:22.237822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b801cf7-ddf5-42d1-aa1b-fba2a4d0c590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:22.238538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b801cf7-ddf5-42d1-aa1b-fba2a4d0c590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:22.239052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b801cf7-ddf5-42d1-aa1b-fba2a4d0c590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:22.239499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b801cf7-ddf5-42d1-aa1b-fba2a4d0c590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:22.269190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5b801cf7-ddf5-42d1-aa1b-fba2a4d0c590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044904 Aug 18 22:03:22.269768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 769/1535] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:22 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:03:22.520399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a2a32ab3-2683-41bf-a99f-58a6340a5faf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:22.522571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a2a32ab3-2683-41bf-a99f-58a6340a5faf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:22.528492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2a32ab3-2683-41bf-a99f-58a6340a5faf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:22.528974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2a32ab3-2683-41bf-a99f-58a6340a5faf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:22.529413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2a32ab3-2683-41bf-a99f-58a6340a5faf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:22.530126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2a32ab3-2683-41bf-a99f-58a6340a5faf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:22.530583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2a32ab3-2683-41bf-a99f-58a6340a5faf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:22.531012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2a32ab3-2683-41bf-a99f-58a6340a5faf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:22.561391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a2a32ab3-2683-41bf-a99f-58a6340a5faf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044932 Aug 18 22:03:22.561927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 767/1536] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:22.677794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:03:22.678033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:03:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:03:22.846906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52acb000-14f5-4698-8238-eaadff5f89fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:22.849518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-52acb000-14f5-4698-8238-eaadff5f89fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:22.855935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52acb000-14f5-4698-8238-eaadff5f89fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:22.856407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52acb000-14f5-4698-8238-eaadff5f89fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:22.856836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52acb000-14f5-4698-8238-eaadff5f89fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:22.857519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52acb000-14f5-4698-8238-eaadff5f89fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:22.857992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52acb000-14f5-4698-8238-eaadff5f89fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:22.858416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52acb000-14f5-4698-8238-eaadff5f89fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:22.887064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-52acb000-14f5-4698-8238-eaadff5f89fa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044212 Aug 18 22:03:22.887608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 770/1537] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:23.108941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-118f874e-74e2-4bf0-80f9-e3bf0ff2f51b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:23.111124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-118f874e-74e2-4bf0-80f9-e3bf0ff2f51b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:23.118365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-118f874e-74e2-4bf0-80f9-e3bf0ff2f51b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:23.118844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-118f874e-74e2-4bf0-80f9-e3bf0ff2f51b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:23.119282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-118f874e-74e2-4bf0-80f9-e3bf0ff2f51b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:23.120007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-118f874e-74e2-4bf0-80f9-e3bf0ff2f51b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:23.120463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-118f874e-74e2-4bf0-80f9-e3bf0ff2f51b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:23.120889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-118f874e-74e2-4bf0-80f9-e3bf0ff2f51b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:23.149433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-118f874e-74e2-4bf0-80f9-e3bf0ff2f51b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044634 Aug 18 22:03:23.150035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 768/1538] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:23 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:23.282089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fbbd9e67-f4a3-4bc2-a87c-34902a6a6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:23.284201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fbbd9e67-f4a3-4bc2-a87c-34902a6a6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:23.290685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fbbd9e67-f4a3-4bc2-a87c-34902a6a6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:23.291165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fbbd9e67-f4a3-4bc2-a87c-34902a6a6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:23.291594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fbbd9e67-f4a3-4bc2-a87c-34902a6a6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:23.292282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fbbd9e67-f4a3-4bc2-a87c-34902a6a6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:23.292728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fbbd9e67-f4a3-4bc2-a87c-34902a6a6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:23.293149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fbbd9e67-f4a3-4bc2-a87c-34902a6a6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:23.321248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fbbd9e67-f4a3-4bc2-a87c-34902a6a6b67 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043097 Aug 18 22:03:23.321825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 771/1539] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:23 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:23.574087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-78cad89b-8734-448a-ab1a-270dd305594a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:23.576231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-78cad89b-8734-448a-ab1a-270dd305594a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:23.582333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78cad89b-8734-448a-ab1a-270dd305594a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:23.583452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78cad89b-8734-448a-ab1a-270dd305594a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:23.583885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78cad89b-8734-448a-ab1a-270dd305594a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:23.584576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78cad89b-8734-448a-ab1a-270dd305594a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:23.585028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78cad89b-8734-448a-ab1a-270dd305594a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:23.585459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78cad89b-8734-448a-ab1a-270dd305594a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:23.613985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-78cad89b-8734-448a-ab1a-270dd305594a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043906 Aug 18 22:03:23.614835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 769/1540] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:23 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:23.899967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1a403b83-597b-47bc-8666-70e7b9fb3ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:23.902074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1a403b83-597b-47bc-8666-70e7b9fb3ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:23.908418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a403b83-597b-47bc-8666-70e7b9fb3ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:23.908889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a403b83-597b-47bc-8666-70e7b9fb3ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:23.909320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a403b83-597b-47bc-8666-70e7b9fb3ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:23.910032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a403b83-597b-47bc-8666-70e7b9fb3ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:23.910483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a403b83-597b-47bc-8666-70e7b9fb3ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:23.910998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a403b83-597b-47bc-8666-70e7b9fb3ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:23.940031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1a403b83-597b-47bc-8666-70e7b9fb3ea6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044705 Aug 18 22:03:23.940580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 772/1541] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:24.162081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-231c7890-bd0f-45f3-879b-be90779a255a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:24.164148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-231c7890-bd0f-45f3-879b-be90779a255a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:24.170565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-231c7890-bd0f-45f3-879b-be90779a255a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:24.171048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-231c7890-bd0f-45f3-879b-be90779a255a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:24.171483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-231c7890-bd0f-45f3-879b-be90779a255a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:24.172184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-231c7890-bd0f-45f3-879b-be90779a255a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:24.172636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-231c7890-bd0f-45f3-879b-be90779a255a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:24.173061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-231c7890-bd0f-45f3-879b-be90779a255a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:24.202447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-231c7890-bd0f-45f3-879b-be90779a255a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Aug 18 22:03:24.202994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 770/1542] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:24.332570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3dcc6032-1723-411e-9918-0297d0d7d11e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:24.334717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3dcc6032-1723-411e-9918-0297d0d7d11e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:24.340568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dcc6032-1723-411e-9918-0297d0d7d11e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:24.341040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dcc6032-1723-411e-9918-0297d0d7d11e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:24.341472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dcc6032-1723-411e-9918-0297d0d7d11e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:24.342184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dcc6032-1723-411e-9918-0297d0d7d11e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:24.342637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dcc6032-1723-411e-9918-0297d0d7d11e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:24.343136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dcc6032-1723-411e-9918-0297d0d7d11e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:24.372090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3dcc6032-1723-411e-9918-0297d0d7d11e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043458 Aug 18 22:03:24.372626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 773/1543] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:24 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:03:24.625833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6f0ebbcb-a3ae-49b5-b2df-9902bb313df6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:24.627954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6f0ebbcb-a3ae-49b5-b2df-9902bb313df6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:24.634013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f0ebbcb-a3ae-49b5-b2df-9902bb313df6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:24.634486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f0ebbcb-a3ae-49b5-b2df-9902bb313df6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:24.634922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f0ebbcb-a3ae-49b5-b2df-9902bb313df6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:24.635601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f0ebbcb-a3ae-49b5-b2df-9902bb313df6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:24.636048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f0ebbcb-a3ae-49b5-b2df-9902bb313df6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:24.636466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f0ebbcb-a3ae-49b5-b2df-9902bb313df6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:24.665205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6f0ebbcb-a3ae-49b5-b2df-9902bb313df6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043387 Aug 18 22:03:24.665781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 771/1544] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:24 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:24.952394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ec25172c-57dc-42a6-b741-3ed281391005 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:24.954626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ec25172c-57dc-42a6-b741-3ed281391005 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:24.961660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec25172c-57dc-42a6-b741-3ed281391005 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:24.962141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec25172c-57dc-42a6-b741-3ed281391005 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:24.962580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec25172c-57dc-42a6-b741-3ed281391005 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:24.963272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec25172c-57dc-42a6-b741-3ed281391005 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:24.963727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec25172c-57dc-42a6-b741-3ed281391005 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:24.964152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec25172c-57dc-42a6-b741-3ed281391005 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:24.993552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ec25172c-57dc-42a6-b741-3ed281391005 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045096 Aug 18 22:03:24.994127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 774/1545] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:24 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:25.215124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-82b2836a-e293-4461-b2e5-cfd9952b533c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:25.217349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-82b2836a-e293-4461-b2e5-cfd9952b533c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:25.223769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82b2836a-e293-4461-b2e5-cfd9952b533c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:25.224250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82b2836a-e293-4461-b2e5-cfd9952b533c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:25.224689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82b2836a-e293-4461-b2e5-cfd9952b533c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:25.225386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82b2836a-e293-4461-b2e5-cfd9952b533c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:25.225899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82b2836a-e293-4461-b2e5-cfd9952b533c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:25.226355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82b2836a-e293-4461-b2e5-cfd9952b533c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:25.256488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-82b2836a-e293-4461-b2e5-cfd9952b533c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045390 Aug 18 22:03:25.257051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 772/1546] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:25 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:25.384035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9d539d66-687a-402f-8b22-d841369f576c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:25.386211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9d539d66-687a-402f-8b22-d841369f576c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:25.392238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d539d66-687a-402f-8b22-d841369f576c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:25.392723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d539d66-687a-402f-8b22-d841369f576c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:25.393166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d539d66-687a-402f-8b22-d841369f576c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:25.393906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d539d66-687a-402f-8b22-d841369f576c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:25.394369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d539d66-687a-402f-8b22-d841369f576c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:25.394811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d539d66-687a-402f-8b22-d841369f576c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:25.424715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9d539d66-687a-402f-8b22-d841369f576c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Aug 18 22:03:25.425272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 775/1547] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:25 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:25.678565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-37d6d3a4-5b12-4ad3-9f81-6c7a37ba1c15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:25.680706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-37d6d3a4-5b12-4ad3-9f81-6c7a37ba1c15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:25.686710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37d6d3a4-5b12-4ad3-9f81-6c7a37ba1c15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:25.687201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37d6d3a4-5b12-4ad3-9f81-6c7a37ba1c15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:25.687648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37d6d3a4-5b12-4ad3-9f81-6c7a37ba1c15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:25.688383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37d6d3a4-5b12-4ad3-9f81-6c7a37ba1c15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:25.688843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37d6d3a4-5b12-4ad3-9f81-6c7a37ba1c15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:25.689276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37d6d3a4-5b12-4ad3-9f81-6c7a37ba1c15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:25.719508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-37d6d3a4-5b12-4ad3-9f81-6c7a37ba1c15 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045888 Aug 18 22:03:25.720079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 773/1548] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:26.005181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cfb8514d-94d9-46c0-bd2b-005f1d0de385 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:26.007267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cfb8514d-94d9-46c0-bd2b-005f1d0de385 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:26.013800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cfb8514d-94d9-46c0-bd2b-005f1d0de385 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:26.014282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cfb8514d-94d9-46c0-bd2b-005f1d0de385 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:26.014722 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cfb8514d-94d9-46c0-bd2b-005f1d0de385 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:26.015424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cfb8514d-94d9-46c0-bd2b-005f1d0de385 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:26.015997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cfb8514d-94d9-46c0-bd2b-005f1d0de385 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:26.016418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cfb8514d-94d9-46c0-bd2b-005f1d0de385 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:26.029743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:26.046323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cfb8514d-94d9-46c0-bd2b-005f1d0de385 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045192 Aug 18 22:03:26.046881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 776/1549] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:25 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:26.268585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b8e07200-e905-4a8f-9e2e-5033a1b56786 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:26.271225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b8e07200-e905-4a8f-9e2e-5033a1b56786 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:26.277773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e07200-e905-4a8f-9e2e-5033a1b56786 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:26.278271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e07200-e905-4a8f-9e2e-5033a1b56786 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:26.278705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e07200-e905-4a8f-9e2e-5033a1b56786 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:26.279403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e07200-e905-4a8f-9e2e-5033a1b56786 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:26.279863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e07200-e905-4a8f-9e2e-5033a1b56786 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:26.280295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8e07200-e905-4a8f-9e2e-5033a1b56786 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:26.309211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b8e07200-e905-4a8f-9e2e-5033a1b56786 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Aug 18 22:03:26.309786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 774/1550] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:26 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:26.437228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5716d971-e220-43d9-87b8-ba97505a900f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:26.439380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5716d971-e220-43d9-87b8-ba97505a900f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:26.445405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5716d971-e220-43d9-87b8-ba97505a900f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:26.445919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5716d971-e220-43d9-87b8-ba97505a900f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:26.446361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5716d971-e220-43d9-87b8-ba97505a900f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:26.447055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5716d971-e220-43d9-87b8-ba97505a900f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:26.447513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5716d971-e220-43d9-87b8-ba97505a900f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:26.447941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5716d971-e220-43d9-87b8-ba97505a900f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:26.477215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5716d971-e220-43d9-87b8-ba97505a900f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Aug 18 22:03:26.477793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 777/1551] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:26 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:26.731185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-42ea7de9-024f-42e1-90c6-9347c3402e56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:26.733320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-42ea7de9-024f-42e1-90c6-9347c3402e56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:26.739546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42ea7de9-024f-42e1-90c6-9347c3402e56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:26.740034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42ea7de9-024f-42e1-90c6-9347c3402e56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:26.740465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42ea7de9-024f-42e1-90c6-9347c3402e56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:26.741161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42ea7de9-024f-42e1-90c6-9347c3402e56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:26.741643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42ea7de9-024f-42e1-90c6-9347c3402e56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:26.742075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42ea7de9-024f-42e1-90c6-9347c3402e56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:26.771838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-42ea7de9-024f-42e1-90c6-9347c3402e56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Aug 18 22:03:26.772393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 775/1552] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:26 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:27.058698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7e5e4f82-9459-4d89-bb6e-592d72449f5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:27.060901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7e5e4f82-9459-4d89-bb6e-592d72449f5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:27.067988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e5e4f82-9459-4d89-bb6e-592d72449f5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:27.068480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e5e4f82-9459-4d89-bb6e-592d72449f5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:27.068921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e5e4f82-9459-4d89-bb6e-592d72449f5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:27.069647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e5e4f82-9459-4d89-bb6e-592d72449f5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:27.070109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e5e4f82-9459-4d89-bb6e-592d72449f5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:27.070541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e5e4f82-9459-4d89-bb6e-592d72449f5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:27.099542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7e5e4f82-9459-4d89-bb6e-592d72449f5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044623 Aug 18 22:03:27.100107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 778/1553] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:27 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:27.321515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-db1ebdf8-29fe-4486-9dd1-f98233d1cd4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:27.323621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-db1ebdf8-29fe-4486-9dd1-f98233d1cd4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:27.329981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db1ebdf8-29fe-4486-9dd1-f98233d1cd4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:27.330458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db1ebdf8-29fe-4486-9dd1-f98233d1cd4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:27.330887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db1ebdf8-29fe-4486-9dd1-f98233d1cd4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:27.331571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db1ebdf8-29fe-4486-9dd1-f98233d1cd4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:27.332025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db1ebdf8-29fe-4486-9dd1-f98233d1cd4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:27.332447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db1ebdf8-29fe-4486-9dd1-f98233d1cd4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:27.348988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:27.361933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-db1ebdf8-29fe-4486-9dd1-f98233d1cd4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044579 Aug 18 22:03:27.362489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 776/1554] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:27 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:27.488642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-577313fa-1d91-46d4-8496-ea22ef311d34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:27.491389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-577313fa-1d91-46d4-8496-ea22ef311d34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:27.497293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-577313fa-1d91-46d4-8496-ea22ef311d34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:27.497816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-577313fa-1d91-46d4-8496-ea22ef311d34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:27.498358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-577313fa-1d91-46d4-8496-ea22ef311d34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:27.499061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-577313fa-1d91-46d4-8496-ea22ef311d34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:27.499520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-577313fa-1d91-46d4-8496-ea22ef311d34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:27.499949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-577313fa-1d91-46d4-8496-ea22ef311d34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:27.528305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-577313fa-1d91-46d4-8496-ea22ef311d34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043620 Aug 18 22:03:27.528876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 779/1555] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:27 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:27.784095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8ae07506-85df-4867-a5fb-dddc369c4252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:27.786856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8ae07506-85df-4867-a5fb-dddc369c4252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:27.792934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ae07506-85df-4867-a5fb-dddc369c4252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:27.793422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ae07506-85df-4867-a5fb-dddc369c4252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:27.793907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ae07506-85df-4867-a5fb-dddc369c4252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:27.794611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ae07506-85df-4867-a5fb-dddc369c4252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:27.795069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ae07506-85df-4867-a5fb-dddc369c4252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:27.795501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ae07506-85df-4867-a5fb-dddc369c4252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:27.824237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8ae07506-85df-4867-a5fb-dddc369c4252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Aug 18 22:03:27.824791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 777/1556] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:28.111982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c3bf16a5-1d9c-4879-89a9-f6ceb43385ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:28.114180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c3bf16a5-1d9c-4879-89a9-f6ceb43385ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:28.120514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3bf16a5-1d9c-4879-89a9-f6ceb43385ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:28.120994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3bf16a5-1d9c-4879-89a9-f6ceb43385ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:28.121430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3bf16a5-1d9c-4879-89a9-f6ceb43385ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:28.122158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3bf16a5-1d9c-4879-89a9-f6ceb43385ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:28.122615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3bf16a5-1d9c-4879-89a9-f6ceb43385ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:28.123043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3bf16a5-1d9c-4879-89a9-f6ceb43385ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:28.152662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c3bf16a5-1d9c-4879-89a9-f6ceb43385ec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044660 Aug 18 22:03:28.153215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 780/1557] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:28.374755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-779e478e-4b3c-4c27-a464-ab6e5ecbfe73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:28.376852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-779e478e-4b3c-4c27-a464-ab6e5ecbfe73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:28.383382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-779e478e-4b3c-4c27-a464-ab6e5ecbfe73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:28.383864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-779e478e-4b3c-4c27-a464-ab6e5ecbfe73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:28.384300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-779e478e-4b3c-4c27-a464-ab6e5ecbfe73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:28.384991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-779e478e-4b3c-4c27-a464-ab6e5ecbfe73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:28.385444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-779e478e-4b3c-4c27-a464-ab6e5ecbfe73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:28.385903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-779e478e-4b3c-4c27-a464-ab6e5ecbfe73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:28.414955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-779e478e-4b3c-4c27-a464-ab6e5ecbfe73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044207 Aug 18 22:03:28.415514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 778/1558] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:28 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:28.540277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-58c7555f-fa15-422b-9126-04beb02384b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:28.542472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-58c7555f-fa15-422b-9126-04beb02384b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:28.548371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58c7555f-fa15-422b-9126-04beb02384b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:28.549111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58c7555f-fa15-422b-9126-04beb02384b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:28.549553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58c7555f-fa15-422b-9126-04beb02384b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:28.550280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58c7555f-fa15-422b-9126-04beb02384b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:28.550739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58c7555f-fa15-422b-9126-04beb02384b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:28.551171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58c7555f-fa15-422b-9126-04beb02384b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:28.580253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-58c7555f-fa15-422b-9126-04beb02384b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Aug 18 22:03:28.580808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 781/1559] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:28 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:28.836385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-86c3740c-6f38-4ca1-8443-5f24254c8ad0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:28.838551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-86c3740c-6f38-4ca1-8443-5f24254c8ad0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:28.845664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86c3740c-6f38-4ca1-8443-5f24254c8ad0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:28.846150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86c3740c-6f38-4ca1-8443-5f24254c8ad0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:28.846589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86c3740c-6f38-4ca1-8443-5f24254c8ad0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:28.847284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86c3740c-6f38-4ca1-8443-5f24254c8ad0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:28.847738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86c3740c-6f38-4ca1-8443-5f24254c8ad0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:28.848653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86c3740c-6f38-4ca1-8443-5f24254c8ad0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:28.878689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-86c3740c-6f38-4ca1-8443-5f24254c8ad0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046142 Aug 18 22:03:28.879173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 779/1560] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:29.165238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3f28274c-7de6-4735-b96e-839ec37a0024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:29.167354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3f28274c-7de6-4735-b96e-839ec37a0024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:29.173992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f28274c-7de6-4735-b96e-839ec37a0024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:29.174479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f28274c-7de6-4735-b96e-839ec37a0024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:29.174920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f28274c-7de6-4735-b96e-839ec37a0024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:29.175621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f28274c-7de6-4735-b96e-839ec37a0024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:29.176081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f28274c-7de6-4735-b96e-839ec37a0024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:29.176514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f28274c-7de6-4735-b96e-839ec37a0024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:29.204554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3f28274c-7de6-4735-b96e-839ec37a0024 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044002 Aug 18 22:03:29.205115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 782/1561] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:29.427611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-adcf1758-24d0-4f1c-992d-c9d90a1cba8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:29.429726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-adcf1758-24d0-4f1c-992d-c9d90a1cba8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:29.435678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-adcf1758-24d0-4f1c-992d-c9d90a1cba8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:29.436161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-adcf1758-24d0-4f1c-992d-c9d90a1cba8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:29.436609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-adcf1758-24d0-4f1c-992d-c9d90a1cba8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:29.437306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-adcf1758-24d0-4f1c-992d-c9d90a1cba8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:29.437803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-adcf1758-24d0-4f1c-992d-c9d90a1cba8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:29.438240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-adcf1758-24d0-4f1c-992d-c9d90a1cba8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:29.469215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-adcf1758-24d0-4f1c-992d-c9d90a1cba8d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045538 Aug 18 22:03:29.469448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 780/1562] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:29 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:29.591786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d458b288-2c59-4409-bd0a-4a4de8e99cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:29.593962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d458b288-2c59-4409-bd0a-4a4de8e99cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:29.599789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d458b288-2c59-4409-bd0a-4a4de8e99cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:29.600263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d458b288-2c59-4409-bd0a-4a4de8e99cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:29.600691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d458b288-2c59-4409-bd0a-4a4de8e99cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:29.601379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d458b288-2c59-4409-bd0a-4a4de8e99cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:29.601851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d458b288-2c59-4409-bd0a-4a4de8e99cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:29.602276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d458b288-2c59-4409-bd0a-4a4de8e99cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:29.632791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d458b288-2c59-4409-bd0a-4a4de8e99cd4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044903 Aug 18 22:03:29.633343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 783/1563] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:29 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:29.890585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ddcb2bcb-9aab-44df-bee7-19e039736165 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:29.892726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ddcb2bcb-9aab-44df-bee7-19e039736165 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:29.899784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddcb2bcb-9aab-44df-bee7-19e039736165 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:29.900271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddcb2bcb-9aab-44df-bee7-19e039736165 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:29.900711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddcb2bcb-9aab-44df-bee7-19e039736165 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:29.901413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddcb2bcb-9aab-44df-bee7-19e039736165 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:29.901898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddcb2bcb-9aab-44df-bee7-19e039736165 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:29.902334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ddcb2bcb-9aab-44df-bee7-19e039736165 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:29.931535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ddcb2bcb-9aab-44df-bee7-19e039736165 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Aug 18 22:03:29.932095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 781/1564] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:29 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:30.217483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-edc28825-a528-430b-b620-e04673f792b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:30.219691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-edc28825-a528-430b-b620-e04673f792b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:30.226092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc28825-a528-430b-b620-e04673f792b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:30.226571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc28825-a528-430b-b620-e04673f792b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:30.227034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc28825-a528-430b-b620-e04673f792b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:30.227731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc28825-a528-430b-b620-e04673f792b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:30.228191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc28825-a528-430b-b620-e04673f792b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:30.228620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc28825-a528-430b-b620-e04673f792b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:30.258624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-edc28825-a528-430b-b620-e04673f792b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044934 Aug 18 22:03:30.259097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 784/1565] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:30.481890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-27880d9e-011d-4a90-a73d-8f8733d36566 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:30.484086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-27880d9e-011d-4a90-a73d-8f8733d36566 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:30.490853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27880d9e-011d-4a90-a73d-8f8733d36566 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:30.491333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27880d9e-011d-4a90-a73d-8f8733d36566 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:30.491771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27880d9e-011d-4a90-a73d-8f8733d36566 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:30.492465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27880d9e-011d-4a90-a73d-8f8733d36566 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:30.492919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27880d9e-011d-4a90-a73d-8f8733d36566 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:30.493345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27880d9e-011d-4a90-a73d-8f8733d36566 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:30.521224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-27880d9e-011d-4a90-a73d-8f8733d36566 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043324 Aug 18 22:03:30.521815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 782/1566] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:30.645729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0e4cdd26-a4f9-46c4-a914-12089a3ef503 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:30.647868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0e4cdd26-a4f9-46c4-a914-12089a3ef503 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:30.653759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e4cdd26-a4f9-46c4-a914-12089a3ef503 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:30.654242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e4cdd26-a4f9-46c4-a914-12089a3ef503 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:30.654680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e4cdd26-a4f9-46c4-a914-12089a3ef503 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:30.655437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e4cdd26-a4f9-46c4-a914-12089a3ef503 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:30.655904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e4cdd26-a4f9-46c4-a914-12089a3ef503 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:30.656464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e4cdd26-a4f9-46c4-a914-12089a3ef503 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:30.685747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0e4cdd26-a4f9-46c4-a914-12089a3ef503 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Aug 18 22:03:30.686294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 785/1567] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:30 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:30.943816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6c5c3c02-7aa3-4567-96f9-2bdc8aaa704b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:30.945975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6c5c3c02-7aa3-4567-96f9-2bdc8aaa704b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:30.952312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c5c3c02-7aa3-4567-96f9-2bdc8aaa704b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:30.952793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c5c3c02-7aa3-4567-96f9-2bdc8aaa704b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:30.953319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c5c3c02-7aa3-4567-96f9-2bdc8aaa704b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:30.954039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c5c3c02-7aa3-4567-96f9-2bdc8aaa704b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:30.954494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c5c3c02-7aa3-4567-96f9-2bdc8aaa704b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:30.954918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c5c3c02-7aa3-4567-96f9-2bdc8aaa704b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:30.984597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6c5c3c02-7aa3-4567-96f9-2bdc8aaa704b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 Aug 18 22:03:30.985151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 783/1568] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:30 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:31.271564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-36f5fa8b-c314-4550-b122-60cd6889cd23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:31.273745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-36f5fa8b-c314-4550-b122-60cd6889cd23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:31.280151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36f5fa8b-c314-4550-b122-60cd6889cd23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:31.280614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36f5fa8b-c314-4550-b122-60cd6889cd23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:31.281051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36f5fa8b-c314-4550-b122-60cd6889cd23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:31.281779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36f5fa8b-c314-4550-b122-60cd6889cd23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:31.282236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36f5fa8b-c314-4550-b122-60cd6889cd23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:31.282665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36f5fa8b-c314-4550-b122-60cd6889cd23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:31.311822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-36f5fa8b-c314-4550-b122-60cd6889cd23 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044895 Aug 18 22:03:31.312416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 786/1569] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:31 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:31.533041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07582907-e660-41af-98f7-22d5f808d808 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:31.535190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07582907-e660-41af-98f7-22d5f808d808 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:31.541135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07582907-e660-41af-98f7-22d5f808d808 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:31.541638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07582907-e660-41af-98f7-22d5f808d808 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:31.542145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07582907-e660-41af-98f7-22d5f808d808 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:31.542829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07582907-e660-41af-98f7-22d5f808d808 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:31.543282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07582907-e660-41af-98f7-22d5f808d808 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:31.543707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07582907-e660-41af-98f7-22d5f808d808 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:31.573397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07582907-e660-41af-98f7-22d5f808d808 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Aug 18 22:03:31.573987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 784/1570] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:31 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:31.698620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-65bf661e-e771-4b6d-99c9-949daac4ee4f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:31.700756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-65bf661e-e771-4b6d-99c9-949daac4ee4f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:31.706658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65bf661e-e771-4b6d-99c9-949daac4ee4f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:31.707163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65bf661e-e771-4b6d-99c9-949daac4ee4f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:31.707600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65bf661e-e771-4b6d-99c9-949daac4ee4f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:31.708333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65bf661e-e771-4b6d-99c9-949daac4ee4f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:31.708785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65bf661e-e771-4b6d-99c9-949daac4ee4f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:31.709208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65bf661e-e771-4b6d-99c9-949daac4ee4f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:31.737886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-65bf661e-e771-4b6d-99c9-949daac4ee4f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043134 Aug 18 22:03:31.738446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 787/1571] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:31.996573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-614a63fd-9704-40fc-aa01-c340728387a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:31.998670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-614a63fd-9704-40fc-aa01-c340728387a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:32.004975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-614a63fd-9704-40fc-aa01-c340728387a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:32.005452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-614a63fd-9704-40fc-aa01-c340728387a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:32.005925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-614a63fd-9704-40fc-aa01-c340728387a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:32.006612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-614a63fd-9704-40fc-aa01-c340728387a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:32.007062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-614a63fd-9704-40fc-aa01-c340728387a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:32.007482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-614a63fd-9704-40fc-aa01-c340728387a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:32.035389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-614a63fd-9704-40fc-aa01-c340728387a3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042808 Aug 18 22:03:32.035937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 785/1572] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:31 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:32.324238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-005daec5-ed88-4062-bc02-1e3923173b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:32.326463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-005daec5-ed88-4062-bc02-1e3923173b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:32.333457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-005daec5-ed88-4062-bc02-1e3923173b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:32.333972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-005daec5-ed88-4062-bc02-1e3923173b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:32.334411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-005daec5-ed88-4062-bc02-1e3923173b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:32.335109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-005daec5-ed88-4062-bc02-1e3923173b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:32.335566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-005daec5-ed88-4062-bc02-1e3923173b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:32.335998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-005daec5-ed88-4062-bc02-1e3923173b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:32.367320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-005daec5-ed88-4062-bc02-1e3923173b45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046997 Aug 18 22:03:32.367893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 788/1573] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:32.586285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-74b3bfe1-7fe6-408b-8c37-d3fe4baa779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:32.588337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-74b3bfe1-7fe6-408b-8c37-d3fe4baa779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:32.590364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:32.595564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74b3bfe1-7fe6-408b-8c37-d3fe4baa779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:32.596040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74b3bfe1-7fe6-408b-8c37-d3fe4baa779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:32.596469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74b3bfe1-7fe6-408b-8c37-d3fe4baa779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:32.597161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74b3bfe1-7fe6-408b-8c37-d3fe4baa779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:32.597621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74b3bfe1-7fe6-408b-8c37-d3fe4baa779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:32.598052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74b3bfe1-7fe6-408b-8c37-d3fe4baa779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:32.626125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-74b3bfe1-7fe6-408b-8c37-d3fe4baa779c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Aug 18 22:03:32.626670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 786/1574] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:32.750168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fdfd8a11-214a-43a3-8d23-420974ac4afe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:32.752295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fdfd8a11-214a-43a3-8d23-420974ac4afe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:32.758714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdfd8a11-214a-43a3-8d23-420974ac4afe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:32.759193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdfd8a11-214a-43a3-8d23-420974ac4afe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:32.759631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdfd8a11-214a-43a3-8d23-420974ac4afe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:32.760322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdfd8a11-214a-43a3-8d23-420974ac4afe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:32.760774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdfd8a11-214a-43a3-8d23-420974ac4afe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:32.761202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdfd8a11-214a-43a3-8d23-420974ac4afe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:32.790533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fdfd8a11-214a-43a3-8d23-420974ac4afe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044249 Aug 18 22:03:32.791095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 789/1575] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:32 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:33.047310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f96f7223-bd0c-42ff-99e3-69e7cc074cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:33.049711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f96f7223-bd0c-42ff-99e3-69e7cc074cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:33.056504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f96f7223-bd0c-42ff-99e3-69e7cc074cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:33.056977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f96f7223-bd0c-42ff-99e3-69e7cc074cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:33.057411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f96f7223-bd0c-42ff-99e3-69e7cc074cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:33.058129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f96f7223-bd0c-42ff-99e3-69e7cc074cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:33.058583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f96f7223-bd0c-42ff-99e3-69e7cc074cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:33.059004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f96f7223-bd0c-42ff-99e3-69e7cc074cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:33.087943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f96f7223-bd0c-42ff-99e3-69e7cc074cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Aug 18 22:03:33.088502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 787/1576] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:33 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:33.380177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bb382688-a554-4585-9625-313008c60bf2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:33.382398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bb382688-a554-4585-9625-313008c60bf2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:33.388659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb382688-a554-4585-9625-313008c60bf2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:33.389136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb382688-a554-4585-9625-313008c60bf2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:33.389624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb382688-a554-4585-9625-313008c60bf2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:33.390323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb382688-a554-4585-9625-313008c60bf2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:33.390785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb382688-a554-4585-9625-313008c60bf2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:33.391214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb382688-a554-4585-9625-313008c60bf2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:33.420036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bb382688-a554-4585-9625-313008c60bf2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043892 Aug 18 22:03:33.420593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 790/1577] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:33 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:33.639239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bcdd9617-c052-41f3-aaa2-15cd8b12780d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:33.641318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bcdd9617-c052-41f3-aaa2-15cd8b12780d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:33.648131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcdd9617-c052-41f3-aaa2-15cd8b12780d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:33.648618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcdd9617-c052-41f3-aaa2-15cd8b12780d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:33.649060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcdd9617-c052-41f3-aaa2-15cd8b12780d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:33.649793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcdd9617-c052-41f3-aaa2-15cd8b12780d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:33.650254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcdd9617-c052-41f3-aaa2-15cd8b12780d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:33.650685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcdd9617-c052-41f3-aaa2-15cd8b12780d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:33.679695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bcdd9617-c052-41f3-aaa2-15cd8b12780d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044538 Aug 18 22:03:33.680260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 788/1578] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:33 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:33.803848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2171a185-c903-4a3b-944a-ba50a5f96b6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:33.805993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2171a185-c903-4a3b-944a-ba50a5f96b6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:33.811793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2171a185-c903-4a3b-944a-ba50a5f96b6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:33.812268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2171a185-c903-4a3b-944a-ba50a5f96b6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:33.812697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2171a185-c903-4a3b-944a-ba50a5f96b6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:33.813385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2171a185-c903-4a3b-944a-ba50a5f96b6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:33.813864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2171a185-c903-4a3b-944a-ba50a5f96b6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:33.814286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2171a185-c903-4a3b-944a-ba50a5f96b6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:33.842633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2171a185-c903-4a3b-944a-ba50a5f96b6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 Aug 18 22:03:33.843186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 791/1579] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:34.100718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-052bda1e-4116-4d9c-b77c-c66940ef5750 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:34.102922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-052bda1e-4116-4d9c-b77c-c66940ef5750 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:34.109244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-052bda1e-4116-4d9c-b77c-c66940ef5750 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:34.109782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-052bda1e-4116-4d9c-b77c-c66940ef5750 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:34.110225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-052bda1e-4116-4d9c-b77c-c66940ef5750 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:34.110917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-052bda1e-4116-4d9c-b77c-c66940ef5750 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:34.111390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-052bda1e-4116-4d9c-b77c-c66940ef5750 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:34.111797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-052bda1e-4116-4d9c-b77c-c66940ef5750 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:34.140524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-052bda1e-4116-4d9c-b77c-c66940ef5750 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 Aug 18 22:03:34.141075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 789/1580] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:34 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:34.432811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a3a9b8a-bc85-4afc-9b36-e3fc50e25e5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:34.434913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0a3a9b8a-bc85-4afc-9b36-e3fc50e25e5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:34.441282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a3a9b8a-bc85-4afc-9b36-e3fc50e25e5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:34.441800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a3a9b8a-bc85-4afc-9b36-e3fc50e25e5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:34.442239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a3a9b8a-bc85-4afc-9b36-e3fc50e25e5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:34.442940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a3a9b8a-bc85-4afc-9b36-e3fc50e25e5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:34.443391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a3a9b8a-bc85-4afc-9b36-e3fc50e25e5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:34.443817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a3a9b8a-bc85-4afc-9b36-e3fc50e25e5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:34.473189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a3a9b8a-bc85-4afc-9b36-e3fc50e25e5b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044393 Aug 18 22:03:34.474423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 792/1581] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:34.692036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1c87a13f-78b0-4219-afb6-357e214f064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:34.694844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1c87a13f-78b0-4219-afb6-357e214f064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:34.700813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c87a13f-78b0-4219-afb6-357e214f064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:34.701329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c87a13f-78b0-4219-afb6-357e214f064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:34.701785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c87a13f-78b0-4219-afb6-357e214f064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:34.702507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c87a13f-78b0-4219-afb6-357e214f064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:34.702952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c87a13f-78b0-4219-afb6-357e214f064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:34.703375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c87a13f-78b0-4219-afb6-357e214f064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:34.733363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1c87a13f-78b0-4219-afb6-357e214f064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045339 Aug 18 22:03:34.733960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 790/1582] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:34 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:34.854880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-53074e06-23ab-4fe2-9e7a-cbd0795b4dfa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:34.856995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-53074e06-23ab-4fe2-9e7a-cbd0795b4dfa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:34.862876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53074e06-23ab-4fe2-9e7a-cbd0795b4dfa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:34.863349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53074e06-23ab-4fe2-9e7a-cbd0795b4dfa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:34.863779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53074e06-23ab-4fe2-9e7a-cbd0795b4dfa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:34.864468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53074e06-23ab-4fe2-9e7a-cbd0795b4dfa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:34.865034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53074e06-23ab-4fe2-9e7a-cbd0795b4dfa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:34.865384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53074e06-23ab-4fe2-9e7a-cbd0795b4dfa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:34.868894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:34.895142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-53074e06-23ab-4fe2-9e7a-cbd0795b4dfa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044125 Aug 18 22:03:34.896273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 793/1583] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:35.152916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0d532a7a-ffec-476c-848c-9ec10bfcc6cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:35.155058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0d532a7a-ffec-476c-848c-9ec10bfcc6cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:35.161491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d532a7a-ffec-476c-848c-9ec10bfcc6cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:35.162001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d532a7a-ffec-476c-848c-9ec10bfcc6cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:35.162441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d532a7a-ffec-476c-848c-9ec10bfcc6cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:35.163126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d532a7a-ffec-476c-848c-9ec10bfcc6cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:35.163577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d532a7a-ffec-476c-848c-9ec10bfcc6cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:35.163999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d532a7a-ffec-476c-848c-9ec10bfcc6cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:35.193794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0d532a7a-ffec-476c-848c-9ec10bfcc6cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044814 Aug 18 22:03:35.194350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 791/1584] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:35.486705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f7e2ec84-6609-46d9-86d6-b62a49693c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:35.488776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f7e2ec84-6609-46d9-86d6-b62a49693c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:35.495685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7e2ec84-6609-46d9-86d6-b62a49693c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:35.496158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7e2ec84-6609-46d9-86d6-b62a49693c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:35.496596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7e2ec84-6609-46d9-86d6-b62a49693c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:35.497281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7e2ec84-6609-46d9-86d6-b62a49693c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:35.497763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7e2ec84-6609-46d9-86d6-b62a49693c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:35.498187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7e2ec84-6609-46d9-86d6-b62a49693c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:35.527635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f7e2ec84-6609-46d9-86d6-b62a49693c9c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045103 Aug 18 22:03:35.528189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 794/1585] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:35.746146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8d64cb31-235f-48ed-bc7a-a8eb8f9fa201 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:35.748241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8d64cb31-235f-48ed-bc7a-a8eb8f9fa201 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:35.754322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d64cb31-235f-48ed-bc7a-a8eb8f9fa201 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:35.754814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d64cb31-235f-48ed-bc7a-a8eb8f9fa201 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:35.755442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d64cb31-235f-48ed-bc7a-a8eb8f9fa201 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:35.756419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d64cb31-235f-48ed-bc7a-a8eb8f9fa201 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:35.757101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d64cb31-235f-48ed-bc7a-a8eb8f9fa201 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:35.757771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d64cb31-235f-48ed-bc7a-a8eb8f9fa201 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:35.787839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8d64cb31-235f-48ed-bc7a-a8eb8f9fa201 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045541 Aug 18 22:03:35.788427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 792/1586] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:35 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:35.908054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d3c87ff0-c255-4473-b155-57762af342ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:35.910208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d3c87ff0-c255-4473-b155-57762af342ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:35.916694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3c87ff0-c255-4473-b155-57762af342ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:35.917166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3c87ff0-c255-4473-b155-57762af342ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:35.917621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3c87ff0-c255-4473-b155-57762af342ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:35.918305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3c87ff0-c255-4473-b155-57762af342ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:35.918754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3c87ff0-c255-4473-b155-57762af342ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:35.919176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3c87ff0-c255-4473-b155-57762af342ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:35.947134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d3c87ff0-c255-4473-b155-57762af342ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 Aug 18 22:03:35.947675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 795/1587] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:35 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:36.206098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1fd5cfd5-91b2-4915-ad86-9fc85ee35f69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:36.208747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1fd5cfd5-91b2-4915-ad86-9fc85ee35f69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:36.215231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fd5cfd5-91b2-4915-ad86-9fc85ee35f69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:36.215698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fd5cfd5-91b2-4915-ad86-9fc85ee35f69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:36.216127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fd5cfd5-91b2-4915-ad86-9fc85ee35f69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:36.216812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fd5cfd5-91b2-4915-ad86-9fc85ee35f69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:36.217263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fd5cfd5-91b2-4915-ad86-9fc85ee35f69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:36.217710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fd5cfd5-91b2-4915-ad86-9fc85ee35f69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:36.221288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:36.247286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1fd5cfd5-91b2-4915-ad86-9fc85ee35f69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045407 Aug 18 22:03:36.247850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 793/1588] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:36 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:36.539999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-739c731e-3b82-47f3-9242-44a89f12baff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:36.542189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-739c731e-3b82-47f3-9242-44a89f12baff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:36.548534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-739c731e-3b82-47f3-9242-44a89f12baff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:36.549265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-739c731e-3b82-47f3-9242-44a89f12baff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:36.549732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-739c731e-3b82-47f3-9242-44a89f12baff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:36.550422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-739c731e-3b82-47f3-9242-44a89f12baff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:36.550871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-739c731e-3b82-47f3-9242-44a89f12baff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:36.551292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-739c731e-3b82-47f3-9242-44a89f12baff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:36.579395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-739c731e-3b82-47f3-9242-44a89f12baff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043384 Aug 18 22:03:36.579933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 796/1589] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:36.800415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d7b87dc0-7cfc-4b9a-9e95-7138ea54e650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:36.803033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d7b87dc0-7cfc-4b9a-9e95-7138ea54e650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:36.809113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7b87dc0-7cfc-4b9a-9e95-7138ea54e650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:36.809621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7b87dc0-7cfc-4b9a-9e95-7138ea54e650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:36.810075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7b87dc0-7cfc-4b9a-9e95-7138ea54e650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:36.810778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7b87dc0-7cfc-4b9a-9e95-7138ea54e650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:36.811240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7b87dc0-7cfc-4b9a-9e95-7138ea54e650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:36.811675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7b87dc0-7cfc-4b9a-9e95-7138ea54e650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:36.841400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d7b87dc0-7cfc-4b9a-9e95-7138ea54e650 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045267 Aug 18 22:03:36.842020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 794/1590] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:36 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:36.959175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-98d6e126-857c-41a0-adad-c2870b13fc82 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:36.961321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-98d6e126-857c-41a0-adad-c2870b13fc82 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:36.967166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98d6e126-857c-41a0-adad-c2870b13fc82 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:36.967644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98d6e126-857c-41a0-adad-c2870b13fc82 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:36.968078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98d6e126-857c-41a0-adad-c2870b13fc82 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:36.968772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98d6e126-857c-41a0-adad-c2870b13fc82 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:36.969216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98d6e126-857c-41a0-adad-c2870b13fc82 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:36.969666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-98d6e126-857c-41a0-adad-c2870b13fc82 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:36.997980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-98d6e126-857c-41a0-adad-c2870b13fc82 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042703 Aug 18 22:03:36.998525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 797/1591] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:36 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:37.259722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-67c51a02-2520-41a8-8255-c66bc1712289 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:37.261844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-67c51a02-2520-41a8-8255-c66bc1712289 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:37.268294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67c51a02-2520-41a8-8255-c66bc1712289 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:37.268773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67c51a02-2520-41a8-8255-c66bc1712289 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:37.269209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67c51a02-2520-41a8-8255-c66bc1712289 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:37.269959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67c51a02-2520-41a8-8255-c66bc1712289 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:37.270414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67c51a02-2520-41a8-8255-c66bc1712289 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:37.270836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67c51a02-2520-41a8-8255-c66bc1712289 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:37.299645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-67c51a02-2520-41a8-8255-c66bc1712289 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044000 Aug 18 22:03:37.300193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 795/1592] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:37 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:37.592408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-16def578-9a60-4f01-9eac-58dd08b7bf11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:37.594647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-16def578-9a60-4f01-9eac-58dd08b7bf11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:37.601835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16def578-9a60-4f01-9eac-58dd08b7bf11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:37.602333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16def578-9a60-4f01-9eac-58dd08b7bf11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:37.602767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16def578-9a60-4f01-9eac-58dd08b7bf11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:37.603711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16def578-9a60-4f01-9eac-58dd08b7bf11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:37.604221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16def578-9a60-4f01-9eac-58dd08b7bf11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:37.604660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16def578-9a60-4f01-9eac-58dd08b7bf11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:37.634628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-16def578-9a60-4f01-9eac-58dd08b7bf11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046222 Aug 18 22:03:37.635185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 798/1593] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:37.853836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9fb4b26d-9e8b-4a53-895e-06ac215c47bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:37.855895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9fb4b26d-9e8b-4a53-895e-06ac215c47bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:37.861850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fb4b26d-9e8b-4a53-895e-06ac215c47bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:37.862335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fb4b26d-9e8b-4a53-895e-06ac215c47bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:37.862775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fb4b26d-9e8b-4a53-895e-06ac215c47bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:37.863470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fb4b26d-9e8b-4a53-895e-06ac215c47bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:37.863926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fb4b26d-9e8b-4a53-895e-06ac215c47bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:37.864363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fb4b26d-9e8b-4a53-895e-06ac215c47bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:37.892946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9fb4b26d-9e8b-4a53-895e-06ac215c47bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043176 Aug 18 22:03:37.893504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 796/1594] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:37 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:38.010169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-07dd5386-9435-4122-b68f-eb8c57bb2a7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:38.012408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-07dd5386-9435-4122-b68f-eb8c57bb2a7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:38.018284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07dd5386-9435-4122-b68f-eb8c57bb2a7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:38.018761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07dd5386-9435-4122-b68f-eb8c57bb2a7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:38.019196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07dd5386-9435-4122-b68f-eb8c57bb2a7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:38.019892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07dd5386-9435-4122-b68f-eb8c57bb2a7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:38.020352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07dd5386-9435-4122-b68f-eb8c57bb2a7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:38.021421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07dd5386-9435-4122-b68f-eb8c57bb2a7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:38.049703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-07dd5386-9435-4122-b68f-eb8c57bb2a7a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043457 Aug 18 22:03:38.050253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 799/1595] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:38 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:38.312625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b9f58b8f-2315-4cba-ab79-4682e21e253d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:38.314834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b9f58b8f-2315-4cba-ab79-4682e21e253d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:38.321833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9f58b8f-2315-4cba-ab79-4682e21e253d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:38.322318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9f58b8f-2315-4cba-ab79-4682e21e253d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:38.322757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9f58b8f-2315-4cba-ab79-4682e21e253d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:38.323448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9f58b8f-2315-4cba-ab79-4682e21e253d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:38.323906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9f58b8f-2315-4cba-ab79-4682e21e253d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:38.324336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9f58b8f-2315-4cba-ab79-4682e21e253d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:38.352450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b9f58b8f-2315-4cba-ab79-4682e21e253d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043783 Aug 18 22:03:38.353003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 797/1596] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:38 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:38.646159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1a5f5986-1b02-4c13-9ea6-0286ee6b38f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:38.648250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1a5f5986-1b02-4c13-9ea6-0286ee6b38f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:38.654487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a5f5986-1b02-4c13-9ea6-0286ee6b38f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:38.654963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a5f5986-1b02-4c13-9ea6-0286ee6b38f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:38.655401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a5f5986-1b02-4c13-9ea6-0286ee6b38f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:38.656092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a5f5986-1b02-4c13-9ea6-0286ee6b38f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:38.656544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a5f5986-1b02-4c13-9ea6-0286ee6b38f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:38.656981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a5f5986-1b02-4c13-9ea6-0286ee6b38f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:38.686689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1a5f5986-1b02-4c13-9ea6-0286ee6b38f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044692 Aug 18 22:03:38.687251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 800/1597] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:38 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:38.905871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-52bf2000-eca1-4bb6-bc12-1a20af2cc819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:38.907951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-52bf2000-eca1-4bb6-bc12-1a20af2cc819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:38.914531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52bf2000-eca1-4bb6-bc12-1a20af2cc819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:38.915015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52bf2000-eca1-4bb6-bc12-1a20af2cc819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:38.915455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52bf2000-eca1-4bb6-bc12-1a20af2cc819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:38.916150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52bf2000-eca1-4bb6-bc12-1a20af2cc819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:38.916608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52bf2000-eca1-4bb6-bc12-1a20af2cc819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:38.917060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52bf2000-eca1-4bb6-bc12-1a20af2cc819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:38.945221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-52bf2000-eca1-4bb6-bc12-1a20af2cc819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Aug 18 22:03:38.945808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 798/1598] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:38 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:39.061839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-faee3857-5feb-49ba-b5e1-8ddd5005f223 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:39.064027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-faee3857-5feb-49ba-b5e1-8ddd5005f223 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:39.069912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faee3857-5feb-49ba-b5e1-8ddd5005f223 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:39.070396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faee3857-5feb-49ba-b5e1-8ddd5005f223 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:39.070838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faee3857-5feb-49ba-b5e1-8ddd5005f223 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:39.071538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faee3857-5feb-49ba-b5e1-8ddd5005f223 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:39.071996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faee3857-5feb-49ba-b5e1-8ddd5005f223 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:39.072444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faee3857-5feb-49ba-b5e1-8ddd5005f223 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:39.101779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-faee3857-5feb-49ba-b5e1-8ddd5005f223 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043927 Aug 18 22:03:39.102336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 801/1599] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:39 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:39.365329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f6a75ef7-e090-4229-b23e-cf0751da5f39 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:39.367540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f6a75ef7-e090-4229-b23e-cf0751da5f39 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:39.373882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6a75ef7-e090-4229-b23e-cf0751da5f39 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:39.374365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6a75ef7-e090-4229-b23e-cf0751da5f39 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:39.374861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6a75ef7-e090-4229-b23e-cf0751da5f39 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:39.375555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6a75ef7-e090-4229-b23e-cf0751da5f39 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:39.376007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6a75ef7-e090-4229-b23e-cf0751da5f39 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:39.376434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6a75ef7-e090-4229-b23e-cf0751da5f39 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:39.405634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f6a75ef7-e090-4229-b23e-cf0751da5f39 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044508 Aug 18 22:03:39.406194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 799/1600] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:39.699705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-35ae5ad4-c9dc-4f21-85bb-2be9b9c4b1e0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:39.701809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-35ae5ad4-c9dc-4f21-85bb-2be9b9c4b1e0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:39.708226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35ae5ad4-c9dc-4f21-85bb-2be9b9c4b1e0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:39.708703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35ae5ad4-c9dc-4f21-85bb-2be9b9c4b1e0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:39.709149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35ae5ad4-c9dc-4f21-85bb-2be9b9c4b1e0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:39.709871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35ae5ad4-c9dc-4f21-85bb-2be9b9c4b1e0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:39.710331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35ae5ad4-c9dc-4f21-85bb-2be9b9c4b1e0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:39.711290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35ae5ad4-c9dc-4f21-85bb-2be9b9c4b1e0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:39.741613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-35ae5ad4-c9dc-4f21-85bb-2be9b9c4b1e0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045898 Aug 18 22:03:39.742189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 802/1601] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:39.957574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b6e96da7-217d-43cd-877c-42e98c6553a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:39.959676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b6e96da7-217d-43cd-877c-42e98c6553a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:39.965720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6e96da7-217d-43cd-877c-42e98c6553a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:39.966198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6e96da7-217d-43cd-877c-42e98c6553a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:39.966635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6e96da7-217d-43cd-877c-42e98c6553a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:39.967324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6e96da7-217d-43cd-877c-42e98c6553a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:39.967780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6e96da7-217d-43cd-877c-42e98c6553a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:39.968206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6e96da7-217d-43cd-877c-42e98c6553a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:39.997085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b6e96da7-217d-43cd-877c-42e98c6553a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043532 Aug 18 22:03:39.997657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 800/1602] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:39 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:40.114908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fa478022-cb7a-4f99-a368-6e0cc9e2d338 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:40.117027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fa478022-cb7a-4f99-a368-6e0cc9e2d338 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:40.122943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa478022-cb7a-4f99-a368-6e0cc9e2d338 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:40.123420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa478022-cb7a-4f99-a368-6e0cc9e2d338 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:40.123850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa478022-cb7a-4f99-a368-6e0cc9e2d338 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:40.124536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa478022-cb7a-4f99-a368-6e0cc9e2d338 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:40.124986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa478022-cb7a-4f99-a368-6e0cc9e2d338 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:40.125407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa478022-cb7a-4f99-a368-6e0cc9e2d338 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:40.153620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fa478022-cb7a-4f99-a368-6e0cc9e2d338 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043398 Aug 18 22:03:40.154402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 803/1603] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:40.418101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d7adbf45-efb1-4b62-a2b2-e027473cb662 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:40.420241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d7adbf45-efb1-4b62-a2b2-e027473cb662 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:40.426577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7adbf45-efb1-4b62-a2b2-e027473cb662 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:40.427057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7adbf45-efb1-4b62-a2b2-e027473cb662 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:40.427494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7adbf45-efb1-4b62-a2b2-e027473cb662 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:40.428185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7adbf45-efb1-4b62-a2b2-e027473cb662 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:40.428638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7adbf45-efb1-4b62-a2b2-e027473cb662 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:40.429080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7adbf45-efb1-4b62-a2b2-e027473cb662 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:40.457234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d7adbf45-efb1-4b62-a2b2-e027473cb662 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043111 Aug 18 22:03:40.458324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 801/1604] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:40 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:40.755317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-53288e91-90d8-499f-99ba-1b1931e7fef7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:40.757431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-53288e91-90d8-499f-99ba-1b1931e7fef7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:40.759737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:40.764849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53288e91-90d8-499f-99ba-1b1931e7fef7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:40.765320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53288e91-90d8-499f-99ba-1b1931e7fef7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:40.765777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53288e91-90d8-499f-99ba-1b1931e7fef7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:40.766469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53288e91-90d8-499f-99ba-1b1931e7fef7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:40.766912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53288e91-90d8-499f-99ba-1b1931e7fef7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:40.767329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53288e91-90d8-499f-99ba-1b1931e7fef7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:40.798347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-53288e91-90d8-499f-99ba-1b1931e7fef7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048364 Aug 18 22:03:40.799160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 804/1605] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:41.009332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a796d763-77e1-49e8-9f64-862995d06e32 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:41.011483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a796d763-77e1-49e8-9f64-862995d06e32 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:41.017570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a796d763-77e1-49e8-9f64-862995d06e32 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:41.018087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a796d763-77e1-49e8-9f64-862995d06e32 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:41.018524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a796d763-77e1-49e8-9f64-862995d06e32 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:41.019220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a796d763-77e1-49e8-9f64-862995d06e32 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:41.019677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a796d763-77e1-49e8-9f64-862995d06e32 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:41.020104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a796d763-77e1-49e8-9f64-862995d06e32 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:41.048602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a796d763-77e1-49e8-9f64-862995d06e32 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043729 Aug 18 22:03:41.049415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 802/1606] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:41 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:41.166017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cac82310-35d8-49f8-9d39-0f13f0f9c543 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:41.168170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cac82310-35d8-49f8-9d39-0f13f0f9c543 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:41.174302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac82310-35d8-49f8-9d39-0f13f0f9c543 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:41.174789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac82310-35d8-49f8-9d39-0f13f0f9c543 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:41.175233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac82310-35d8-49f8-9d39-0f13f0f9c543 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:41.175935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac82310-35d8-49f8-9d39-0f13f0f9c543 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:41.176404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac82310-35d8-49f8-9d39-0f13f0f9c543 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:41.177324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cac82310-35d8-49f8-9d39-0f13f0f9c543 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:41.208071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cac82310-35d8-49f8-9d39-0f13f0f9c543 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046043 Aug 18 22:03:41.208637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 805/1607] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:41.469897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dc6bdf5c-dc7b-4146-a357-d951c8a87602 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:41.472041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dc6bdf5c-dc7b-4146-a357-d951c8a87602 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:41.478399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6bdf5c-dc7b-4146-a357-d951c8a87602 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:41.478878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6bdf5c-dc7b-4146-a357-d951c8a87602 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:41.479311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6bdf5c-dc7b-4146-a357-d951c8a87602 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:41.479996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6bdf5c-dc7b-4146-a357-d951c8a87602 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:41.480446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6bdf5c-dc7b-4146-a357-d951c8a87602 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:41.480870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6bdf5c-dc7b-4146-a357-d951c8a87602 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:41.510165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dc6bdf5c-dc7b-4146-a357-d951c8a87602 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044195 Aug 18 22:03:41.510721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 803/1608] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:41 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:41.810939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5cc5b9e4-8071-4a0f-88ea-856b79ec60b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:41.813043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5cc5b9e4-8071-4a0f-88ea-856b79ec60b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:41.819544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cc5b9e4-8071-4a0f-88ea-856b79ec60b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:41.820013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cc5b9e4-8071-4a0f-88ea-856b79ec60b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:41.820444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cc5b9e4-8071-4a0f-88ea-856b79ec60b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:41.821157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cc5b9e4-8071-4a0f-88ea-856b79ec60b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:41.821618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cc5b9e4-8071-4a0f-88ea-856b79ec60b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:41.822044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cc5b9e4-8071-4a0f-88ea-856b79ec60b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:41.850286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5cc5b9e4-8071-4a0f-88ea-856b79ec60b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043419 Aug 18 22:03:41.850830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 806/1609] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:42.060296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6b61b27f-3935-40db-926b-8239f1f39473 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:42.062529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6b61b27f-3935-40db-926b-8239f1f39473 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:42.068402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b61b27f-3935-40db-926b-8239f1f39473 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:42.068881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b61b27f-3935-40db-926b-8239f1f39473 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:42.069311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b61b27f-3935-40db-926b-8239f1f39473 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:42.070027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b61b27f-3935-40db-926b-8239f1f39473 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:42.070481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b61b27f-3935-40db-926b-8239f1f39473 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:42.070904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b61b27f-3935-40db-926b-8239f1f39473 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:42.100467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6b61b27f-3935-40db-926b-8239f1f39473 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044011 Aug 18 22:03:42.101239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 804/1610] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:42 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:42.220789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-28c3b4d5-6f4d-4512-b211-4862e7c41aa7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:42.222985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-28c3b4d5-6f4d-4512-b211-4862e7c41aa7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:42.229456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28c3b4d5-6f4d-4512-b211-4862e7c41aa7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:42.230090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28c3b4d5-6f4d-4512-b211-4862e7c41aa7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:42.230533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28c3b4d5-6f4d-4512-b211-4862e7c41aa7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:42.231233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28c3b4d5-6f4d-4512-b211-4862e7c41aa7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:42.231694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28c3b4d5-6f4d-4512-b211-4862e7c41aa7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:42.232124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28c3b4d5-6f4d-4512-b211-4862e7c41aa7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:42.260995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-28c3b4d5-6f4d-4512-b211-4862e7c41aa7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044498 Aug 18 22:03:42.261552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 807/1611] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:42 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:42.523362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bd972a9d-71dc-4eb5-8b4e-1f2bce4432a8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:42.525489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bd972a9d-71dc-4eb5-8b4e-1f2bce4432a8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:42.531825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd972a9d-71dc-4eb5-8b4e-1f2bce4432a8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:42.532311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd972a9d-71dc-4eb5-8b4e-1f2bce4432a8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:42.532748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd972a9d-71dc-4eb5-8b4e-1f2bce4432a8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:42.533444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd972a9d-71dc-4eb5-8b4e-1f2bce4432a8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:42.533921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd972a9d-71dc-4eb5-8b4e-1f2bce4432a8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:42.534349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd972a9d-71dc-4eb5-8b4e-1f2bce4432a8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:42.563489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bd972a9d-71dc-4eb5-8b4e-1f2bce4432a8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Aug 18 22:03:42.564053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 805/1612] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:42.862544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b2c7f6eb-d643-4105-9b75-b4f89572e03e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:42.865181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b2c7f6eb-d643-4105-9b75-b4f89572e03e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:42.871517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2c7f6eb-d643-4105-9b75-b4f89572e03e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:42.871988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2c7f6eb-d643-4105-9b75-b4f89572e03e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:42.872414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2c7f6eb-d643-4105-9b75-b4f89572e03e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:42.873102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2c7f6eb-d643-4105-9b75-b4f89572e03e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:42.873550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2c7f6eb-d643-4105-9b75-b4f89572e03e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:42.874018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2c7f6eb-d643-4105-9b75-b4f89572e03e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:42.902731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b2c7f6eb-d643-4105-9b75-b4f89572e03e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044146 Aug 18 22:03:42.903271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 808/1613] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:43.112785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a8a54d2c-f053-40d9-9eeb-a486baa468d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:43.115505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a8a54d2c-f053-40d9-9eeb-a486baa468d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:43.121428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8a54d2c-f053-40d9-9eeb-a486baa468d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:43.121945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8a54d2c-f053-40d9-9eeb-a486baa468d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:43.122383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8a54d2c-f053-40d9-9eeb-a486baa468d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:43.123073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8a54d2c-f053-40d9-9eeb-a486baa468d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:43.123530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8a54d2c-f053-40d9-9eeb-a486baa468d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:43.123957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8a54d2c-f053-40d9-9eeb-a486baa468d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:43.163802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a8a54d2c-f053-40d9-9eeb-a486baa468d4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054845 Aug 18 22:03:43.164654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 806/1614] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:43 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:43.273035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-93401298-a399-4df6-96d2-13e182b8040f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:43.275183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-93401298-a399-4df6-96d2-13e182b8040f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:43.280963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93401298-a399-4df6-96d2-13e182b8040f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:43.281435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93401298-a399-4df6-96d2-13e182b8040f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:43.281915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93401298-a399-4df6-96d2-13e182b8040f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:43.282603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93401298-a399-4df6-96d2-13e182b8040f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:43.283056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93401298-a399-4df6-96d2-13e182b8040f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:43.283480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93401298-a399-4df6-96d2-13e182b8040f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:43.309530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:43.314856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-93401298-a399-4df6-96d2-13e182b8040f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045749 Aug 18 22:03:43.315420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 809/1615] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:43 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:43.576462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-82f4bda9-ccf1-4d72-b922-2fd1ca80da2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:43.578793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-82f4bda9-ccf1-4d72-b922-2fd1ca80da2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:43.585734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82f4bda9-ccf1-4d72-b922-2fd1ca80da2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:43.586219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82f4bda9-ccf1-4d72-b922-2fd1ca80da2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:43.586660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82f4bda9-ccf1-4d72-b922-2fd1ca80da2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:43.587354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82f4bda9-ccf1-4d72-b922-2fd1ca80da2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:43.587811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82f4bda9-ccf1-4d72-b922-2fd1ca80da2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:43.588240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82f4bda9-ccf1-4d72-b922-2fd1ca80da2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:43.617791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-82f4bda9-ccf1-4d72-b922-2fd1ca80da2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045267 Aug 18 22:03:43.618348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 807/1616] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:43 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:43.915342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a6c65090-0926-4996-a503-0e51f23a45a1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:43.917387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a6c65090-0926-4996-a503-0e51f23a45a1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:43.923680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6c65090-0926-4996-a503-0e51f23a45a1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:43.924410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6c65090-0926-4996-a503-0e51f23a45a1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:43.924842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6c65090-0926-4996-a503-0e51f23a45a1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:43.925527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6c65090-0926-4996-a503-0e51f23a45a1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:43.925999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6c65090-0926-4996-a503-0e51f23a45a1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:43.926424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6c65090-0926-4996-a503-0e51f23a45a1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:43.955433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a6c65090-0926-4996-a503-0e51f23a45a1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044345 Aug 18 22:03:43.955984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 810/1617] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:44.178149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-695fce7b-faa5-473b-9521-8228ea72c4be tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:44.180218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-695fce7b-faa5-473b-9521-8228ea72c4be tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:44.186250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-695fce7b-faa5-473b-9521-8228ea72c4be tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:44.186727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-695fce7b-faa5-473b-9521-8228ea72c4be tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:44.187162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-695fce7b-faa5-473b-9521-8228ea72c4be tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:44.187843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-695fce7b-faa5-473b-9521-8228ea72c4be tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:44.188292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-695fce7b-faa5-473b-9521-8228ea72c4be tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:44.188712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-695fce7b-faa5-473b-9521-8228ea72c4be tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:44.217536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-695fce7b-faa5-473b-9521-8228ea72c4be tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044203 Aug 18 22:03:44.218109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 808/1618] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:44.327392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-abc61d41-2ea7-4102-915f-5eed285b1ad1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:44.329522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-abc61d41-2ea7-4102-915f-5eed285b1ad1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:44.335439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abc61d41-2ea7-4102-915f-5eed285b1ad1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:44.335922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abc61d41-2ea7-4102-915f-5eed285b1ad1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:44.336360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abc61d41-2ea7-4102-915f-5eed285b1ad1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:44.337055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abc61d41-2ea7-4102-915f-5eed285b1ad1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:44.337510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abc61d41-2ea7-4102-915f-5eed285b1ad1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:44.337961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abc61d41-2ea7-4102-915f-5eed285b1ad1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:44.366485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-abc61d41-2ea7-4102-915f-5eed285b1ad1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043068 Aug 18 22:03:44.367035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 811/1619] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:44 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:44.630241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b45108e4-b48d-4e35-b362-676572971c4d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:44.632390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b45108e4-b48d-4e35-b362-676572971c4d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:44.638725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b45108e4-b48d-4e35-b362-676572971c4d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:44.639203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b45108e4-b48d-4e35-b362-676572971c4d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:44.639637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b45108e4-b48d-4e35-b362-676572971c4d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:44.640318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b45108e4-b48d-4e35-b362-676572971c4d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:44.640764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b45108e4-b48d-4e35-b362-676572971c4d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:44.641184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b45108e4-b48d-4e35-b362-676572971c4d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:44.665178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:44.670428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b45108e4-b48d-4e35-b362-676572971c4d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044243 Aug 18 22:03:44.670978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 809/1620] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:44 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:44.968587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bc9aaedb-e95d-492b-a544-4b3a36a891a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:44.970676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bc9aaedb-e95d-492b-a544-4b3a36a891a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:44.977674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc9aaedb-e95d-492b-a544-4b3a36a891a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:44.978153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc9aaedb-e95d-492b-a544-4b3a36a891a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:44.978589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc9aaedb-e95d-492b-a544-4b3a36a891a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:44.979276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc9aaedb-e95d-492b-a544-4b3a36a891a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:44.979726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc9aaedb-e95d-492b-a544-4b3a36a891a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:44.980155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc9aaedb-e95d-492b-a544-4b3a36a891a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:45.008378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bc9aaedb-e95d-492b-a544-4b3a36a891a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043964 Aug 18 22:03:45.008919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 812/1621] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:45.230721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6b75d6ab-336a-4d5f-a179-45afb8bcfc1a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:45.232792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6b75d6ab-336a-4d5f-a179-45afb8bcfc1a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:45.238670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b75d6ab-336a-4d5f-a179-45afb8bcfc1a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:45.239152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b75d6ab-336a-4d5f-a179-45afb8bcfc1a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:45.239590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b75d6ab-336a-4d5f-a179-45afb8bcfc1a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:45.240280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b75d6ab-336a-4d5f-a179-45afb8bcfc1a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:45.240737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b75d6ab-336a-4d5f-a179-45afb8bcfc1a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:45.241167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b75d6ab-336a-4d5f-a179-45afb8bcfc1a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:45.269417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6b75d6ab-336a-4d5f-a179-45afb8bcfc1a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042986 Aug 18 22:03:45.269999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 810/1622] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:45 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:45.378938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-96ab479c-d92a-48c4-9f5a-117b44bd641b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:45.381557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-96ab479c-d92a-48c4-9f5a-117b44bd641b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:45.387480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96ab479c-d92a-48c4-9f5a-117b44bd641b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:45.387965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96ab479c-d92a-48c4-9f5a-117b44bd641b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:45.388411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96ab479c-d92a-48c4-9f5a-117b44bd641b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:45.389112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96ab479c-d92a-48c4-9f5a-117b44bd641b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:45.389570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96ab479c-d92a-48c4-9f5a-117b44bd641b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:45.390029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96ab479c-d92a-48c4-9f5a-117b44bd641b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:45.418914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-96ab479c-d92a-48c4-9f5a-117b44bd641b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Aug 18 22:03:45.419466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 813/1623] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:45 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:45.683443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1f822b61-529e-4b99-9c9f-ae596fb897ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:45.685698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1f822b61-529e-4b99-9c9f-ae596fb897ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:45.692102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f822b61-529e-4b99-9c9f-ae596fb897ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:45.693148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f822b61-529e-4b99-9c9f-ae596fb897ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:45.693585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f822b61-529e-4b99-9c9f-ae596fb897ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:45.694308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f822b61-529e-4b99-9c9f-ae596fb897ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:45.694759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f822b61-529e-4b99-9c9f-ae596fb897ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:45.695180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f822b61-529e-4b99-9c9f-ae596fb897ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:45.724553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1f822b61-529e-4b99-9c9f-ae596fb897ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044986 Aug 18 22:03:45.725121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 811/1624] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:45 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:46.020542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5397d69d-f9ba-401c-bb7d-ce61fe6fea3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:46.022716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5397d69d-f9ba-401c-bb7d-ce61fe6fea3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:46.028541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5397d69d-f9ba-401c-bb7d-ce61fe6fea3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:46.029009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5397d69d-f9ba-401c-bb7d-ce61fe6fea3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:46.029433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5397d69d-f9ba-401c-bb7d-ce61fe6fea3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:46.030139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5397d69d-f9ba-401c-bb7d-ce61fe6fea3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:46.030587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5397d69d-f9ba-401c-bb7d-ce61fe6fea3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:46.031040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5397d69d-f9ba-401c-bb7d-ce61fe6fea3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:46.060687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5397d69d-f9ba-401c-bb7d-ce61fe6fea3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044260 Aug 18 22:03:46.061233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 814/1625] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:46 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:46.282136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2856bf3e-ceb9-4e88-8cb4-9dc7baf30d1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:46.284259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2856bf3e-ceb9-4e88-8cb4-9dc7baf30d1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:46.290756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2856bf3e-ceb9-4e88-8cb4-9dc7baf30d1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:46.291231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2856bf3e-ceb9-4e88-8cb4-9dc7baf30d1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:46.291663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2856bf3e-ceb9-4e88-8cb4-9dc7baf30d1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:46.292351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2856bf3e-ceb9-4e88-8cb4-9dc7baf30d1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:46.292805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2856bf3e-ceb9-4e88-8cb4-9dc7baf30d1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:46.293223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2856bf3e-ceb9-4e88-8cb4-9dc7baf30d1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:46.322074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2856bf3e-ceb9-4e88-8cb4-9dc7baf30d1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043803 Aug 18 22:03:46.322622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 812/1626] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:46 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:46.430807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dd985cda-7ca4-4e9c-b839-06476ce859bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:46.432965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dd985cda-7ca4-4e9c-b839-06476ce859bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:46.439320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd985cda-7ca4-4e9c-b839-06476ce859bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:46.439790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd985cda-7ca4-4e9c-b839-06476ce859bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:46.440219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd985cda-7ca4-4e9c-b839-06476ce859bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:46.440899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd985cda-7ca4-4e9c-b839-06476ce859bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:46.441347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd985cda-7ca4-4e9c-b839-06476ce859bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:46.441821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd985cda-7ca4-4e9c-b839-06476ce859bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:46.469846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dd985cda-7ca4-4e9c-b839-06476ce859bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042923 Aug 18 22:03:46.470388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 815/1627] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:46.736396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-90a79414-0222-4090-89e4-38fb2650e779 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:46.738580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-90a79414-0222-4090-89e4-38fb2650e779 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:46.745180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90a79414-0222-4090-89e4-38fb2650e779 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:46.745702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90a79414-0222-4090-89e4-38fb2650e779 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:46.746147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90a79414-0222-4090-89e4-38fb2650e779 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:46.746853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90a79414-0222-4090-89e4-38fb2650e779 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:46.747340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90a79414-0222-4090-89e4-38fb2650e779 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:46.747771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90a79414-0222-4090-89e4-38fb2650e779 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:46.777763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-90a79414-0222-4090-89e4-38fb2650e779 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Aug 18 22:03:46.778318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 813/1628] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:46 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:47.073281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7360456e-82fa-4328-9b83-a2c1788e4b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:47.075468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7360456e-82fa-4328-9b83-a2c1788e4b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:47.081589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7360456e-82fa-4328-9b83-a2c1788e4b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:47.082097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7360456e-82fa-4328-9b83-a2c1788e4b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:47.082535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7360456e-82fa-4328-9b83-a2c1788e4b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:47.083893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7360456e-82fa-4328-9b83-a2c1788e4b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:47.084349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7360456e-82fa-4328-9b83-a2c1788e4b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:47.084775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7360456e-82fa-4328-9b83-a2c1788e4b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:47.114092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7360456e-82fa-4328-9b83-a2c1788e4b44 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044658 Aug 18 22:03:47.114665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 816/1629] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:47 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:47.334276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-70a5b4cd-d5fc-42d5-a470-6bcbc3251fef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:47.336330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-70a5b4cd-d5fc-42d5-a470-6bcbc3251fef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:47.342327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70a5b4cd-d5fc-42d5-a470-6bcbc3251fef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:47.342831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70a5b4cd-d5fc-42d5-a470-6bcbc3251fef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:47.343314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70a5b4cd-d5fc-42d5-a470-6bcbc3251fef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:47.344024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70a5b4cd-d5fc-42d5-a470-6bcbc3251fef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:47.344478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70a5b4cd-d5fc-42d5-a470-6bcbc3251fef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:47.344895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70a5b4cd-d5fc-42d5-a470-6bcbc3251fef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:47.373311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-70a5b4cd-d5fc-42d5-a470-6bcbc3251fef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042983 Aug 18 22:03:47.373897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 814/1630] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:47 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:47.482598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-101f5d98-f776-43e2-9ea2-ded38f255f9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:47.484775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-101f5d98-f776-43e2-9ea2-ded38f255f9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:47.491814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-101f5d98-f776-43e2-9ea2-ded38f255f9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:47.492295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-101f5d98-f776-43e2-9ea2-ded38f255f9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:47.492732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-101f5d98-f776-43e2-9ea2-ded38f255f9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:47.493427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-101f5d98-f776-43e2-9ea2-ded38f255f9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:47.493908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-101f5d98-f776-43e2-9ea2-ded38f255f9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:47.494340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-101f5d98-f776-43e2-9ea2-ded38f255f9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:47.522889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-101f5d98-f776-43e2-9ea2-ded38f255f9a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Aug 18 22:03:47.523439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 817/1631] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:47.790594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ede6de39-17de-4677-b42d-a2dda643b002 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:47.792798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ede6de39-17de-4677-b42d-a2dda643b002 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:47.799457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ede6de39-17de-4677-b42d-a2dda643b002 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:47.799942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ede6de39-17de-4677-b42d-a2dda643b002 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:47.800381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ede6de39-17de-4677-b42d-a2dda643b002 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:47.801077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ede6de39-17de-4677-b42d-a2dda643b002 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:47.802246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ede6de39-17de-4677-b42d-a2dda643b002 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:47.802684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ede6de39-17de-4677-b42d-a2dda643b002 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:47.832065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ede6de39-17de-4677-b42d-a2dda643b002 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045966 Aug 18 22:03:47.832628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 815/1632] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:47 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:48.126229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ead9056c-bb63-44ca-a57d-5f0498dad8c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:48.128398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ead9056c-bb63-44ca-a57d-5f0498dad8c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:48.134304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ead9056c-bb63-44ca-a57d-5f0498dad8c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:48.134776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ead9056c-bb63-44ca-a57d-5f0498dad8c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:48.135204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ead9056c-bb63-44ca-a57d-5f0498dad8c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:48.135887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ead9056c-bb63-44ca-a57d-5f0498dad8c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:48.136335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ead9056c-bb63-44ca-a57d-5f0498dad8c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:48.136754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ead9056c-bb63-44ca-a57d-5f0498dad8c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:48.165860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ead9056c-bb63-44ca-a57d-5f0498dad8c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043531 Aug 18 22:03:48.166395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 818/1633] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:48.386263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-465066b0-e813-4070-b6aa-9eabee845ae9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:48.388407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-465066b0-e813-4070-b6aa-9eabee845ae9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:48.394389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-465066b0-e813-4070-b6aa-9eabee845ae9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:48.394873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-465066b0-e813-4070-b6aa-9eabee845ae9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:48.395964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-465066b0-e813-4070-b6aa-9eabee845ae9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:48.396664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-465066b0-e813-4070-b6aa-9eabee845ae9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:48.397118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-465066b0-e813-4070-b6aa-9eabee845ae9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:48.397548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-465066b0-e813-4070-b6aa-9eabee845ae9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:48.425613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-465066b0-e813-4070-b6aa-9eabee845ae9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043318 Aug 18 22:03:48.426172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 816/1634] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:48 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:48.535305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0d8c3f78-de46-4112-bbf5-db221741ac79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:48.537454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0d8c3f78-de46-4112-bbf5-db221741ac79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:48.543902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d8c3f78-de46-4112-bbf5-db221741ac79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:48.544372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d8c3f78-de46-4112-bbf5-db221741ac79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:48.544808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d8c3f78-de46-4112-bbf5-db221741ac79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:48.545502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d8c3f78-de46-4112-bbf5-db221741ac79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:48.545980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d8c3f78-de46-4112-bbf5-db221741ac79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:48.546408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d8c3f78-de46-4112-bbf5-db221741ac79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:48.575935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0d8c3f78-de46-4112-bbf5-db221741ac79 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044673 Aug 18 22:03:48.576492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 819/1635] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:48 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:48.843987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-baf8dd61-d76c-483d-a27e-a9c8a93e11aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:48.846547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-baf8dd61-d76c-483d-a27e-a9c8a93e11aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:48.853738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baf8dd61-d76c-483d-a27e-a9c8a93e11aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:48.854230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baf8dd61-d76c-483d-a27e-a9c8a93e11aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:48.854670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baf8dd61-d76c-483d-a27e-a9c8a93e11aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:48.855372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baf8dd61-d76c-483d-a27e-a9c8a93e11aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:48.855827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baf8dd61-d76c-483d-a27e-a9c8a93e11aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:48.856255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baf8dd61-d76c-483d-a27e-a9c8a93e11aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:48.885860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-baf8dd61-d76c-483d-a27e-a9c8a93e11aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045817 Aug 18 22:03:48.886417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 817/1636] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:48 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:49.178395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-30997c90-6cf5-42cd-b39d-c29faa857621 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:49.180525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-30997c90-6cf5-42cd-b39d-c29faa857621 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:49.186442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30997c90-6cf5-42cd-b39d-c29faa857621 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:49.186920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30997c90-6cf5-42cd-b39d-c29faa857621 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:49.187370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30997c90-6cf5-42cd-b39d-c29faa857621 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:49.188054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30997c90-6cf5-42cd-b39d-c29faa857621 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:49.188535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30997c90-6cf5-42cd-b39d-c29faa857621 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:49.188986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30997c90-6cf5-42cd-b39d-c29faa857621 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:49.218954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-30997c90-6cf5-42cd-b39d-c29faa857621 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044755 Aug 18 22:03:49.219703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 820/1637] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:49.437863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-416da93d-7d43-4339-b9d3-59253044c0a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:49.440007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-416da93d-7d43-4339-b9d3-59253044c0a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:49.446762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-416da93d-7d43-4339-b9d3-59253044c0a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:49.447237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-416da93d-7d43-4339-b9d3-59253044c0a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:49.447672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-416da93d-7d43-4339-b9d3-59253044c0a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:49.448358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-416da93d-7d43-4339-b9d3-59253044c0a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:49.448812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-416da93d-7d43-4339-b9d3-59253044c0a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:49.449236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-416da93d-7d43-4339-b9d3-59253044c0a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:49.477171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-416da93d-7d43-4339-b9d3-59253044c0a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043303 Aug 18 22:03:49.477938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 818/1638] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:49 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:49.587702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b2edf7ef-50a6-4205-98ff-77f0587b039a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:49.589916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b2edf7ef-50a6-4205-98ff-77f0587b039a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:49.596247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2edf7ef-50a6-4205-98ff-77f0587b039a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:49.596727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2edf7ef-50a6-4205-98ff-77f0587b039a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:49.597166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2edf7ef-50a6-4205-98ff-77f0587b039a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:49.597892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2edf7ef-50a6-4205-98ff-77f0587b039a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:49.598351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2edf7ef-50a6-4205-98ff-77f0587b039a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:49.598890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2edf7ef-50a6-4205-98ff-77f0587b039a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:49.629631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b2edf7ef-50a6-4205-98ff-77f0587b039a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 Aug 18 22:03:49.630746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 821/1639] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:49 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:49.898133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8dcb20b0-252c-47cc-ba75-2ebf18cd0b4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:49.900272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8dcb20b0-252c-47cc-ba75-2ebf18cd0b4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:49.906812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8dcb20b0-252c-47cc-ba75-2ebf18cd0b4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:49.907298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8dcb20b0-252c-47cc-ba75-2ebf18cd0b4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:49.907741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8dcb20b0-252c-47cc-ba75-2ebf18cd0b4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:49.908448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8dcb20b0-252c-47cc-ba75-2ebf18cd0b4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:49.908907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8dcb20b0-252c-47cc-ba75-2ebf18cd0b4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:49.909336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8dcb20b0-252c-47cc-ba75-2ebf18cd0b4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:49.939250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8dcb20b0-252c-47cc-ba75-2ebf18cd0b4a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045083 Aug 18 22:03:49.939815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 819/1640] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:49 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:50.231821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7c5cb81c-8377-4144-8d22-42f73c6a3920 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:50.233961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7c5cb81c-8377-4144-8d22-42f73c6a3920 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:50.240005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5cb81c-8377-4144-8d22-42f73c6a3920 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:50.240504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5cb81c-8377-4144-8d22-42f73c6a3920 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:50.240934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5cb81c-8377-4144-8d22-42f73c6a3920 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:50.241661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5cb81c-8377-4144-8d22-42f73c6a3920 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:50.242107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5cb81c-8377-4144-8d22-42f73c6a3920 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:50.242535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5cb81c-8377-4144-8d22-42f73c6a3920 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:50.271620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7c5cb81c-8377-4144-8d22-42f73c6a3920 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043745 Aug 18 22:03:50.272171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 822/1641] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:50.488582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-88d12c9f-03f7-4efc-8fb0-b38a0574ea21 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:50.491143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-88d12c9f-03f7-4efc-8fb0-b38a0574ea21 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:50.496957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88d12c9f-03f7-4efc-8fb0-b38a0574ea21 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:50.497433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88d12c9f-03f7-4efc-8fb0-b38a0574ea21 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:50.497903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88d12c9f-03f7-4efc-8fb0-b38a0574ea21 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:50.498590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88d12c9f-03f7-4efc-8fb0-b38a0574ea21 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:50.499037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88d12c9f-03f7-4efc-8fb0-b38a0574ea21 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:50.499460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88d12c9f-03f7-4efc-8fb0-b38a0574ea21 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:50.530131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-88d12c9f-03f7-4efc-8fb0-b38a0574ea21 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045528 Aug 18 22:03:50.530692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 820/1642] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:50.642326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae6ffb6e-4d94-48d3-9797-fdb46c49e75d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:50.644470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ae6ffb6e-4d94-48d3-9797-fdb46c49e75d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:50.650817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6ffb6e-4d94-48d3-9797-fdb46c49e75d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:50.651304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6ffb6e-4d94-48d3-9797-fdb46c49e75d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:50.651740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6ffb6e-4d94-48d3-9797-fdb46c49e75d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:50.652432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6ffb6e-4d94-48d3-9797-fdb46c49e75d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:50.652890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6ffb6e-4d94-48d3-9797-fdb46c49e75d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:50.653319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae6ffb6e-4d94-48d3-9797-fdb46c49e75d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:50.682955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ae6ffb6e-4d94-48d3-9797-fdb46c49e75d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044523 Aug 18 22:03:50.683513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 823/1643] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:50 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:50.951352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-74ca296f-5e2f-42f7-a8c9-b30ac3526c8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:50.953528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-74ca296f-5e2f-42f7-a8c9-b30ac3526c8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:50.960183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74ca296f-5e2f-42f7-a8c9-b30ac3526c8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:50.960664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74ca296f-5e2f-42f7-a8c9-b30ac3526c8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:50.961095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74ca296f-5e2f-42f7-a8c9-b30ac3526c8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:50.961808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74ca296f-5e2f-42f7-a8c9-b30ac3526c8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:50.962259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74ca296f-5e2f-42f7-a8c9-b30ac3526c8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:50.962678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74ca296f-5e2f-42f7-a8c9-b30ac3526c8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:50.991553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-74ca296f-5e2f-42f7-a8c9-b30ac3526c8e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044109 Aug 18 22:03:50.992169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 821/1644] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:50 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:51.284057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d6639797-d32a-4277-96d0-be9faa458c14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:51.286224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d6639797-d32a-4277-96d0-be9faa458c14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:51.292144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6639797-d32a-4277-96d0-be9faa458c14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:51.292624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6639797-d32a-4277-96d0-be9faa458c14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:51.293060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6639797-d32a-4277-96d0-be9faa458c14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:51.293801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6639797-d32a-4277-96d0-be9faa458c14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:51.294274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6639797-d32a-4277-96d0-be9faa458c14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:51.294701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6639797-d32a-4277-96d0-be9faa458c14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:51.323762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d6639797-d32a-4277-96d0-be9faa458c14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043710 Aug 18 22:03:51.324317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 824/1645] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:51 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:51.542298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5795374f-2cc3-4a7d-84a6-e2e169ca0757 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:51.544461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5795374f-2cc3-4a7d-84a6-e2e169ca0757 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:51.551253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5795374f-2cc3-4a7d-84a6-e2e169ca0757 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:51.551742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5795374f-2cc3-4a7d-84a6-e2e169ca0757 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:51.552184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5795374f-2cc3-4a7d-84a6-e2e169ca0757 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:51.552887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5795374f-2cc3-4a7d-84a6-e2e169ca0757 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:51.553352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5795374f-2cc3-4a7d-84a6-e2e169ca0757 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:51.553822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5795374f-2cc3-4a7d-84a6-e2e169ca0757 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:51.582478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5795374f-2cc3-4a7d-84a6-e2e169ca0757 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044109 Aug 18 22:03:51.583706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 822/1646] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:51.695019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ca7ced9-ab2a-43eb-89bf-1608d112bb48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:51.697084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ca7ced9-ab2a-43eb-89bf-1608d112bb48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:51.703596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ca7ced9-ab2a-43eb-89bf-1608d112bb48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:51.704084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ca7ced9-ab2a-43eb-89bf-1608d112bb48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:51.704524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ca7ced9-ab2a-43eb-89bf-1608d112bb48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:51.705224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ca7ced9-ab2a-43eb-89bf-1608d112bb48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:51.705710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ca7ced9-ab2a-43eb-89bf-1608d112bb48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:51.706137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ca7ced9-ab2a-43eb-89bf-1608d112bb48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:51.735173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ca7ced9-ab2a-43eb-89bf-1608d112bb48 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044712 Aug 18 22:03:51.735735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 825/1647] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:51 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:52.003881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ee3d96be-e1b1-4c0d-83a9-d21d2b41fa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:52.006630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ee3d96be-e1b1-4c0d-83a9-d21d2b41fa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:52.012974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee3d96be-e1b1-4c0d-83a9-d21d2b41fa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:52.013454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee3d96be-e1b1-4c0d-83a9-d21d2b41fa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:52.013917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee3d96be-e1b1-4c0d-83a9-d21d2b41fa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:52.014634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee3d96be-e1b1-4c0d-83a9-d21d2b41fa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:52.015089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee3d96be-e1b1-4c0d-83a9-d21d2b41fa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:52.015598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee3d96be-e1b1-4c0d-83a9-d21d2b41fa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:52.044061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ee3d96be-e1b1-4c0d-83a9-d21d2b41fa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044222 Aug 18 22:03:52.044603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 823/1648] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:51 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:52.336037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e4a94128-59ca-4100-bb6c-977c67ac1b13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:52.338282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e4a94128-59ca-4100-bb6c-977c67ac1b13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:52.344210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4a94128-59ca-4100-bb6c-977c67ac1b13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:52.344681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4a94128-59ca-4100-bb6c-977c67ac1b13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:52.345112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4a94128-59ca-4100-bb6c-977c67ac1b13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:52.345827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4a94128-59ca-4100-bb6c-977c67ac1b13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:52.346280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4a94128-59ca-4100-bb6c-977c67ac1b13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:52.346704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4a94128-59ca-4100-bb6c-977c67ac1b13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:52.360506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:52.376534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e4a94128-59ca-4100-bb6c-977c67ac1b13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044485 Aug 18 22:03:52.377085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 826/1649] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:52 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:52.595229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-06d1ed47-80f9-4f5b-ae9b-e6155bfcb5c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:52.597270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-06d1ed47-80f9-4f5b-ae9b-e6155bfcb5c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:52.603911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06d1ed47-80f9-4f5b-ae9b-e6155bfcb5c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:52.604388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06d1ed47-80f9-4f5b-ae9b-e6155bfcb5c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:52.604823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06d1ed47-80f9-4f5b-ae9b-e6155bfcb5c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:52.605511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06d1ed47-80f9-4f5b-ae9b-e6155bfcb5c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:52.605990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06d1ed47-80f9-4f5b-ae9b-e6155bfcb5c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:52.606414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06d1ed47-80f9-4f5b-ae9b-e6155bfcb5c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:52.634249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-06d1ed47-80f9-4f5b-ae9b-e6155bfcb5c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043046 Aug 18 22:03:52.634796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 824/1650] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:52.747222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5e05040a-20ce-4f9d-93f1-248401c013e6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:52.749389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5e05040a-20ce-4f9d-93f1-248401c013e6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:52.756468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e05040a-20ce-4f9d-93f1-248401c013e6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:52.756934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e05040a-20ce-4f9d-93f1-248401c013e6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:52.757372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e05040a-20ce-4f9d-93f1-248401c013e6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:52.758106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e05040a-20ce-4f9d-93f1-248401c013e6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:52.758556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e05040a-20ce-4f9d-93f1-248401c013e6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:52.758979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e05040a-20ce-4f9d-93f1-248401c013e6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:52.788816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5e05040a-20ce-4f9d-93f1-248401c013e6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045550 Aug 18 22:03:52.789399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 827/1651] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:53.056081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4728dba5-7e3d-474b-857a-1dd20de0712b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:53.058310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4728dba5-7e3d-474b-857a-1dd20de0712b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:53.064678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4728dba5-7e3d-474b-857a-1dd20de0712b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:53.065153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4728dba5-7e3d-474b-857a-1dd20de0712b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:53.065588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4728dba5-7e3d-474b-857a-1dd20de0712b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:53.066303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4728dba5-7e3d-474b-857a-1dd20de0712b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:53.066756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4728dba5-7e3d-474b-857a-1dd20de0712b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:53.067674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4728dba5-7e3d-474b-857a-1dd20de0712b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:53.097104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4728dba5-7e3d-474b-857a-1dd20de0712b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 Aug 18 22:03:53.097699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 825/1652] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:53 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:53.389284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6f964b95-86a7-4652-a109-8e0c6dfc3d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:53.391391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6f964b95-86a7-4652-a109-8e0c6dfc3d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:53.397283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f964b95-86a7-4652-a109-8e0c6dfc3d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:53.397795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f964b95-86a7-4652-a109-8e0c6dfc3d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:53.398229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f964b95-86a7-4652-a109-8e0c6dfc3d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:53.398923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f964b95-86a7-4652-a109-8e0c6dfc3d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:53.399374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f964b95-86a7-4652-a109-8e0c6dfc3d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:53.399800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f964b95-86a7-4652-a109-8e0c6dfc3d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:53.428659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6f964b95-86a7-4652-a109-8e0c6dfc3d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043736 Aug 18 22:03:53.429211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 828/1653] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:53 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:53.646091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1ba39295-f0ab-4edc-b1b7-eb06e41ffec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:53.648164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1ba39295-f0ab-4edc-b1b7-eb06e41ffec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:53.654160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ba39295-f0ab-4edc-b1b7-eb06e41ffec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:53.654645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ba39295-f0ab-4edc-b1b7-eb06e41ffec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:53.655085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ba39295-f0ab-4edc-b1b7-eb06e41ffec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:53.655782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ba39295-f0ab-4edc-b1b7-eb06e41ffec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:53.656247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ba39295-f0ab-4edc-b1b7-eb06e41ffec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:53.656675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ba39295-f0ab-4edc-b1b7-eb06e41ffec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:53.673231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:53.687082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1ba39295-f0ab-4edc-b1b7-eb06e41ffec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045057 Aug 18 22:03:53.687650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 826/1654] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:53 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:53.802999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c7ba7007-87fa-4e39-a852-444e83d83030 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:53.805139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c7ba7007-87fa-4e39-a852-444e83d83030 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:53.811476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7ba7007-87fa-4e39-a852-444e83d83030 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:53.811961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7ba7007-87fa-4e39-a852-444e83d83030 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:53.812401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7ba7007-87fa-4e39-a852-444e83d83030 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:53.813097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7ba7007-87fa-4e39-a852-444e83d83030 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:53.813553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7ba7007-87fa-4e39-a852-444e83d83030 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:53.814010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7ba7007-87fa-4e39-a852-444e83d83030 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:53.842221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c7ba7007-87fa-4e39-a852-444e83d83030 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044289 Aug 18 22:03:53.842782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 829/1655] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:54.110585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d3cbba22-d41a-47d9-9fb9-f1dcf38601b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:54.112630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d3cbba22-d41a-47d9-9fb9-f1dcf38601b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:54.119061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3cbba22-d41a-47d9-9fb9-f1dcf38601b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:54.119543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3cbba22-d41a-47d9-9fb9-f1dcf38601b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:54.119976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3cbba22-d41a-47d9-9fb9-f1dcf38601b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:54.120671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3cbba22-d41a-47d9-9fb9-f1dcf38601b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:54.121126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3cbba22-d41a-47d9-9fb9-f1dcf38601b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:54.121550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3cbba22-d41a-47d9-9fb9-f1dcf38601b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:54.150337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d3cbba22-d41a-47d9-9fb9-f1dcf38601b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043797 Aug 18 22:03:54.150899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 827/1656] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:54 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:54.440868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-143a0944-a637-4814-ada8-964e9b336894 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:54.443471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-143a0944-a637-4814-ada8-964e9b336894 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:54.449417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-143a0944-a637-4814-ada8-964e9b336894 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:54.449937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-143a0944-a637-4814-ada8-964e9b336894 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:54.450384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-143a0944-a637-4814-ada8-964e9b336894 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:54.451080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-143a0944-a637-4814-ada8-964e9b336894 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:54.451536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-143a0944-a637-4814-ada8-964e9b336894 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:54.451964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-143a0944-a637-4814-ada8-964e9b336894 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:54.480692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-143a0944-a637-4814-ada8-964e9b336894 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043900 Aug 18 22:03:54.481241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 830/1657] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:54 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:54.699534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d608c2e6-76bc-4b8a-b92b-52d52e022ef0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:54.701631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d608c2e6-76bc-4b8a-b92b-52d52e022ef0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:54.707721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d608c2e6-76bc-4b8a-b92b-52d52e022ef0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:54.708217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d608c2e6-76bc-4b8a-b92b-52d52e022ef0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:54.709436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d608c2e6-76bc-4b8a-b92b-52d52e022ef0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:54.710369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d608c2e6-76bc-4b8a-b92b-52d52e022ef0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:54.710844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d608c2e6-76bc-4b8a-b92b-52d52e022ef0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:54.711279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d608c2e6-76bc-4b8a-b92b-52d52e022ef0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:54.742716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d608c2e6-76bc-4b8a-b92b-52d52e022ef0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047174 Aug 18 22:03:54.743281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 828/1658] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:54 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:54.854241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8132b972-7a33-4126-bc11-bde1ed8596fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:54.856401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8132b972-7a33-4126-bc11-bde1ed8596fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:54.862976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8132b972-7a33-4126-bc11-bde1ed8596fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:54.863460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8132b972-7a33-4126-bc11-bde1ed8596fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:54.864401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8132b972-7a33-4126-bc11-bde1ed8596fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:54.865138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8132b972-7a33-4126-bc11-bde1ed8596fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:54.865629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8132b972-7a33-4126-bc11-bde1ed8596fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:54.866062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8132b972-7a33-4126-bc11-bde1ed8596fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:54.896071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8132b972-7a33-4126-bc11-bde1ed8596fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045733 Aug 18 22:03:54.896658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 831/1659] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:55.163226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e9ed6dfb-17b7-475f-afcd-25dc246f3a24 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:55.165357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e9ed6dfb-17b7-475f-afcd-25dc246f3a24 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:55.172167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9ed6dfb-17b7-475f-afcd-25dc246f3a24 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:55.172307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9ed6dfb-17b7-475f-afcd-25dc246f3a24 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:55.172717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9ed6dfb-17b7-475f-afcd-25dc246f3a24 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:55.173408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9ed6dfb-17b7-475f-afcd-25dc246f3a24 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:55.173896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9ed6dfb-17b7-475f-afcd-25dc246f3a24 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:55.174574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9ed6dfb-17b7-475f-afcd-25dc246f3a24 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:55.203342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e9ed6dfb-17b7-475f-afcd-25dc246f3a24 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Aug 18 22:03:55.203886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 829/1660] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:55 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:55.492828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-30cd3cfb-6336-4f55-9242-db62efdaaa6b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:55.494925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-30cd3cfb-6336-4f55-9242-db62efdaaa6b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:55.500817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30cd3cfb-6336-4f55-9242-db62efdaaa6b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:55.501288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30cd3cfb-6336-4f55-9242-db62efdaaa6b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:55.501749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30cd3cfb-6336-4f55-9242-db62efdaaa6b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:55.502437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30cd3cfb-6336-4f55-9242-db62efdaaa6b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:55.502881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30cd3cfb-6336-4f55-9242-db62efdaaa6b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:55.503302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30cd3cfb-6336-4f55-9242-db62efdaaa6b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:55.531703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-30cd3cfb-6336-4f55-9242-db62efdaaa6b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042918 Aug 18 22:03:55.532242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 832/1661] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:55.755689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-daa70aa2-3b74-4f8c-8b6f-2cb2b1c553e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:55.757801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-daa70aa2-3b74-4f8c-8b6f-2cb2b1c553e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:55.763748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daa70aa2-3b74-4f8c-8b6f-2cb2b1c553e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:55.764235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daa70aa2-3b74-4f8c-8b6f-2cb2b1c553e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:55.764678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daa70aa2-3b74-4f8c-8b6f-2cb2b1c553e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:55.765477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daa70aa2-3b74-4f8c-8b6f-2cb2b1c553e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:55.765870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daa70aa2-3b74-4f8c-8b6f-2cb2b1c553e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:55.766325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daa70aa2-3b74-4f8c-8b6f-2cb2b1c553e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:55.795146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-daa70aa2-3b74-4f8c-8b6f-2cb2b1c553e5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Aug 18 22:03:55.795704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 830/1662] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:55 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:55.908378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5ea1a7d2-3913-40bd-905d-7d7131984821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:55.910548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5ea1a7d2-3913-40bd-905d-7d7131984821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:55.916813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ea1a7d2-3913-40bd-905d-7d7131984821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:55.917286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ea1a7d2-3913-40bd-905d-7d7131984821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:55.917756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ea1a7d2-3913-40bd-905d-7d7131984821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:55.918448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ea1a7d2-3913-40bd-905d-7d7131984821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:55.918900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ea1a7d2-3913-40bd-905d-7d7131984821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:55.919325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ea1a7d2-3913-40bd-905d-7d7131984821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:55.948523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5ea1a7d2-3913-40bd-905d-7d7131984821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044124 Aug 18 22:03:55.949067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 833/1663] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:55 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:56.215662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6f03be5a-5e47-4919-ae4e-5a35e4a29c21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:56.217823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6f03be5a-5e47-4919-ae4e-5a35e4a29c21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:56.224126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f03be5a-5e47-4919-ae4e-5a35e4a29c21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:56.224601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f03be5a-5e47-4919-ae4e-5a35e4a29c21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:56.225030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f03be5a-5e47-4919-ae4e-5a35e4a29c21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:56.225746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f03be5a-5e47-4919-ae4e-5a35e4a29c21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:56.226199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f03be5a-5e47-4919-ae4e-5a35e4a29c21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:56.226624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f03be5a-5e47-4919-ae4e-5a35e4a29c21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:56.255995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6f03be5a-5e47-4919-ae4e-5a35e4a29c21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044350 Aug 18 22:03:56.256554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 831/1664] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:56 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:56.544494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6044dfe3-6f4a-4a6e-8cce-e4b2f95daced tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:56.546689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6044dfe3-6f4a-4a6e-8cce-e4b2f95daced tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:56.553525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6044dfe3-6f4a-4a6e-8cce-e4b2f95daced tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:56.554034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6044dfe3-6f4a-4a6e-8cce-e4b2f95daced tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:56.554501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6044dfe3-6f4a-4a6e-8cce-e4b2f95daced tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:56.555198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6044dfe3-6f4a-4a6e-8cce-e4b2f95daced tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:56.555653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6044dfe3-6f4a-4a6e-8cce-e4b2f95daced tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:56.556084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6044dfe3-6f4a-4a6e-8cce-e4b2f95daced tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:56.584880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6044dfe3-6f4a-4a6e-8cce-e4b2f95daced tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044356 Aug 18 22:03:56.585435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 834/1665] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:56.808244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3ed8264d-6026-44ab-b565-343d03b8c4d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:56.810401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3ed8264d-6026-44ab-b565-343d03b8c4d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:56.816384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ed8264d-6026-44ab-b565-343d03b8c4d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:56.816862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ed8264d-6026-44ab-b565-343d03b8c4d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:56.817334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ed8264d-6026-44ab-b565-343d03b8c4d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:56.818055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ed8264d-6026-44ab-b565-343d03b8c4d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:56.818502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ed8264d-6026-44ab-b565-343d03b8c4d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:56.818921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ed8264d-6026-44ab-b565-343d03b8c4d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:56.847659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3ed8264d-6026-44ab-b565-343d03b8c4d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043340 Aug 18 22:03:56.848693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 832/1666] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:56 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:56.961345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-12365dac-60a1-4bc5-ae03-278daec4cdf0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:56.963525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-12365dac-60a1-4bc5-ae03-278daec4cdf0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:56.969919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12365dac-60a1-4bc5-ae03-278daec4cdf0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:56.970349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12365dac-60a1-4bc5-ae03-278daec4cdf0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:56.970786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12365dac-60a1-4bc5-ae03-278daec4cdf0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:56.971488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12365dac-60a1-4bc5-ae03-278daec4cdf0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:56.971944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12365dac-60a1-4bc5-ae03-278daec4cdf0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:56.972374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12365dac-60a1-4bc5-ae03-278daec4cdf0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:57.001349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-12365dac-60a1-4bc5-ae03-278daec4cdf0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Aug 18 22:03:57.001935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 835/1667] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:56 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:57.268317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2f0df2ec-a1ba-425f-ab65-8e930acd71ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:57.271048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2f0df2ec-a1ba-425f-ab65-8e930acd71ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:57.277374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f0df2ec-a1ba-425f-ab65-8e930acd71ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:57.277887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f0df2ec-a1ba-425f-ab65-8e930acd71ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:57.278320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f0df2ec-a1ba-425f-ab65-8e930acd71ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:57.278999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f0df2ec-a1ba-425f-ab65-8e930acd71ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:57.279445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f0df2ec-a1ba-425f-ab65-8e930acd71ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:57.279864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f0df2ec-a1ba-425f-ab65-8e930acd71ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:57.308183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2f0df2ec-a1ba-425f-ab65-8e930acd71ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043913 Aug 18 22:03:57.308732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 833/1668] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:57 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:57.596845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2e993c12-1b17-400c-9dde-882201c9a76f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:57.599047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2e993c12-1b17-400c-9dde-882201c9a76f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:57.604931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e993c12-1b17-400c-9dde-882201c9a76f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:57.605408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e993c12-1b17-400c-9dde-882201c9a76f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:57.605870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e993c12-1b17-400c-9dde-882201c9a76f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:57.606563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e993c12-1b17-400c-9dde-882201c9a76f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:57.607010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e993c12-1b17-400c-9dde-882201c9a76f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:57.607435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e993c12-1b17-400c-9dde-882201c9a76f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:57.636872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2e993c12-1b17-400c-9dde-882201c9a76f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043940 Aug 18 22:03:57.637391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 836/1669] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:57.860742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-375ecab5-442b-4faa-b136-d040ad4e9f30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:57.862845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-375ecab5-442b-4faa-b136-d040ad4e9f30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:57.869483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375ecab5-442b-4faa-b136-d040ad4e9f30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:57.869998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375ecab5-442b-4faa-b136-d040ad4e9f30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:57.870442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375ecab5-442b-4faa-b136-d040ad4e9f30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:57.871145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375ecab5-442b-4faa-b136-d040ad4e9f30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:57.871604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375ecab5-442b-4faa-b136-d040ad4e9f30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:57.872036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375ecab5-442b-4faa-b136-d040ad4e9f30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:57.901968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-375ecab5-442b-4faa-b136-d040ad4e9f30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Aug 18 22:03:57.906528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 834/1670] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:58.013478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b6ce83b8-f441-4327-90ea-f0f7c101ba66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:58.015823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b6ce83b8-f441-4327-90ea-f0f7c101ba66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:58.022284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6ce83b8-f441-4327-90ea-f0f7c101ba66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:58.022766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6ce83b8-f441-4327-90ea-f0f7c101ba66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:58.023209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6ce83b8-f441-4327-90ea-f0f7c101ba66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:58.023980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6ce83b8-f441-4327-90ea-f0f7c101ba66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:58.024462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6ce83b8-f441-4327-90ea-f0f7c101ba66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:58.024891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b6ce83b8-f441-4327-90ea-f0f7c101ba66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:58.055269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b6ce83b8-f441-4327-90ea-f0f7c101ba66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 Aug 18 22:03:58.055846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 837/1671] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:58.320142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-35e3694b-7561-42fc-b076-0dbc4727713e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:58.322405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-35e3694b-7561-42fc-b076-0dbc4727713e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:58.328308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35e3694b-7561-42fc-b076-0dbc4727713e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:58.328782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35e3694b-7561-42fc-b076-0dbc4727713e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:58.329216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35e3694b-7561-42fc-b076-0dbc4727713e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:58.329932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35e3694b-7561-42fc-b076-0dbc4727713e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:58.330386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35e3694b-7561-42fc-b076-0dbc4727713e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:58.330919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35e3694b-7561-42fc-b076-0dbc4727713e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:58.359244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-35e3694b-7561-42fc-b076-0dbc4727713e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042948 Aug 18 22:03:58.359793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 835/1672] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:58 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:03:58.649216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-902360ca-febe-4bf4-b9d1-cfb34c85a215 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:58.651364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-902360ca-febe-4bf4-b9d1-cfb34c85a215 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:58.657313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-902360ca-febe-4bf4-b9d1-cfb34c85a215 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:58.657825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-902360ca-febe-4bf4-b9d1-cfb34c85a215 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:58.658256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-902360ca-febe-4bf4-b9d1-cfb34c85a215 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:58.658938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-902360ca-febe-4bf4-b9d1-cfb34c85a215 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:58.659382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-902360ca-febe-4bf4-b9d1-cfb34c85a215 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:58.659810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-902360ca-febe-4bf4-b9d1-cfb34c85a215 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:58.688697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-902360ca-febe-4bf4-b9d1-cfb34c85a215 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044062 Aug 18 22:03:58.689455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 838/1673] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:58.914219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eb37b220-7c62-458a-a2f3-db2c58a746d9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:58.916373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eb37b220-7c62-458a-a2f3-db2c58a746d9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:58.918716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:03:58.923978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb37b220-7c62-458a-a2f3-db2c58a746d9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:58.924717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb37b220-7c62-458a-a2f3-db2c58a746d9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:58.925157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb37b220-7c62-458a-a2f3-db2c58a746d9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:58.925885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb37b220-7c62-458a-a2f3-db2c58a746d9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:58.926348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb37b220-7c62-458a-a2f3-db2c58a746d9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:58.926777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb37b220-7c62-458a-a2f3-db2c58a746d9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:58.955478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eb37b220-7c62-458a-a2f3-db2c58a746d9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Aug 18 22:03:58.956037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 836/1674] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:58 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:59.068346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-87defbf1-59e9-4db4-98f2-f11feb52a4eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:59.070560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-87defbf1-59e9-4db4-98f2-f11feb52a4eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:59.076898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87defbf1-59e9-4db4-98f2-f11feb52a4eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:59.077374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87defbf1-59e9-4db4-98f2-f11feb52a4eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:59.077838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87defbf1-59e9-4db4-98f2-f11feb52a4eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:59.078534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87defbf1-59e9-4db4-98f2-f11feb52a4eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:59.078980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87defbf1-59e9-4db4-98f2-f11feb52a4eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:59.079398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87defbf1-59e9-4db4-98f2-f11feb52a4eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:59.108501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-87defbf1-59e9-4db4-98f2-f11feb52a4eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044900 Aug 18 22:03:59.108983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 839/1675] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:59 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:59.371528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-76cde0cc-49d8-404d-ac4f-17cace96ca22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:59.373645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-76cde0cc-49d8-404d-ac4f-17cace96ca22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:59.380210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76cde0cc-49d8-404d-ac4f-17cace96ca22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:59.380699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76cde0cc-49d8-404d-ac4f-17cace96ca22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:59.381138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76cde0cc-49d8-404d-ac4f-17cace96ca22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:59.381857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76cde0cc-49d8-404d-ac4f-17cace96ca22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:59.382316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76cde0cc-49d8-404d-ac4f-17cace96ca22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:59.382742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76cde0cc-49d8-404d-ac4f-17cace96ca22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:59.411163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-76cde0cc-49d8-404d-ac4f-17cace96ca22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043722 Aug 18 22:03:59.411715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 837/1676] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:59 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:03:59.701086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fcff18e3-4d33-4519-af01-2e1ba5c9f892 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:59.703335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fcff18e3-4d33-4519-af01-2e1ba5c9f892 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:59.709149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcff18e3-4d33-4519-af01-2e1ba5c9f892 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:59.709660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcff18e3-4d33-4519-af01-2e1ba5c9f892 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:59.710200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcff18e3-4d33-4519-af01-2e1ba5c9f892 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:59.710897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcff18e3-4d33-4519-af01-2e1ba5c9f892 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:59.711348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcff18e3-4d33-4519-af01-2e1ba5c9f892 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:59.711772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcff18e3-4d33-4519-af01-2e1ba5c9f892 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:59.741901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fcff18e3-4d33-4519-af01-2e1ba5c9f892 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044882 Aug 18 22:03:59.742467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 840/1677] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:03:59 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:03:59.968668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1ced0039-7a0d-4a05-ba3b-5ac302e10d87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:03:59.970748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1ced0039-7a0d-4a05-ba3b-5ac302e10d87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:03:59.977889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ced0039-7a0d-4a05-ba3b-5ac302e10d87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:59.978367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ced0039-7a0d-4a05-ba3b-5ac302e10d87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:59.978801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ced0039-7a0d-4a05-ba3b-5ac302e10d87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:03:59.979493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ced0039-7a0d-4a05-ba3b-5ac302e10d87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:03:59.979948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ced0039-7a0d-4a05-ba3b-5ac302e10d87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:03:59.980373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ced0039-7a0d-4a05-ba3b-5ac302e10d87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:00.008232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1ced0039-7a0d-4a05-ba3b-5ac302e10d87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043697 Aug 18 22:04:00.008793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 838/1678] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:03:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:00.120681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4d5f99b3-0a75-4a4c-860f-bc98717e3bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:00.122834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4d5f99b3-0a75-4a4c-860f-bc98717e3bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:00.129098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d5f99b3-0a75-4a4c-860f-bc98717e3bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:00.129570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d5f99b3-0a75-4a4c-860f-bc98717e3bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:00.130032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d5f99b3-0a75-4a4c-860f-bc98717e3bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:00.130717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d5f99b3-0a75-4a4c-860f-bc98717e3bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:00.131167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d5f99b3-0a75-4a4c-860f-bc98717e3bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:00.131586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d5f99b3-0a75-4a4c-860f-bc98717e3bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:00.162044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4d5f99b3-0a75-4a4c-860f-bc98717e3bb1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044259 Aug 18 22:04:00.162257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 841/1679] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:00 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:00.424055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-64e66cb8-4b6c-4da1-a650-6709690eec59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:00.426555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-64e66cb8-4b6c-4da1-a650-6709690eec59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:00.432439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64e66cb8-4b6c-4da1-a650-6709690eec59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:00.432922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64e66cb8-4b6c-4da1-a650-6709690eec59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:00.433411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64e66cb8-4b6c-4da1-a650-6709690eec59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:00.434157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64e66cb8-4b6c-4da1-a650-6709690eec59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:00.434613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64e66cb8-4b6c-4da1-a650-6709690eec59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:00.435042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64e66cb8-4b6c-4da1-a650-6709690eec59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:00.464871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-64e66cb8-4b6c-4da1-a650-6709690eec59 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044903 Aug 18 22:04:00.465421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 839/1680] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:00 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:00.754227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-913861df-b815-48fe-b0e7-8a0de5d3fbbe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:00.756974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-913861df-b815-48fe-b0e7-8a0de5d3fbbe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:00.762975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-913861df-b815-48fe-b0e7-8a0de5d3fbbe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:00.763456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-913861df-b815-48fe-b0e7-8a0de5d3fbbe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:00.763896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-913861df-b815-48fe-b0e7-8a0de5d3fbbe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:00.764590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-913861df-b815-48fe-b0e7-8a0de5d3fbbe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:00.765048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-913861df-b815-48fe-b0e7-8a0de5d3fbbe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:00.765481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-913861df-b815-48fe-b0e7-8a0de5d3fbbe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:00.796339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-913861df-b815-48fe-b0e7-8a0de5d3fbbe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046061 Aug 18 22:04:00.796908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 842/1681] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:00 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:04:01.020818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-35501bd7-e45b-457e-b51a-12d55faaa12a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:01.023030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-35501bd7-e45b-457e-b51a-12d55faaa12a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:01.030594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35501bd7-e45b-457e-b51a-12d55faaa12a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:01.031247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35501bd7-e45b-457e-b51a-12d55faaa12a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:01.031753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35501bd7-e45b-457e-b51a-12d55faaa12a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:01.032392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35501bd7-e45b-457e-b51a-12d55faaa12a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:01.032879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35501bd7-e45b-457e-b51a-12d55faaa12a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:01.033315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35501bd7-e45b-457e-b51a-12d55faaa12a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:01.066884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-35501bd7-e45b-457e-b51a-12d55faaa12a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049742 Aug 18 22:04:01.067530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 840/1682] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:01 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:01.174669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c72abc14-9f7f-44f4-9c09-c66b03b4f1d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:01.177487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c72abc14-9f7f-44f4-9c09-c66b03b4f1d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:01.183861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c72abc14-9f7f-44f4-9c09-c66b03b4f1d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:01.184340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c72abc14-9f7f-44f4-9c09-c66b03b4f1d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:01.184774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c72abc14-9f7f-44f4-9c09-c66b03b4f1d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:01.185469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c72abc14-9f7f-44f4-9c09-c66b03b4f1d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:01.185955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c72abc14-9f7f-44f4-9c09-c66b03b4f1d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:01.186387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c72abc14-9f7f-44f4-9c09-c66b03b4f1d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:01.188709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:01.215296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c72abc14-9f7f-44f4-9c09-c66b03b4f1d3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044862 Aug 18 22:04:01.215847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 843/1683] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:01 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:01.477556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-066bd5cd-6e62-40e3-8893-dd6a73cfc1ab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:01.479641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-066bd5cd-6e62-40e3-8893-dd6a73cfc1ab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:01.485839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-066bd5cd-6e62-40e3-8893-dd6a73cfc1ab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:01.486318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-066bd5cd-6e62-40e3-8893-dd6a73cfc1ab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:01.486750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-066bd5cd-6e62-40e3-8893-dd6a73cfc1ab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:01.487431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-066bd5cd-6e62-40e3-8893-dd6a73cfc1ab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:01.487879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-066bd5cd-6e62-40e3-8893-dd6a73cfc1ab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:01.488298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-066bd5cd-6e62-40e3-8893-dd6a73cfc1ab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:01.516428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-066bd5cd-6e62-40e3-8893-dd6a73cfc1ab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043368 Aug 18 22:04:01.516971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 841/1684] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:01 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:01.808373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2a7630ec-821b-4705-9a95-12b1a2288b55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:01.810586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2a7630ec-821b-4705-9a95-12b1a2288b55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:01.816549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a7630ec-821b-4705-9a95-12b1a2288b55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:01.817728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a7630ec-821b-4705-9a95-12b1a2288b55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:01.818173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a7630ec-821b-4705-9a95-12b1a2288b55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:01.818912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a7630ec-821b-4705-9a95-12b1a2288b55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:01.819364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a7630ec-821b-4705-9a95-12b1a2288b55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:01.819794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a7630ec-821b-4705-9a95-12b1a2288b55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:01.848790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2a7630ec-821b-4705-9a95-12b1a2288b55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044379 Aug 18 22:04:01.849346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 844/1685] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:02.078812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8669e9ec-7a72-4e71-9ffa-302907bfd560 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:02.080913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8669e9ec-7a72-4e71-9ffa-302907bfd560 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:02.088036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8669e9ec-7a72-4e71-9ffa-302907bfd560 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:02.088519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8669e9ec-7a72-4e71-9ffa-302907bfd560 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:02.088955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8669e9ec-7a72-4e71-9ffa-302907bfd560 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:02.089689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8669e9ec-7a72-4e71-9ffa-302907bfd560 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:02.090145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8669e9ec-7a72-4e71-9ffa-302907bfd560 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:02.090572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8669e9ec-7a72-4e71-9ffa-302907bfd560 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:02.120025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8669e9ec-7a72-4e71-9ffa-302907bfd560 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045210 Aug 18 22:04:02.120580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 842/1686] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:02 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:02.227549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fa7b6131-b69a-4128-8a92-8a43797bf233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:02.229715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fa7b6131-b69a-4128-8a92-8a43797bf233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:02.235960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa7b6131-b69a-4128-8a92-8a43797bf233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:02.236432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa7b6131-b69a-4128-8a92-8a43797bf233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:02.236860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa7b6131-b69a-4128-8a92-8a43797bf233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:02.237542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa7b6131-b69a-4128-8a92-8a43797bf233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:02.238015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa7b6131-b69a-4128-8a92-8a43797bf233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:02.238434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa7b6131-b69a-4128-8a92-8a43797bf233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:02.268166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fa7b6131-b69a-4128-8a92-8a43797bf233 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044546 Aug 18 22:04:02.268724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 845/1687] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:02 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:02.528262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4f4eb109-f020-4715-b85a-481da047abb4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:02.530497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4f4eb109-f020-4715-b85a-481da047abb4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:02.537185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f4eb109-f020-4715-b85a-481da047abb4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:02.537695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f4eb109-f020-4715-b85a-481da047abb4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:02.538134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f4eb109-f020-4715-b85a-481da047abb4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:02.538832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f4eb109-f020-4715-b85a-481da047abb4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:02.539288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f4eb109-f020-4715-b85a-481da047abb4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:02.539717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f4eb109-f020-4715-b85a-481da047abb4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:02.543285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:02.569413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4f4eb109-f020-4715-b85a-481da047abb4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 Aug 18 22:04:02.569995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 843/1688] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:02 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:02.860470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dfda3a9b-14b9-432d-a10a-0bbdadb4fd55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:02.862640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dfda3a9b-14b9-432d-a10a-0bbdadb4fd55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:02.869416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfda3a9b-14b9-432d-a10a-0bbdadb4fd55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:02.869935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfda3a9b-14b9-432d-a10a-0bbdadb4fd55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:02.870371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfda3a9b-14b9-432d-a10a-0bbdadb4fd55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:02.871086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfda3a9b-14b9-432d-a10a-0bbdadb4fd55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:02.871542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfda3a9b-14b9-432d-a10a-0bbdadb4fd55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:02.871973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfda3a9b-14b9-432d-a10a-0bbdadb4fd55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:02.901645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dfda3a9b-14b9-432d-a10a-0bbdadb4fd55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045135 Aug 18 22:04:02.902224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 846/1689] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:03.132435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bcf280cd-f4c1-45c5-9278-1ee87e88b19e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:03.134644 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bcf280cd-f4c1-45c5-9278-1ee87e88b19e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:03.141086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcf280cd-f4c1-45c5-9278-1ee87e88b19e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:03.141578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcf280cd-f4c1-45c5-9278-1ee87e88b19e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:03.142054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcf280cd-f4c1-45c5-9278-1ee87e88b19e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:03.142768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcf280cd-f4c1-45c5-9278-1ee87e88b19e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:03.143231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcf280cd-f4c1-45c5-9278-1ee87e88b19e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:03.143663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcf280cd-f4c1-45c5-9278-1ee87e88b19e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:03.174564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bcf280cd-f4c1-45c5-9278-1ee87e88b19e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045854 Aug 18 22:04:03.175134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 844/1690] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:03 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:03.280448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c8865ea5-738d-4a43-987f-003b721508cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:03.282660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c8865ea5-738d-4a43-987f-003b721508cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:03.288929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8865ea5-738d-4a43-987f-003b721508cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:03.289412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8865ea5-738d-4a43-987f-003b721508cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:03.289885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8865ea5-738d-4a43-987f-003b721508cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:03.290582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8865ea5-738d-4a43-987f-003b721508cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:03.291039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8865ea5-738d-4a43-987f-003b721508cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:03.291466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8865ea5-738d-4a43-987f-003b721508cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:03.320803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c8865ea5-738d-4a43-987f-003b721508cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044357 Aug 18 22:04:03.321366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 847/1691] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:03 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:03.581824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f33770e4-8d2f-41bf-a54f-240e2f536f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:03.584534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f33770e4-8d2f-41bf-a54f-240e2f536f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:03.590440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f33770e4-8d2f-41bf-a54f-240e2f536f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:03.590916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f33770e4-8d2f-41bf-a54f-240e2f536f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:03.591348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f33770e4-8d2f-41bf-a54f-240e2f536f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:03.592028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f33770e4-8d2f-41bf-a54f-240e2f536f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:03.592477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f33770e4-8d2f-41bf-a54f-240e2f536f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:03.592901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f33770e4-8d2f-41bf-a54f-240e2f536f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:03.621000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f33770e4-8d2f-41bf-a54f-240e2f536f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043344 Aug 18 22:04:03.621541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 845/1692] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:03 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:03.913977 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b67fdce1-4f11-43bc-81db-1ea267d7c50c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:03.916162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b67fdce1-4f11-43bc-81db-1ea267d7c50c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:03.922119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b67fdce1-4f11-43bc-81db-1ea267d7c50c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:03.922598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b67fdce1-4f11-43bc-81db-1ea267d7c50c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:03.923037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b67fdce1-4f11-43bc-81db-1ea267d7c50c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:03.923738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b67fdce1-4f11-43bc-81db-1ea267d7c50c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:03.924196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b67fdce1-4f11-43bc-81db-1ea267d7c50c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:03.924878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b67fdce1-4f11-43bc-81db-1ea267d7c50c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:03.955111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b67fdce1-4f11-43bc-81db-1ea267d7c50c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045082 Aug 18 22:04:03.955660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 848/1693] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:04.186868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fa20f39f-d65a-4213-8655-9a9298527a72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:04.188982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fa20f39f-d65a-4213-8655-9a9298527a72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:04.195422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa20f39f-d65a-4213-8655-9a9298527a72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:04.195905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa20f39f-d65a-4213-8655-9a9298527a72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:04.196342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa20f39f-d65a-4213-8655-9a9298527a72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:04.197033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa20f39f-d65a-4213-8655-9a9298527a72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:04.197491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa20f39f-d65a-4213-8655-9a9298527a72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:04.197945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa20f39f-d65a-4213-8655-9a9298527a72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:04.226474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fa20f39f-d65a-4213-8655-9a9298527a72 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043624 Aug 18 22:04:04.227031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 846/1694] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:04.332804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cf994a5f-dd78-45a3-84d7-f099ec299239 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:04.334962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cf994a5f-dd78-45a3-84d7-f099ec299239 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:04.341178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf994a5f-dd78-45a3-84d7-f099ec299239 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:04.341681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf994a5f-dd78-45a3-84d7-f099ec299239 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:04.342117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf994a5f-dd78-45a3-84d7-f099ec299239 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:04.342797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf994a5f-dd78-45a3-84d7-f099ec299239 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:04.343255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf994a5f-dd78-45a3-84d7-f099ec299239 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:04.343676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf994a5f-dd78-45a3-84d7-f099ec299239 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:04.372589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cf994a5f-dd78-45a3-84d7-f099ec299239 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Aug 18 22:04:04.373120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 849/1695] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:04 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:04.632989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-90e1f8fd-470c-4256-97da-a8de2a7ac7b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:04.635217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-90e1f8fd-470c-4256-97da-a8de2a7ac7b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:04.641127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90e1f8fd-470c-4256-97da-a8de2a7ac7b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:04.641636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90e1f8fd-470c-4256-97da-a8de2a7ac7b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:04.642081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90e1f8fd-470c-4256-97da-a8de2a7ac7b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:04.642777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90e1f8fd-470c-4256-97da-a8de2a7ac7b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:04.643238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90e1f8fd-470c-4256-97da-a8de2a7ac7b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:04.643669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90e1f8fd-470c-4256-97da-a8de2a7ac7b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:04.673050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-90e1f8fd-470c-4256-97da-a8de2a7ac7b4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044225 Aug 18 22:04:04.673612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 847/1696] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:04 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:04.967366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c7d9c90f-7e7d-47ba-b1e4-41ef9437dd50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:04.969513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c7d9c90f-7e7d-47ba-b1e4-41ef9437dd50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:04.975382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7d9c90f-7e7d-47ba-b1e4-41ef9437dd50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:04.975848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7d9c90f-7e7d-47ba-b1e4-41ef9437dd50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:04.976275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7d9c90f-7e7d-47ba-b1e4-41ef9437dd50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:04.976952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7d9c90f-7e7d-47ba-b1e4-41ef9437dd50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:04.977397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7d9c90f-7e7d-47ba-b1e4-41ef9437dd50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:04.977845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7d9c90f-7e7d-47ba-b1e4-41ef9437dd50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:05.005793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c7d9c90f-7e7d-47ba-b1e4-41ef9437dd50 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042332 Aug 18 22:04:05.006337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 850/1697] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:05.238649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-46a90e1a-9234-46ba-a554-d5fea9933cb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:05.241215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46a90e1a-9234-46ba-a554-d5fea9933cb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:05.247774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46a90e1a-9234-46ba-a554-d5fea9933cb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:05.248260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46a90e1a-9234-46ba-a554-d5fea9933cb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:05.248702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46a90e1a-9234-46ba-a554-d5fea9933cb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:05.249406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46a90e1a-9234-46ba-a554-d5fea9933cb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:05.249903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46a90e1a-9234-46ba-a554-d5fea9933cb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:05.250332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46a90e1a-9234-46ba-a554-d5fea9933cb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:05.279326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-46a90e1a-9234-46ba-a554-d5fea9933cb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044649 Aug 18 22:04:05.279897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 848/1698] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:05 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:04:05.384761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5db2c00b-1b70-4574-8973-312d2a07ae8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:05.387046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5db2c00b-1b70-4574-8973-312d2a07ae8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:05.393342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5db2c00b-1b70-4574-8973-312d2a07ae8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:05.393856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5db2c00b-1b70-4574-8973-312d2a07ae8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:05.394293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5db2c00b-1b70-4574-8973-312d2a07ae8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:05.394983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5db2c00b-1b70-4574-8973-312d2a07ae8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:05.395436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5db2c00b-1b70-4574-8973-312d2a07ae8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:05.395861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5db2c00b-1b70-4574-8973-312d2a07ae8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:05.425406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5db2c00b-1b70-4574-8973-312d2a07ae8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044570 Aug 18 22:04:05.425991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 851/1699] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:05 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:05.685496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2d719832-8571-4489-837a-ac6f19260574 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:05.690462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2d719832-8571-4489-837a-ac6f19260574 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:05.693968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d719832-8571-4489-837a-ac6f19260574 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:05.694466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d719832-8571-4489-837a-ac6f19260574 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:05.694913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d719832-8571-4489-837a-ac6f19260574 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:05.695621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d719832-8571-4489-837a-ac6f19260574 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:05.696089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d719832-8571-4489-837a-ac6f19260574 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:05.696523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d719832-8571-4489-837a-ac6f19260574 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:05.726415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2d719832-8571-4489-837a-ac6f19260574 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044833 Aug 18 22:04:05.726982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 849/1700] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:05 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:06.018065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c11b131d-f651-4c1c-95d6-68430bb16953 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:06.020769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c11b131d-f651-4c1c-95d6-68430bb16953 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:06.026654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c11b131d-f651-4c1c-95d6-68430bb16953 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:06.027128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c11b131d-f651-4c1c-95d6-68430bb16953 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:06.027561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c11b131d-f651-4c1c-95d6-68430bb16953 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:06.028248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c11b131d-f651-4c1c-95d6-68430bb16953 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:06.028700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c11b131d-f651-4c1c-95d6-68430bb16953 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:06.029123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c11b131d-f651-4c1c-95d6-68430bb16953 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:06.057996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c11b131d-f651-4c1c-95d6-68430bb16953 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043905 Aug 18 22:04:06.058555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 852/1701] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:06 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:06.291671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-18627747-3da9-42fa-8235-305c5600b87e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:06.294069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-18627747-3da9-42fa-8235-305c5600b87e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:06.300834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18627747-3da9-42fa-8235-305c5600b87e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:06.301324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18627747-3da9-42fa-8235-305c5600b87e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:06.301797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18627747-3da9-42fa-8235-305c5600b87e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:06.302500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18627747-3da9-42fa-8235-305c5600b87e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:06.302959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18627747-3da9-42fa-8235-305c5600b87e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:06.303393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18627747-3da9-42fa-8235-305c5600b87e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:06.332195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-18627747-3da9-42fa-8235-305c5600b87e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044442 Aug 18 22:04:06.333382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 850/1702] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:06 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:06.438207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-255f8917-644f-48bb-9a80-1bef4ed22416 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:06.440326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-255f8917-644f-48bb-9a80-1bef4ed22416 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:06.447117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-255f8917-644f-48bb-9a80-1bef4ed22416 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:06.447591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-255f8917-644f-48bb-9a80-1bef4ed22416 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:06.448018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-255f8917-644f-48bb-9a80-1bef4ed22416 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:06.448698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-255f8917-644f-48bb-9a80-1bef4ed22416 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:06.449146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-255f8917-644f-48bb-9a80-1bef4ed22416 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:06.449564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-255f8917-644f-48bb-9a80-1bef4ed22416 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:06.478127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-255f8917-644f-48bb-9a80-1bef4ed22416 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043796 Aug 18 22:04:06.478667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 853/1703] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:06 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:06.737926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9bfff97f-1853-4e8c-86ee-50522e51adc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:06.740578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9bfff97f-1853-4e8c-86ee-50522e51adc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:06.746714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bfff97f-1853-4e8c-86ee-50522e51adc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:06.747210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bfff97f-1853-4e8c-86ee-50522e51adc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:06.747656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bfff97f-1853-4e8c-86ee-50522e51adc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:06.748368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bfff97f-1853-4e8c-86ee-50522e51adc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:06.748831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bfff97f-1853-4e8c-86ee-50522e51adc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:06.749264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bfff97f-1853-4e8c-86ee-50522e51adc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:06.778732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9bfff97f-1853-4e8c-86ee-50522e51adc1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044783 Aug 18 22:04:06.779288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 851/1704] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:06 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:07.069780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0ffea383-7980-4885-a179-d5ff9dbccff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:07.071898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0ffea383-7980-4885-a179-d5ff9dbccff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:07.073833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:07.078998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ffea383-7980-4885-a179-d5ff9dbccff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:07.079482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ffea383-7980-4885-a179-d5ff9dbccff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:07.079918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ffea383-7980-4885-a179-d5ff9dbccff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:07.080612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ffea383-7980-4885-a179-d5ff9dbccff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:07.081067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ffea383-7980-4885-a179-d5ff9dbccff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:07.081491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ffea383-7980-4885-a179-d5ff9dbccff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:07.110323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0ffea383-7980-4885-a179-d5ff9dbccff9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044424 Aug 18 22:04:07.111117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 854/1705] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:07.345228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-45704323-157c-46a1-add3-0f2f6756bb7d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:07.347439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-45704323-157c-46a1-add3-0f2f6756bb7d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:07.354392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45704323-157c-46a1-add3-0f2f6756bb7d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:07.354876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45704323-157c-46a1-add3-0f2f6756bb7d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:07.355320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45704323-157c-46a1-add3-0f2f6756bb7d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:07.356017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45704323-157c-46a1-add3-0f2f6756bb7d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:07.356476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45704323-157c-46a1-add3-0f2f6756bb7d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:07.356904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45704323-157c-46a1-add3-0f2f6756bb7d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:07.385611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-45704323-157c-46a1-add3-0f2f6756bb7d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Aug 18 22:04:07.386211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 852/1706] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:07.490365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1790a1b2-2994-446a-ad2f-5272beefae63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:07.492473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1790a1b2-2994-446a-ad2f-5272beefae63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:07.498718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1790a1b2-2994-446a-ad2f-5272beefae63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:07.499196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1790a1b2-2994-446a-ad2f-5272beefae63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:07.499718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1790a1b2-2994-446a-ad2f-5272beefae63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:07.500314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1790a1b2-2994-446a-ad2f-5272beefae63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:07.500760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1790a1b2-2994-446a-ad2f-5272beefae63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:07.501177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1790a1b2-2994-446a-ad2f-5272beefae63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:07.529583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1790a1b2-2994-446a-ad2f-5272beefae63 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Aug 18 22:04:07.530141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 855/1707] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:07 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:07.791575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f86c5e89-ec00-4d26-a07d-09ba4da90d54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:07.793876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f86c5e89-ec00-4d26-a07d-09ba4da90d54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:07.800498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f86c5e89-ec00-4d26-a07d-09ba4da90d54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:07.800985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f86c5e89-ec00-4d26-a07d-09ba4da90d54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:07.802084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f86c5e89-ec00-4d26-a07d-09ba4da90d54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:07.802778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f86c5e89-ec00-4d26-a07d-09ba4da90d54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:07.803236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f86c5e89-ec00-4d26-a07d-09ba4da90d54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:07.803691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f86c5e89-ec00-4d26-a07d-09ba4da90d54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:07.831776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f86c5e89-ec00-4d26-a07d-09ba4da90d54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044097 Aug 18 22:04:07.832326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 853/1708] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:07 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:08.123798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ee07ade2-e3a1-4a5c-984a-05a483c81d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:08.126024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ee07ade2-e3a1-4a5c-984a-05a483c81d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:08.131962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee07ade2-e3a1-4a5c-984a-05a483c81d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:08.132456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee07ade2-e3a1-4a5c-984a-05a483c81d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:08.132888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee07ade2-e3a1-4a5c-984a-05a483c81d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:08.133576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee07ade2-e3a1-4a5c-984a-05a483c81d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:08.134043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee07ade2-e3a1-4a5c-984a-05a483c81d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:08.134467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee07ade2-e3a1-4a5c-984a-05a483c81d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:08.164598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ee07ade2-e3a1-4a5c-984a-05a483c81d91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044863 Aug 18 22:04:08.165180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 856/1709] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:04:08.398579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ab14a22f-afa3-471e-bfed-d44434464286 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:08.400797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ab14a22f-afa3-471e-bfed-d44434464286 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:08.407556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab14a22f-afa3-471e-bfed-d44434464286 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:08.408041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab14a22f-afa3-471e-bfed-d44434464286 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:08.408482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab14a22f-afa3-471e-bfed-d44434464286 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:08.409178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab14a22f-afa3-471e-bfed-d44434464286 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:08.409671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab14a22f-afa3-471e-bfed-d44434464286 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:08.410109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab14a22f-afa3-471e-bfed-d44434464286 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:08.439407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ab14a22f-afa3-471e-bfed-d44434464286 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045349 Aug 18 22:04:08.439967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 854/1710] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:08 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:08.541987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f6e27c42-2e14-4c57-a7a0-a581a5f48253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:08.544148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f6e27c42-2e14-4c57-a7a0-a581a5f48253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:08.550705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6e27c42-2e14-4c57-a7a0-a581a5f48253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:08.551187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6e27c42-2e14-4c57-a7a0-a581a5f48253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:08.551623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6e27c42-2e14-4c57-a7a0-a581a5f48253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:08.552433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6e27c42-2e14-4c57-a7a0-a581a5f48253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:08.552891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6e27c42-2e14-4c57-a7a0-a581a5f48253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:08.553315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6e27c42-2e14-4c57-a7a0-a581a5f48253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:08.581801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f6e27c42-2e14-4c57-a7a0-a581a5f48253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043823 Aug 18 22:04:08.582349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 857/1711] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:08 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:08.843759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-28fb35b6-8598-4768-959c-f0c264bc1f75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:08.845951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-28fb35b6-8598-4768-959c-f0c264bc1f75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:08.852140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28fb35b6-8598-4768-959c-f0c264bc1f75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:08.852630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28fb35b6-8598-4768-959c-f0c264bc1f75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:08.853074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28fb35b6-8598-4768-959c-f0c264bc1f75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:08.853813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28fb35b6-8598-4768-959c-f0c264bc1f75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:08.854273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28fb35b6-8598-4768-959c-f0c264bc1f75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:08.854704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28fb35b6-8598-4768-959c-f0c264bc1f75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:08.885304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-28fb35b6-8598-4768-959c-f0c264bc1f75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Aug 18 22:04:08.886015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 855/1712] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:08 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:09.177528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e1465a91-e1a2-4fa4-b74f-779fd604dbe6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:09.179695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e1465a91-e1a2-4fa4-b74f-779fd604dbe6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:09.185782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e1465a91-e1a2-4fa4-b74f-779fd604dbe6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:09.186264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e1465a91-e1a2-4fa4-b74f-779fd604dbe6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:09.186699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e1465a91-e1a2-4fa4-b74f-779fd604dbe6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:09.187401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e1465a91-e1a2-4fa4-b74f-779fd604dbe6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:09.187851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e1465a91-e1a2-4fa4-b74f-779fd604dbe6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:09.188277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e1465a91-e1a2-4fa4-b74f-779fd604dbe6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:09.218983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e1465a91-e1a2-4fa4-b74f-779fd604dbe6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046219 Aug 18 22:04:09.219575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 858/1713] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:09.451974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-543f6259-fef8-44c6-a95e-25e7e3bd20b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:09.454070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-543f6259-fef8-44c6-a95e-25e7e3bd20b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:09.460559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-543f6259-fef8-44c6-a95e-25e7e3bd20b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:09.461071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-543f6259-fef8-44c6-a95e-25e7e3bd20b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:09.461507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-543f6259-fef8-44c6-a95e-25e7e3bd20b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:09.462225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-543f6259-fef8-44c6-a95e-25e7e3bd20b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:09.462681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-543f6259-fef8-44c6-a95e-25e7e3bd20b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:09.463108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-543f6259-fef8-44c6-a95e-25e7e3bd20b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:09.492480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-543f6259-fef8-44c6-a95e-25e7e3bd20b3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044652 Aug 18 22:04:09.493038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 856/1714] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:09 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:09.594148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-054fc220-ef0e-42da-a7ff-f72cfb0af4a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:09.596325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-054fc220-ef0e-42da-a7ff-f72cfb0af4a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:09.603175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-054fc220-ef0e-42da-a7ff-f72cfb0af4a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:09.603657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-054fc220-ef0e-42da-a7ff-f72cfb0af4a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:09.604097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-054fc220-ef0e-42da-a7ff-f72cfb0af4a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:09.604792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-054fc220-ef0e-42da-a7ff-f72cfb0af4a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:09.605262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-054fc220-ef0e-42da-a7ff-f72cfb0af4a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:09.605719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-054fc220-ef0e-42da-a7ff-f72cfb0af4a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:09.630543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:09.635981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-054fc220-ef0e-42da-a7ff-f72cfb0af4a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045781 Aug 18 22:04:09.636547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 859/1715] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:09 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:09.899845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bbad91dd-8272-47ca-a11e-51afcfa9ab8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:09.901984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bbad91dd-8272-47ca-a11e-51afcfa9ab8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:09.907900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbad91dd-8272-47ca-a11e-51afcfa9ab8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:09.908373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbad91dd-8272-47ca-a11e-51afcfa9ab8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:09.908803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbad91dd-8272-47ca-a11e-51afcfa9ab8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:09.909485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbad91dd-8272-47ca-a11e-51afcfa9ab8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:09.909964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbad91dd-8272-47ca-a11e-51afcfa9ab8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:09.910385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbad91dd-8272-47ca-a11e-51afcfa9ab8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:09.939383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bbad91dd-8272-47ca-a11e-51afcfa9ab8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044029 Aug 18 22:04:09.939928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 857/1716] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:09 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:10.231544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-479063a6-0c71-4aa1-9a25-2afb83cb64c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:10.233774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-479063a6-0c71-4aa1-9a25-2afb83cb64c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:10.239803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-479063a6-0c71-4aa1-9a25-2afb83cb64c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:10.240286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-479063a6-0c71-4aa1-9a25-2afb83cb64c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:10.240725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-479063a6-0c71-4aa1-9a25-2afb83cb64c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:10.241421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-479063a6-0c71-4aa1-9a25-2afb83cb64c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:10.241900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-479063a6-0c71-4aa1-9a25-2afb83cb64c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:10.242329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-479063a6-0c71-4aa1-9a25-2afb83cb64c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:10.272188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-479063a6-0c71-4aa1-9a25-2afb83cb64c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044879 Aug 18 22:04:10.272759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 860/1717] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:10.504456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-93cd18b2-ac70-44ec-80b5-d4821550bba4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:10.507144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-93cd18b2-ac70-44ec-80b5-d4821550bba4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:10.513530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93cd18b2-ac70-44ec-80b5-d4821550bba4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:10.514052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93cd18b2-ac70-44ec-80b5-d4821550bba4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:10.514491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93cd18b2-ac70-44ec-80b5-d4821550bba4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:10.515190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93cd18b2-ac70-44ec-80b5-d4821550bba4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:10.515681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93cd18b2-ac70-44ec-80b5-d4821550bba4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:10.516111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-93cd18b2-ac70-44ec-80b5-d4821550bba4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:10.543941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-93cd18b2-ac70-44ec-80b5-d4821550bba4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043541 Aug 18 22:04:10.544495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 858/1718] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:10 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:04:10.647540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dd2cc48b-adfb-4123-86ce-ad44080bcd65 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:10.649755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dd2cc48b-adfb-4123-86ce-ad44080bcd65 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:10.656018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd2cc48b-adfb-4123-86ce-ad44080bcd65 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:10.656500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd2cc48b-adfb-4123-86ce-ad44080bcd65 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:10.656934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd2cc48b-adfb-4123-86ce-ad44080bcd65 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:10.657643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd2cc48b-adfb-4123-86ce-ad44080bcd65 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:10.658099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd2cc48b-adfb-4123-86ce-ad44080bcd65 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:10.658521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd2cc48b-adfb-4123-86ce-ad44080bcd65 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:10.687503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dd2cc48b-adfb-4123-86ce-ad44080bcd65 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043930 Aug 18 22:04:10.688050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 861/1719] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:10 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:10.951563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-36f4e309-6ae4-46bc-9c19-2ab0a7cf38fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:10.953753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-36f4e309-6ae4-46bc-9c19-2ab0a7cf38fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:10.959789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36f4e309-6ae4-46bc-9c19-2ab0a7cf38fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:10.960275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36f4e309-6ae4-46bc-9c19-2ab0a7cf38fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:10.960715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36f4e309-6ae4-46bc-9c19-2ab0a7cf38fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:10.961412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36f4e309-6ae4-46bc-9c19-2ab0a7cf38fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:10.961899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36f4e309-6ae4-46bc-9c19-2ab0a7cf38fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:10.962333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36f4e309-6ae4-46bc-9c19-2ab0a7cf38fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:10.986620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:10.992450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-36f4e309-6ae4-46bc-9c19-2ab0a7cf38fd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Aug 18 22:04:10.993006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 859/1720] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:10 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:11.284194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-961fbd92-e83d-454b-9573-b198f85a6b5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:11.286334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-961fbd92-e83d-454b-9573-b198f85a6b5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:11.292932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-961fbd92-e83d-454b-9573-b198f85a6b5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:11.293406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-961fbd92-e83d-454b-9573-b198f85a6b5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:11.293869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-961fbd92-e83d-454b-9573-b198f85a6b5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:11.294554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-961fbd92-e83d-454b-9573-b198f85a6b5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:11.295002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-961fbd92-e83d-454b-9573-b198f85a6b5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:11.295418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-961fbd92-e83d-454b-9573-b198f85a6b5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:11.323470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-961fbd92-e83d-454b-9573-b198f85a6b5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043199 Aug 18 22:04:11.324018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 862/1721] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:11.556238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0993c1d1-3e02-4fd9-baf8-6e49d87ec0a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:11.558423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0993c1d1-3e02-4fd9-baf8-6e49d87ec0a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:11.564947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0993c1d1-3e02-4fd9-baf8-6e49d87ec0a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:11.565432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0993c1d1-3e02-4fd9-baf8-6e49d87ec0a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:11.565918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0993c1d1-3e02-4fd9-baf8-6e49d87ec0a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:11.566624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0993c1d1-3e02-4fd9-baf8-6e49d87ec0a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:11.567114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0993c1d1-3e02-4fd9-baf8-6e49d87ec0a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:11.567544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0993c1d1-3e02-4fd9-baf8-6e49d87ec0a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:11.596733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0993c1d1-3e02-4fd9-baf8-6e49d87ec0a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044406 Aug 18 22:04:11.597499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 860/1722] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:11.699501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b8992ac7-ccd4-490e-a242-ce4a8b0c7f43 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:11.701679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b8992ac7-ccd4-490e-a242-ce4a8b0c7f43 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:11.708130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8992ac7-ccd4-490e-a242-ce4a8b0c7f43 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:11.708614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8992ac7-ccd4-490e-a242-ce4a8b0c7f43 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:11.709054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8992ac7-ccd4-490e-a242-ce4a8b0c7f43 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:11.710556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8992ac7-ccd4-490e-a242-ce4a8b0c7f43 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:11.711015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8992ac7-ccd4-490e-a242-ce4a8b0c7f43 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:11.711446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8992ac7-ccd4-490e-a242-ce4a8b0c7f43 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:11.740260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b8992ac7-ccd4-490e-a242-ce4a8b0c7f43 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044680 Aug 18 22:04:11.740812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 863/1723] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:12.005086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9ec3c850-9795-4736-a2e0-2d89466dcbda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:12.007781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9ec3c850-9795-4736-a2e0-2d89466dcbda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:12.013725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ec3c850-9795-4736-a2e0-2d89466dcbda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:12.014210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ec3c850-9795-4736-a2e0-2d89466dcbda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:12.014652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ec3c850-9795-4736-a2e0-2d89466dcbda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:12.015521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ec3c850-9795-4736-a2e0-2d89466dcbda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:12.015807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ec3c850-9795-4736-a2e0-2d89466dcbda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:12.016233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ec3c850-9795-4736-a2e0-2d89466dcbda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:12.044338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9ec3c850-9795-4736-a2e0-2d89466dcbda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043313 Aug 18 22:04:12.044887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 861/1724] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:11 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:12.335605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-998bf72f-7ca8-4baf-8580-400c47d85613 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:12.337774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-998bf72f-7ca8-4baf-8580-400c47d85613 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:12.343652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-998bf72f-7ca8-4baf-8580-400c47d85613 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:12.344124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-998bf72f-7ca8-4baf-8580-400c47d85613 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:12.344555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-998bf72f-7ca8-4baf-8580-400c47d85613 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:12.345239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-998bf72f-7ca8-4baf-8580-400c47d85613 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:12.345709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-998bf72f-7ca8-4baf-8580-400c47d85613 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:12.346130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-998bf72f-7ca8-4baf-8580-400c47d85613 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:12.375195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-998bf72f-7ca8-4baf-8580-400c47d85613 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043450 Aug 18 22:04:12.375733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 864/1725] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:12 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:12.608340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0db683e6-f188-455a-baf2-02a3f7577c73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:12.610470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0db683e6-f188-455a-baf2-02a3f7577c73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:12.617362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0db683e6-f188-455a-baf2-02a3f7577c73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:12.617865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0db683e6-f188-455a-baf2-02a3f7577c73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:12.618299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0db683e6-f188-455a-baf2-02a3f7577c73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:12.618986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0db683e6-f188-455a-baf2-02a3f7577c73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:12.619435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0db683e6-f188-455a-baf2-02a3f7577c73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:12.619856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0db683e6-f188-455a-baf2-02a3f7577c73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:12.648059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0db683e6-f188-455a-baf2-02a3f7577c73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043634 Aug 18 22:04:12.648604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 862/1726] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:12 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:12.752456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f2a321df-a0c9-41a3-a95a-3e4da29da83d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:12.754608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f2a321df-a0c9-41a3-a95a-3e4da29da83d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:12.760838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2a321df-a0c9-41a3-a95a-3e4da29da83d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:12.761309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2a321df-a0c9-41a3-a95a-3e4da29da83d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:12.761777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2a321df-a0c9-41a3-a95a-3e4da29da83d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:12.762462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2a321df-a0c9-41a3-a95a-3e4da29da83d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:12.762909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2a321df-a0c9-41a3-a95a-3e4da29da83d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:12.763329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2a321df-a0c9-41a3-a95a-3e4da29da83d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:12.792411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f2a321df-a0c9-41a3-a95a-3e4da29da83d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Aug 18 22:04:12.792955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 865/1727] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:12 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:13.056646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ffd1edb9-5b51-43af-b086-1edc438a8faa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:13.058855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ffd1edb9-5b51-43af-b086-1edc438a8faa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:13.065045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffd1edb9-5b51-43af-b086-1edc438a8faa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:13.065527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffd1edb9-5b51-43af-b086-1edc438a8faa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:13.065990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffd1edb9-5b51-43af-b086-1edc438a8faa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:13.066685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffd1edb9-5b51-43af-b086-1edc438a8faa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:13.067140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffd1edb9-5b51-43af-b086-1edc438a8faa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:13.067576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffd1edb9-5b51-43af-b086-1edc438a8faa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:13.097251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ffd1edb9-5b51-43af-b086-1edc438a8faa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Aug 18 22:04:13.097843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 863/1728] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:13 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:13.388648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d60d5f55-f616-459b-9c98-845e65090b87 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:13.390862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d60d5f55-f616-459b-9c98-845e65090b87 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:13.396702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d60d5f55-f616-459b-9c98-845e65090b87 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:13.397176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d60d5f55-f616-459b-9c98-845e65090b87 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:13.397632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d60d5f55-f616-459b-9c98-845e65090b87 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:13.398321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d60d5f55-f616-459b-9c98-845e65090b87 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:13.398772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d60d5f55-f616-459b-9c98-845e65090b87 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:13.399196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d60d5f55-f616-459b-9c98-845e65090b87 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:13.429243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d60d5f55-f616-459b-9c98-845e65090b87 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044845 Aug 18 22:04:13.429825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 866/1729] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:13 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:13.659560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4b43e594-2983-4af4-8244-767018f4f344 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:13.661627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4b43e594-2983-4af4-8244-767018f4f344 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:13.668101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b43e594-2983-4af4-8244-767018f4f344 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:13.668575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b43e594-2983-4af4-8244-767018f4f344 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:13.669007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b43e594-2983-4af4-8244-767018f4f344 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:13.669722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b43e594-2983-4af4-8244-767018f4f344 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:13.670183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b43e594-2983-4af4-8244-767018f4f344 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:13.670594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b43e594-2983-4af4-8244-767018f4f344 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:13.700892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4b43e594-2983-4af4-8244-767018f4f344 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045378 Aug 18 22:04:13.701456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 864/1730] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:13 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:13.805119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aef2aeca-d717-4fdd-b25d-978328fac1bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:13.807302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aef2aeca-d717-4fdd-b25d-978328fac1bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:13.813610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aef2aeca-d717-4fdd-b25d-978328fac1bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:13.814106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aef2aeca-d717-4fdd-b25d-978328fac1bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:13.814545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aef2aeca-d717-4fdd-b25d-978328fac1bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:13.815234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aef2aeca-d717-4fdd-b25d-978328fac1bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:13.815686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aef2aeca-d717-4fdd-b25d-978328fac1bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:13.816148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aef2aeca-d717-4fdd-b25d-978328fac1bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:13.845028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aef2aeca-d717-4fdd-b25d-978328fac1bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044476 Aug 18 22:04:13.845580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 867/1731] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:14.109052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1f52c251-68ee-4908-95f4-8ad3c0314147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:14.111260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1f52c251-68ee-4908-95f4-8ad3c0314147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:14.117093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f52c251-68ee-4908-95f4-8ad3c0314147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:14.117573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f52c251-68ee-4908-95f4-8ad3c0314147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:14.118033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f52c251-68ee-4908-95f4-8ad3c0314147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:14.118719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f52c251-68ee-4908-95f4-8ad3c0314147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:14.119197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f52c251-68ee-4908-95f4-8ad3c0314147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:14.119620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f52c251-68ee-4908-95f4-8ad3c0314147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:14.148544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1f52c251-68ee-4908-95f4-8ad3c0314147 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043353 Aug 18 22:04:14.149088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 865/1732] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:14 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:14.441386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aa668a26-fc88-4cf7-8a8a-c3eed2237a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:14.443623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aa668a26-fc88-4cf7-8a8a-c3eed2237a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:14.449496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa668a26-fc88-4cf7-8a8a-c3eed2237a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:14.449980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa668a26-fc88-4cf7-8a8a-c3eed2237a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:14.450412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa668a26-fc88-4cf7-8a8a-c3eed2237a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:14.451097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa668a26-fc88-4cf7-8a8a-c3eed2237a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:14.451544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa668a26-fc88-4cf7-8a8a-c3eed2237a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:14.451965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa668a26-fc88-4cf7-8a8a-c3eed2237a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:14.481040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aa668a26-fc88-4cf7-8a8a-c3eed2237a53 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043584 Aug 18 22:04:14.481583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 868/1733] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:14.713586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-abf515e2-1db5-44de-ba76-71885faa5f6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:14.715688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-abf515e2-1db5-44de-ba76-71885faa5f6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:14.722277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abf515e2-1db5-44de-ba76-71885faa5f6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:14.722746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abf515e2-1db5-44de-ba76-71885faa5f6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:14.723180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abf515e2-1db5-44de-ba76-71885faa5f6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:14.723883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abf515e2-1db5-44de-ba76-71885faa5f6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:14.724337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abf515e2-1db5-44de-ba76-71885faa5f6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:14.724768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abf515e2-1db5-44de-ba76-71885faa5f6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:14.752704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-abf515e2-1db5-44de-ba76-71885faa5f6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043773 Aug 18 22:04:14.753255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 866/1734] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:14.856824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-df161651-3372-4e50-8886-a3a8fdb55133 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:14.859077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-df161651-3372-4e50-8886-a3a8fdb55133 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:14.865223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df161651-3372-4e50-8886-a3a8fdb55133 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:14.866228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df161651-3372-4e50-8886-a3a8fdb55133 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:14.866671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df161651-3372-4e50-8886-a3a8fdb55133 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:14.867374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df161651-3372-4e50-8886-a3a8fdb55133 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:14.867829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df161651-3372-4e50-8886-a3a8fdb55133 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:14.868256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df161651-3372-4e50-8886-a3a8fdb55133 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:14.897779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-df161651-3372-4e50-8886-a3a8fdb55133 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Aug 18 22:04:14.898333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 869/1735] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:15.160913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ef8bd61f-b8b1-4547-a7f7-a0057e926037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:15.163152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ef8bd61f-b8b1-4547-a7f7-a0057e926037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:15.168967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef8bd61f-b8b1-4547-a7f7-a0057e926037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:15.169442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef8bd61f-b8b1-4547-a7f7-a0057e926037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:15.169934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef8bd61f-b8b1-4547-a7f7-a0057e926037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:15.170619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef8bd61f-b8b1-4547-a7f7-a0057e926037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:15.171069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef8bd61f-b8b1-4547-a7f7-a0057e926037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:15.171493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef8bd61f-b8b1-4547-a7f7-a0057e926037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:15.200926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ef8bd61f-b8b1-4547-a7f7-a0057e926037 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Aug 18 22:04:15.201470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 867/1736] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:15 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:15.493095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-926419f3-2408-4448-ab78-9485eb4fbbb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:15.495256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-926419f3-2408-4448-ab78-9485eb4fbbb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:15.501164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-926419f3-2408-4448-ab78-9485eb4fbbb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:15.501681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-926419f3-2408-4448-ab78-9485eb4fbbb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:15.502118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-926419f3-2408-4448-ab78-9485eb4fbbb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:15.502815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-926419f3-2408-4448-ab78-9485eb4fbbb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:15.503269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-926419f3-2408-4448-ab78-9485eb4fbbb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:15.503697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-926419f3-2408-4448-ab78-9485eb4fbbb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:15.532010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-926419f3-2408-4448-ab78-9485eb4fbbb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043649 Aug 18 22:04:15.532556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 870/1737] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:15.765114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f37d3f37-b0b5-46a2-bee7-3af900af79dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:15.767272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f37d3f37-b0b5-46a2-bee7-3af900af79dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:15.774307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f37d3f37-b0b5-46a2-bee7-3af900af79dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:15.774791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f37d3f37-b0b5-46a2-bee7-3af900af79dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:15.775233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f37d3f37-b0b5-46a2-bee7-3af900af79dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:15.775933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f37d3f37-b0b5-46a2-bee7-3af900af79dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:15.776394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f37d3f37-b0b5-46a2-bee7-3af900af79dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:15.776830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f37d3f37-b0b5-46a2-bee7-3af900af79dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:15.805916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f37d3f37-b0b5-46a2-bee7-3af900af79dc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044718 Aug 18 22:04:15.806470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 868/1738] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:15 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:15.910231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3069844b-0cd9-42c4-be48-48afcedb1644 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:15.912415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3069844b-0cd9-42c4-be48-48afcedb1644 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:15.920316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3069844b-0cd9-42c4-be48-48afcedb1644 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:15.921085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3069844b-0cd9-42c4-be48-48afcedb1644 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:15.921818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3069844b-0cd9-42c4-be48-48afcedb1644 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:15.922549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3069844b-0cd9-42c4-be48-48afcedb1644 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:15.923034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3069844b-0cd9-42c4-be48-48afcedb1644 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:15.923468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3069844b-0cd9-42c4-be48-48afcedb1644 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:15.956016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3069844b-0cd9-42c4-be48-48afcedb1644 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049736 Aug 18 22:04:15.956579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 871/1739] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:15 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:16.212635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e750b37d-dae7-4948-8d32-0be260de063f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:16.215154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e750b37d-dae7-4948-8d32-0be260de063f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:16.223840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e750b37d-dae7-4948-8d32-0be260de063f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:16.224572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e750b37d-dae7-4948-8d32-0be260de063f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:16.225228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e750b37d-dae7-4948-8d32-0be260de063f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:16.226320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e750b37d-dae7-4948-8d32-0be260de063f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:16.227014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e750b37d-dae7-4948-8d32-0be260de063f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:16.227662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e750b37d-dae7-4948-8d32-0be260de063f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:16.267707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e750b37d-dae7-4948-8d32-0be260de063f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059602 Aug 18 22:04:16.268271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 869/1740] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:16 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:16.544292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aa5d2d26-4ba2-4e75-a367-41dac3fe8287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:16.546453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aa5d2d26-4ba2-4e75-a367-41dac3fe8287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:16.552969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa5d2d26-4ba2-4e75-a367-41dac3fe8287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:16.553448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa5d2d26-4ba2-4e75-a367-41dac3fe8287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:16.554417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa5d2d26-4ba2-4e75-a367-41dac3fe8287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:16.555176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa5d2d26-4ba2-4e75-a367-41dac3fe8287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:16.555628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa5d2d26-4ba2-4e75-a367-41dac3fe8287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:16.556093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa5d2d26-4ba2-4e75-a367-41dac3fe8287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:16.587334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aa5d2d26-4ba2-4e75-a367-41dac3fe8287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046954 Aug 18 22:04:16.587884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 872/1741] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:16.817997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b0a5a60a-8510-4060-9e7b-d79e1bdb9aeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:16.820173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b0a5a60a-8510-4060-9e7b-d79e1bdb9aeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:16.826494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0a5a60a-8510-4060-9e7b-d79e1bdb9aeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:16.826970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0a5a60a-8510-4060-9e7b-d79e1bdb9aeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:16.827605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0a5a60a-8510-4060-9e7b-d79e1bdb9aeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:16.828090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0a5a60a-8510-4060-9e7b-d79e1bdb9aeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:16.828539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0a5a60a-8510-4060-9e7b-d79e1bdb9aeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:16.828962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0a5a60a-8510-4060-9e7b-d79e1bdb9aeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:16.857349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b0a5a60a-8510-4060-9e7b-d79e1bdb9aeb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043261 Aug 18 22:04:16.857940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 870/1742] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:04:16.968485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c4e32ba2-89f4-42d1-9dd1-371c92415c13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:16.970660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c4e32ba2-89f4-42d1-9dd1-371c92415c13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:16.976973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4e32ba2-89f4-42d1-9dd1-371c92415c13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:16.977444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4e32ba2-89f4-42d1-9dd1-371c92415c13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:16.977910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4e32ba2-89f4-42d1-9dd1-371c92415c13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:16.978594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4e32ba2-89f4-42d1-9dd1-371c92415c13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:16.979045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4e32ba2-89f4-42d1-9dd1-371c92415c13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:16.979466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4e32ba2-89f4-42d1-9dd1-371c92415c13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:17.008084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c4e32ba2-89f4-42d1-9dd1-371c92415c13 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043607 Aug 18 22:04:17.008632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 873/1743] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:16 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:17.280281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e41254bf-315d-4fb8-8e70-2c992b7ba7a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:17.282416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e41254bf-315d-4fb8-8e70-2c992b7ba7a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:17.288962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e41254bf-315d-4fb8-8e70-2c992b7ba7a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:17.289453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e41254bf-315d-4fb8-8e70-2c992b7ba7a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:17.289910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e41254bf-315d-4fb8-8e70-2c992b7ba7a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:17.290593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e41254bf-315d-4fb8-8e70-2c992b7ba7a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:17.291041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e41254bf-315d-4fb8-8e70-2c992b7ba7a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:17.291461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e41254bf-315d-4fb8-8e70-2c992b7ba7a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:17.319703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e41254bf-315d-4fb8-8e70-2c992b7ba7a0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043373 Aug 18 22:04:17.320247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 871/1744] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:17 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:17.599718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0318569-d957-47d8-a799-0cab78d56481 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:17.602003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d0318569-d957-47d8-a799-0cab78d56481 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:17.608481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0318569-d957-47d8-a799-0cab78d56481 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:17.608956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0318569-d957-47d8-a799-0cab78d56481 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:17.609428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0318569-d957-47d8-a799-0cab78d56481 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:17.610154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0318569-d957-47d8-a799-0cab78d56481 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:17.610609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0318569-d957-47d8-a799-0cab78d56481 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:17.611039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0318569-d957-47d8-a799-0cab78d56481 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:17.640284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d0318569-d957-47d8-a799-0cab78d56481 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044497 Aug 18 22:04:17.640844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 874/1745] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:17.869847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-618efb63-9166-459b-bc5b-a2443e863a8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:17.871925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-618efb63-9166-459b-bc5b-a2443e863a8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:17.878362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-618efb63-9166-459b-bc5b-a2443e863a8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:17.878846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-618efb63-9166-459b-bc5b-a2443e863a8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:17.879283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-618efb63-9166-459b-bc5b-a2443e863a8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:17.879997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-618efb63-9166-459b-bc5b-a2443e863a8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:17.880462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-618efb63-9166-459b-bc5b-a2443e863a8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:17.880889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-618efb63-9166-459b-bc5b-a2443e863a8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:17.909422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-618efb63-9166-459b-bc5b-a2443e863a8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044136 Aug 18 22:04:17.909997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 872/1746] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:18.020565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3d4554ac-7ac5-4623-ab92-d0d55a9bdac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:18.022749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3d4554ac-7ac5-4623-ab92-d0d55a9bdac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:18.028568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d4554ac-7ac5-4623-ab92-d0d55a9bdac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:18.029047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d4554ac-7ac5-4623-ab92-d0d55a9bdac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:18.029486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d4554ac-7ac5-4623-ab92-d0d55a9bdac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:18.030203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d4554ac-7ac5-4623-ab92-d0d55a9bdac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:18.030658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d4554ac-7ac5-4623-ab92-d0d55a9bdac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:18.031092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d4554ac-7ac5-4623-ab92-d0d55a9bdac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:18.061117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3d4554ac-7ac5-4623-ab92-d0d55a9bdac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044484 Aug 18 22:04:18.061689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 875/1747] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:18 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:18.331837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3cabba09-3c5e-4872-82db-d2f20c0623d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:18.334032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3cabba09-3c5e-4872-82db-d2f20c0623d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:18.339921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cabba09-3c5e-4872-82db-d2f20c0623d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:18.340409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cabba09-3c5e-4872-82db-d2f20c0623d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:18.340851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cabba09-3c5e-4872-82db-d2f20c0623d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:18.341556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cabba09-3c5e-4872-82db-d2f20c0623d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:18.342039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cabba09-3c5e-4872-82db-d2f20c0623d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:18.342472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cabba09-3c5e-4872-82db-d2f20c0623d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:18.372021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3cabba09-3c5e-4872-82db-d2f20c0623d7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Aug 18 22:04:18.372572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 873/1748] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:18 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:18.653015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-373e50c6-b74c-4f8d-893b-e767000b1a42 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:18.655178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-373e50c6-b74c-4f8d-893b-e767000b1a42 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:18.661552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-373e50c6-b74c-4f8d-893b-e767000b1a42 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:18.662063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-373e50c6-b74c-4f8d-893b-e767000b1a42 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:18.662501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-373e50c6-b74c-4f8d-893b-e767000b1a42 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:18.663191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-373e50c6-b74c-4f8d-893b-e767000b1a42 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:18.664273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-373e50c6-b74c-4f8d-893b-e767000b1a42 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:18.664704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-373e50c6-b74c-4f8d-893b-e767000b1a42 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:18.678357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:18.694091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-373e50c6-b74c-4f8d-893b-e767000b1a42 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045009 Aug 18 22:04:18.694655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 876/1749] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:18 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:18.920641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-861fef2f-ee5d-4989-965f-e74ea5c33f75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:18.922805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-861fef2f-ee5d-4989-965f-e74ea5c33f75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:18.929524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-861fef2f-ee5d-4989-965f-e74ea5c33f75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:18.930033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-861fef2f-ee5d-4989-965f-e74ea5c33f75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:18.930486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-861fef2f-ee5d-4989-965f-e74ea5c33f75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:18.931159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-861fef2f-ee5d-4989-965f-e74ea5c33f75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:18.931610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-861fef2f-ee5d-4989-965f-e74ea5c33f75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:18.932033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-861fef2f-ee5d-4989-965f-e74ea5c33f75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:18.960838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-861fef2f-ee5d-4989-965f-e74ea5c33f75 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043466 Aug 18 22:04:18.961397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 874/1750] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:19.074017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b582433d-b628-4d46-9df3-69db39f5403c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:19.076236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b582433d-b628-4d46-9df3-69db39f5403c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:19.082453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b582433d-b628-4d46-9df3-69db39f5403c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:19.082974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b582433d-b628-4d46-9df3-69db39f5403c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:19.083413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b582433d-b628-4d46-9df3-69db39f5403c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:19.084121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b582433d-b628-4d46-9df3-69db39f5403c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:19.084611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b582433d-b628-4d46-9df3-69db39f5403c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:19.085128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b582433d-b628-4d46-9df3-69db39f5403c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:19.114761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b582433d-b628-4d46-9df3-69db39f5403c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045150 Aug 18 22:04:19.115246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 877/1751] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:19 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:19.384686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-888a7a2a-0e83-49bd-aa93-b6ac0cec53d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:19.386774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-888a7a2a-0e83-49bd-aa93-b6ac0cec53d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:19.393089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-888a7a2a-0e83-49bd-aa93-b6ac0cec53d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:19.393577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-888a7a2a-0e83-49bd-aa93-b6ac0cec53d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:19.394039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-888a7a2a-0e83-49bd-aa93-b6ac0cec53d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:19.394748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-888a7a2a-0e83-49bd-aa93-b6ac0cec53d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:19.395202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-888a7a2a-0e83-49bd-aa93-b6ac0cec53d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:19.395628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-888a7a2a-0e83-49bd-aa93-b6ac0cec53d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:19.425952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-888a7a2a-0e83-49bd-aa93-b6ac0cec53d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045849 Aug 18 22:04:19.426527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 875/1752] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:19 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:19.706794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d9cbdba-cbdb-4217-8c53-06efb820084b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:19.709281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1d9cbdba-cbdb-4217-8c53-06efb820084b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:19.715848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d9cbdba-cbdb-4217-8c53-06efb820084b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:19.716332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d9cbdba-cbdb-4217-8c53-06efb820084b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:19.716763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d9cbdba-cbdb-4217-8c53-06efb820084b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:19.717460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d9cbdba-cbdb-4217-8c53-06efb820084b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:19.717952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d9cbdba-cbdb-4217-8c53-06efb820084b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:19.718480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d9cbdba-cbdb-4217-8c53-06efb820084b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:19.749616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1d9cbdba-cbdb-4217-8c53-06efb820084b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046694 Aug 18 22:04:19.750204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 878/1753] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:19.972144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-97c0c99b-9021-4002-afc4-f756d6fcb175 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:19.974552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-97c0c99b-9021-4002-afc4-f756d6fcb175 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:19.981500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97c0c99b-9021-4002-afc4-f756d6fcb175 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:19.982019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97c0c99b-9021-4002-afc4-f756d6fcb175 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:19.982462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97c0c99b-9021-4002-afc4-f756d6fcb175 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:19.983160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97c0c99b-9021-4002-afc4-f756d6fcb175 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:19.983626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97c0c99b-9021-4002-afc4-f756d6fcb175 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:19.984063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97c0c99b-9021-4002-afc4-f756d6fcb175 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:20.001157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:20.014067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-97c0c99b-9021-4002-afc4-f756d6fcb175 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045967 Aug 18 22:04:20.014624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 876/1754] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:19 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:20.127413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5cbb088a-1556-457b-97ae-890f52730bc6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:20.129558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5cbb088a-1556-457b-97ae-890f52730bc6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:20.135449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbb088a-1556-457b-97ae-890f52730bc6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:20.135927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbb088a-1556-457b-97ae-890f52730bc6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:20.136360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbb088a-1556-457b-97ae-890f52730bc6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:20.137051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbb088a-1556-457b-97ae-890f52730bc6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:20.137502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbb088a-1556-457b-97ae-890f52730bc6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:20.137961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cbb088a-1556-457b-97ae-890f52730bc6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:20.167100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5cbb088a-1556-457b-97ae-890f52730bc6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043714 Aug 18 22:04:20.167652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 879/1755] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:20.439046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-254d432a-9cef-4c74-b2b1-2b51bc38984e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:20.441170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-254d432a-9cef-4c74-b2b1-2b51bc38984e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:20.447658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-254d432a-9cef-4c74-b2b1-2b51bc38984e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:20.448134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-254d432a-9cef-4c74-b2b1-2b51bc38984e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:20.448564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-254d432a-9cef-4c74-b2b1-2b51bc38984e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:20.449248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-254d432a-9cef-4c74-b2b1-2b51bc38984e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:20.449727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-254d432a-9cef-4c74-b2b1-2b51bc38984e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:20.450149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-254d432a-9cef-4c74-b2b1-2b51bc38984e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:20.479812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-254d432a-9cef-4c74-b2b1-2b51bc38984e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Aug 18 22:04:20.480374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 877/1756] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:20 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:20.761794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2547cab4-92d3-42b9-a031-0f98c545bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:20.763929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2547cab4-92d3-42b9-a031-0f98c545bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:20.770310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2547cab4-92d3-42b9-a031-0f98c545bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:20.770785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2547cab4-92d3-42b9-a031-0f98c545bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:20.771219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2547cab4-92d3-42b9-a031-0f98c545bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:20.771913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2547cab4-92d3-42b9-a031-0f98c545bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:20.772363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2547cab4-92d3-42b9-a031-0f98c545bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:20.773455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2547cab4-92d3-42b9-a031-0f98c545bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:20.805334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2547cab4-92d3-42b9-a031-0f98c545bbd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047987 Aug 18 22:04:20.805930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 880/1757] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:20 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:21.026517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-59cd2ee1-5859-41cc-bd20-32bfac270936 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:21.028853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-59cd2ee1-5859-41cc-bd20-32bfac270936 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:21.038918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59cd2ee1-5859-41cc-bd20-32bfac270936 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:21.039405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59cd2ee1-5859-41cc-bd20-32bfac270936 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:21.039840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59cd2ee1-5859-41cc-bd20-32bfac270936 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:21.040541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59cd2ee1-5859-41cc-bd20-32bfac270936 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:21.042129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59cd2ee1-5859-41cc-bd20-32bfac270936 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:21.042563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59cd2ee1-5859-41cc-bd20-32bfac270936 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:21.072154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-59cd2ee1-5859-41cc-bd20-32bfac270936 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049600 Aug 18 22:04:21.072710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 878/1758] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:21 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:21.180230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f8ec1f00-33fd-4a17-9c90-97fbe5e9a2d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:21.182392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f8ec1f00-33fd-4a17-9c90-97fbe5e9a2d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:21.188543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8ec1f00-33fd-4a17-9c90-97fbe5e9a2d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:21.189023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8ec1f00-33fd-4a17-9c90-97fbe5e9a2d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:21.189457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8ec1f00-33fd-4a17-9c90-97fbe5e9a2d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:21.190229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8ec1f00-33fd-4a17-9c90-97fbe5e9a2d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:21.190645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8ec1f00-33fd-4a17-9c90-97fbe5e9a2d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:21.191070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8ec1f00-33fd-4a17-9c90-97fbe5e9a2d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:21.220005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f8ec1f00-33fd-4a17-9c90-97fbe5e9a2d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044235 Aug 18 22:04:21.220549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 881/1759] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:21.492883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2588ed0e-6a9c-4fbc-8d78-51f863bd4796 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:21.495064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2588ed0e-6a9c-4fbc-8d78-51f863bd4796 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:21.500942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2588ed0e-6a9c-4fbc-8d78-51f863bd4796 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:21.501427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2588ed0e-6a9c-4fbc-8d78-51f863bd4796 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:21.501904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2588ed0e-6a9c-4fbc-8d78-51f863bd4796 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:21.502609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2588ed0e-6a9c-4fbc-8d78-51f863bd4796 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:21.503068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2588ed0e-6a9c-4fbc-8d78-51f863bd4796 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:21.503501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2588ed0e-6a9c-4fbc-8d78-51f863bd4796 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:21.533259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2588ed0e-6a9c-4fbc-8d78-51f863bd4796 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 Aug 18 22:04:21.533856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 879/1760] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:21 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:21.817512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-88263549-fe35-4968-bbbc-d49e15a57942 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:21.819710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-88263549-fe35-4968-bbbc-d49e15a57942 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:21.827499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88263549-fe35-4968-bbbc-d49e15a57942 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:21.827999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88263549-fe35-4968-bbbc-d49e15a57942 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:21.828443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88263549-fe35-4968-bbbc-d49e15a57942 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:21.829196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88263549-fe35-4968-bbbc-d49e15a57942 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:21.829655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88263549-fe35-4968-bbbc-d49e15a57942 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:21.830086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88263549-fe35-4968-bbbc-d49e15a57942 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:21.860570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-88263549-fe35-4968-bbbc-d49e15a57942 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047546 Aug 18 22:04:21.861122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 882/1761] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:22.084590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-44c69ab4-725c-41ab-b2ea-47b451be23ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:22.087535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-44c69ab4-725c-41ab-b2ea-47b451be23ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:22.094007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44c69ab4-725c-41ab-b2ea-47b451be23ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:22.094495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44c69ab4-725c-41ab-b2ea-47b451be23ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:22.094937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44c69ab4-725c-41ab-b2ea-47b451be23ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:22.095642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44c69ab4-725c-41ab-b2ea-47b451be23ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:22.096416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44c69ab4-725c-41ab-b2ea-47b451be23ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:22.096566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44c69ab4-725c-41ab-b2ea-47b451be23ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:22.125306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-44c69ab4-725c-41ab-b2ea-47b451be23ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044575 Aug 18 22:04:22.125918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 880/1762] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:22 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:22.232391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9fead287-9b8a-4315-a59a-0197ef215795 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:22.234618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9fead287-9b8a-4315-a59a-0197ef215795 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:22.240517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fead287-9b8a-4315-a59a-0197ef215795 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:22.240985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fead287-9b8a-4315-a59a-0197ef215795 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:22.241412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fead287-9b8a-4315-a59a-0197ef215795 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:22.242124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fead287-9b8a-4315-a59a-0197ef215795 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:22.242572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fead287-9b8a-4315-a59a-0197ef215795 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:22.242989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fead287-9b8a-4315-a59a-0197ef215795 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:22.271307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9fead287-9b8a-4315-a59a-0197ef215795 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042896 Aug 18 22:04:22.271861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 883/1763] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:22 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:22.545669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-905d1c1c-9d3d-45ba-a6e4-c95f175748e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:22.547798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-905d1c1c-9d3d-45ba-a6e4-c95f175748e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:22.554523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905d1c1c-9d3d-45ba-a6e4-c95f175748e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:22.554999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905d1c1c-9d3d-45ba-a6e4-c95f175748e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:22.555433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905d1c1c-9d3d-45ba-a6e4-c95f175748e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:22.556120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905d1c1c-9d3d-45ba-a6e4-c95f175748e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:22.556573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905d1c1c-9d3d-45ba-a6e4-c95f175748e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:22.557002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905d1c1c-9d3d-45ba-a6e4-c95f175748e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:22.585605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-905d1c1c-9d3d-45ba-a6e4-c95f175748e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Aug 18 22:04:22.586185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 881/1764] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:22.878431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2620bc33-e588-4208-a4fe-8132708a2d83 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:22.880579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2620bc33-e588-4208-a4fe-8132708a2d83 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:22.886953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2620bc33-e588-4208-a4fe-8132708a2d83 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:22.887452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2620bc33-e588-4208-a4fe-8132708a2d83 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:22.887881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2620bc33-e588-4208-a4fe-8132708a2d83 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:22.888615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2620bc33-e588-4208-a4fe-8132708a2d83 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:22.889066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2620bc33-e588-4208-a4fe-8132708a2d83 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:22.889493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2620bc33-e588-4208-a4fe-8132708a2d83 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:22.918414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2620bc33-e588-4208-a4fe-8132708a2d83 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043903 Aug 18 22:04:22.918957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 884/1765] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:23.137551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2e7f7727-1fef-4070-9e8f-a6e225ca7862 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:23.139749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2e7f7727-1fef-4070-9e8f-a6e225ca7862 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:23.146294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e7f7727-1fef-4070-9e8f-a6e225ca7862 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:23.146787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e7f7727-1fef-4070-9e8f-a6e225ca7862 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:23.147232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e7f7727-1fef-4070-9e8f-a6e225ca7862 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:23.148425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e7f7727-1fef-4070-9e8f-a6e225ca7862 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:23.148888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e7f7727-1fef-4070-9e8f-a6e225ca7862 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:23.149319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e7f7727-1fef-4070-9e8f-a6e225ca7862 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:23.178742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2e7f7727-1fef-4070-9e8f-a6e225ca7862 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045133 Aug 18 22:04:23.179328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 882/1766] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:23 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:23.284727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c63b7a2c-a15f-4fe8-82f3-395e7d67f507 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:23.286893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c63b7a2c-a15f-4fe8-82f3-395e7d67f507 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:23.293643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c63b7a2c-a15f-4fe8-82f3-395e7d67f507 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:23.294119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c63b7a2c-a15f-4fe8-82f3-395e7d67f507 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:23.294548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c63b7a2c-a15f-4fe8-82f3-395e7d67f507 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:23.295227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c63b7a2c-a15f-4fe8-82f3-395e7d67f507 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:23.295675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c63b7a2c-a15f-4fe8-82f3-395e7d67f507 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:23.296100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c63b7a2c-a15f-4fe8-82f3-395e7d67f507 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:23.324604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c63b7a2c-a15f-4fe8-82f3-395e7d67f507 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Aug 18 22:04:23.325147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 885/1767] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:23 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:23.598031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-818b5351-2c1a-4cfc-85eb-abd48afbad1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:23.600169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-818b5351-2c1a-4cfc-85eb-abd48afbad1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:23.606435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-818b5351-2c1a-4cfc-85eb-abd48afbad1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:23.606943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-818b5351-2c1a-4cfc-85eb-abd48afbad1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:23.607462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-818b5351-2c1a-4cfc-85eb-abd48afbad1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:23.608167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-818b5351-2c1a-4cfc-85eb-abd48afbad1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:23.608732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-818b5351-2c1a-4cfc-85eb-abd48afbad1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:23.609039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-818b5351-2c1a-4cfc-85eb-abd48afbad1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:23.638292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-818b5351-2c1a-4cfc-85eb-abd48afbad1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Aug 18 22:04:23.638846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 883/1768] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:23 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:23.938149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6ace6286-2074-452a-8f68-8a9f650ca7c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:23.940551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6ace6286-2074-452a-8f68-8a9f650ca7c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:23.947761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ace6286-2074-452a-8f68-8a9f650ca7c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:23.948267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ace6286-2074-452a-8f68-8a9f650ca7c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:23.948710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ace6286-2074-452a-8f68-8a9f650ca7c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:23.949418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ace6286-2074-452a-8f68-8a9f650ca7c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:23.949898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ace6286-2074-452a-8f68-8a9f650ca7c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:23.950326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ace6286-2074-452a-8f68-8a9f650ca7c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:23.979022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6ace6286-2074-452a-8f68-8a9f650ca7c2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047550 Aug 18 22:04:23.979589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 886/1769] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:24.191111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5a963696-71e3-4edd-ac3e-925175a284c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:24.193147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5a963696-71e3-4edd-ac3e-925175a284c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:24.200186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a963696-71e3-4edd-ac3e-925175a284c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:24.200669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a963696-71e3-4edd-ac3e-925175a284c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:24.201104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a963696-71e3-4edd-ac3e-925175a284c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:24.201832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a963696-71e3-4edd-ac3e-925175a284c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:24.203143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a963696-71e3-4edd-ac3e-925175a284c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:24.203143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a963696-71e3-4edd-ac3e-925175a284c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:24.232337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5a963696-71e3-4edd-ac3e-925175a284c0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045255 Aug 18 22:04:24.232886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 884/1770] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:24.336972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f81aaa0b-ad50-407f-afb9-0f2a4228d89c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:24.339158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f81aaa0b-ad50-407f-afb9-0f2a4228d89c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:24.345368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f81aaa0b-ad50-407f-afb9-0f2a4228d89c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:24.345883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f81aaa0b-ad50-407f-afb9-0f2a4228d89c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:24.346327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f81aaa0b-ad50-407f-afb9-0f2a4228d89c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:24.347030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f81aaa0b-ad50-407f-afb9-0f2a4228d89c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:24.347491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f81aaa0b-ad50-407f-afb9-0f2a4228d89c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:24.347924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f81aaa0b-ad50-407f-afb9-0f2a4228d89c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:24.377354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f81aaa0b-ad50-407f-afb9-0f2a4228d89c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Aug 18 22:04:24.377948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 887/1771] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:24 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:24.650829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7ba4b625-ca47-44e3-966f-61021009fc85 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:24.652994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7ba4b625-ca47-44e3-966f-61021009fc85 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:24.659300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ba4b625-ca47-44e3-966f-61021009fc85 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:24.659782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ba4b625-ca47-44e3-966f-61021009fc85 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:24.660220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ba4b625-ca47-44e3-966f-61021009fc85 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:24.660937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ba4b625-ca47-44e3-966f-61021009fc85 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:24.661394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ba4b625-ca47-44e3-966f-61021009fc85 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:24.661846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ba4b625-ca47-44e3-966f-61021009fc85 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:24.691952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7ba4b625-ca47-44e3-966f-61021009fc85 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 Aug 18 22:04:24.692523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 885/1772] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:24 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:24.991332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eec0285a-2e37-4601-b506-5c1d113c537d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:24.993535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eec0285a-2e37-4601-b506-5c1d113c537d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:25.002095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eec0285a-2e37-4601-b506-5c1d113c537d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:25.002617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eec0285a-2e37-4601-b506-5c1d113c537d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:25.003082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eec0285a-2e37-4601-b506-5c1d113c537d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:25.004002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eec0285a-2e37-4601-b506-5c1d113c537d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:25.004489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eec0285a-2e37-4601-b506-5c1d113c537d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:25.004923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eec0285a-2e37-4601-b506-5c1d113c537d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:25.035012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eec0285a-2e37-4601-b506-5c1d113c537d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047640 Aug 18 22:04:25.035571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 888/1773] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:24 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:04:25.244626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5418d580-de31-46f3-a3f3-b9a9ac606693 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:25.246736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5418d580-de31-46f3-a3f3-b9a9ac606693 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:25.249071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:25.254311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5418d580-de31-46f3-a3f3-b9a9ac606693 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:25.254797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5418d580-de31-46f3-a3f3-b9a9ac606693 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:25.255234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5418d580-de31-46f3-a3f3-b9a9ac606693 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:25.255933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5418d580-de31-46f3-a3f3-b9a9ac606693 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:25.256385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5418d580-de31-46f3-a3f3-b9a9ac606693 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:25.256813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5418d580-de31-46f3-a3f3-b9a9ac606693 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:25.286230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5418d580-de31-46f3-a3f3-b9a9ac606693 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045665 Aug 18 22:04:25.286779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 886/1774] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:25 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:25.389394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-be3ec3de-f270-4119-bab5-ff743da610d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:25.391562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-be3ec3de-f270-4119-bab5-ff743da610d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:25.397727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be3ec3de-f270-4119-bab5-ff743da610d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:25.398207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be3ec3de-f270-4119-bab5-ff743da610d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:25.398644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be3ec3de-f270-4119-bab5-ff743da610d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:25.399339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be3ec3de-f270-4119-bab5-ff743da610d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:25.399790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be3ec3de-f270-4119-bab5-ff743da610d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:25.400214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be3ec3de-f270-4119-bab5-ff743da610d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:25.429636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-be3ec3de-f270-4119-bab5-ff743da610d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043659 Aug 18 22:04:25.430192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 889/1775] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:25 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:25.704162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-082514d6-43ca-4d3a-a53f-942c646ca161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:25.706389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-082514d6-43ca-4d3a-a53f-942c646ca161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:25.712290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-082514d6-43ca-4d3a-a53f-942c646ca161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:25.712775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-082514d6-43ca-4d3a-a53f-942c646ca161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:25.713219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-082514d6-43ca-4d3a-a53f-942c646ca161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:25.713956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-082514d6-43ca-4d3a-a53f-942c646ca161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:25.714419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-082514d6-43ca-4d3a-a53f-942c646ca161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:25.714853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-082514d6-43ca-4d3a-a53f-942c646ca161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:25.745100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-082514d6-43ca-4d3a-a53f-942c646ca161 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Aug 18 22:04:25.745690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 887/1776] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:26.047948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-02ae45dc-da17-44c9-91c9-6a538af4925f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:26.050369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-02ae45dc-da17-44c9-91c9-6a538af4925f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:26.057910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02ae45dc-da17-44c9-91c9-6a538af4925f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:26.058399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02ae45dc-da17-44c9-91c9-6a538af4925f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:26.058840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02ae45dc-da17-44c9-91c9-6a538af4925f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:26.059546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02ae45dc-da17-44c9-91c9-6a538af4925f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:26.060008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02ae45dc-da17-44c9-91c9-6a538af4925f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:26.060441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-02ae45dc-da17-44c9-91c9-6a538af4925f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:26.089282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-02ae45dc-da17-44c9-91c9-6a538af4925f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045983 Aug 18 22:04:26.089839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 890/1777] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:26 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:26.298437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2402c77f-2fbc-42de-86b3-6567cf1081df tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:26.300813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2402c77f-2fbc-42de-86b3-6567cf1081df tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:26.307130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2402c77f-2fbc-42de-86b3-6567cf1081df tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:26.307605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2402c77f-2fbc-42de-86b3-6567cf1081df tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:26.308034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2402c77f-2fbc-42de-86b3-6567cf1081df tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:26.308718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2402c77f-2fbc-42de-86b3-6567cf1081df tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:26.309167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2402c77f-2fbc-42de-86b3-6567cf1081df tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:26.309587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2402c77f-2fbc-42de-86b3-6567cf1081df tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:26.337963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2402c77f-2fbc-42de-86b3-6567cf1081df tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043400 Aug 18 22:04:26.338513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 888/1778] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:26 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:26.441099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3fbb49bf-82e6-4b9d-917b-b16e36887be3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:26.443264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3fbb49bf-82e6-4b9d-917b-b16e36887be3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:26.449554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fbb49bf-82e6-4b9d-917b-b16e36887be3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:26.450061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fbb49bf-82e6-4b9d-917b-b16e36887be3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:26.450494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fbb49bf-82e6-4b9d-917b-b16e36887be3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:26.451180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fbb49bf-82e6-4b9d-917b-b16e36887be3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:26.451626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fbb49bf-82e6-4b9d-917b-b16e36887be3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:26.452044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fbb49bf-82e6-4b9d-917b-b16e36887be3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:26.480561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3fbb49bf-82e6-4b9d-917b-b16e36887be3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043595 Aug 18 22:04:26.481106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 891/1779] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:26 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:26.756629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8108eceb-a477-4601-8f16-884cf3fafea1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:26.759343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8108eceb-a477-4601-8f16-884cf3fafea1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:26.765290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8108eceb-a477-4601-8f16-884cf3fafea1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:26.765813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8108eceb-a477-4601-8f16-884cf3fafea1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:26.766248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8108eceb-a477-4601-8f16-884cf3fafea1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:26.766930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8108eceb-a477-4601-8f16-884cf3fafea1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:26.767378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8108eceb-a477-4601-8f16-884cf3fafea1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:26.767798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8108eceb-a477-4601-8f16-884cf3fafea1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:26.796277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8108eceb-a477-4601-8f16-884cf3fafea1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043579 Aug 18 22:04:26.796894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 889/1780] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:26 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:27.100970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-70e6736b-2906-4a6f-a036-21761c231454 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:27.103601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-70e6736b-2906-4a6f-a036-21761c231454 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:27.110018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70e6736b-2906-4a6f-a036-21761c231454 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:27.110542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70e6736b-2906-4a6f-a036-21761c231454 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:27.110983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70e6736b-2906-4a6f-a036-21761c231454 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:27.111791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70e6736b-2906-4a6f-a036-21761c231454 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:27.112254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70e6736b-2906-4a6f-a036-21761c231454 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:27.112688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70e6736b-2906-4a6f-a036-21761c231454 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:27.142706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-70e6736b-2906-4a6f-a036-21761c231454 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045813 Aug 18 22:04:27.143269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 892/1781] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:27 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:27.350263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-39877f52-2369-4120-9c53-4d398f4d9cdf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:27.352895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-39877f52-2369-4120-9c53-4d398f4d9cdf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:27.359431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39877f52-2369-4120-9c53-4d398f4d9cdf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:27.359914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39877f52-2369-4120-9c53-4d398f4d9cdf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:27.360354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39877f52-2369-4120-9c53-4d398f4d9cdf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:27.361087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39877f52-2369-4120-9c53-4d398f4d9cdf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:27.361547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39877f52-2369-4120-9c53-4d398f4d9cdf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:27.362006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39877f52-2369-4120-9c53-4d398f4d9cdf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:27.390704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-39877f52-2369-4120-9c53-4d398f4d9cdf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044417 Aug 18 22:04:27.391418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 890/1782] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:27 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:27.492778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-288189cd-2ec8-41c5-b86b-a157fa7733dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:27.494958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-288189cd-2ec8-41c5-b86b-a157fa7733dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:27.501406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-288189cd-2ec8-41c5-b86b-a157fa7733dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:27.501922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-288189cd-2ec8-41c5-b86b-a157fa7733dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:27.502355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-288189cd-2ec8-41c5-b86b-a157fa7733dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:27.503046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-288189cd-2ec8-41c5-b86b-a157fa7733dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:27.503500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-288189cd-2ec8-41c5-b86b-a157fa7733dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:27.503921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-288189cd-2ec8-41c5-b86b-a157fa7733dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:27.506266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:27.535047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-288189cd-2ec8-41c5-b86b-a157fa7733dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046226 Aug 18 22:04:27.535606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 893/1783] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:27 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:27.808951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bbb70ab8-fa9e-4031-87b9-ed9df7d37a2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:27.811115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bbb70ab8-fa9e-4031-87b9-ed9df7d37a2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:27.817204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbb70ab8-fa9e-4031-87b9-ed9df7d37a2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:27.817729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbb70ab8-fa9e-4031-87b9-ed9df7d37a2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:27.818175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbb70ab8-fa9e-4031-87b9-ed9df7d37a2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:27.818892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbb70ab8-fa9e-4031-87b9-ed9df7d37a2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:27.819338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbb70ab8-fa9e-4031-87b9-ed9df7d37a2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:27.820417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbb70ab8-fa9e-4031-87b9-ed9df7d37a2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:27.848855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bbb70ab8-fa9e-4031-87b9-ed9df7d37a2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Aug 18 22:04:27.849409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 891/1784] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:28.154683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1c6b1809-1d57-4ea2-9175-a5ff7817369d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:28.156832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1c6b1809-1d57-4ea2-9175-a5ff7817369d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:28.163704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6b1809-1d57-4ea2-9175-a5ff7817369d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:28.164189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6b1809-1d57-4ea2-9175-a5ff7817369d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:28.164622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6b1809-1d57-4ea2-9175-a5ff7817369d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:28.165320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6b1809-1d57-4ea2-9175-a5ff7817369d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:28.165868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6b1809-1d57-4ea2-9175-a5ff7817369d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:28.166214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6b1809-1d57-4ea2-9175-a5ff7817369d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:28.196582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1c6b1809-1d57-4ea2-9175-a5ff7817369d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045710 Aug 18 22:04:28.197131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 894/1785] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:28.403918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-679a8910-b691-479d-9195-b4fd671e8a76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:28.405999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-679a8910-b691-479d-9195-b4fd671e8a76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:28.412021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-679a8910-b691-479d-9195-b4fd671e8a76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:28.412495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-679a8910-b691-479d-9195-b4fd671e8a76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:28.412927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-679a8910-b691-479d-9195-b4fd671e8a76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:28.414301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-679a8910-b691-479d-9195-b4fd671e8a76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:28.414751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-679a8910-b691-479d-9195-b4fd671e8a76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:28.415175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-679a8910-b691-479d-9195-b4fd671e8a76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:28.443542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-679a8910-b691-479d-9195-b4fd671e8a76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043882 Aug 18 22:04:28.444095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 892/1786] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:28 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:28.547286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-85f81df9-8319-463f-a0d4-dcb9a521414f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:28.549439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-85f81df9-8319-463f-a0d4-dcb9a521414f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:28.555628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-85f81df9-8319-463f-a0d4-dcb9a521414f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:28.556105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-85f81df9-8319-463f-a0d4-dcb9a521414f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:28.556543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-85f81df9-8319-463f-a0d4-dcb9a521414f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:28.557230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-85f81df9-8319-463f-a0d4-dcb9a521414f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:28.557720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-85f81df9-8319-463f-a0d4-dcb9a521414f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:28.558147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-85f81df9-8319-463f-a0d4-dcb9a521414f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:28.586558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-85f81df9-8319-463f-a0d4-dcb9a521414f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043179 Aug 18 22:04:28.587105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 895/1787] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:28 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:28.861976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f0d0945e-e38e-4e21-9b2c-c32da882bf1a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:28.864117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f0d0945e-e38e-4e21-9b2c-c32da882bf1a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:28.870560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0d0945e-e38e-4e21-9b2c-c32da882bf1a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:28.871044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0d0945e-e38e-4e21-9b2c-c32da882bf1a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:28.871483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0d0945e-e38e-4e21-9b2c-c32da882bf1a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:28.872183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0d0945e-e38e-4e21-9b2c-c32da882bf1a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:28.872643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0d0945e-e38e-4e21-9b2c-c32da882bf1a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:28.873071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0d0945e-e38e-4e21-9b2c-c32da882bf1a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:28.876751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:28.903979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f0d0945e-e38e-4e21-9b2c-c32da882bf1a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046851 Aug 18 22:04:28.904535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 893/1788] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:29.208779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ed4a5c2-c2d9-4820-b2e6-898980900d6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:29.211058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ed4a5c2-c2d9-4820-b2e6-898980900d6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:29.218535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ed4a5c2-c2d9-4820-b2e6-898980900d6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:29.219053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ed4a5c2-c2d9-4820-b2e6-898980900d6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:29.219499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ed4a5c2-c2d9-4820-b2e6-898980900d6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:29.220250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ed4a5c2-c2d9-4820-b2e6-898980900d6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:29.220706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ed4a5c2-c2d9-4820-b2e6-898980900d6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:29.221291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ed4a5c2-c2d9-4820-b2e6-898980900d6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:29.255752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ed4a5c2-c2d9-4820-b2e6-898980900d6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050910 Aug 18 22:04:29.256503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 896/1789] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:29.289528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6c890f70-efba-4291-a844-2c9df5458695 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:29.291670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6c890f70-efba-4291-a844-2c9df5458695 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:29.297925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c890f70-efba-4291-a844-2c9df5458695 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:29.298403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c890f70-efba-4291-a844-2c9df5458695 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:29.298836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c890f70-efba-4291-a844-2c9df5458695 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:29.299520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c890f70-efba-4291-a844-2c9df5458695 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:29.300230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c890f70-efba-4291-a844-2c9df5458695 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:29.300648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c890f70-efba-4291-a844-2c9df5458695 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:29.329979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6c890f70-efba-4291-a844-2c9df5458695 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044257 Aug 18 22:04:29.330545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 894/1790] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:29 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:29.455612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-faa016ee-392f-47d6-8ff2-2b5d900864e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:29.457735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-faa016ee-392f-47d6-8ff2-2b5d900864e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:29.463658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faa016ee-392f-47d6-8ff2-2b5d900864e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:29.464168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faa016ee-392f-47d6-8ff2-2b5d900864e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:29.464604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faa016ee-392f-47d6-8ff2-2b5d900864e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:29.465293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faa016ee-392f-47d6-8ff2-2b5d900864e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:29.465773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faa016ee-392f-47d6-8ff2-2b5d900864e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:29.466200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faa016ee-392f-47d6-8ff2-2b5d900864e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:29.494980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-faa016ee-392f-47d6-8ff2-2b5d900864e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043410 Aug 18 22:04:29.495532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 897/1791] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:29 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:29.598719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e46f0550-764f-46dd-a41b-d72625572880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:29.601347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e46f0550-764f-46dd-a41b-d72625572880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:29.607334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e46f0550-764f-46dd-a41b-d72625572880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:29.607825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e46f0550-764f-46dd-a41b-d72625572880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:29.608269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e46f0550-764f-46dd-a41b-d72625572880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:29.609067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e46f0550-764f-46dd-a41b-d72625572880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:29.609531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e46f0550-764f-46dd-a41b-d72625572880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:29.610010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e46f0550-764f-46dd-a41b-d72625572880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:29.639452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e46f0550-764f-46dd-a41b-d72625572880 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Aug 18 22:04:29.640105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 895/1792] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:29 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:29.916883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5bc1b597-cb51-43a4-b459-ac2453ade658 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:29.919061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5bc1b597-cb51-43a4-b459-ac2453ade658 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:29.925132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bc1b597-cb51-43a4-b459-ac2453ade658 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:29.925642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bc1b597-cb51-43a4-b459-ac2453ade658 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:29.926079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bc1b597-cb51-43a4-b459-ac2453ade658 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:29.926773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bc1b597-cb51-43a4-b459-ac2453ade658 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:29.927221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bc1b597-cb51-43a4-b459-ac2453ade658 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:29.927645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bc1b597-cb51-43a4-b459-ac2453ade658 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:29.955843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5bc1b597-cb51-43a4-b459-ac2453ade658 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043480 Aug 18 22:04:29.956395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 898/1793] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:29 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:30.268935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3ccaaae9-1f68-499b-b393-3c76643620ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:30.271088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3ccaaae9-1f68-499b-b393-3c76643620ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:30.278041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ccaaae9-1f68-499b-b393-3c76643620ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:30.278798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ccaaae9-1f68-499b-b393-3c76643620ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:30.279235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ccaaae9-1f68-499b-b393-3c76643620ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:30.279945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ccaaae9-1f68-499b-b393-3c76643620ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:30.280397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ccaaae9-1f68-499b-b393-3c76643620ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:30.280820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ccaaae9-1f68-499b-b393-3c76643620ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:30.309967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3ccaaae9-1f68-499b-b393-3c76643620ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044969 Aug 18 22:04:30.310522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 896/1794] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:30.342323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c529f4dd-ac1b-4b29-8750-1427d40a48f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:30.344449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c529f4dd-ac1b-4b29-8750-1427d40a48f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:30.350764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c529f4dd-ac1b-4b29-8750-1427d40a48f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:30.351242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c529f4dd-ac1b-4b29-8750-1427d40a48f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:30.351675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c529f4dd-ac1b-4b29-8750-1427d40a48f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:30.352365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c529f4dd-ac1b-4b29-8750-1427d40a48f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:30.352817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c529f4dd-ac1b-4b29-8750-1427d40a48f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:30.353240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c529f4dd-ac1b-4b29-8750-1427d40a48f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:30.381436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c529f4dd-ac1b-4b29-8750-1427d40a48f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042985 Aug 18 22:04:30.382596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 899/1795] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:30.507909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c4a7f47c-3bb4-4376-a437-8521ad40ad78 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:30.509999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c4a7f47c-3bb4-4376-a437-8521ad40ad78 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:30.515989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4a7f47c-3bb4-4376-a437-8521ad40ad78 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:30.516551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4a7f47c-3bb4-4376-a437-8521ad40ad78 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:30.516994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4a7f47c-3bb4-4376-a437-8521ad40ad78 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:30.517733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4a7f47c-3bb4-4376-a437-8521ad40ad78 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:30.518194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4a7f47c-3bb4-4376-a437-8521ad40ad78 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:30.518627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4a7f47c-3bb4-4376-a437-8521ad40ad78 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:30.547304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c4a7f47c-3bb4-4376-a437-8521ad40ad78 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044033 Aug 18 22:04:30.547869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 897/1796] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:30.651729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d8a4598-157d-4450-88d3-2b2470216c14 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:30.653933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7d8a4598-157d-4450-88d3-2b2470216c14 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:30.659770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d8a4598-157d-4450-88d3-2b2470216c14 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:30.660249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d8a4598-157d-4450-88d3-2b2470216c14 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:30.660709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d8a4598-157d-4450-88d3-2b2470216c14 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:30.661401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d8a4598-157d-4450-88d3-2b2470216c14 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:30.661885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d8a4598-157d-4450-88d3-2b2470216c14 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:30.662310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d8a4598-157d-4450-88d3-2b2470216c14 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:30.691349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d8a4598-157d-4450-88d3-2b2470216c14 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043485 Aug 18 22:04:30.691918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 900/1797] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:30 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:30.968537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0d0dcbc1-2120-4d3e-aec9-ed4244350ec7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:30.970719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0d0dcbc1-2120-4d3e-aec9-ed4244350ec7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:30.977160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d0dcbc1-2120-4d3e-aec9-ed4244350ec7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:30.977668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d0dcbc1-2120-4d3e-aec9-ed4244350ec7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:30.978113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d0dcbc1-2120-4d3e-aec9-ed4244350ec7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:30.978815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d0dcbc1-2120-4d3e-aec9-ed4244350ec7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:30.979273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d0dcbc1-2120-4d3e-aec9-ed4244350ec7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:30.979706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d0dcbc1-2120-4d3e-aec9-ed4244350ec7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:31.014408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0d0dcbc1-2120-4d3e-aec9-ed4244350ec7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049852 Aug 18 22:04:31.015082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 898/1798] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:30 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:31.321330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4ac2c31b-fa14-41b7-a8b8-c4c174c14909 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:31.323595 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4ac2c31b-fa14-41b7-a8b8-c4c174c14909 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:31.329660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ac2c31b-fa14-41b7-a8b8-c4c174c14909 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:31.330180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ac2c31b-fa14-41b7-a8b8-c4c174c14909 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:31.330623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ac2c31b-fa14-41b7-a8b8-c4c174c14909 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:31.331329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ac2c31b-fa14-41b7-a8b8-c4c174c14909 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:31.331788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ac2c31b-fa14-41b7-a8b8-c4c174c14909 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:31.332220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ac2c31b-fa14-41b7-a8b8-c4c174c14909 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:31.366444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4ac2c31b-fa14-41b7-a8b8-c4c174c14909 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048881 Aug 18 22:04:31.367268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 901/1799] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:31 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:31.394300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dd972e60-3aa7-404b-b485-eeae2ddbe539 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:31.396464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dd972e60-3aa7-404b-b485-eeae2ddbe539 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:31.403287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd972e60-3aa7-404b-b485-eeae2ddbe539 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:31.403766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd972e60-3aa7-404b-b485-eeae2ddbe539 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:31.404206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd972e60-3aa7-404b-b485-eeae2ddbe539 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:31.404892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd972e60-3aa7-404b-b485-eeae2ddbe539 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:31.405353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd972e60-3aa7-404b-b485-eeae2ddbe539 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:31.405811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd972e60-3aa7-404b-b485-eeae2ddbe539 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:31.435224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dd972e60-3aa7-404b-b485-eeae2ddbe539 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 Aug 18 22:04:31.435778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 899/1800] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:31.559649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9f5bb565-3b79-4d2b-a9b0-c7f68e32064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:31.561815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9f5bb565-3b79-4d2b-a9b0-c7f68e32064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:31.567680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f5bb565-3b79-4d2b-a9b0-c7f68e32064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:31.568158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f5bb565-3b79-4d2b-a9b0-c7f68e32064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:31.568597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f5bb565-3b79-4d2b-a9b0-c7f68e32064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:31.569288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f5bb565-3b79-4d2b-a9b0-c7f68e32064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:31.569782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f5bb565-3b79-4d2b-a9b0-c7f68e32064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:31.570217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f5bb565-3b79-4d2b-a9b0-c7f68e32064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:31.598455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9f5bb565-3b79-4d2b-a9b0-c7f68e32064b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042736 Aug 18 22:04:31.599002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 902/1801] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:31 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:31.704365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b8a4f0c1-4435-4291-b23c-4fbc74c0f05d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:31.706594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b8a4f0c1-4435-4291-b23c-4fbc74c0f05d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:31.713294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8a4f0c1-4435-4291-b23c-4fbc74c0f05d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:31.713806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8a4f0c1-4435-4291-b23c-4fbc74c0f05d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:31.714242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8a4f0c1-4435-4291-b23c-4fbc74c0f05d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:31.714946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8a4f0c1-4435-4291-b23c-4fbc74c0f05d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:31.715401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8a4f0c1-4435-4291-b23c-4fbc74c0f05d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:31.715834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8a4f0c1-4435-4291-b23c-4fbc74c0f05d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:31.744692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b8a4f0c1-4435-4291-b23c-4fbc74c0f05d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044238 Aug 18 22:04:31.745247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 900/1802] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:32.026836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e2c9fb28-b247-415c-8425-2e9cf54b7c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:32.028960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e2c9fb28-b247-415c-8425-2e9cf54b7c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:32.034862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c9fb28-b247-415c-8425-2e9cf54b7c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:32.035335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c9fb28-b247-415c-8425-2e9cf54b7c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:32.035767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c9fb28-b247-415c-8425-2e9cf54b7c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:32.036448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c9fb28-b247-415c-8425-2e9cf54b7c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:32.036898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c9fb28-b247-415c-8425-2e9cf54b7c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:32.037316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2c9fb28-b247-415c-8425-2e9cf54b7c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:32.066193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e2c9fb28-b247-415c-8425-2e9cf54b7c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 Aug 18 22:04:32.066747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 903/1803] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:32 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:32.380058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1430a1e1-d160-4943-9bc4-91a54c67a058 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:32.382883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1430a1e1-d160-4943-9bc4-91a54c67a058 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:32.388770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1430a1e1-d160-4943-9bc4-91a54c67a058 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:32.389253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1430a1e1-d160-4943-9bc4-91a54c67a058 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:32.389721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1430a1e1-d160-4943-9bc4-91a54c67a058 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:32.390412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1430a1e1-d160-4943-9bc4-91a54c67a058 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:32.390866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1430a1e1-d160-4943-9bc4-91a54c67a058 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:32.391289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1430a1e1-d160-4943-9bc4-91a54c67a058 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:32.420118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1430a1e1-d160-4943-9bc4-91a54c67a058 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043978 Aug 18 22:04:32.420667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 901/1804] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:32.447969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f21cf424-8198-4845-aea7-ad719b7a1659 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:32.450157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f21cf424-8198-4845-aea7-ad719b7a1659 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:32.452455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:32.457816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f21cf424-8198-4845-aea7-ad719b7a1659 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:32.458298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f21cf424-8198-4845-aea7-ad719b7a1659 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:32.458735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f21cf424-8198-4845-aea7-ad719b7a1659 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:32.459432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f21cf424-8198-4845-aea7-ad719b7a1659 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:32.459890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f21cf424-8198-4845-aea7-ad719b7a1659 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:32.460320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f21cf424-8198-4845-aea7-ad719b7a1659 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:32.489731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f21cf424-8198-4845-aea7-ad719b7a1659 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046357 Aug 18 22:04:32.490297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 904/1805] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:32.611728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-18638e99-8b1c-43ea-bc76-c9b1b05bb75e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:32.613834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-18638e99-8b1c-43ea-bc76-c9b1b05bb75e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:32.620473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18638e99-8b1c-43ea-bc76-c9b1b05bb75e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:32.620956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18638e99-8b1c-43ea-bc76-c9b1b05bb75e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:32.621392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18638e99-8b1c-43ea-bc76-c9b1b05bb75e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:32.622115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18638e99-8b1c-43ea-bc76-c9b1b05bb75e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:32.622573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18638e99-8b1c-43ea-bc76-c9b1b05bb75e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:32.622997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-18638e99-8b1c-43ea-bc76-c9b1b05bb75e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:32.650894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-18638e99-8b1c-43ea-bc76-c9b1b05bb75e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043221 Aug 18 22:04:32.651446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 902/1806] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:32.756819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a00ea7c9-816b-42db-9ca6-ca07f5775b22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:32.759157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a00ea7c9-816b-42db-9ca6-ca07f5775b22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:32.764999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a00ea7c9-816b-42db-9ca6-ca07f5775b22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:32.765486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a00ea7c9-816b-42db-9ca6-ca07f5775b22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:32.765959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a00ea7c9-816b-42db-9ca6-ca07f5775b22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:32.766654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a00ea7c9-816b-42db-9ca6-ca07f5775b22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:32.767112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a00ea7c9-816b-42db-9ca6-ca07f5775b22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:32.767542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a00ea7c9-816b-42db-9ca6-ca07f5775b22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:32.796367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a00ea7c9-816b-42db-9ca6-ca07f5775b22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043512 Aug 18 22:04:32.796920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 905/1807] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:32 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:33.079169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d0268490-f688-4d01-bbec-79303dc76caa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:33.081331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d0268490-f688-4d01-bbec-79303dc76caa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:33.087812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0268490-f688-4d01-bbec-79303dc76caa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:33.088296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0268490-f688-4d01-bbec-79303dc76caa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:33.088738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0268490-f688-4d01-bbec-79303dc76caa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:33.089433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0268490-f688-4d01-bbec-79303dc76caa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:33.089914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0268490-f688-4d01-bbec-79303dc76caa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:33.090372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0268490-f688-4d01-bbec-79303dc76caa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:33.119563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d0268490-f688-4d01-bbec-79303dc76caa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Aug 18 22:04:33.120046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 903/1808] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:33 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:33.432446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-caf094e9-75d6-445e-9995-09fd3abdd21b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:33.434569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-caf094e9-75d6-445e-9995-09fd3abdd21b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:33.440440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-caf094e9-75d6-445e-9995-09fd3abdd21b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:33.440916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-caf094e9-75d6-445e-9995-09fd3abdd21b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:33.441352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-caf094e9-75d6-445e-9995-09fd3abdd21b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:33.442077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-caf094e9-75d6-445e-9995-09fd3abdd21b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:33.442530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-caf094e9-75d6-445e-9995-09fd3abdd21b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:33.442954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-caf094e9-75d6-445e-9995-09fd3abdd21b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:33.472621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-caf094e9-75d6-445e-9995-09fd3abdd21b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044307 Aug 18 22:04:33.473220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 906/1809] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:33 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:33.502435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cba548ba-4675-45f8-8fdc-3be0bbd26c2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:33.504622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cba548ba-4675-45f8-8fdc-3be0bbd26c2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:33.511442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cba548ba-4675-45f8-8fdc-3be0bbd26c2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:33.511920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cba548ba-4675-45f8-8fdc-3be0bbd26c2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:33.512350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cba548ba-4675-45f8-8fdc-3be0bbd26c2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:33.513036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cba548ba-4675-45f8-8fdc-3be0bbd26c2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:33.513487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cba548ba-4675-45f8-8fdc-3be0bbd26c2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:33.513936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cba548ba-4675-45f8-8fdc-3be0bbd26c2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:33.543395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cba548ba-4675-45f8-8fdc-3be0bbd26c2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044828 Aug 18 22:04:33.543949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 904/1810] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:33.663169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-25c76572-ba74-43a7-9745-89c9366c84ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:33.665310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-25c76572-ba74-43a7-9745-89c9366c84ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:33.671303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25c76572-ba74-43a7-9745-89c9366c84ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:33.671790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25c76572-ba74-43a7-9745-89c9366c84ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:33.672270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25c76572-ba74-43a7-9745-89c9366c84ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:33.672934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25c76572-ba74-43a7-9745-89c9366c84ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:33.673392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25c76572-ba74-43a7-9745-89c9366c84ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:33.673846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25c76572-ba74-43a7-9745-89c9366c84ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:33.704186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-25c76572-ba74-43a7-9745-89c9366c84ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Aug 18 22:04:33.704687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 907/1811] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:33 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:33.809255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a686d149-9a9e-4d2e-924c-dde885109340 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:33.811448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a686d149-9a9e-4d2e-924c-dde885109340 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:33.820937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a686d149-9a9e-4d2e-924c-dde885109340 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:33.821430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a686d149-9a9e-4d2e-924c-dde885109340 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:33.821911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a686d149-9a9e-4d2e-924c-dde885109340 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:33.822628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a686d149-9a9e-4d2e-924c-dde885109340 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:33.823095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a686d149-9a9e-4d2e-924c-dde885109340 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:33.823530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a686d149-9a9e-4d2e-924c-dde885109340 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:33.852114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a686d149-9a9e-4d2e-924c-dde885109340 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046768 Aug 18 22:04:33.852675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 905/1812] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:34.131660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8f3a7e8a-18c5-4483-bc86-5ac4c361bffb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:34.133824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8f3a7e8a-18c5-4483-bc86-5ac4c361bffb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:34.139883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f3a7e8a-18c5-4483-bc86-5ac4c361bffb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:34.140364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f3a7e8a-18c5-4483-bc86-5ac4c361bffb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:34.140806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f3a7e8a-18c5-4483-bc86-5ac4c361bffb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:34.141496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f3a7e8a-18c5-4483-bc86-5ac4c361bffb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:34.141978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f3a7e8a-18c5-4483-bc86-5ac4c361bffb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:34.142405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f3a7e8a-18c5-4483-bc86-5ac4c361bffb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:34.172176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8f3a7e8a-18c5-4483-bc86-5ac4c361bffb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044468 Aug 18 22:04:34.172728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 908/1813] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:34 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:34.485007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0fc2c9de-cf68-4ae3-9ff6-007a54cc014f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:34.487133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0fc2c9de-cf68-4ae3-9ff6-007a54cc014f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:34.493075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fc2c9de-cf68-4ae3-9ff6-007a54cc014f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:34.493555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fc2c9de-cf68-4ae3-9ff6-007a54cc014f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:34.494026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fc2c9de-cf68-4ae3-9ff6-007a54cc014f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:34.494727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fc2c9de-cf68-4ae3-9ff6-007a54cc014f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:34.495186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fc2c9de-cf68-4ae3-9ff6-007a54cc014f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:34.495621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fc2c9de-cf68-4ae3-9ff6-007a54cc014f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:34.524708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0fc2c9de-cf68-4ae3-9ff6-007a54cc014f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043707 Aug 18 22:04:34.525342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 906/1814] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:34.555701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-249b66a6-04f2-4b13-8d4a-6f9d575565ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:34.557876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-249b66a6-04f2-4b13-8d4a-6f9d575565ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:34.564119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249b66a6-04f2-4b13-8d4a-6f9d575565ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:34.564591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249b66a6-04f2-4b13-8d4a-6f9d575565ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:34.565019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249b66a6-04f2-4b13-8d4a-6f9d575565ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:34.565739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249b66a6-04f2-4b13-8d4a-6f9d575565ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:34.566182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249b66a6-04f2-4b13-8d4a-6f9d575565ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:34.566601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249b66a6-04f2-4b13-8d4a-6f9d575565ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:34.590581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:34.595496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-249b66a6-04f2-4b13-8d4a-6f9d575565ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043770 Aug 18 22:04:34.596047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 909/1815] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:34.717107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aa1a036a-f466-4c91-aee3-e4121f140891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:34.719288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-aa1a036a-f466-4c91-aee3-e4121f140891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:34.725288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa1a036a-f466-4c91-aee3-e4121f140891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:34.725925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa1a036a-f466-4c91-aee3-e4121f140891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:34.726369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa1a036a-f466-4c91-aee3-e4121f140891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:34.727161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa1a036a-f466-4c91-aee3-e4121f140891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:34.727624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa1a036a-f466-4c91-aee3-e4121f140891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:34.728053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa1a036a-f466-4c91-aee3-e4121f140891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:34.756312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aa1a036a-f466-4c91-aee3-e4121f140891 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043125 Aug 18 22:04:34.757284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 907/1816] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:34 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:34.865068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-78bfa16a-9129-40be-8742-398fc9019ed6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:34.867274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-78bfa16a-9129-40be-8742-398fc9019ed6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:34.873575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78bfa16a-9129-40be-8742-398fc9019ed6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:34.874088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78bfa16a-9129-40be-8742-398fc9019ed6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:34.874523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78bfa16a-9129-40be-8742-398fc9019ed6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:34.875253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78bfa16a-9129-40be-8742-398fc9019ed6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:34.875708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78bfa16a-9129-40be-8742-398fc9019ed6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:34.876138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78bfa16a-9129-40be-8742-398fc9019ed6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:34.905528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-78bfa16a-9129-40be-8742-398fc9019ed6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045045 Aug 18 22:04:34.906109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 910/1817] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:35.184736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3cae4a8b-1f72-4e60-8b09-fd42f963921c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:35.187046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3cae4a8b-1f72-4e60-8b09-fd42f963921c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:35.192978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cae4a8b-1f72-4e60-8b09-fd42f963921c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:35.193461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cae4a8b-1f72-4e60-8b09-fd42f963921c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:35.193934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cae4a8b-1f72-4e60-8b09-fd42f963921c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:35.195241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cae4a8b-1f72-4e60-8b09-fd42f963921c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:35.195704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cae4a8b-1f72-4e60-8b09-fd42f963921c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:35.196189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cae4a8b-1f72-4e60-8b09-fd42f963921c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:35.224698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3cae4a8b-1f72-4e60-8b09-fd42f963921c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043894 Aug 18 22:04:35.225259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 908/1818] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:35.537003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6fef6f6a-fd69-4cb5-bd10-ad25ed5c3268 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:35.539787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6fef6f6a-fd69-4cb5-bd10-ad25ed5c3268 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:35.545971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fef6f6a-fd69-4cb5-bd10-ad25ed5c3268 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:35.546565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fef6f6a-fd69-4cb5-bd10-ad25ed5c3268 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:35.546879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fef6f6a-fd69-4cb5-bd10-ad25ed5c3268 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:35.547572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fef6f6a-fd69-4cb5-bd10-ad25ed5c3268 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:35.548026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fef6f6a-fd69-4cb5-bd10-ad25ed5c3268 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:35.548450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fef6f6a-fd69-4cb5-bd10-ad25ed5c3268 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:35.577987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6fef6f6a-fd69-4cb5-bd10-ad25ed5c3268 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044922 Aug 18 22:04:35.578620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 911/1819] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:35.607728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3e9fdad3-310c-451c-85f0-00ec2f9bfa70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:35.610133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3e9fdad3-310c-451c-85f0-00ec2f9bfa70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:35.617162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e9fdad3-310c-451c-85f0-00ec2f9bfa70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:35.617677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e9fdad3-310c-451c-85f0-00ec2f9bfa70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:35.618117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e9fdad3-310c-451c-85f0-00ec2f9bfa70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:35.618814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e9fdad3-310c-451c-85f0-00ec2f9bfa70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:35.619289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e9fdad3-310c-451c-85f0-00ec2f9bfa70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:35.619718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e9fdad3-310c-451c-85f0-00ec2f9bfa70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:35.644033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:35.649133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3e9fdad3-310c-451c-85f0-00ec2f9bfa70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045330 Aug 18 22:04:35.649703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 909/1820] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:35 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:35.768828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2443b0a6-cdfe-40c4-921f-51f580840930 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:35.770992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2443b0a6-cdfe-40c4-921f-51f580840930 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:35.776788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2443b0a6-cdfe-40c4-921f-51f580840930 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:35.777262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2443b0a6-cdfe-40c4-921f-51f580840930 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:35.777728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2443b0a6-cdfe-40c4-921f-51f580840930 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:35.778414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2443b0a6-cdfe-40c4-921f-51f580840930 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:35.778863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2443b0a6-cdfe-40c4-921f-51f580840930 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:35.779285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2443b0a6-cdfe-40c4-921f-51f580840930 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:35.809277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2443b0a6-cdfe-40c4-921f-51f580840930 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044235 Aug 18 22:04:35.809789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 912/1821] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:35 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:35.918532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1bdd0528-c5d8-4cb7-ad49-35541fb7a4a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:35.920668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1bdd0528-c5d8-4cb7-ad49-35541fb7a4a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:35.927200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bdd0528-c5d8-4cb7-ad49-35541fb7a4a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:35.927684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bdd0528-c5d8-4cb7-ad49-35541fb7a4a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:35.928129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bdd0528-c5d8-4cb7-ad49-35541fb7a4a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:35.928821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bdd0528-c5d8-4cb7-ad49-35541fb7a4a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:35.929275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bdd0528-c5d8-4cb7-ad49-35541fb7a4a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:35.929726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bdd0528-c5d8-4cb7-ad49-35541fb7a4a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:35.957874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1bdd0528-c5d8-4cb7-ad49-35541fb7a4a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043239 Aug 18 22:04:35.958425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 910/1822] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:35 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:36.236415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9596ed4b-fb8a-4835-b3ae-6a7268b62e8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:36.238521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9596ed4b-fb8a-4835-b3ae-6a7268b62e8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:36.244461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9596ed4b-fb8a-4835-b3ae-6a7268b62e8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:36.244947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9596ed4b-fb8a-4835-b3ae-6a7268b62e8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:36.245384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9596ed4b-fb8a-4835-b3ae-6a7268b62e8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:36.246105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9596ed4b-fb8a-4835-b3ae-6a7268b62e8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:36.246562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9596ed4b-fb8a-4835-b3ae-6a7268b62e8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:36.246989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9596ed4b-fb8a-4835-b3ae-6a7268b62e8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:36.276379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9596ed4b-fb8a-4835-b3ae-6a7268b62e8a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Aug 18 22:04:36.276930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 913/1823] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:36 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:36.435682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f92dfd77-9dfb-417e-8438-b28bbec1f9c0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:36.436181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f92dfd77-9dfb-417e-8438-b28bbec1f9c0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:36.442060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f92dfd77-9dfb-417e-8438-b28bbec1f9c0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:36.442538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f92dfd77-9dfb-417e-8438-b28bbec1f9c0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:36.442974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f92dfd77-9dfb-417e-8438-b28bbec1f9c0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:36.443654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f92dfd77-9dfb-417e-8438-b28bbec1f9c0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:36.444102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f92dfd77-9dfb-417e-8438-b28bbec1f9c0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:36.445019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f92dfd77-9dfb-417e-8438-b28bbec1f9c0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:36.590268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fee2e977-cb51-4dd2-92af-576636beb1b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:36.592383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fee2e977-cb51-4dd2-92af-576636beb1b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:36.598622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fee2e977-cb51-4dd2-92af-576636beb1b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:36.599308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fee2e977-cb51-4dd2-92af-576636beb1b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:36.599738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fee2e977-cb51-4dd2-92af-576636beb1b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:36.600433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fee2e977-cb51-4dd2-92af-576636beb1b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:36.600938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fee2e977-cb51-4dd2-92af-576636beb1b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:36.601355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fee2e977-cb51-4dd2-92af-576636beb1b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:36.624894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-f92dfd77-9dfb-417e-8438-b28bbec1f9c0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lazy-loading 'services' on Instance uuid 3f0b7a98-3ba3-4739-8b60-3c7946107c6e {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:04:36.639348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fee2e977-cb51-4dd2-92af-576636beb1b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052691 Aug 18 22:04:36.640271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 914/1824] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:04:36.660053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cb432c8b-0201-4b57-ad06-deca02a6c4dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:36.662254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cb432c8b-0201-4b57-ad06-deca02a6c4dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:36.668018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb432c8b-0201-4b57-ad06-deca02a6c4dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:36.668503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb432c8b-0201-4b57-ad06-deca02a6c4dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:36.668941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb432c8b-0201-4b57-ad06-deca02a6c4dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:36.669671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb432c8b-0201-4b57-ad06-deca02a6c4dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:36.670135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb432c8b-0201-4b57-ad06-deca02a6c4dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:36.670564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cb432c8b-0201-4b57-ad06-deca02a6c4dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:36.703594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cb432c8b-0201-4b57-ad06-deca02a6c4dd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047142 Aug 18 22:04:36.704504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 915/1825] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:36.710464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f92dfd77-9dfb-417e-8438-b28bbec1f9c0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [7b7f1467-1fdf-40cc-9cbd-b8df38f3d5a6] AMQP server on 10.222.0.82:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 22:04:36.822300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9fcefb4e-0775-40b2-a86d-3dd32ff585a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:36.824473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9fcefb4e-0775-40b2-a86d-3dd32ff585a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:36.830488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fcefb4e-0775-40b2-a86d-3dd32ff585a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:36.830968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fcefb4e-0775-40b2-a86d-3dd32ff585a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:36.831404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fcefb4e-0775-40b2-a86d-3dd32ff585a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:36.832100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fcefb4e-0775-40b2-a86d-3dd32ff585a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:36.832554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fcefb4e-0775-40b2-a86d-3dd32ff585a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:36.832990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fcefb4e-0775-40b2-a86d-3dd32ff585a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:36.860646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9fcefb4e-0775-40b2-a86d-3dd32ff585a5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042995 Aug 18 22:04:36.861263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 916/1826] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:36 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:04:36.970689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ff12dcae-3d82-4461-97c7-e9e7cf441a21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:36.972809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ff12dcae-3d82-4461-97c7-e9e7cf441a21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:36.979287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff12dcae-3d82-4461-97c7-e9e7cf441a21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:36.979761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff12dcae-3d82-4461-97c7-e9e7cf441a21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:36.980193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff12dcae-3d82-4461-97c7-e9e7cf441a21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:36.980885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff12dcae-3d82-4461-97c7-e9e7cf441a21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:36.981339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff12dcae-3d82-4461-97c7-e9e7cf441a21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:36.981797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff12dcae-3d82-4461-97c7-e9e7cf441a21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:37.012225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ff12dcae-3d82-4461-97c7-e9e7cf441a21 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045284 Aug 18 22:04:37.013047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 917/1827] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:36 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:04:37.289044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-566f9b09-cf6c-404e-b9b9-0c9e728baa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:37.291189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-566f9b09-cf6c-404e-b9b9-0c9e728baa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:37.297091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-566f9b09-cf6c-404e-b9b9-0c9e728baa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:37.297567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-566f9b09-cf6c-404e-b9b9-0c9e728baa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:37.298024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-566f9b09-cf6c-404e-b9b9-0c9e728baa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:37.298715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-566f9b09-cf6c-404e-b9b9-0c9e728baa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:37.299160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-566f9b09-cf6c-404e-b9b9-0c9e728baa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:37.299581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-566f9b09-cf6c-404e-b9b9-0c9e728baa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:37.329874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-566f9b09-cf6c-404e-b9b9-0c9e728baa4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045192 Aug 18 22:04:37.330429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 918/1828] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:37 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:04:37.651785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-45ddb37a-fc55-49c0-987d-58a663eede77 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:37.653934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-45ddb37a-fc55-49c0-987d-58a663eede77 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:37.660215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45ddb37a-fc55-49c0-987d-58a663eede77 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:37.660691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45ddb37a-fc55-49c0-987d-58a663eede77 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:37.661127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45ddb37a-fc55-49c0-987d-58a663eede77 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:37.661838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45ddb37a-fc55-49c0-987d-58a663eede77 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:37.662291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45ddb37a-fc55-49c0-987d-58a663eede77 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:37.662719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-45ddb37a-fc55-49c0-987d-58a663eede77 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:37.692001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-45ddb37a-fc55-49c0-987d-58a663eede77 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044779 Aug 18 22:04:37.692568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 919/1829] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:04:37.717311 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-54882d7c-79a2-4520-bf49-02b5d5557c8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:37.719461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-54882d7c-79a2-4520-bf49-02b5d5557c8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:37.723095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [None req-f92dfd77-9dfb-417e-8438-b28bbec1f9c0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [7b7f1467-1fdf-40cc-9cbd-b8df38f3d5a6] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 49682. Aug 18 22:04:37.725584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54882d7c-79a2-4520-bf49-02b5d5557c8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:37.726089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54882d7c-79a2-4520-bf49-02b5d5557c8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:37.726527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54882d7c-79a2-4520-bf49-02b5d5557c8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:37.726628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f92dfd77-9dfb-417e-8438-b28bbec1f9c0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "DELETE /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e/os-volume_attachments/d8c02a59-adcf-48a4-8a38-e38dbbbb00f8" status: 202 len: 0 microversion: 2.1 time: 1.294857 Aug 18 22:04:37.727185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 911/1830] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 22:04:36 2022] DELETE /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e/os-volume_attachments/d8c02a59-adcf-48a4-8a38-e38dbbbb00f8 => generated 0 bytes in 1296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:04:37.727321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54882d7c-79a2-4520-bf49-02b5d5557c8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:37.727679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54882d7c-79a2-4520-bf49-02b5d5557c8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:37.728102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54882d7c-79a2-4520-bf49-02b5d5557c8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:37.760676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-54882d7c-79a2-4520-bf49-02b5d5557c8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047243 Aug 18 22:04:37.761257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 920/1831] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:37 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:04:37.872582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2e112824-cbdb-4952-b2e6-fcfb118541d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:37.875061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2e112824-cbdb-4952-b2e6-fcfb118541d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:37.881162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e112824-cbdb-4952-b2e6-fcfb118541d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:37.881680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e112824-cbdb-4952-b2e6-fcfb118541d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:37.882617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e112824-cbdb-4952-b2e6-fcfb118541d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:37.883312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e112824-cbdb-4952-b2e6-fcfb118541d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:37.883783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e112824-cbdb-4952-b2e6-fcfb118541d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:37.884210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2e112824-cbdb-4952-b2e6-fcfb118541d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:37.913564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2e112824-cbdb-4952-b2e6-fcfb118541d1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045201 Aug 18 22:04:37.914086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 912/1832] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:37 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:38.024956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-856c1ee2-cd77-4f02-856b-a422e983f7e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:38.027150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-856c1ee2-cd77-4f02-856b-a422e983f7e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:38.032939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-856c1ee2-cd77-4f02-856b-a422e983f7e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:38.033415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-856c1ee2-cd77-4f02-856b-a422e983f7e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:38.033886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-856c1ee2-cd77-4f02-856b-a422e983f7e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:38.034568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-856c1ee2-cd77-4f02-856b-a422e983f7e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:38.035016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-856c1ee2-cd77-4f02-856b-a422e983f7e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:38.035436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-856c1ee2-cd77-4f02-856b-a422e983f7e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:38.064208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-856c1ee2-cd77-4f02-856b-a422e983f7e0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Aug 18 22:04:38.064761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 921/1833] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:38 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:38.341814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-259d25c5-c254-4ca3-b09f-c5c560ada0c6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:38.343984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-259d25c5-c254-4ca3-b09f-c5c560ada0c6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:38.349944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-259d25c5-c254-4ca3-b09f-c5c560ada0c6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:38.350425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-259d25c5-c254-4ca3-b09f-c5c560ada0c6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:38.351517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-259d25c5-c254-4ca3-b09f-c5c560ada0c6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:38.352211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-259d25c5-c254-4ca3-b09f-c5c560ada0c6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:38.352666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-259d25c5-c254-4ca3-b09f-c5c560ada0c6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:38.353092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-259d25c5-c254-4ca3-b09f-c5c560ada0c6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:38.381242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-259d25c5-c254-4ca3-b09f-c5c560ada0c6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043452 Aug 18 22:04:38.381824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 913/1834] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:38 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:38.704594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-568a1738-3a1b-439b-99aa-b717fc40873a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:38.706826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-568a1738-3a1b-439b-99aa-b717fc40873a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:38.714314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-568a1738-3a1b-439b-99aa-b717fc40873a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:38.714799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-568a1738-3a1b-439b-99aa-b717fc40873a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:38.715297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-568a1738-3a1b-439b-99aa-b717fc40873a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:38.716092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-568a1738-3a1b-439b-99aa-b717fc40873a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:38.716551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-568a1738-3a1b-439b-99aa-b717fc40873a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:38.716984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-568a1738-3a1b-439b-99aa-b717fc40873a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:38.753430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-568a1738-3a1b-439b-99aa-b717fc40873a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052826 Aug 18 22:04:38.754034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 922/1835] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:38 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:38.772312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-50f180b3-5e87-44b9-b056-a737cd4f3eb0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:38.775100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-50f180b3-5e87-44b9-b056-a737cd4f3eb0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:38.781425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50f180b3-5e87-44b9-b056-a737cd4f3eb0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:38.781932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50f180b3-5e87-44b9-b056-a737cd4f3eb0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:38.782368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50f180b3-5e87-44b9-b056-a737cd4f3eb0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:38.783056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50f180b3-5e87-44b9-b056-a737cd4f3eb0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:38.783506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50f180b3-5e87-44b9-b056-a737cd4f3eb0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:38.783931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50f180b3-5e87-44b9-b056-a737cd4f3eb0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:38.813636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-50f180b3-5e87-44b9-b056-a737cd4f3eb0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045224 Aug 18 22:04:38.814202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 914/1836] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:38 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:38.926143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eed65f59-faf0-4ea2-9472-7b0e61070d14 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:38.928240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eed65f59-faf0-4ea2-9472-7b0e61070d14 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:38.934705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eed65f59-faf0-4ea2-9472-7b0e61070d14 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:38.935190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eed65f59-faf0-4ea2-9472-7b0e61070d14 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:38.935625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eed65f59-faf0-4ea2-9472-7b0e61070d14 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:38.936319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eed65f59-faf0-4ea2-9472-7b0e61070d14 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:38.936925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eed65f59-faf0-4ea2-9472-7b0e61070d14 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:38.937266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eed65f59-faf0-4ea2-9472-7b0e61070d14 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:38.965557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eed65f59-faf0-4ea2-9472-7b0e61070d14 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043669 Aug 18 22:04:38.966131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 923/1837] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:38 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:39.076912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-64b2be01-1391-4f25-b568-f1432c8ff15c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:39.079140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-64b2be01-1391-4f25-b568-f1432c8ff15c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:39.085046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64b2be01-1391-4f25-b568-f1432c8ff15c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:39.085508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64b2be01-1391-4f25-b568-f1432c8ff15c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:39.085978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64b2be01-1391-4f25-b568-f1432c8ff15c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:39.086673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64b2be01-1391-4f25-b568-f1432c8ff15c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:39.087129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64b2be01-1391-4f25-b568-f1432c8ff15c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:39.087612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64b2be01-1391-4f25-b568-f1432c8ff15c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:39.117389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-64b2be01-1391-4f25-b568-f1432c8ff15c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044421 Aug 18 22:04:39.117962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 915/1838] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:39 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:39.393892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ed19fe3f-435a-4520-b799-2cc8730190da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:39.396026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ed19fe3f-435a-4520-b799-2cc8730190da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:39.401911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed19fe3f-435a-4520-b799-2cc8730190da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:39.402392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed19fe3f-435a-4520-b799-2cc8730190da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:39.402829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed19fe3f-435a-4520-b799-2cc8730190da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:39.403544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed19fe3f-435a-4520-b799-2cc8730190da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:39.403996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed19fe3f-435a-4520-b799-2cc8730190da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:39.404418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed19fe3f-435a-4520-b799-2cc8730190da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:39.434208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ed19fe3f-435a-4520-b799-2cc8730190da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Aug 18 22:04:39.434759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 924/1839] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:39.766036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fb556fef-9e1b-4ed8-b8be-f816f0f56256 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:39.768191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fb556fef-9e1b-4ed8-b8be-f816f0f56256 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:39.774733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb556fef-9e1b-4ed8-b8be-f816f0f56256 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:39.775288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb556fef-9e1b-4ed8-b8be-f816f0f56256 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:39.775686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb556fef-9e1b-4ed8-b8be-f816f0f56256 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:39.776373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb556fef-9e1b-4ed8-b8be-f816f0f56256 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:39.776820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb556fef-9e1b-4ed8-b8be-f816f0f56256 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:39.777239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb556fef-9e1b-4ed8-b8be-f816f0f56256 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:39.806814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fb556fef-9e1b-4ed8-b8be-f816f0f56256 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044782 Aug 18 22:04:39.807364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 916/1840] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:39.825989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f090e70b-a6dd-48bb-a90a-6a0c956d66ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:39.828230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f090e70b-a6dd-48bb-a90a-6a0c956d66ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:39.834633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f090e70b-a6dd-48bb-a90a-6a0c956d66ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:39.835635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f090e70b-a6dd-48bb-a90a-6a0c956d66ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:39.836074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f090e70b-a6dd-48bb-a90a-6a0c956d66ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:39.836770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f090e70b-a6dd-48bb-a90a-6a0c956d66ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:39.837228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f090e70b-a6dd-48bb-a90a-6a0c956d66ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:39.837688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f090e70b-a6dd-48bb-a90a-6a0c956d66ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:39.868518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f090e70b-a6dd-48bb-a90a-6a0c956d66ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045318 Aug 18 22:04:39.868518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 925/1841] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:39 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:39.977718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-444df517-2b6e-46e4-b5de-3160768b68b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:39.979830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-444df517-2b6e-46e4-b5de-3160768b68b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:39.986022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-444df517-2b6e-46e4-b5de-3160768b68b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:39.986532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-444df517-2b6e-46e4-b5de-3160768b68b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:39.986973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-444df517-2b6e-46e4-b5de-3160768b68b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:39.987676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-444df517-2b6e-46e4-b5de-3160768b68b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:39.988163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-444df517-2b6e-46e4-b5de-3160768b68b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:39.988596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-444df517-2b6e-46e4-b5de-3160768b68b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:40.017159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-444df517-2b6e-46e4-b5de-3160768b68b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 Aug 18 22:04:40.017746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 917/1842] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:39 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:40.130039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d1a6ac6-f38a-4ed7-9c3e-d896ed18f74c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:40.132721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1d1a6ac6-f38a-4ed7-9c3e-d896ed18f74c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:40.139436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1a6ac6-f38a-4ed7-9c3e-d896ed18f74c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:40.139924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1a6ac6-f38a-4ed7-9c3e-d896ed18f74c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:40.140365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1a6ac6-f38a-4ed7-9c3e-d896ed18f74c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:40.141059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1a6ac6-f38a-4ed7-9c3e-d896ed18f74c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:40.141513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1a6ac6-f38a-4ed7-9c3e-d896ed18f74c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:40.141963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1a6ac6-f38a-4ed7-9c3e-d896ed18f74c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:40.156121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:40.171735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1d1a6ac6-f38a-4ed7-9c3e-d896ed18f74c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045696 Aug 18 22:04:40.172288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 926/1843] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:40.447112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7d8db8c8-63f0-480e-a21a-c8f1ca0f68e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:40.449281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7d8db8c8-63f0-480e-a21a-c8f1ca0f68e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:40.455256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d8db8c8-63f0-480e-a21a-c8f1ca0f68e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:40.455744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d8db8c8-63f0-480e-a21a-c8f1ca0f68e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:40.456186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d8db8c8-63f0-480e-a21a-c8f1ca0f68e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:40.456882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d8db8c8-63f0-480e-a21a-c8f1ca0f68e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:40.457341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d8db8c8-63f0-480e-a21a-c8f1ca0f68e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:40.457800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d8db8c8-63f0-480e-a21a-c8f1ca0f68e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:40.486237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7d8db8c8-63f0-480e-a21a-c8f1ca0f68e7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043675 Aug 18 22:04:40.486798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 918/1844] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:40 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:40.818502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f4ae67b5-0883-40ed-a274-0134eb79f043 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:40.820638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f4ae67b5-0883-40ed-a274-0134eb79f043 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:40.826934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ae67b5-0883-40ed-a274-0134eb79f043 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:40.827816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ae67b5-0883-40ed-a274-0134eb79f043 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:40.827816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ae67b5-0883-40ed-a274-0134eb79f043 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:40.828535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ae67b5-0883-40ed-a274-0134eb79f043 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:40.828990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ae67b5-0883-40ed-a274-0134eb79f043 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:40.829421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ae67b5-0883-40ed-a274-0134eb79f043 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:40.858966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f4ae67b5-0883-40ed-a274-0134eb79f043 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044436 Aug 18 22:04:40.859521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 927/1845] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:40.878909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-50538866-50e9-41b9-bb07-12a68c5bfeac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:40.881086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-50538866-50e9-41b9-bb07-12a68c5bfeac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:40.887663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50538866-50e9-41b9-bb07-12a68c5bfeac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:40.888143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50538866-50e9-41b9-bb07-12a68c5bfeac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:40.888581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50538866-50e9-41b9-bb07-12a68c5bfeac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:40.889274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50538866-50e9-41b9-bb07-12a68c5bfeac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:40.889757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50538866-50e9-41b9-bb07-12a68c5bfeac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:40.890191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50538866-50e9-41b9-bb07-12a68c5bfeac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:40.919832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-50538866-50e9-41b9-bb07-12a68c5bfeac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044791 Aug 18 22:04:40.920418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 919/1846] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:40 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:41.029235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-40e62eec-b11c-4b23-9f9b-293a32e9ade1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:41.031396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-40e62eec-b11c-4b23-9f9b-293a32e9ade1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:41.037298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40e62eec-b11c-4b23-9f9b-293a32e9ade1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:41.037804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40e62eec-b11c-4b23-9f9b-293a32e9ade1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:41.038738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40e62eec-b11c-4b23-9f9b-293a32e9ade1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:41.039420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40e62eec-b11c-4b23-9f9b-293a32e9ade1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:41.039864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40e62eec-b11c-4b23-9f9b-293a32e9ade1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:41.040285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40e62eec-b11c-4b23-9f9b-293a32e9ade1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:41.075548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-40e62eec-b11c-4b23-9f9b-293a32e9ade1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050168 Aug 18 22:04:41.076108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 928/1847] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:41 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:41.184260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ac8349ea-02e1-4fec-8f1d-9a8159704717 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:41.186433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ac8349ea-02e1-4fec-8f1d-9a8159704717 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:41.192779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac8349ea-02e1-4fec-8f1d-9a8159704717 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:41.193267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac8349ea-02e1-4fec-8f1d-9a8159704717 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:41.193747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac8349ea-02e1-4fec-8f1d-9a8159704717 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:41.194444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac8349ea-02e1-4fec-8f1d-9a8159704717 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:41.194902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac8349ea-02e1-4fec-8f1d-9a8159704717 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:41.195357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac8349ea-02e1-4fec-8f1d-9a8159704717 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:41.224003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ac8349ea-02e1-4fec-8f1d-9a8159704717 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043724 Aug 18 22:04:41.224569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 920/1848] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:41.498725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cce1e057-cdf8-4a6a-bac8-bc27555a80e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:41.500803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cce1e057-cdf8-4a6a-bac8-bc27555a80e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:41.506652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cce1e057-cdf8-4a6a-bac8-bc27555a80e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:41.507623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cce1e057-cdf8-4a6a-bac8-bc27555a80e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:41.508048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cce1e057-cdf8-4a6a-bac8-bc27555a80e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:41.508730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cce1e057-cdf8-4a6a-bac8-bc27555a80e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:41.509183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cce1e057-cdf8-4a6a-bac8-bc27555a80e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:41.509623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cce1e057-cdf8-4a6a-bac8-bc27555a80e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:41.538241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cce1e057-cdf8-4a6a-bac8-bc27555a80e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Aug 18 22:04:41.538783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 929/1849] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:41 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:41.871879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a05b6aaa-2dcf-4027-a01b-c5fe8594847b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:41.874064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a05b6aaa-2dcf-4027-a01b-c5fe8594847b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:41.881001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a05b6aaa-2dcf-4027-a01b-c5fe8594847b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:41.881703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a05b6aaa-2dcf-4027-a01b-c5fe8594847b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:41.882516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a05b6aaa-2dcf-4027-a01b-c5fe8594847b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:41.883228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a05b6aaa-2dcf-4027-a01b-c5fe8594847b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:41.883677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a05b6aaa-2dcf-4027-a01b-c5fe8594847b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:41.884096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a05b6aaa-2dcf-4027-a01b-c5fe8594847b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:41.913021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a05b6aaa-2dcf-4027-a01b-c5fe8594847b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045217 Aug 18 22:04:41.913570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 921/1850] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:41.932643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab8f4762-52f7-412b-a9f3-7263a6493baf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:41.934881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab8f4762-52f7-412b-a9f3-7263a6493baf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:41.941109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8f4762-52f7-412b-a9f3-7263a6493baf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:41.941583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8f4762-52f7-412b-a9f3-7263a6493baf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:41.942047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8f4762-52f7-412b-a9f3-7263a6493baf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:41.942729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8f4762-52f7-412b-a9f3-7263a6493baf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:41.943175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8f4762-52f7-412b-a9f3-7263a6493baf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:41.943594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8f4762-52f7-412b-a9f3-7263a6493baf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:41.973078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab8f4762-52f7-412b-a9f3-7263a6493baf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044980 Aug 18 22:04:41.973677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 930/1851] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:41 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:42.087608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-42b1ab40-d081-4fd3-a295-f5c6611a1b2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:42.089839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-42b1ab40-d081-4fd3-a295-f5c6611a1b2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:42.096485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42b1ab40-d081-4fd3-a295-f5c6611a1b2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:42.096961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42b1ab40-d081-4fd3-a295-f5c6611a1b2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:42.097391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42b1ab40-d081-4fd3-a295-f5c6611a1b2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:42.098110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42b1ab40-d081-4fd3-a295-f5c6611a1b2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:42.098562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42b1ab40-d081-4fd3-a295-f5c6611a1b2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:42.098984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42b1ab40-d081-4fd3-a295-f5c6611a1b2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:42.127250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-42b1ab40-d081-4fd3-a295-f5c6611a1b2d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043478 Aug 18 22:04:42.127744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 922/1852] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:42 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:42.238560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c3c793b-0ae5-4a1e-b511-db80962b85d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:42.240712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c3c793b-0ae5-4a1e-b511-db80962b85d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:42.247265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c3c793b-0ae5-4a1e-b511-db80962b85d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:42.247752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c3c793b-0ae5-4a1e-b511-db80962b85d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:42.248188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c3c793b-0ae5-4a1e-b511-db80962b85d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:42.248877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c3c793b-0ae5-4a1e-b511-db80962b85d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:42.249327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c3c793b-0ae5-4a1e-b511-db80962b85d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:42.249810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c3c793b-0ae5-4a1e-b511-db80962b85d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:42.277948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c3c793b-0ae5-4a1e-b511-db80962b85d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044948 Aug 18 22:04:42.278497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 931/1853] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:42 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:42.550643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ad16fc48-f358-4771-bd43-0573ecfb43a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:42.552796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ad16fc48-f358-4771-bd43-0573ecfb43a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:42.559338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad16fc48-f358-4771-bd43-0573ecfb43a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:42.559826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad16fc48-f358-4771-bd43-0573ecfb43a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:42.560268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad16fc48-f358-4771-bd43-0573ecfb43a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:42.560962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad16fc48-f358-4771-bd43-0573ecfb43a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:42.561420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad16fc48-f358-4771-bd43-0573ecfb43a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:42.561875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad16fc48-f358-4771-bd43-0573ecfb43a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:42.590569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ad16fc48-f358-4771-bd43-0573ecfb43a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044184 Aug 18 22:04:42.591120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 923/1854] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:42.925533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f3a70a84-4104-4e92-a7d4-374e5520f9d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:42.927690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f3a70a84-4104-4e92-a7d4-374e5520f9d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:42.933712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3a70a84-4104-4e92-a7d4-374e5520f9d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:42.934260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3a70a84-4104-4e92-a7d4-374e5520f9d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:42.934625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3a70a84-4104-4e92-a7d4-374e5520f9d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:42.935323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3a70a84-4104-4e92-a7d4-374e5520f9d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:42.935776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3a70a84-4104-4e92-a7d4-374e5520f9d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:42.936201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3a70a84-4104-4e92-a7d4-374e5520f9d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:42.965566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f3a70a84-4104-4e92-a7d4-374e5520f9d4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044350 Aug 18 22:04:42.966134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 932/1855] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:42.985337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e138457b-7333-401a-b866-2c6af49a0afe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:42.987599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e138457b-7333-401a-b866-2c6af49a0afe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:42.994276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e138457b-7333-401a-b866-2c6af49a0afe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:42.994762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e138457b-7333-401a-b866-2c6af49a0afe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:42.995200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e138457b-7333-401a-b866-2c6af49a0afe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:42.995927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e138457b-7333-401a-b866-2c6af49a0afe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:42.996384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e138457b-7333-401a-b866-2c6af49a0afe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:42.996842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e138457b-7333-401a-b866-2c6af49a0afe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:43.026933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e138457b-7333-401a-b866-2c6af49a0afe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045419 Aug 18 22:04:43.027536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 924/1856] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:43.139539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4973fbb4-d8e8-4fef-bafd-581ce8436f59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:43.141623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4973fbb4-d8e8-4fef-bafd-581ce8436f59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:43.148165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4973fbb4-d8e8-4fef-bafd-581ce8436f59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:43.148618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4973fbb4-d8e8-4fef-bafd-581ce8436f59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:43.149061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4973fbb4-d8e8-4fef-bafd-581ce8436f59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:43.149788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4973fbb4-d8e8-4fef-bafd-581ce8436f59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:43.150252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4973fbb4-d8e8-4fef-bafd-581ce8436f59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:43.150681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4973fbb4-d8e8-4fef-bafd-581ce8436f59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:43.178972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4973fbb4-d8e8-4fef-bafd-581ce8436f59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043439 Aug 18 22:04:43.179519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 933/1857] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:43 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:43.290078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e45abf8e-da48-469b-a979-a24f8914b0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:43.292212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e45abf8e-da48-469b-a979-a24f8914b0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:43.298372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e45abf8e-da48-469b-a979-a24f8914b0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:43.298863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e45abf8e-da48-469b-a979-a24f8914b0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:43.299303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e45abf8e-da48-469b-a979-a24f8914b0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:43.300266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e45abf8e-da48-469b-a979-a24f8914b0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:43.300723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e45abf8e-da48-469b-a979-a24f8914b0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:43.301152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e45abf8e-da48-469b-a979-a24f8914b0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:43.326940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:43.332393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e45abf8e-da48-469b-a979-a24f8914b0df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046282 Aug 18 22:04:43.332947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 925/1858] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:43 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:43.602309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-48c34641-068a-429c-b996-ce45956bed2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:43.604460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-48c34641-068a-429c-b996-ce45956bed2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:43.610399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c34641-068a-429c-b996-ce45956bed2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:43.610873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c34641-068a-429c-b996-ce45956bed2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:43.611301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c34641-068a-429c-b996-ce45956bed2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:43.611986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c34641-068a-429c-b996-ce45956bed2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:43.612433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c34641-068a-429c-b996-ce45956bed2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:43.612853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c34641-068a-429c-b996-ce45956bed2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:43.642036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-48c34641-068a-429c-b996-ce45956bed2f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043629 Aug 18 22:04:43.642583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 934/1859] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:43 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:43.978658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-04b5b83c-5262-4115-a63f-d0fd617d8057 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:43.980774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-04b5b83c-5262-4115-a63f-d0fd617d8057 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:43.988459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04b5b83c-5262-4115-a63f-d0fd617d8057 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:43.989090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04b5b83c-5262-4115-a63f-d0fd617d8057 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:43.989360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04b5b83c-5262-4115-a63f-d0fd617d8057 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:43.990091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04b5b83c-5262-4115-a63f-d0fd617d8057 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:43.990570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04b5b83c-5262-4115-a63f-d0fd617d8057 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:43.990990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04b5b83c-5262-4115-a63f-d0fd617d8057 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:44.020749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-04b5b83c-5262-4115-a63f-d0fd617d8057 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046746 Aug 18 22:04:44.021302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 926/1860] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:04:44.039377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a3a79faf-7e02-4ca8-9fd8-8df3bf2ea20f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:44.041514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a3a79faf-7e02-4ca8-9fd8-8df3bf2ea20f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:44.048029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3a79faf-7e02-4ca8-9fd8-8df3bf2ea20f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:44.048515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3a79faf-7e02-4ca8-9fd8-8df3bf2ea20f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:44.048953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3a79faf-7e02-4ca8-9fd8-8df3bf2ea20f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:44.049694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3a79faf-7e02-4ca8-9fd8-8df3bf2ea20f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:44.050408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3a79faf-7e02-4ca8-9fd8-8df3bf2ea20f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:44.050837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3a79faf-7e02-4ca8-9fd8-8df3bf2ea20f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:44.080320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a3a79faf-7e02-4ca8-9fd8-8df3bf2ea20f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Aug 18 22:04:44.080583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 935/1861] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:44 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:44.190631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9d9cfbb3-acb2-45dc-a090-7ffc4928b059 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:44.193123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9d9cfbb3-acb2-45dc-a090-7ffc4928b059 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:44.199012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d9cfbb3-acb2-45dc-a090-7ffc4928b059 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:44.199497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d9cfbb3-acb2-45dc-a090-7ffc4928b059 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:44.199936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d9cfbb3-acb2-45dc-a090-7ffc4928b059 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:44.200626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d9cfbb3-acb2-45dc-a090-7ffc4928b059 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:44.201080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d9cfbb3-acb2-45dc-a090-7ffc4928b059 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:44.201508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d9cfbb3-acb2-45dc-a090-7ffc4928b059 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:44.231390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9d9cfbb3-acb2-45dc-a090-7ffc4928b059 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044723 Aug 18 22:04:44.231876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 927/1862] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:44.344620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb4bc154-06e6-4e96-966e-f6abf2d0909c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:44.346817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fb4bc154-06e6-4e96-966e-f6abf2d0909c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:44.353268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb4bc154-06e6-4e96-966e-f6abf2d0909c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:44.353777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb4bc154-06e6-4e96-966e-f6abf2d0909c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:44.354209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb4bc154-06e6-4e96-966e-f6abf2d0909c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:44.354894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb4bc154-06e6-4e96-966e-f6abf2d0909c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:44.355342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb4bc154-06e6-4e96-966e-f6abf2d0909c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:44.355762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb4bc154-06e6-4e96-966e-f6abf2d0909c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:44.383706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fb4bc154-06e6-4e96-966e-f6abf2d0909c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042993 Aug 18 22:04:44.384245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 936/1863] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:44 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:44.654645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6e50d387-175a-4a63-a37a-3e70c1cca933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:44.656790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6e50d387-175a-4a63-a37a-3e70c1cca933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:44.662840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e50d387-175a-4a63-a37a-3e70c1cca933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:44.663379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e50d387-175a-4a63-a37a-3e70c1cca933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:44.663819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e50d387-175a-4a63-a37a-3e70c1cca933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:44.664506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e50d387-175a-4a63-a37a-3e70c1cca933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:44.664970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e50d387-175a-4a63-a37a-3e70c1cca933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:44.665398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e50d387-175a-4a63-a37a-3e70c1cca933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:44.695612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6e50d387-175a-4a63-a37a-3e70c1cca933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044855 Aug 18 22:04:44.696182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 928/1864] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:44 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:45.032908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2ffedcb9-ea80-4292-b9f1-ad237650d854 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:45.035077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2ffedcb9-ea80-4292-b9f1-ad237650d854 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:45.041011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ffedcb9-ea80-4292-b9f1-ad237650d854 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:45.041589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ffedcb9-ea80-4292-b9f1-ad237650d854 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:45.041949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ffedcb9-ea80-4292-b9f1-ad237650d854 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:45.042640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ffedcb9-ea80-4292-b9f1-ad237650d854 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:45.043096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ffedcb9-ea80-4292-b9f1-ad237650d854 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:45.043524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ffedcb9-ea80-4292-b9f1-ad237650d854 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:45.073923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2ffedcb9-ea80-4292-b9f1-ad237650d854 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044859 Aug 18 22:04:45.074491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 937/1865] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:45 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:45.092447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c2d17ac8-cb19-41f9-b8b9-88d06a86d4c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:45.094627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c2d17ac8-cb19-41f9-b8b9-88d06a86d4c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:45.100912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d17ac8-cb19-41f9-b8b9-88d06a86d4c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:45.101388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d17ac8-cb19-41f9-b8b9-88d06a86d4c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:45.101864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d17ac8-cb19-41f9-b8b9-88d06a86d4c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:45.102572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d17ac8-cb19-41f9-b8b9-88d06a86d4c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:45.103026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d17ac8-cb19-41f9-b8b9-88d06a86d4c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:45.103448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d17ac8-cb19-41f9-b8b9-88d06a86d4c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:45.133166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c2d17ac8-cb19-41f9-b8b9-88d06a86d4c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Aug 18 22:04:45.133746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 929/1866] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:45.244061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2ff5ddfc-e008-4b10-83a2-5649097fbcf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:45.246233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2ff5ddfc-e008-4b10-83a2-5649097fbcf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:45.252254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ff5ddfc-e008-4b10-83a2-5649097fbcf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:45.252738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ff5ddfc-e008-4b10-83a2-5649097fbcf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:45.253177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ff5ddfc-e008-4b10-83a2-5649097fbcf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:45.253902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ff5ddfc-e008-4b10-83a2-5649097fbcf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:45.254364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ff5ddfc-e008-4b10-83a2-5649097fbcf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:45.254794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ff5ddfc-e008-4b10-83a2-5649097fbcf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:45.283144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2ff5ddfc-e008-4b10-83a2-5649097fbcf9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043650 Aug 18 22:04:45.283631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 938/1867] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:45 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:45.395939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-489aba79-1817-437c-a027-4aca03d2250a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:45.399157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-489aba79-1817-437c-a027-4aca03d2250a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:45.405257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-489aba79-1817-437c-a027-4aca03d2250a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:45.405772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-489aba79-1817-437c-a027-4aca03d2250a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:45.406214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-489aba79-1817-437c-a027-4aca03d2250a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:45.406919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-489aba79-1817-437c-a027-4aca03d2250a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:45.407384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-489aba79-1817-437c-a027-4aca03d2250a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:45.407815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-489aba79-1817-437c-a027-4aca03d2250a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:45.439039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-489aba79-1817-437c-a027-4aca03d2250a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046987 Aug 18 22:04:45.439595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 930/1868] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:45 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:45.707166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9f4a31c0-6fbf-4ca4-962a-c07337046947 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:45.709264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9f4a31c0-6fbf-4ca4-962a-c07337046947 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:45.715710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f4a31c0-6fbf-4ca4-962a-c07337046947 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:45.716197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f4a31c0-6fbf-4ca4-962a-c07337046947 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:45.716638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f4a31c0-6fbf-4ca4-962a-c07337046947 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:45.717345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f4a31c0-6fbf-4ca4-962a-c07337046947 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:45.718103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f4a31c0-6fbf-4ca4-962a-c07337046947 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:45.718436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f4a31c0-6fbf-4ca4-962a-c07337046947 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:45.748293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9f4a31c0-6fbf-4ca4-962a-c07337046947 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045225 Aug 18 22:04:45.748927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 939/1869] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:45 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:46.086858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0a0fefd4-25d4-4b21-950e-3617514245ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:46.089013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0a0fefd4-25d4-4b21-950e-3617514245ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:46.095137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a0fefd4-25d4-4b21-950e-3617514245ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:46.095740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a0fefd4-25d4-4b21-950e-3617514245ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:46.096047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a0fefd4-25d4-4b21-950e-3617514245ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:46.096747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a0fefd4-25d4-4b21-950e-3617514245ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:46.097204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a0fefd4-25d4-4b21-950e-3617514245ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:46.097657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a0fefd4-25d4-4b21-950e-3617514245ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:46.127453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0a0fefd4-25d4-4b21-950e-3617514245ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045272 Aug 18 22:04:46.128017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 931/1870] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:46 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:46.145538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e3547b71-bfac-4331-80a8-b26c1744f5e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:46.148469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e3547b71-bfac-4331-80a8-b26c1744f5e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:46.154416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3547b71-bfac-4331-80a8-b26c1744f5e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:46.154896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3547b71-bfac-4331-80a8-b26c1744f5e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:46.155332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3547b71-bfac-4331-80a8-b26c1744f5e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:46.156026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3547b71-bfac-4331-80a8-b26c1744f5e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:46.156482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3547b71-bfac-4331-80a8-b26c1744f5e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:46.156909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3547b71-bfac-4331-80a8-b26c1744f5e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:46.185570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e3547b71-bfac-4331-80a8-b26c1744f5e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Aug 18 22:04:46.186145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 940/1871] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:46 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:46.294096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-84aeeb4c-be53-4858-94e5-e014fcf2e3ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:46.296259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-84aeeb4c-be53-4858-94e5-e014fcf2e3ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:46.302900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84aeeb4c-be53-4858-94e5-e014fcf2e3ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:46.303394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84aeeb4c-be53-4858-94e5-e014fcf2e3ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:46.304339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84aeeb4c-be53-4858-94e5-e014fcf2e3ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:46.305041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84aeeb4c-be53-4858-94e5-e014fcf2e3ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:46.305499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84aeeb4c-be53-4858-94e5-e014fcf2e3ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:46.305959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84aeeb4c-be53-4858-94e5-e014fcf2e3ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:46.334682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-84aeeb4c-be53-4858-94e5-e014fcf2e3ce tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Aug 18 22:04:46.335248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 932/1872] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:46 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:46.451815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-56490451-2ea7-41ba-a6ed-0937e4f20048 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:46.453925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-56490451-2ea7-41ba-a6ed-0937e4f20048 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:46.460366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56490451-2ea7-41ba-a6ed-0937e4f20048 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:46.460844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56490451-2ea7-41ba-a6ed-0937e4f20048 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:46.461275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56490451-2ea7-41ba-a6ed-0937e4f20048 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:46.461993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56490451-2ea7-41ba-a6ed-0937e4f20048 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:46.462447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56490451-2ea7-41ba-a6ed-0937e4f20048 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:46.462871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56490451-2ea7-41ba-a6ed-0937e4f20048 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:46.491050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-56490451-2ea7-41ba-a6ed-0937e4f20048 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043279 Aug 18 22:04:46.492116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 941/1873] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:46.761718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3c32df3e-4135-4c45-90bd-3fe32e1f45b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:46.764516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3c32df3e-4135-4c45-90bd-3fe32e1f45b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:46.771575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c32df3e-4135-4c45-90bd-3fe32e1f45b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:46.772102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c32df3e-4135-4c45-90bd-3fe32e1f45b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:46.772711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c32df3e-4135-4c45-90bd-3fe32e1f45b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:46.773902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c32df3e-4135-4c45-90bd-3fe32e1f45b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:46.774618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c32df3e-4135-4c45-90bd-3fe32e1f45b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:46.775250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c32df3e-4135-4c45-90bd-3fe32e1f45b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:46.806356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3c32df3e-4135-4c45-90bd-3fe32e1f45b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049164 Aug 18 22:04:46.806915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 933/1874] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:46 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:47.140519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bb48c833-a785-4916-910c-7248c8b20812 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:47.142781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bb48c833-a785-4916-910c-7248c8b20812 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:47.149376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb48c833-a785-4916-910c-7248c8b20812 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:47.149998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb48c833-a785-4916-910c-7248c8b20812 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:47.150314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb48c833-a785-4916-910c-7248c8b20812 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:47.151014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb48c833-a785-4916-910c-7248c8b20812 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:47.151468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb48c833-a785-4916-910c-7248c8b20812 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:47.151891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb48c833-a785-4916-910c-7248c8b20812 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:47.181441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bb48c833-a785-4916-910c-7248c8b20812 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044965 Aug 18 22:04:47.182026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 942/1875] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:47 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:47.197225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fc014560-bd0b-4c1f-880b-26e1eb51bb7b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:47.199417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fc014560-bd0b-4c1f-880b-26e1eb51bb7b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:47.205784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc014560-bd0b-4c1f-880b-26e1eb51bb7b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:47.206264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc014560-bd0b-4c1f-880b-26e1eb51bb7b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:47.206703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc014560-bd0b-4c1f-880b-26e1eb51bb7b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:47.207395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc014560-bd0b-4c1f-880b-26e1eb51bb7b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:47.207857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc014560-bd0b-4c1f-880b-26e1eb51bb7b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:47.208280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc014560-bd0b-4c1f-880b-26e1eb51bb7b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:47.238012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fc014560-bd0b-4c1f-880b-26e1eb51bb7b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044596 Aug 18 22:04:47.238567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 934/1876] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:47 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:47.346734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aa7ed295-7d71-416d-b50d-a73ab5345e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:47.348857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aa7ed295-7d71-416d-b50d-a73ab5345e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:47.355381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa7ed295-7d71-416d-b50d-a73ab5345e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:47.355862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa7ed295-7d71-416d-b50d-a73ab5345e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:47.356296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa7ed295-7d71-416d-b50d-a73ab5345e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:47.356981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa7ed295-7d71-416d-b50d-a73ab5345e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:47.357427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa7ed295-7d71-416d-b50d-a73ab5345e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:47.357875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa7ed295-7d71-416d-b50d-a73ab5345e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:47.361353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:47.386140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aa7ed295-7d71-416d-b50d-a73ab5345e5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043255 Aug 18 22:04:47.386685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 943/1877] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:47 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:47.503802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-041d50e5-a02b-42c3-a7b1-4ec7a09eb3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:47.505885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-041d50e5-a02b-42c3-a7b1-4ec7a09eb3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:47.512242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-041d50e5-a02b-42c3-a7b1-4ec7a09eb3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:47.512720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-041d50e5-a02b-42c3-a7b1-4ec7a09eb3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:47.513154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-041d50e5-a02b-42c3-a7b1-4ec7a09eb3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:47.513875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-041d50e5-a02b-42c3-a7b1-4ec7a09eb3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:47.514329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-041d50e5-a02b-42c3-a7b1-4ec7a09eb3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:47.514926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-041d50e5-a02b-42c3-a7b1-4ec7a09eb3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:47.543545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-041d50e5-a02b-42c3-a7b1-4ec7a09eb3cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043739 Aug 18 22:04:47.544086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 935/1878] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:47.818538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5c975bce-5492-43a9-bdf5-b6a3320c67a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:47.821250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5c975bce-5492-43a9-bdf5-b6a3320c67a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:47.827616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c975bce-5492-43a9-bdf5-b6a3320c67a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:47.828084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c975bce-5492-43a9-bdf5-b6a3320c67a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:47.828515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c975bce-5492-43a9-bdf5-b6a3320c67a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:47.829197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c975bce-5492-43a9-bdf5-b6a3320c67a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:47.829673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c975bce-5492-43a9-bdf5-b6a3320c67a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:47.830088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c975bce-5492-43a9-bdf5-b6a3320c67a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:47.858176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5c975bce-5492-43a9-bdf5-b6a3320c67a5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043600 Aug 18 22:04:47.858731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 944/1879] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:47 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:48.192842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1abc1551-3037-4a40-94c3-123c680ffa43 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:48.195676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1abc1551-3037-4a40-94c3-123c680ffa43 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:48.197576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:48.203250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1abc1551-3037-4a40-94c3-123c680ffa43 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:48.203730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1abc1551-3037-4a40-94c3-123c680ffa43 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:48.204167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1abc1551-3037-4a40-94c3-123c680ffa43 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:48.204859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1abc1551-3037-4a40-94c3-123c680ffa43 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:48.205311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1abc1551-3037-4a40-94c3-123c680ffa43 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:48.205763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1abc1551-3037-4a40-94c3-123c680ffa43 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:48.234917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1abc1551-3037-4a40-94c3-123c680ffa43 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046065 Aug 18 22:04:48.235472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 936/1880] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:48.250173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b2839f5-c67f-46d6-94de-ba67ff6300a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:48.252345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5b2839f5-c67f-46d6-94de-ba67ff6300a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:48.258260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b2839f5-c67f-46d6-94de-ba67ff6300a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:48.258739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b2839f5-c67f-46d6-94de-ba67ff6300a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:48.259175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b2839f5-c67f-46d6-94de-ba67ff6300a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:48.259859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b2839f5-c67f-46d6-94de-ba67ff6300a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:48.260313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b2839f5-c67f-46d6-94de-ba67ff6300a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:48.260736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b2839f5-c67f-46d6-94de-ba67ff6300a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:48.290422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5b2839f5-c67f-46d6-94de-ba67ff6300a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Aug 18 22:04:48.290974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 945/1881] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:48 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:48.398507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c760dac4-2cf0-4cc8-b7c0-37041c0e4e6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:48.400655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c760dac4-2cf0-4cc8-b7c0-37041c0e4e6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:48.406670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c760dac4-2cf0-4cc8-b7c0-37041c0e4e6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:48.407149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c760dac4-2cf0-4cc8-b7c0-37041c0e4e6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:48.407583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c760dac4-2cf0-4cc8-b7c0-37041c0e4e6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:48.408283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c760dac4-2cf0-4cc8-b7c0-37041c0e4e6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:48.408735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c760dac4-2cf0-4cc8-b7c0-37041c0e4e6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:48.409162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c760dac4-2cf0-4cc8-b7c0-37041c0e4e6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:48.439035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c760dac4-2cf0-4cc8-b7c0-37041c0e4e6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044431 Aug 18 22:04:48.439580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 937/1882] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:48 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:48.556499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8de894e6-b602-43e7-a3d3-afe58cc1e269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:48.558640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8de894e6-b602-43e7-a3d3-afe58cc1e269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:48.564441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8de894e6-b602-43e7-a3d3-afe58cc1e269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:48.564912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8de894e6-b602-43e7-a3d3-afe58cc1e269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:48.565345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8de894e6-b602-43e7-a3d3-afe58cc1e269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:48.566074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8de894e6-b602-43e7-a3d3-afe58cc1e269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:48.566531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8de894e6-b602-43e7-a3d3-afe58cc1e269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:48.566956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8de894e6-b602-43e7-a3d3-afe58cc1e269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:48.595240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8de894e6-b602-43e7-a3d3-afe58cc1e269 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043309 Aug 18 22:04:48.595786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 946/1883] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:48 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:48.870282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d693435c-1003-4091-831d-914c317b6c60 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:48.872415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d693435c-1003-4091-831d-914c317b6c60 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:48.878855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d693435c-1003-4091-831d-914c317b6c60 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:48.879332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d693435c-1003-4091-831d-914c317b6c60 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:48.879772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d693435c-1003-4091-831d-914c317b6c60 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:48.880466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d693435c-1003-4091-831d-914c317b6c60 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:48.880920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d693435c-1003-4091-831d-914c317b6c60 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:48.881351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d693435c-1003-4091-831d-914c317b6c60 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:48.910161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d693435c-1003-4091-831d-914c317b6c60 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043783 Aug 18 22:04:48.910715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 938/1884] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:48 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:49.246539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b900f2f3-009c-417f-a117-4548f18fa2dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:49.248676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b900f2f3-009c-417f-a117-4548f18fa2dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:49.255055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b900f2f3-009c-417f-a117-4548f18fa2dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:49.255601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b900f2f3-009c-417f-a117-4548f18fa2dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:49.255958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b900f2f3-009c-417f-a117-4548f18fa2dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:49.256656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b900f2f3-009c-417f-a117-4548f18fa2dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:49.257617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b900f2f3-009c-417f-a117-4548f18fa2dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:49.258069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b900f2f3-009c-417f-a117-4548f18fa2dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:49.287064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b900f2f3-009c-417f-a117-4548f18fa2dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044470 Aug 18 22:04:49.287618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 947/1885] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:49.302843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fffb7cd6-83d8-4c4e-b4d1-7dca8101ded1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:49.305455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fffb7cd6-83d8-4c4e-b4d1-7dca8101ded1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:49.311849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fffb7cd6-83d8-4c4e-b4d1-7dca8101ded1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:49.312326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fffb7cd6-83d8-4c4e-b4d1-7dca8101ded1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:49.312745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fffb7cd6-83d8-4c4e-b4d1-7dca8101ded1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:49.313427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fffb7cd6-83d8-4c4e-b4d1-7dca8101ded1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:49.313908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fffb7cd6-83d8-4c4e-b4d1-7dca8101ded1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:49.314336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fffb7cd6-83d8-4c4e-b4d1-7dca8101ded1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:49.343333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fffb7cd6-83d8-4c4e-b4d1-7dca8101ded1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044657 Aug 18 22:04:49.343880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 939/1886] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:49 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:49.451615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9a812aba-bc9a-429a-b14b-f6d0b594db15 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:49.453825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9a812aba-bc9a-429a-b14b-f6d0b594db15 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:49.459733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a812aba-bc9a-429a-b14b-f6d0b594db15 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:49.460271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a812aba-bc9a-429a-b14b-f6d0b594db15 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:49.460711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a812aba-bc9a-429a-b14b-f6d0b594db15 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:49.461404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a812aba-bc9a-429a-b14b-f6d0b594db15 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:49.461889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a812aba-bc9a-429a-b14b-f6d0b594db15 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:49.462318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a812aba-bc9a-429a-b14b-f6d0b594db15 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:49.490719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9a812aba-bc9a-429a-b14b-f6d0b594db15 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043016 Aug 18 22:04:49.491694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 948/1887] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:49 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:49.607180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e4149a41-9846-4d7d-9814-33ab52e5acfb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:49.609354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e4149a41-9846-4d7d-9814-33ab52e5acfb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:49.615306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4149a41-9846-4d7d-9814-33ab52e5acfb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:49.615790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4149a41-9846-4d7d-9814-33ab52e5acfb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:49.616789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4149a41-9846-4d7d-9814-33ab52e5acfb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:49.617482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4149a41-9846-4d7d-9814-33ab52e5acfb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:49.617964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4149a41-9846-4d7d-9814-33ab52e5acfb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:49.618397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4149a41-9846-4d7d-9814-33ab52e5acfb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:49.649339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e4149a41-9846-4d7d-9814-33ab52e5acfb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046045 Aug 18 22:04:49.649962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 940/1888] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:49 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:49.922299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6b2b3936-a4c7-48e5-8f92-308d85bf2c4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:49.924509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6b2b3936-a4c7-48e5-8f92-308d85bf2c4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:49.931357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b2b3936-a4c7-48e5-8f92-308d85bf2c4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:49.931841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b2b3936-a4c7-48e5-8f92-308d85bf2c4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:49.932283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b2b3936-a4c7-48e5-8f92-308d85bf2c4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:49.932983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b2b3936-a4c7-48e5-8f92-308d85bf2c4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:49.933440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b2b3936-a4c7-48e5-8f92-308d85bf2c4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:49.933907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b2b3936-a4c7-48e5-8f92-308d85bf2c4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:49.962280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6b2b3936-a4c7-48e5-8f92-308d85bf2c4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Aug 18 22:04:49.962836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 949/1889] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:49 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:50.300314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-17d9110b-4572-4205-b9e6-9c0b82512f7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:50.302492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-17d9110b-4572-4205-b9e6-9c0b82512f7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:50.309004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17d9110b-4572-4205-b9e6-9c0b82512f7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:50.309574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17d9110b-4572-4205-b9e6-9c0b82512f7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:50.309948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17d9110b-4572-4205-b9e6-9c0b82512f7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:50.310639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17d9110b-4572-4205-b9e6-9c0b82512f7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:50.311094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17d9110b-4572-4205-b9e6-9c0b82512f7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:50.311869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17d9110b-4572-4205-b9e6-9c0b82512f7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:50.340389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-17d9110b-4572-4205-b9e6-9c0b82512f7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044493 Aug 18 22:04:50.340935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 941/1890] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:04:50.355579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7da44b1b-0f18-4df8-9923-246582ecec73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:50.357765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7da44b1b-0f18-4df8-9923-246582ecec73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:50.364077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7da44b1b-0f18-4df8-9923-246582ecec73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:50.364554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7da44b1b-0f18-4df8-9923-246582ecec73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:50.364984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7da44b1b-0f18-4df8-9923-246582ecec73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:50.365694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7da44b1b-0f18-4df8-9923-246582ecec73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:50.366175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7da44b1b-0f18-4df8-9923-246582ecec73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:50.366596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7da44b1b-0f18-4df8-9923-246582ecec73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:50.394894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7da44b1b-0f18-4df8-9923-246582ecec73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043195 Aug 18 22:04:50.395435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 950/1891] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:50 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:50.503531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4631e756-10d9-445c-a48e-c447cf814b1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:50.505690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4631e756-10d9-445c-a48e-c447cf814b1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:50.512104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4631e756-10d9-445c-a48e-c447cf814b1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:50.512587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4631e756-10d9-445c-a48e-c447cf814b1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:50.513017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4631e756-10d9-445c-a48e-c447cf814b1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:50.513733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4631e756-10d9-445c-a48e-c447cf814b1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:50.514182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4631e756-10d9-445c-a48e-c447cf814b1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:50.514604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4631e756-10d9-445c-a48e-c447cf814b1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:50.531341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:50.545249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4631e756-10d9-445c-a48e-c447cf814b1f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045919 Aug 18 22:04:50.545855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 942/1892] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:50.661675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-604b3002-179b-4f50-a519-4324a6de8cc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:50.663840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-604b3002-179b-4f50-a519-4324a6de8cc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:50.669777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-604b3002-179b-4f50-a519-4324a6de8cc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:50.670261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-604b3002-179b-4f50-a519-4324a6de8cc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:50.670718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-604b3002-179b-4f50-a519-4324a6de8cc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:50.671405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-604b3002-179b-4f50-a519-4324a6de8cc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:50.671860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-604b3002-179b-4f50-a519-4324a6de8cc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:50.672293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-604b3002-179b-4f50-a519-4324a6de8cc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:50.701870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-604b3002-179b-4f50-a519-4324a6de8cc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044206 Aug 18 22:04:50.702435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 951/1893] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:50 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:50.974993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-71795178-2075-4d56-be27-84cab85506ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:50.977067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-71795178-2075-4d56-be27-84cab85506ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:50.983050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71795178-2075-4d56-be27-84cab85506ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:50.983629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71795178-2075-4d56-be27-84cab85506ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:50.984081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71795178-2075-4d56-be27-84cab85506ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:50.984765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71795178-2075-4d56-be27-84cab85506ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:50.985225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71795178-2075-4d56-be27-84cab85506ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:50.985685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71795178-2075-4d56-be27-84cab85506ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:51.015264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-71795178-2075-4d56-be27-84cab85506ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Aug 18 22:04:51.015820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 943/1894] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:50 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:51.353118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0d1df6dc-04c7-4ad3-8a2e-2446dc70bccf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:51.355316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0d1df6dc-04c7-4ad3-8a2e-2446dc70bccf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:51.361892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d1df6dc-04c7-4ad3-8a2e-2446dc70bccf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:51.362449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d1df6dc-04c7-4ad3-8a2e-2446dc70bccf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:51.362788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d1df6dc-04c7-4ad3-8a2e-2446dc70bccf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:51.363480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d1df6dc-04c7-4ad3-8a2e-2446dc70bccf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:51.363932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d1df6dc-04c7-4ad3-8a2e-2446dc70bccf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:51.364360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d1df6dc-04c7-4ad3-8a2e-2446dc70bccf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:51.393427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0d1df6dc-04c7-4ad3-8a2e-2446dc70bccf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044716 Aug 18 22:04:51.394020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 952/1895] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:51 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:51.407324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5d3950ee-0665-442a-b436-4e450d0665e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:51.409466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5d3950ee-0665-442a-b436-4e450d0665e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:51.416364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d3950ee-0665-442a-b436-4e450d0665e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:51.416849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d3950ee-0665-442a-b436-4e450d0665e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:51.417289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d3950ee-0665-442a-b436-4e450d0665e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:51.418015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d3950ee-0665-442a-b436-4e450d0665e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:51.418478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d3950ee-0665-442a-b436-4e450d0665e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:51.418912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d3950ee-0665-442a-b436-4e450d0665e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:51.448343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5d3950ee-0665-442a-b436-4e450d0665e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Aug 18 22:04:51.448904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 944/1896] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:51 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:51.557912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c7e4c57e-d030-4b45-9b9c-67a2973ceb6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:51.560043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c7e4c57e-d030-4b45-9b9c-67a2973ceb6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:51.565955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7e4c57e-d030-4b45-9b9c-67a2973ceb6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:51.566432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7e4c57e-d030-4b45-9b9c-67a2973ceb6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:51.566861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7e4c57e-d030-4b45-9b9c-67a2973ceb6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:51.567545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7e4c57e-d030-4b45-9b9c-67a2973ceb6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:51.567991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7e4c57e-d030-4b45-9b9c-67a2973ceb6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:51.568407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7e4c57e-d030-4b45-9b9c-67a2973ceb6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:51.596376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c7e4c57e-d030-4b45-9b9c-67a2973ceb6e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043031 Aug 18 22:04:51.596915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 953/1897] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:51.714929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4040ff88-5154-495c-a34e-0839468b55e4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:51.716999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4040ff88-5154-495c-a34e-0839468b55e4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:51.723149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4040ff88-5154-495c-a34e-0839468b55e4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:51.723637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4040ff88-5154-495c-a34e-0839468b55e4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:51.724075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4040ff88-5154-495c-a34e-0839468b55e4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:51.724778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4040ff88-5154-495c-a34e-0839468b55e4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:51.725229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4040ff88-5154-495c-a34e-0839468b55e4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:51.726364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4040ff88-5154-495c-a34e-0839468b55e4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:51.755191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4040ff88-5154-495c-a34e-0839468b55e4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044289 Aug 18 22:04:51.755747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 945/1898] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:51 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:52.028185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-157c767b-8092-404a-a276-5b29a16f3685 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:52.030346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-157c767b-8092-404a-a276-5b29a16f3685 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:52.032188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:52.037563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-157c767b-8092-404a-a276-5b29a16f3685 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:52.038138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-157c767b-8092-404a-a276-5b29a16f3685 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:52.038586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-157c767b-8092-404a-a276-5b29a16f3685 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:52.039289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-157c767b-8092-404a-a276-5b29a16f3685 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:52.039747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-157c767b-8092-404a-a276-5b29a16f3685 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:52.040176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-157c767b-8092-404a-a276-5b29a16f3685 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:52.070058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-157c767b-8092-404a-a276-5b29a16f3685 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045328 Aug 18 22:04:52.070619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 954/1899] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:52 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:52.406112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d159ae66-7da1-43fa-a8bb-d282251207ed tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:52.408179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d159ae66-7da1-43fa-a8bb-d282251207ed tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:52.414455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d159ae66-7da1-43fa-a8bb-d282251207ed tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:52.414940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d159ae66-7da1-43fa-a8bb-d282251207ed tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:52.415379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d159ae66-7da1-43fa-a8bb-d282251207ed tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:52.416085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d159ae66-7da1-43fa-a8bb-d282251207ed tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:52.416547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d159ae66-7da1-43fa-a8bb-d282251207ed tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:52.416978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d159ae66-7da1-43fa-a8bb-d282251207ed tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:52.448405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d159ae66-7da1-43fa-a8bb-d282251207ed tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046346 Aug 18 22:04:52.448976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 946/1900] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:52 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:52.460278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-80f713c1-03f7-4fba-83e8-975ecb9b918b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:52.462500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-80f713c1-03f7-4fba-83e8-975ecb9b918b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:52.469211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80f713c1-03f7-4fba-83e8-975ecb9b918b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:52.469736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80f713c1-03f7-4fba-83e8-975ecb9b918b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:52.470180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80f713c1-03f7-4fba-83e8-975ecb9b918b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:52.470890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80f713c1-03f7-4fba-83e8-975ecb9b918b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:52.471351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80f713c1-03f7-4fba-83e8-975ecb9b918b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:52.471786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80f713c1-03f7-4fba-83e8-975ecb9b918b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:52.501922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-80f713c1-03f7-4fba-83e8-975ecb9b918b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045484 Aug 18 22:04:52.502484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 955/1901] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:52 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:52.608930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-10092361-921c-4ca2-98f7-0d875163b300 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:52.611106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-10092361-921c-4ca2-98f7-0d875163b300 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:52.617576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10092361-921c-4ca2-98f7-0d875163b300 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:52.618085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10092361-921c-4ca2-98f7-0d875163b300 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:52.618515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10092361-921c-4ca2-98f7-0d875163b300 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:52.619200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10092361-921c-4ca2-98f7-0d875163b300 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:52.619647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10092361-921c-4ca2-98f7-0d875163b300 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:52.620068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10092361-921c-4ca2-98f7-0d875163b300 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:52.648268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-10092361-921c-4ca2-98f7-0d875163b300 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043255 Aug 18 22:04:52.648813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 947/1902] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:52.766741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cd8f3605-74a9-4571-a170-f164d15c3639 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:52.768877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cd8f3605-74a9-4571-a170-f164d15c3639 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:52.774748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd8f3605-74a9-4571-a170-f164d15c3639 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:52.775231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd8f3605-74a9-4571-a170-f164d15c3639 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:52.775669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd8f3605-74a9-4571-a170-f164d15c3639 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:52.776364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd8f3605-74a9-4571-a170-f164d15c3639 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:52.776818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd8f3605-74a9-4571-a170-f164d15c3639 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:52.777242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd8f3605-74a9-4571-a170-f164d15c3639 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:52.809401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cd8f3605-74a9-4571-a170-f164d15c3639 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046648 Aug 18 22:04:52.810004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 956/1903] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:53.082328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-54ab9a71-7b6e-45b1-a3d1-90b9a639c74b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:53.084501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-54ab9a71-7b6e-45b1-a3d1-90b9a639c74b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:53.091078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-54ab9a71-7b6e-45b1-a3d1-90b9a639c74b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:53.091565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-54ab9a71-7b6e-45b1-a3d1-90b9a639c74b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:53.092004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-54ab9a71-7b6e-45b1-a3d1-90b9a639c74b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:53.092996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-54ab9a71-7b6e-45b1-a3d1-90b9a639c74b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:53.093285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-54ab9a71-7b6e-45b1-a3d1-90b9a639c74b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:53.093748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-54ab9a71-7b6e-45b1-a3d1-90b9a639c74b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:53.123527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-54ab9a71-7b6e-45b1-a3d1-90b9a639c74b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045121 Aug 18 22:04:53.124090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 948/1904] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:53 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:53.461369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f197af21-6bbc-470b-8bf2-92dce5db970a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:53.463425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f197af21-6bbc-470b-8bf2-92dce5db970a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:53.469876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f197af21-6bbc-470b-8bf2-92dce5db970a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:53.470358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f197af21-6bbc-470b-8bf2-92dce5db970a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:53.470800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f197af21-6bbc-470b-8bf2-92dce5db970a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:53.471497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f197af21-6bbc-470b-8bf2-92dce5db970a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:53.471956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f197af21-6bbc-470b-8bf2-92dce5db970a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:53.472384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f197af21-6bbc-470b-8bf2-92dce5db970a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:53.500478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f197af21-6bbc-470b-8bf2-92dce5db970a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043753 Aug 18 22:04:53.501036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 957/1905] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:53 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:53.514197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a7aee681-9052-430c-b9c5-e12a3a03e9cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:53.516385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a7aee681-9052-430c-b9c5-e12a3a03e9cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:53.523401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7aee681-9052-430c-b9c5-e12a3a03e9cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:53.523872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7aee681-9052-430c-b9c5-e12a3a03e9cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:53.524309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7aee681-9052-430c-b9c5-e12a3a03e9cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:53.524996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7aee681-9052-430c-b9c5-e12a3a03e9cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:53.525449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7aee681-9052-430c-b9c5-e12a3a03e9cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:53.525907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7aee681-9052-430c-b9c5-e12a3a03e9cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:53.554278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a7aee681-9052-430c-b9c5-e12a3a03e9cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043987 Aug 18 22:04:53.554825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 949/1906] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:53 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:53.660531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b8d18977-b1c5-4691-aeda-50cc56df3a5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:53.662768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b8d18977-b1c5-4691-aeda-50cc56df3a5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:53.668780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8d18977-b1c5-4691-aeda-50cc56df3a5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:53.669256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8d18977-b1c5-4691-aeda-50cc56df3a5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:53.669728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8d18977-b1c5-4691-aeda-50cc56df3a5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:53.670418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8d18977-b1c5-4691-aeda-50cc56df3a5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:53.670876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8d18977-b1c5-4691-aeda-50cc56df3a5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:53.671329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b8d18977-b1c5-4691-aeda-50cc56df3a5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:53.699996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b8d18977-b1c5-4691-aeda-50cc56df3a5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043536 Aug 18 22:04:53.700553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 958/1907] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:53 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:53.822007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-56016e54-5511-4285-a9a1-debb85a26d50 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:53.824173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-56016e54-5511-4285-a9a1-debb85a26d50 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:53.830106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56016e54-5511-4285-a9a1-debb85a26d50 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:53.830581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56016e54-5511-4285-a9a1-debb85a26d50 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:53.831009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56016e54-5511-4285-a9a1-debb85a26d50 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:53.831698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56016e54-5511-4285-a9a1-debb85a26d50 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:53.832150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56016e54-5511-4285-a9a1-debb85a26d50 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:53.832572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56016e54-5511-4285-a9a1-debb85a26d50 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:53.860678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-56016e54-5511-4285-a9a1-debb85a26d50 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Aug 18 22:04:53.861227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 950/1908] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:54.136942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a598b205-e79a-4a09-8556-7dd45269ea55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:54.139116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a598b205-e79a-4a09-8556-7dd45269ea55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:54.145102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a598b205-e79a-4a09-8556-7dd45269ea55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:54.145584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a598b205-e79a-4a09-8556-7dd45269ea55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:54.146054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a598b205-e79a-4a09-8556-7dd45269ea55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:54.146757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a598b205-e79a-4a09-8556-7dd45269ea55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:54.147215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a598b205-e79a-4a09-8556-7dd45269ea55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:54.147646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a598b205-e79a-4a09-8556-7dd45269ea55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:54.171599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:54.176930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a598b205-e79a-4a09-8556-7dd45269ea55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Aug 18 22:04:54.177493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 959/1909] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:54 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:54.512636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-df56137e-1d06-4f77-9e1d-d9ae8966518a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:54.514722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-df56137e-1d06-4f77-9e1d-d9ae8966518a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:54.521280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df56137e-1d06-4f77-9e1d-d9ae8966518a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:54.521789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df56137e-1d06-4f77-9e1d-d9ae8966518a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:54.522226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df56137e-1d06-4f77-9e1d-d9ae8966518a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:54.522932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df56137e-1d06-4f77-9e1d-d9ae8966518a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:54.523386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df56137e-1d06-4f77-9e1d-d9ae8966518a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:54.523813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df56137e-1d06-4f77-9e1d-d9ae8966518a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:54.554862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-df56137e-1d06-4f77-9e1d-d9ae8966518a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046298 Aug 18 22:04:54.555409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 951/1910] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:54 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:54.566517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-04534596-b764-45f4-801c-6bfa15f2eae6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:54.568708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-04534596-b764-45f4-801c-6bfa15f2eae6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:54.575622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04534596-b764-45f4-801c-6bfa15f2eae6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:54.576109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04534596-b764-45f4-801c-6bfa15f2eae6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:54.576548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04534596-b764-45f4-801c-6bfa15f2eae6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:54.577246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04534596-b764-45f4-801c-6bfa15f2eae6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:54.577739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04534596-b764-45f4-801c-6bfa15f2eae6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:54.578173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04534596-b764-45f4-801c-6bfa15f2eae6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:54.607624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-04534596-b764-45f4-801c-6bfa15f2eae6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Aug 18 22:04:54.608172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 960/1911] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:54 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:54.712851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f3c2d54d-eb4c-4e94-a06d-5e41e18e2a50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:54.714776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f3c2d54d-eb4c-4e94-a06d-5e41e18e2a50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:54.720985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3c2d54d-eb4c-4e94-a06d-5e41e18e2a50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:54.721477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3c2d54d-eb4c-4e94-a06d-5e41e18e2a50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:54.721949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3c2d54d-eb4c-4e94-a06d-5e41e18e2a50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:54.722659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3c2d54d-eb4c-4e94-a06d-5e41e18e2a50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:54.723119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3c2d54d-eb4c-4e94-a06d-5e41e18e2a50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:54.723550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3c2d54d-eb4c-4e94-a06d-5e41e18e2a50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:54.755789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f3c2d54d-eb4c-4e94-a06d-5e41e18e2a50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047533 Aug 18 22:04:54.756363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 952/1912] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:54 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:54.872604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4d23ee2c-743a-40e5-85dd-c613819bb1ed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:54.874964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4d23ee2c-743a-40e5-85dd-c613819bb1ed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:54.881178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d23ee2c-743a-40e5-85dd-c613819bb1ed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:54.881696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d23ee2c-743a-40e5-85dd-c613819bb1ed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:54.882134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d23ee2c-743a-40e5-85dd-c613819bb1ed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:54.882834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d23ee2c-743a-40e5-85dd-c613819bb1ed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:54.883284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d23ee2c-743a-40e5-85dd-c613819bb1ed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:54.883709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d23ee2c-743a-40e5-85dd-c613819bb1ed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:54.914341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4d23ee2c-743a-40e5-85dd-c613819bb1ed tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045859 Aug 18 22:04:54.914914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 961/1913] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:55.189469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d05750af-ae80-42c0-ba98-c9dfc63a3686 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:55.191578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d05750af-ae80-42c0-ba98-c9dfc63a3686 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:55.198118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d05750af-ae80-42c0-ba98-c9dfc63a3686 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:55.198604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d05750af-ae80-42c0-ba98-c9dfc63a3686 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:55.199044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d05750af-ae80-42c0-ba98-c9dfc63a3686 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:55.199741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d05750af-ae80-42c0-ba98-c9dfc63a3686 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:55.200200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d05750af-ae80-42c0-ba98-c9dfc63a3686 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:55.200636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d05750af-ae80-42c0-ba98-c9dfc63a3686 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:55.229836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d05750af-ae80-42c0-ba98-c9dfc63a3686 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044393 Aug 18 22:04:55.230387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 953/1914] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:55 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:55.506109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:04:55.506326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:04:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:04:55.568177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ae3b57c-9e9d-430e-adbe-7dad2fbe5473 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:55.570997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ae3b57c-9e9d-430e-adbe-7dad2fbe5473 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:55.577276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ae3b57c-9e9d-430e-adbe-7dad2fbe5473 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:55.577782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ae3b57c-9e9d-430e-adbe-7dad2fbe5473 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:55.578217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ae3b57c-9e9d-430e-adbe-7dad2fbe5473 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:55.578903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ae3b57c-9e9d-430e-adbe-7dad2fbe5473 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:55.579353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ae3b57c-9e9d-430e-adbe-7dad2fbe5473 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:55.579770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ae3b57c-9e9d-430e-adbe-7dad2fbe5473 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:55.607956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ae3b57c-9e9d-430e-adbe-7dad2fbe5473 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044407 Aug 18 22:04:55.608495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 962/1915] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:55.685330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6d61086a-c3d6-4834-a929-dfe83694f954 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:55.692389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6d61086a-c3d6-4834-a929-dfe83694f954 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:55.699753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d61086a-c3d6-4834-a929-dfe83694f954 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:55.700569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d61086a-c3d6-4834-a929-dfe83694f954 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:55.701478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d61086a-c3d6-4834-a929-dfe83694f954 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:55.702458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d61086a-c3d6-4834-a929-dfe83694f954 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:55.703802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d61086a-c3d6-4834-a929-dfe83694f954 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:55.704249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d61086a-c3d6-4834-a929-dfe83694f954 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:55.735321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6d61086a-c3d6-4834-a929-dfe83694f954 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119328 Aug 18 22:04:55.735890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 954/1916] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:55 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:55.768025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-40388be9-3211-4585-b440-f928ce4a0ce6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:55.770266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-40388be9-3211-4585-b440-f928ce4a0ce6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:55.776165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40388be9-3211-4585-b440-f928ce4a0ce6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:55.776645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40388be9-3211-4585-b440-f928ce4a0ce6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:55.777082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40388be9-3211-4585-b440-f928ce4a0ce6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:55.777816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40388be9-3211-4585-b440-f928ce4a0ce6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:55.778277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40388be9-3211-4585-b440-f928ce4a0ce6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:55.778720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40388be9-3211-4585-b440-f928ce4a0ce6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:55.808299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-40388be9-3211-4585-b440-f928ce4a0ce6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Aug 18 22:04:55.808855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 963/1917] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:55 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:55.926410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5d2c6f0a-4fbb-4ced-90fd-5928f142ce5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:55.929162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5d2c6f0a-4fbb-4ced-90fd-5928f142ce5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:55.935363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d2c6f0a-4fbb-4ced-90fd-5928f142ce5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:55.935850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d2c6f0a-4fbb-4ced-90fd-5928f142ce5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:55.936680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d2c6f0a-4fbb-4ced-90fd-5928f142ce5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:55.936999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d2c6f0a-4fbb-4ced-90fd-5928f142ce5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:55.937462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d2c6f0a-4fbb-4ced-90fd-5928f142ce5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:55.937929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d2c6f0a-4fbb-4ced-90fd-5928f142ce5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:55.967886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5d2c6f0a-4fbb-4ced-90fd-5928f142ce5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045594 Aug 18 22:04:55.968446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 955/1918] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:55 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:56.241426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-232f970f-8f7e-43f0-99d5-b94551a4279f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:56.243590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-232f970f-8f7e-43f0-99d5-b94551a4279f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:56.249611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-232f970f-8f7e-43f0-99d5-b94551a4279f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:56.250101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-232f970f-8f7e-43f0-99d5-b94551a4279f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:56.250537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-232f970f-8f7e-43f0-99d5-b94551a4279f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:56.251229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-232f970f-8f7e-43f0-99d5-b94551a4279f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:56.251687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-232f970f-8f7e-43f0-99d5-b94551a4279f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:56.252103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-232f970f-8f7e-43f0-99d5-b94551a4279f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:56.281319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-232f970f-8f7e-43f0-99d5-b94551a4279f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Aug 18 22:04:56.281902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 964/1919] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:56 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:56.620345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1d0c79d5-4a3c-4795-ba49-723b42fda802 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:56.622545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1d0c79d5-4a3c-4795-ba49-723b42fda802 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:56.628919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d0c79d5-4a3c-4795-ba49-723b42fda802 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:56.629398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d0c79d5-4a3c-4795-ba49-723b42fda802 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:56.629906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d0c79d5-4a3c-4795-ba49-723b42fda802 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:56.630617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d0c79d5-4a3c-4795-ba49-723b42fda802 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:56.631074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d0c79d5-4a3c-4795-ba49-723b42fda802 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:56.631501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d0c79d5-4a3c-4795-ba49-723b42fda802 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:56.661479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1d0c79d5-4a3c-4795-ba49-723b42fda802 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045202 Aug 18 22:04:56.662060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 956/1920] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:56.747381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a92a21f8-5303-4839-bc86-a1fcdc513517 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:56.749527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a92a21f8-5303-4839-bc86-a1fcdc513517 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:56.755877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a92a21f8-5303-4839-bc86-a1fcdc513517 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:56.756352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a92a21f8-5303-4839-bc86-a1fcdc513517 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:56.757275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a92a21f8-5303-4839-bc86-a1fcdc513517 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:56.757988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a92a21f8-5303-4839-bc86-a1fcdc513517 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:56.758436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a92a21f8-5303-4839-bc86-a1fcdc513517 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:56.759172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a92a21f8-5303-4839-bc86-a1fcdc513517 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:56.789389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a92a21f8-5303-4839-bc86-a1fcdc513517 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045900 Aug 18 22:04:56.790674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 965/1921] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:56 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:56.821046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bef76e35-9a2d-4c34-8ac4-eaa37207b5b2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:56.823235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bef76e35-9a2d-4c34-8ac4-eaa37207b5b2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:56.829228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bef76e35-9a2d-4c34-8ac4-eaa37207b5b2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:56.829763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bef76e35-9a2d-4c34-8ac4-eaa37207b5b2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:56.830208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bef76e35-9a2d-4c34-8ac4-eaa37207b5b2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:56.830908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bef76e35-9a2d-4c34-8ac4-eaa37207b5b2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:56.831367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bef76e35-9a2d-4c34-8ac4-eaa37207b5b2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:56.831798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bef76e35-9a2d-4c34-8ac4-eaa37207b5b2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:56.859878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bef76e35-9a2d-4c34-8ac4-eaa37207b5b2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043471 Aug 18 22:04:56.860427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 957/1922] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:56 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:56.980124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8baa455a-01a0-4d6f-93ac-fd437e0072f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:56.982349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8baa455a-01a0-4d6f-93ac-fd437e0072f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:56.988383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8baa455a-01a0-4d6f-93ac-fd437e0072f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:56.988859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8baa455a-01a0-4d6f-93ac-fd437e0072f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:56.989298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8baa455a-01a0-4d6f-93ac-fd437e0072f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:56.990025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8baa455a-01a0-4d6f-93ac-fd437e0072f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:56.990509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8baa455a-01a0-4d6f-93ac-fd437e0072f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:56.990935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8baa455a-01a0-4d6f-93ac-fd437e0072f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:57.020177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8baa455a-01a0-4d6f-93ac-fd437e0072f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043977 Aug 18 22:04:57.020730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 966/1923] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:56 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:57.294069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1f733ae0-9d6c-42d0-ad7b-3133ff0e1fba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:57.296335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1f733ae0-9d6c-42d0-ad7b-3133ff0e1fba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:57.302571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f733ae0-9d6c-42d0-ad7b-3133ff0e1fba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:57.303052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f733ae0-9d6c-42d0-ad7b-3133ff0e1fba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:57.304123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f733ae0-9d6c-42d0-ad7b-3133ff0e1fba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:57.304944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f733ae0-9d6c-42d0-ad7b-3133ff0e1fba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:57.305404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f733ae0-9d6c-42d0-ad7b-3133ff0e1fba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:57.305885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f733ae0-9d6c-42d0-ad7b-3133ff0e1fba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:57.334084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1f733ae0-9d6c-42d0-ad7b-3133ff0e1fba tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044018 Aug 18 22:04:57.334643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 958/1924] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:57 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:57.737527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-90c9b9c7-6b4c-42fe-95e9-038bab9fbedd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:57.739659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-90c9b9c7-6b4c-42fe-95e9-038bab9fbedd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:57.745764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90c9b9c7-6b4c-42fe-95e9-038bab9fbedd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:57.746253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90c9b9c7-6b4c-42fe-95e9-038bab9fbedd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:57.746696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90c9b9c7-6b4c-42fe-95e9-038bab9fbedd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:57.747399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90c9b9c7-6b4c-42fe-95e9-038bab9fbedd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:57.747876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90c9b9c7-6b4c-42fe-95e9-038bab9fbedd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:57.748279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90c9b9c7-6b4c-42fe-95e9-038bab9fbedd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:57.777871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-90c9b9c7-6b4c-42fe-95e9-038bab9fbedd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.108620 Aug 18 22:04:57.778434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 967/1925] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:57.802361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-80a5cc01-5972-40cc-9ffb-974e2ff2d5e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:57.804543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-80a5cc01-5972-40cc-9ffb-974e2ff2d5e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:57.810681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80a5cc01-5972-40cc-9ffb-974e2ff2d5e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:57.811163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80a5cc01-5972-40cc-9ffb-974e2ff2d5e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:57.811627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80a5cc01-5972-40cc-9ffb-974e2ff2d5e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:57.812323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80a5cc01-5972-40cc-9ffb-974e2ff2d5e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:57.812781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80a5cc01-5972-40cc-9ffb-974e2ff2d5e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:57.813208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80a5cc01-5972-40cc-9ffb-974e2ff2d5e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:57.817037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:04:57.843602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-80a5cc01-5972-40cc-9ffb-974e2ff2d5e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045392 Aug 18 22:04:57.844196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 959/1926] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:57 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:04:57.871895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ccf0e1a7-b5a8-4c60-8bd0-8d9706b6769b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:57.874035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ccf0e1a7-b5a8-4c60-8bd0-8d9706b6769b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:57.879922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccf0e1a7-b5a8-4c60-8bd0-8d9706b6769b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:57.880392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccf0e1a7-b5a8-4c60-8bd0-8d9706b6769b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:57.880822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccf0e1a7-b5a8-4c60-8bd0-8d9706b6769b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:57.881518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccf0e1a7-b5a8-4c60-8bd0-8d9706b6769b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:57.882011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccf0e1a7-b5a8-4c60-8bd0-8d9706b6769b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:57.882434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ccf0e1a7-b5a8-4c60-8bd0-8d9706b6769b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:57.911180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ccf0e1a7-b5a8-4c60-8bd0-8d9706b6769b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043105 Aug 18 22:04:57.911953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 968/1927] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:58.032004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eff7bfc5-ff83-4870-91b8-c98e40688b72 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:58.034197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eff7bfc5-ff83-4870-91b8-c98e40688b72 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:58.040102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff7bfc5-ff83-4870-91b8-c98e40688b72 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:58.040579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff7bfc5-ff83-4870-91b8-c98e40688b72 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:58.041012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff7bfc5-ff83-4870-91b8-c98e40688b72 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:58.041729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff7bfc5-ff83-4870-91b8-c98e40688b72 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:58.042184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff7bfc5-ff83-4870-91b8-c98e40688b72 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:58.042608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff7bfc5-ff83-4870-91b8-c98e40688b72 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:58.071908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eff7bfc5-ff83-4870-91b8-c98e40688b72 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043887 Aug 18 22:04:58.072460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 960/1928] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:58.346467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fefc2d61-f97b-4f01-9657-3b57c3d20657 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:58.348643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fefc2d61-f97b-4f01-9657-3b57c3d20657 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:58.354625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fefc2d61-f97b-4f01-9657-3b57c3d20657 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:58.355109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fefc2d61-f97b-4f01-9657-3b57c3d20657 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:58.355551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fefc2d61-f97b-4f01-9657-3b57c3d20657 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:58.356246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fefc2d61-f97b-4f01-9657-3b57c3d20657 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:58.356705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fefc2d61-f97b-4f01-9657-3b57c3d20657 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:58.357133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fefc2d61-f97b-4f01-9657-3b57c3d20657 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:58.387403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fefc2d61-f97b-4f01-9657-3b57c3d20657 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044871 Aug 18 22:04:58.387960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 969/1929] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:58 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:58.790665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3e93b203-4f19-417f-83f9-a4b4026b35af tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:58.792901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3e93b203-4f19-417f-83f9-a4b4026b35af tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:58.798862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e93b203-4f19-417f-83f9-a4b4026b35af tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:58.799335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e93b203-4f19-417f-83f9-a4b4026b35af tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:58.799764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e93b203-4f19-417f-83f9-a4b4026b35af tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:58.800700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e93b203-4f19-417f-83f9-a4b4026b35af tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:58.801145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e93b203-4f19-417f-83f9-a4b4026b35af tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:58.801571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e93b203-4f19-417f-83f9-a4b4026b35af tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:58.830657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3e93b203-4f19-417f-83f9-a4b4026b35af tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044455 Aug 18 22:04:58.831214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 961/1930] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:58.855437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d9ec03f4-36b4-4b2a-9a6f-74e1620162db tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:58.857662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d9ec03f4-36b4-4b2a-9a6f-74e1620162db tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:58.863980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9ec03f4-36b4-4b2a-9a6f-74e1620162db tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:58.864462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9ec03f4-36b4-4b2a-9a6f-74e1620162db tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:58.864900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9ec03f4-36b4-4b2a-9a6f-74e1620162db tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:58.865645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9ec03f4-36b4-4b2a-9a6f-74e1620162db tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:58.866783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9ec03f4-36b4-4b2a-9a6f-74e1620162db tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:58.867290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d9ec03f4-36b4-4b2a-9a6f-74e1620162db tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:58.897084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d9ec03f4-36b4-4b2a-9a6f-74e1620162db tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045488 Aug 18 22:04:58.897666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 970/1931] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:58 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:58.923827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b9aa449c-e792-48c8-9261-e8b5b872ed6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:58.926401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b9aa449c-e792-48c8-9261-e8b5b872ed6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:58.933069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9aa449c-e792-48c8-9261-e8b5b872ed6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:58.933554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9aa449c-e792-48c8-9261-e8b5b872ed6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:58.934024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9aa449c-e792-48c8-9261-e8b5b872ed6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:58.934720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9aa449c-e792-48c8-9261-e8b5b872ed6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:58.935174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9aa449c-e792-48c8-9261-e8b5b872ed6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:58.935600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9aa449c-e792-48c8-9261-e8b5b872ed6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:58.963562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b9aa449c-e792-48c8-9261-e8b5b872ed6d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043787 Aug 18 22:04:58.964118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 962/1932] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:58 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:59.084167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4a510a98-e3a3-4983-add8-6813dbbc5d32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:59.086967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4a510a98-e3a3-4983-add8-6813dbbc5d32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:59.092849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a510a98-e3a3-4983-add8-6813dbbc5d32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:59.093324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a510a98-e3a3-4983-add8-6813dbbc5d32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:59.093840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a510a98-e3a3-4983-add8-6813dbbc5d32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:59.094539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a510a98-e3a3-4983-add8-6813dbbc5d32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:59.094993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a510a98-e3a3-4983-add8-6813dbbc5d32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:59.095418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a510a98-e3a3-4983-add8-6813dbbc5d32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:59.124317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4a510a98-e3a3-4983-add8-6813dbbc5d32 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044114 Aug 18 22:04:59.124868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 971/1933] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:59 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:59.400122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3d2df3e8-db73-474a-86a5-9f447a428340 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:59.402245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3d2df3e8-db73-474a-86a5-9f447a428340 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:59.408390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d2df3e8-db73-474a-86a5-9f447a428340 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:59.408870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d2df3e8-db73-474a-86a5-9f447a428340 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:59.409305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d2df3e8-db73-474a-86a5-9f447a428340 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:59.410032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d2df3e8-db73-474a-86a5-9f447a428340 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:59.410487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d2df3e8-db73-474a-86a5-9f447a428340 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:59.410915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d2df3e8-db73-474a-86a5-9f447a428340 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:59.440326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3d2df3e8-db73-474a-86a5-9f447a428340 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044737 Aug 18 22:04:59.440878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 963/1934] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:59 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:59.841994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-54cc74ed-54cc-42c0-a403-9a2a5178790e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:59.844473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-54cc74ed-54cc-42c0-a403-9a2a5178790e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:59.850656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54cc74ed-54cc-42c0-a403-9a2a5178790e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:59.851125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54cc74ed-54cc-42c0-a403-9a2a5178790e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:59.851564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54cc74ed-54cc-42c0-a403-9a2a5178790e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:59.852253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54cc74ed-54cc-42c0-a403-9a2a5178790e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:59.852708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54cc74ed-54cc-42c0-a403-9a2a5178790e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:59.853132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54cc74ed-54cc-42c0-a403-9a2a5178790e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:59.883603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-54cc74ed-54cc-42c0-a403-9a2a5178790e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045560 Aug 18 22:04:59.884209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 972/1935] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:04:59 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:04:59.908257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e0035622-a069-46bd-8374-21ed02904f0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:59.910487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e0035622-a069-46bd-8374-21ed02904f0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:59.916819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0035622-a069-46bd-8374-21ed02904f0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:59.917304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0035622-a069-46bd-8374-21ed02904f0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:59.917784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0035622-a069-46bd-8374-21ed02904f0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:59.918478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0035622-a069-46bd-8374-21ed02904f0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:59.918937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0035622-a069-46bd-8374-21ed02904f0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:59.919370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0035622-a069-46bd-8374-21ed02904f0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:59.950046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e0035622-a069-46bd-8374-21ed02904f0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045585 Aug 18 22:04:59.950685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 964/1936] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:59 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:04:59.976958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-14c692af-f8b2-45b1-bf56-ad7d8b0eb641 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:04:59.978265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-14c692af-f8b2-45b1-bf56-ad7d8b0eb641 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:04:59.984185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c692af-f8b2-45b1-bf56-ad7d8b0eb641 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:59.984661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c692af-f8b2-45b1-bf56-ad7d8b0eb641 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:59.985090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c692af-f8b2-45b1-bf56-ad7d8b0eb641 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:04:59.985938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c692af-f8b2-45b1-bf56-ad7d8b0eb641 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:04:59.986386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c692af-f8b2-45b1-bf56-ad7d8b0eb641 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:04:59.986805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14c692af-f8b2-45b1-bf56-ad7d8b0eb641 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:00.016076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-14c692af-f8b2-45b1-bf56-ad7d8b0eb641 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 Aug 18 22:05:00.016626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 973/1937] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:04:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:00.201693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9022527d-9291-4ac5-ae16-ae969a3c808b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:00.203839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9022527d-9291-4ac5-ae16-ae969a3c808b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:00.209790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9022527d-9291-4ac5-ae16-ae969a3c808b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:00.210276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9022527d-9291-4ac5-ae16-ae969a3c808b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:00.210720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9022527d-9291-4ac5-ae16-ae969a3c808b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:00.211416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9022527d-9291-4ac5-ae16-ae969a3c808b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:00.211875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9022527d-9291-4ac5-ae16-ae969a3c808b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:00.212307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9022527d-9291-4ac5-ae16-ae969a3c808b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:00.242159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9022527d-9291-4ac5-ae16-ae969a3c808b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109605 Aug 18 22:05:00.242653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 965/1938] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:00 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:00.452565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7cc56101-5324-4927-9722-dcafa8607c97 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:00.454757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7cc56101-5324-4927-9722-dcafa8607c97 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:00.461078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cc56101-5324-4927-9722-dcafa8607c97 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:00.461590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cc56101-5324-4927-9722-dcafa8607c97 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:00.462055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cc56101-5324-4927-9722-dcafa8607c97 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:00.462763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cc56101-5324-4927-9722-dcafa8607c97 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:00.463214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cc56101-5324-4927-9722-dcafa8607c97 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:00.463641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7cc56101-5324-4927-9722-dcafa8607c97 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:00.494505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7cc56101-5324-4927-9722-dcafa8607c97 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Aug 18 22:05:00.494989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 974/1939] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:00 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:00.896095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-823dc527-5bbe-4abc-bd93-095cfa797d98 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:00.898933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-823dc527-5bbe-4abc-bd93-095cfa797d98 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:00.905022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-823dc527-5bbe-4abc-bd93-095cfa797d98 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:00.905506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-823dc527-5bbe-4abc-bd93-095cfa797d98 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:00.905987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-823dc527-5bbe-4abc-bd93-095cfa797d98 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:00.906710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-823dc527-5bbe-4abc-bd93-095cfa797d98 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:00.907170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-823dc527-5bbe-4abc-bd93-095cfa797d98 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:00.907600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-823dc527-5bbe-4abc-bd93-095cfa797d98 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:00.937223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-823dc527-5bbe-4abc-bd93-095cfa797d98 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045159 Aug 18 22:05:00.937828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 966/1940] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:05:00 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:05:00.962978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e583a8cb-0ef2-484b-89bf-72f1f915c861 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:00.965128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e583a8cb-0ef2-484b-89bf-72f1f915c861 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:00.971377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e583a8cb-0ef2-484b-89bf-72f1f915c861 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:00.971852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e583a8cb-0ef2-484b-89bf-72f1f915c861 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:00.972282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e583a8cb-0ef2-484b-89bf-72f1f915c861 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:00.972965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e583a8cb-0ef2-484b-89bf-72f1f915c861 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:00.973416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e583a8cb-0ef2-484b-89bf-72f1f915c861 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:00.973874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e583a8cb-0ef2-484b-89bf-72f1f915c861 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:01.002633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e583a8cb-0ef2-484b-89bf-72f1f915c861 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044220 Aug 18 22:05:01.003197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 975/1941] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:00 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:01.028922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-84dd3fc8-1d45-4471-ab4a-9e14a24faac2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:01.031171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-84dd3fc8-1d45-4471-ab4a-9e14a24faac2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:01.037066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84dd3fc8-1d45-4471-ab4a-9e14a24faac2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:01.037548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84dd3fc8-1d45-4471-ab4a-9e14a24faac2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:01.038055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84dd3fc8-1d45-4471-ab4a-9e14a24faac2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:01.038778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84dd3fc8-1d45-4471-ab4a-9e14a24faac2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:01.039232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84dd3fc8-1d45-4471-ab4a-9e14a24faac2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:01.039661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84dd3fc8-1d45-4471-ab4a-9e14a24faac2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:01.068996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-84dd3fc8-1d45-4471-ab4a-9e14a24faac2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Aug 18 22:05:01.070066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 967/1942] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:01 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:01.254482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0e135aa5-36b2-47d6-91aa-b4a1a4ca7a40 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:01.257057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0e135aa5-36b2-47d6-91aa-b4a1a4ca7a40 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:01.262989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e135aa5-36b2-47d6-91aa-b4a1a4ca7a40 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:01.263474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e135aa5-36b2-47d6-91aa-b4a1a4ca7a40 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:01.263913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e135aa5-36b2-47d6-91aa-b4a1a4ca7a40 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:01.264616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e135aa5-36b2-47d6-91aa-b4a1a4ca7a40 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:01.265071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e135aa5-36b2-47d6-91aa-b4a1a4ca7a40 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:01.265503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e135aa5-36b2-47d6-91aa-b4a1a4ca7a40 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:01.279481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:01.295032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0e135aa5-36b2-47d6-91aa-b4a1a4ca7a40 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044591 Aug 18 22:05:01.295782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 976/1943] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:01 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:01.508586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-72bb028e-0ebe-4ac9-af93-cf713b1f9611 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:01.510720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-72bb028e-0ebe-4ac9-af93-cf713b1f9611 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:01.516713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72bb028e-0ebe-4ac9-af93-cf713b1f9611 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:01.517194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72bb028e-0ebe-4ac9-af93-cf713b1f9611 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:01.517689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72bb028e-0ebe-4ac9-af93-cf713b1f9611 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:01.518383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72bb028e-0ebe-4ac9-af93-cf713b1f9611 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:01.518841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72bb028e-0ebe-4ac9-af93-cf713b1f9611 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:01.519287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72bb028e-0ebe-4ac9-af93-cf713b1f9611 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:01.547657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-72bb028e-0ebe-4ac9-af93-cf713b1f9611 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043725 Aug 18 22:05:01.548204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 968/1944] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:01 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:01.950540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-463a5cfd-9dfe-446c-a27a-23e6e7b51672 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:01.952673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-463a5cfd-9dfe-446c-a27a-23e6e7b51672 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:01.958713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-463a5cfd-9dfe-446c-a27a-23e6e7b51672 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:01.959200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-463a5cfd-9dfe-446c-a27a-23e6e7b51672 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:01.959635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-463a5cfd-9dfe-446c-a27a-23e6e7b51672 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:01.960336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-463a5cfd-9dfe-446c-a27a-23e6e7b51672 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:01.960791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-463a5cfd-9dfe-446c-a27a-23e6e7b51672 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:01.961220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-463a5cfd-9dfe-446c-a27a-23e6e7b51672 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:01.990622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-463a5cfd-9dfe-446c-a27a-23e6e7b51672 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044799 Aug 18 22:05:01.991927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 977/1945] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:05:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:05:02.015310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-42826122-6e13-450b-b7d0-9e45c42852c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:02.017458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-42826122-6e13-450b-b7d0-9e45c42852c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:02.023911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42826122-6e13-450b-b7d0-9e45c42852c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:02.024397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42826122-6e13-450b-b7d0-9e45c42852c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:02.024842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42826122-6e13-450b-b7d0-9e45c42852c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:02.025543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42826122-6e13-450b-b7d0-9e45c42852c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:02.026032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42826122-6e13-450b-b7d0-9e45c42852c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:02.026465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42826122-6e13-450b-b7d0-9e45c42852c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:02.056628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-42826122-6e13-450b-b7d0-9e45c42852c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045180 Aug 18 22:05:02.060891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 969/1946] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:02.081485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6a80e54b-09fe-4d40-b2cc-7bc4106d6f0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:02.083815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6a80e54b-09fe-4d40-b2cc-7bc4106d6f0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:02.091357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a80e54b-09fe-4d40-b2cc-7bc4106d6f0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:02.091930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a80e54b-09fe-4d40-b2cc-7bc4106d6f0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:02.092373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a80e54b-09fe-4d40-b2cc-7bc4106d6f0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:02.093080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a80e54b-09fe-4d40-b2cc-7bc4106d6f0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:02.093635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a80e54b-09fe-4d40-b2cc-7bc4106d6f0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:02.094072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a80e54b-09fe-4d40-b2cc-7bc4106d6f0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:02.123881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6a80e54b-09fe-4d40-b2cc-7bc4106d6f0c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046267 Aug 18 22:05:02.124445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 978/1947] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:02 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:02.307839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a2785552-84c2-415f-b535-6b090156d48a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:02.310022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a2785552-84c2-415f-b535-6b090156d48a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:02.316132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2785552-84c2-415f-b535-6b090156d48a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:02.316620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2785552-84c2-415f-b535-6b090156d48a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:02.317092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2785552-84c2-415f-b535-6b090156d48a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:02.317834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2785552-84c2-415f-b535-6b090156d48a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:02.318293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2785552-84c2-415f-b535-6b090156d48a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:02.318725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2785552-84c2-415f-b535-6b090156d48a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:02.347512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a2785552-84c2-415f-b535-6b090156d48a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043625 Aug 18 22:05:02.348072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 970/1948] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:02 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:02.560257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-abab60e5-6cf4-44f5-81a8-c3f1fbd167f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:02.562412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-abab60e5-6cf4-44f5-81a8-c3f1fbd167f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:02.568346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abab60e5-6cf4-44f5-81a8-c3f1fbd167f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:02.568839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abab60e5-6cf4-44f5-81a8-c3f1fbd167f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:02.569800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abab60e5-6cf4-44f5-81a8-c3f1fbd167f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:02.570500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abab60e5-6cf4-44f5-81a8-c3f1fbd167f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:02.570959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abab60e5-6cf4-44f5-81a8-c3f1fbd167f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:02.571388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abab60e5-6cf4-44f5-81a8-c3f1fbd167f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:02.601379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-abab60e5-6cf4-44f5-81a8-c3f1fbd167f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044990 Aug 18 22:05:02.601976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 979/1949] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:02 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:03.003515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f3b47de2-c56b-421e-9a4b-1d96ff6dd32b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:03.005679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f3b47de2-c56b-421e-9a4b-1d96ff6dd32b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:03.012193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3b47de2-c56b-421e-9a4b-1d96ff6dd32b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:03.012674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3b47de2-c56b-421e-9a4b-1d96ff6dd32b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:03.013110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3b47de2-c56b-421e-9a4b-1d96ff6dd32b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:03.013845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3b47de2-c56b-421e-9a4b-1d96ff6dd32b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:03.014394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3b47de2-c56b-421e-9a4b-1d96ff6dd32b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:03.014831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3b47de2-c56b-421e-9a4b-1d96ff6dd32b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:03.043701 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f3b47de2-c56b-421e-9a4b-1d96ff6dd32b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044238 Aug 18 22:05:03.044255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 971/1950] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:05:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:05:03.068217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-065b7801-5d15-4ceb-83be-ffc846f7259a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:03.071069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-065b7801-5d15-4ceb-83be-ffc846f7259a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:03.077320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-065b7801-5d15-4ceb-83be-ffc846f7259a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:03.077835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-065b7801-5d15-4ceb-83be-ffc846f7259a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:03.078263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-065b7801-5d15-4ceb-83be-ffc846f7259a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:03.078947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-065b7801-5d15-4ceb-83be-ffc846f7259a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:03.079406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-065b7801-5d15-4ceb-83be-ffc846f7259a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:03.079831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-065b7801-5d15-4ceb-83be-ffc846f7259a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:03.109127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-065b7801-5d15-4ceb-83be-ffc846f7259a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Aug 18 22:05:03.109721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 980/1951] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:03.136670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7d27e9a4-470c-4da9-9a0c-cb609c547819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:03.138840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7d27e9a4-470c-4da9-9a0c-cb609c547819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:03.145573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d27e9a4-470c-4da9-9a0c-cb609c547819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:03.146124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d27e9a4-470c-4da9-9a0c-cb609c547819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:03.146567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d27e9a4-470c-4da9-9a0c-cb609c547819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:03.147281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d27e9a4-470c-4da9-9a0c-cb609c547819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:03.147767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d27e9a4-470c-4da9-9a0c-cb609c547819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:03.148200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d27e9a4-470c-4da9-9a0c-cb609c547819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:03.176620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7d27e9a4-470c-4da9-9a0c-cb609c547819 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043894 Aug 18 22:05:03.177189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 972/1952] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:03 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:03.360319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-850c1800-3dfd-484e-ace8-a4b26aa3303d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:03.362455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-850c1800-3dfd-484e-ace8-a4b26aa3303d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:03.368873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-850c1800-3dfd-484e-ace8-a4b26aa3303d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:03.369343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-850c1800-3dfd-484e-ace8-a4b26aa3303d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:03.369800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-850c1800-3dfd-484e-ace8-a4b26aa3303d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:03.370487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-850c1800-3dfd-484e-ace8-a4b26aa3303d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:03.370937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-850c1800-3dfd-484e-ace8-a4b26aa3303d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:03.371357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-850c1800-3dfd-484e-ace8-a4b26aa3303d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:03.399150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-850c1800-3dfd-484e-ace8-a4b26aa3303d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042735 Aug 18 22:05:03.399627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 981/1953] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:03 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:03.613688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0893750a-1bf6-4700-ab2e-27146dbdef83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:03.615870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0893750a-1bf6-4700-ab2e-27146dbdef83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:03.622405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0893750a-1bf6-4700-ab2e-27146dbdef83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:03.622892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0893750a-1bf6-4700-ab2e-27146dbdef83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:03.623336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0893750a-1bf6-4700-ab2e-27146dbdef83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:03.624033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0893750a-1bf6-4700-ab2e-27146dbdef83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:03.624493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0893750a-1bf6-4700-ab2e-27146dbdef83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:03.624925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0893750a-1bf6-4700-ab2e-27146dbdef83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:03.654629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0893750a-1bf6-4700-ab2e-27146dbdef83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Aug 18 22:05:03.655129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 973/1954] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:03 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:04.057338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d3e3052b-f771-4e77-b743-68132fffc777 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:04.059519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d3e3052b-f771-4e77-b743-68132fffc777 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:04.065396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3e3052b-f771-4e77-b743-68132fffc777 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:04.065899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3e3052b-f771-4e77-b743-68132fffc777 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:04.066334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3e3052b-f771-4e77-b743-68132fffc777 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:04.067024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3e3052b-f771-4e77-b743-68132fffc777 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:04.067478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3e3052b-f771-4e77-b743-68132fffc777 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:04.067904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3e3052b-f771-4e77-b743-68132fffc777 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:04.096230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d3e3052b-f771-4e77-b743-68132fffc777 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043547 Aug 18 22:05:04.096892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 982/1955] 10.222.0.82 () {60 vars in 1343 bytes} [Thu Aug 18 22:05:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:05:04.121384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-19d1caf1-e763-4159-a6c4-07667d4c9b33 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:04.123542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-19d1caf1-e763-4159-a6c4-07667d4c9b33 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:04.129917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19d1caf1-e763-4159-a6c4-07667d4c9b33 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:04.130399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19d1caf1-e763-4159-a6c4-07667d4c9b33 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:04.130837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19d1caf1-e763-4159-a6c4-07667d4c9b33 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:04.131820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19d1caf1-e763-4159-a6c4-07667d4c9b33 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:04.132002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19d1caf1-e763-4159-a6c4-07667d4c9b33 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:04.132895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-19d1caf1-e763-4159-a6c4-07667d4c9b33 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:04.161856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-19d1caf1-e763-4159-a6c4-07667d4c9b33 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 Aug 18 22:05:04.162467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 974/1956] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:04.188752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0be20547-c2ee-473a-ac71-5d50a9906400 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:04.190948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0be20547-c2ee-473a-ac71-5d50a9906400 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:04.196798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0be20547-c2ee-473a-ac71-5d50a9906400 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:04.197282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0be20547-c2ee-473a-ac71-5d50a9906400 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:04.197758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0be20547-c2ee-473a-ac71-5d50a9906400 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:04.198455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0be20547-c2ee-473a-ac71-5d50a9906400 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:04.198917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0be20547-c2ee-473a-ac71-5d50a9906400 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:04.199437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0be20547-c2ee-473a-ac71-5d50a9906400 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:04.228479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0be20547-c2ee-473a-ac71-5d50a9906400 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043558 Aug 18 22:05:04.229039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 983/1957] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:04.412329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-222c7d88-7f96-4bb6-bdd1-22418f6e81e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:04.415062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-222c7d88-7f96-4bb6-bdd1-22418f6e81e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:04.421446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-222c7d88-7f96-4bb6-bdd1-22418f6e81e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:04.421964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-222c7d88-7f96-4bb6-bdd1-22418f6e81e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:04.422438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-222c7d88-7f96-4bb6-bdd1-22418f6e81e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:04.423141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-222c7d88-7f96-4bb6-bdd1-22418f6e81e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:04.423630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-222c7d88-7f96-4bb6-bdd1-22418f6e81e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:04.424060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-222c7d88-7f96-4bb6-bdd1-22418f6e81e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:04.449029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:04.454780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-222c7d88-7f96-4bb6-bdd1-22418f6e81e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047423 Aug 18 22:05:04.455340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 975/1958] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:04 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:05:04.667499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a0eab68e-7d46-4f57-a500-8e0ee9a83414 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:04.669561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a0eab68e-7d46-4f57-a500-8e0ee9a83414 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:04.676260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0eab68e-7d46-4f57-a500-8e0ee9a83414 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:04.676753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0eab68e-7d46-4f57-a500-8e0ee9a83414 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:04.677190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0eab68e-7d46-4f57-a500-8e0ee9a83414 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:04.677915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0eab68e-7d46-4f57-a500-8e0ee9a83414 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:04.678370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0eab68e-7d46-4f57-a500-8e0ee9a83414 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:04.678796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a0eab68e-7d46-4f57-a500-8e0ee9a83414 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:04.710484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a0eab68e-7d46-4f57-a500-8e0ee9a83414 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046841 Aug 18 22:05:04.711058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 984/1959] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:04 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:05.109276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-574dbd88-fe50-4282-ba92-dcac69913bd0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:05:05.111488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-574dbd88-fe50-4282-ba92-dcac69913bd0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:05.119845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-574dbd88-fe50-4282-ba92-dcac69913bd0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:05.120334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-574dbd88-fe50-4282-ba92-dcac69913bd0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:05.120771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-574dbd88-fe50-4282-ba92-dcac69913bd0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:05.121475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-574dbd88-fe50-4282-ba92-dcac69913bd0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:05.121956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-574dbd88-fe50-4282-ba92-dcac69913bd0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:05.122380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-574dbd88-fe50-4282-ba92-dcac69913bd0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:05.174568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-63365e1e-ccb5-43b3-a5a1-3267947f4e93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:05.176959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-63365e1e-ccb5-43b3-a5a1-3267947f4e93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:05.183748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63365e1e-ccb5-43b3-a5a1-3267947f4e93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:05.184224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63365e1e-ccb5-43b3-a5a1-3267947f4e93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:05.184664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63365e1e-ccb5-43b3-a5a1-3267947f4e93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:05.185352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63365e1e-ccb5-43b3-a5a1-3267947f4e93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:05.185836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63365e1e-ccb5-43b3-a5a1-3267947f4e93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:05.186975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63365e1e-ccb5-43b3-a5a1-3267947f4e93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:05.203799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-574dbd88-fe50-4282-ba92-dcac69913bd0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "POST /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/action" status: 200 len: 37835 microversion: 2.20 time: 0.098203 Aug 18 22:05:05.210581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 976/1960] 10.222.0.82 () {62 vars in 1319 bytes} [Thu Aug 18 22:05:05 2022] POST /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47/action => generated 37835 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:05:05.219849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-63365e1e-ccb5-43b3-a5a1-3267947f4e93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048901 Aug 18 22:05:05.220609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 985/1961] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:05:05.240831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0ccb1986-958e-4654-bee6-f46fad30d20f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:05.243596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0ccb1986-958e-4654-bee6-f46fad30d20f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:05.250685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ccb1986-958e-4654-bee6-f46fad30d20f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:05.251177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ccb1986-958e-4654-bee6-f46fad30d20f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:05.251618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ccb1986-958e-4654-bee6-f46fad30d20f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:05.252326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ccb1986-958e-4654-bee6-f46fad30d20f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:05.252785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ccb1986-958e-4654-bee6-f46fad30d20f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:05.253220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ccb1986-958e-4654-bee6-f46fad30d20f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:05.294636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0ccb1986-958e-4654-bee6-f46fad30d20f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058002 Aug 18 22:05:05.295507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 977/1962] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:05 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:05.467827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3358d091-4682-4030-9bc4-2e54f382406d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:05.469902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3358d091-4682-4030-9bc4-2e54f382406d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:05.476307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3358d091-4682-4030-9bc4-2e54f382406d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:05.476784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3358d091-4682-4030-9bc4-2e54f382406d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:05.477228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3358d091-4682-4030-9bc4-2e54f382406d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:05.477937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3358d091-4682-4030-9bc4-2e54f382406d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:05.478392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3358d091-4682-4030-9bc4-2e54f382406d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:05.478818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3358d091-4682-4030-9bc4-2e54f382406d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:05.507582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3358d091-4682-4030-9bc4-2e54f382406d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043774 Aug 18 22:05:05.508134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 986/1963] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:05 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:05.723030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-934ec469-ed95-47ea-b94d-f720692ea80f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:05.725194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-934ec469-ed95-47ea-b94d-f720692ea80f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:05.732082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-934ec469-ed95-47ea-b94d-f720692ea80f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:05.732557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-934ec469-ed95-47ea-b94d-f720692ea80f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:05.732995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-934ec469-ed95-47ea-b94d-f720692ea80f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:05.733717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-934ec469-ed95-47ea-b94d-f720692ea80f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:05.734174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-934ec469-ed95-47ea-b94d-f720692ea80f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:05.734599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-934ec469-ed95-47ea-b94d-f720692ea80f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:05.763649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-934ec469-ed95-47ea-b94d-f720692ea80f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044578 Aug 18 22:05:05.764206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 978/1964] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:05 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:06.232345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cc3aef1d-bc1c-4662-85d0-9355e8567a4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:06.234577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cc3aef1d-bc1c-4662-85d0-9355e8567a4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:06.240963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc3aef1d-bc1c-4662-85d0-9355e8567a4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:06.241446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc3aef1d-bc1c-4662-85d0-9355e8567a4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:06.241919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc3aef1d-bc1c-4662-85d0-9355e8567a4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:06.242620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc3aef1d-bc1c-4662-85d0-9355e8567a4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:06.243079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc3aef1d-bc1c-4662-85d0-9355e8567a4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:06.243511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc3aef1d-bc1c-4662-85d0-9355e8567a4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:06.273454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cc3aef1d-bc1c-4662-85d0-9355e8567a4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045089 Aug 18 22:05:06.274056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 987/1965] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:06.307149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c0a332d7-471f-47af-b615-09226b42084b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:06.309323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c0a332d7-471f-47af-b615-09226b42084b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:06.315955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0a332d7-471f-47af-b615-09226b42084b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:06.316439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0a332d7-471f-47af-b615-09226b42084b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:06.316877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0a332d7-471f-47af-b615-09226b42084b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:06.317573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0a332d7-471f-47af-b615-09226b42084b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:06.318048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0a332d7-471f-47af-b615-09226b42084b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:06.318478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0a332d7-471f-47af-b615-09226b42084b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:06.349025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c0a332d7-471f-47af-b615-09226b42084b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045794 Aug 18 22:05:06.349610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 979/1966] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:06 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:06.520000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3893e33c-5550-4b40-9ae5-9826769ba6d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:06.522083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3893e33c-5550-4b40-9ae5-9826769ba6d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:06.528542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3893e33c-5550-4b40-9ae5-9826769ba6d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:06.529023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3893e33c-5550-4b40-9ae5-9826769ba6d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:06.529467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3893e33c-5550-4b40-9ae5-9826769ba6d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:06.530193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3893e33c-5550-4b40-9ae5-9826769ba6d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:06.530652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3893e33c-5550-4b40-9ae5-9826769ba6d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:06.531108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3893e33c-5550-4b40-9ae5-9826769ba6d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:06.560225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3893e33c-5550-4b40-9ae5-9826769ba6d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044218 Aug 18 22:05:06.560783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 988/1967] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:06 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:06.775730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b09b5440-bffb-4af9-b771-2389809aec66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:06.777889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b09b5440-bffb-4af9-b771-2389809aec66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:06.784258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b09b5440-bffb-4af9-b771-2389809aec66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:06.784739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b09b5440-bffb-4af9-b771-2389809aec66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:06.785174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b09b5440-bffb-4af9-b771-2389809aec66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:06.785894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b09b5440-bffb-4af9-b771-2389809aec66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:06.786349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b09b5440-bffb-4af9-b771-2389809aec66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:06.786773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b09b5440-bffb-4af9-b771-2389809aec66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:06.816485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b09b5440-bffb-4af9-b771-2389809aec66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044643 Aug 18 22:05:06.817051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 980/1968] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:06 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:07.285563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5e91d118-09d4-4653-b43a-17c7cc19bb56 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:07.288330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5e91d118-09d4-4653-b43a-17c7cc19bb56 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:07.294807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e91d118-09d4-4653-b43a-17c7cc19bb56 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:07.295284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e91d118-09d4-4653-b43a-17c7cc19bb56 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:07.295748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e91d118-09d4-4653-b43a-17c7cc19bb56 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:07.296451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e91d118-09d4-4653-b43a-17c7cc19bb56 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:07.296904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e91d118-09d4-4653-b43a-17c7cc19bb56 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:07.297332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e91d118-09d4-4653-b43a-17c7cc19bb56 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:07.327025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5e91d118-09d4-4653-b43a-17c7cc19bb56 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045416 Aug 18 22:05:07.327878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 989/1969] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:07 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:07.361137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3becb425-64a5-4f71-84ad-70788587989b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:07.363373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3becb425-64a5-4f71-84ad-70788587989b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:07.369794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3becb425-64a5-4f71-84ad-70788587989b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:07.370284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3becb425-64a5-4f71-84ad-70788587989b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:07.370736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3becb425-64a5-4f71-84ad-70788587989b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:07.371419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3becb425-64a5-4f71-84ad-70788587989b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:07.371878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3becb425-64a5-4f71-84ad-70788587989b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:07.372310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3becb425-64a5-4f71-84ad-70788587989b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:07.401952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3becb425-64a5-4f71-84ad-70788587989b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044816 Aug 18 22:05:07.406921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 981/1970] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:07.572529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ec0d2326-adda-4666-9578-f26a55520c88 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:07.574604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ec0d2326-adda-4666-9578-f26a55520c88 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:07.580492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec0d2326-adda-4666-9578-f26a55520c88 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:07.581019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec0d2326-adda-4666-9578-f26a55520c88 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:07.581442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec0d2326-adda-4666-9578-f26a55520c88 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:07.582158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec0d2326-adda-4666-9578-f26a55520c88 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:07.582611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec0d2326-adda-4666-9578-f26a55520c88 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:07.583039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec0d2326-adda-4666-9578-f26a55520c88 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:07.612584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ec0d2326-adda-4666-9578-f26a55520c88 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044032 Aug 18 22:05:07.613151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 990/1971] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:07 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:07.830119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6510ac1f-a615-4b98-bfb7-59ece6142766 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:07.832180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6510ac1f-a615-4b98-bfb7-59ece6142766 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:07.838802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6510ac1f-a615-4b98-bfb7-59ece6142766 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:07.839293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6510ac1f-a615-4b98-bfb7-59ece6142766 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:07.839730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6510ac1f-a615-4b98-bfb7-59ece6142766 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:07.840420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6510ac1f-a615-4b98-bfb7-59ece6142766 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:07.840873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6510ac1f-a615-4b98-bfb7-59ece6142766 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:07.841298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6510ac1f-a615-4b98-bfb7-59ece6142766 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:07.870637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6510ac1f-a615-4b98-bfb7-59ece6142766 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044734 Aug 18 22:05:07.871214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 982/1972] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:07 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:08.339336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fd0c7919-f4d8-4ca7-a7e0-4e6c857e4d2e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:08.341678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fd0c7919-f4d8-4ca7-a7e0-4e6c857e4d2e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:08.348062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd0c7919-f4d8-4ca7-a7e0-4e6c857e4d2e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:08.348533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd0c7919-f4d8-4ca7-a7e0-4e6c857e4d2e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:08.348970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd0c7919-f4d8-4ca7-a7e0-4e6c857e4d2e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:08.349689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd0c7919-f4d8-4ca7-a7e0-4e6c857e4d2e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:08.350188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd0c7919-f4d8-4ca7-a7e0-4e6c857e4d2e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:08.350572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd0c7919-f4d8-4ca7-a7e0-4e6c857e4d2e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:08.380823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fd0c7919-f4d8-4ca7-a7e0-4e6c857e4d2e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Aug 18 22:05:08.381399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 991/1973] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:05:08.414601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d22293a6-ac17-4bcb-8ff4-a8bb5879d9f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:08.416918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d22293a6-ac17-4bcb-8ff4-a8bb5879d9f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:08.423080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d22293a6-ac17-4bcb-8ff4-a8bb5879d9f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:08.423566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d22293a6-ac17-4bcb-8ff4-a8bb5879d9f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:08.424000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d22293a6-ac17-4bcb-8ff4-a8bb5879d9f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:08.424702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d22293a6-ac17-4bcb-8ff4-a8bb5879d9f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:08.425154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d22293a6-ac17-4bcb-8ff4-a8bb5879d9f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:08.425866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d22293a6-ac17-4bcb-8ff4-a8bb5879d9f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:08.458211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d22293a6-ac17-4bcb-8ff4-a8bb5879d9f4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047361 Aug 18 22:05:08.458982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 983/1974] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:08 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:08.625288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-359df4a6-3ad9-48b4-aa14-695af1625e7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:08.627415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-359df4a6-3ad9-48b4-aa14-695af1625e7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:08.633773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-359df4a6-3ad9-48b4-aa14-695af1625e7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:08.634262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-359df4a6-3ad9-48b4-aa14-695af1625e7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:08.634700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-359df4a6-3ad9-48b4-aa14-695af1625e7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:08.635397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-359df4a6-3ad9-48b4-aa14-695af1625e7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:08.635855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-359df4a6-3ad9-48b4-aa14-695af1625e7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:08.636285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-359df4a6-3ad9-48b4-aa14-695af1625e7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:08.666623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-359df4a6-3ad9-48b4-aa14-695af1625e7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045256 Aug 18 22:05:08.667949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 992/1975] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:08 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:08.883159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5d125ded-7541-4e7e-80bb-d95e37dc1636 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:08.885283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5d125ded-7541-4e7e-80bb-d95e37dc1636 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:08.891231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d125ded-7541-4e7e-80bb-d95e37dc1636 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:08.891704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d125ded-7541-4e7e-80bb-d95e37dc1636 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:08.892142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d125ded-7541-4e7e-80bb-d95e37dc1636 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:08.892826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d125ded-7541-4e7e-80bb-d95e37dc1636 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:08.893275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d125ded-7541-4e7e-80bb-d95e37dc1636 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:08.893725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d125ded-7541-4e7e-80bb-d95e37dc1636 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:08.923070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5d125ded-7541-4e7e-80bb-d95e37dc1636 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044482 Aug 18 22:05:08.923643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 984/1976] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:08 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:09.393856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2549e401-a738-4071-ae06-5f34f17d6d63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:09.396046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2549e401-a738-4071-ae06-5f34f17d6d63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:09.402382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2549e401-a738-4071-ae06-5f34f17d6d63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:09.402880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2549e401-a738-4071-ae06-5f34f17d6d63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:09.403307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2549e401-a738-4071-ae06-5f34f17d6d63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:09.403995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2549e401-a738-4071-ae06-5f34f17d6d63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:09.404440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2549e401-a738-4071-ae06-5f34f17d6d63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:09.404884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2549e401-a738-4071-ae06-5f34f17d6d63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:09.408419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:09.434607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2549e401-a738-4071-ae06-5f34f17d6d63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044928 Aug 18 22:05:09.435155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 993/1977] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:09.470374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6c5764da-6dd6-458d-94df-90f2508f8cb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:09.472644 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6c5764da-6dd6-458d-94df-90f2508f8cb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:09.479406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c5764da-6dd6-458d-94df-90f2508f8cb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:09.479925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c5764da-6dd6-458d-94df-90f2508f8cb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:09.480241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c5764da-6dd6-458d-94df-90f2508f8cb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:09.480947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c5764da-6dd6-458d-94df-90f2508f8cb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:09.481399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c5764da-6dd6-458d-94df-90f2508f8cb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:09.481852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c5764da-6dd6-458d-94df-90f2508f8cb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:09.512055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6c5764da-6dd6-458d-94df-90f2508f8cb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045501 Aug 18 22:05:09.512614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 985/1978] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:09 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:09.679655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7479ffea-4fc3-4b4d-a7c8-859b4c0c664b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:09.681832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7479ffea-4fc3-4b4d-a7c8-859b4c0c664b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:09.687730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7479ffea-4fc3-4b4d-a7c8-859b4c0c664b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:09.688224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7479ffea-4fc3-4b4d-a7c8-859b4c0c664b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:09.688680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7479ffea-4fc3-4b4d-a7c8-859b4c0c664b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:09.689385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7479ffea-4fc3-4b4d-a7c8-859b4c0c664b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:09.689873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7479ffea-4fc3-4b4d-a7c8-859b4c0c664b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:09.690303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7479ffea-4fc3-4b4d-a7c8-859b4c0c664b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:09.720260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7479ffea-4fc3-4b4d-a7c8-859b4c0c664b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045292 Aug 18 22:05:09.720837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 994/1979] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:09 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:09.935652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-771d5107-15de-46e5-934b-553bf5df3dab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:09.937832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-771d5107-15de-46e5-934b-553bf5df3dab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:09.939827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:09.945960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-771d5107-15de-46e5-934b-553bf5df3dab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:09.946453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-771d5107-15de-46e5-934b-553bf5df3dab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:09.946895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-771d5107-15de-46e5-934b-553bf5df3dab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:09.947607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-771d5107-15de-46e5-934b-553bf5df3dab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:09.948068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-771d5107-15de-46e5-934b-553bf5df3dab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:09.948499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-771d5107-15de-46e5-934b-553bf5df3dab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:09.980366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-771d5107-15de-46e5-934b-553bf5df3dab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048656 Aug 18 22:05:09.980944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 986/1980] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:09 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:10.208702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:05:10.208885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:05:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:05:10.446996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0b10faad-de2d-4dd2-b268-9d8baee7bef7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:10.449041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0b10faad-de2d-4dd2-b268-9d8baee7bef7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:10.455622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b10faad-de2d-4dd2-b268-9d8baee7bef7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:10.456107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b10faad-de2d-4dd2-b268-9d8baee7bef7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:10.456542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b10faad-de2d-4dd2-b268-9d8baee7bef7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:10.457238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b10faad-de2d-4dd2-b268-9d8baee7bef7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:10.457730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b10faad-de2d-4dd2-b268-9d8baee7bef7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:10.458157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b10faad-de2d-4dd2-b268-9d8baee7bef7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:10.488265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0b10faad-de2d-4dd2-b268-9d8baee7bef7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Aug 18 22:05:10.488813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 995/1981] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:10 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:10.524690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-59b782b9-c747-45a6-a5ec-ca4e2b7ccc2b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:10.526924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-59b782b9-c747-45a6-a5ec-ca4e2b7ccc2b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:10.533247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59b782b9-c747-45a6-a5ec-ca4e2b7ccc2b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:10.533779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59b782b9-c747-45a6-a5ec-ca4e2b7ccc2b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:10.534225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59b782b9-c747-45a6-a5ec-ca4e2b7ccc2b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:10.534933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59b782b9-c747-45a6-a5ec-ca4e2b7ccc2b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:10.535392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59b782b9-c747-45a6-a5ec-ca4e2b7ccc2b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:10.535823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59b782b9-c747-45a6-a5ec-ca4e2b7ccc2b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:10.565305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-59b782b9-c747-45a6-a5ec-ca4e2b7ccc2b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 Aug 18 22:05:10.565915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 987/1982] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:10 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:10.732460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26d70c07-a707-4599-beb1-62561238d11b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:10.734633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26d70c07-a707-4599-beb1-62561238d11b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:10.740508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26d70c07-a707-4599-beb1-62561238d11b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:10.740991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26d70c07-a707-4599-beb1-62561238d11b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:10.741425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26d70c07-a707-4599-beb1-62561238d11b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:10.742228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26d70c07-a707-4599-beb1-62561238d11b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:10.742683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26d70c07-a707-4599-beb1-62561238d11b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:10.743108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26d70c07-a707-4599-beb1-62561238d11b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:10.771440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26d70c07-a707-4599-beb1-62561238d11b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 Aug 18 22:05:10.772023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 996/1983] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:10 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:10.992494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-abe4efe9-d844-4266-a71d-4078b7390cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:10.994612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-abe4efe9-d844-4266-a71d-4078b7390cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:11.000807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abe4efe9-d844-4266-a71d-4078b7390cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:11.001307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abe4efe9-d844-4266-a71d-4078b7390cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:11.001777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abe4efe9-d844-4266-a71d-4078b7390cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:11.002475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abe4efe9-d844-4266-a71d-4078b7390cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:11.002938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abe4efe9-d844-4266-a71d-4078b7390cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:11.003371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abe4efe9-d844-4266-a71d-4078b7390cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:11.032918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-abe4efe9-d844-4266-a71d-4078b7390cec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044511 Aug 18 22:05:11.033478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 988/1984] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:10 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:11.500510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4b5a415b-a8a4-4a78-8b46-afeb8594e316 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:11.502663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4b5a415b-a8a4-4a78-8b46-afeb8594e316 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:11.509385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b5a415b-a8a4-4a78-8b46-afeb8594e316 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:11.509891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b5a415b-a8a4-4a78-8b46-afeb8594e316 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:11.510321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b5a415b-a8a4-4a78-8b46-afeb8594e316 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:11.510997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b5a415b-a8a4-4a78-8b46-afeb8594e316 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:11.511445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b5a415b-a8a4-4a78-8b46-afeb8594e316 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:11.511861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b5a415b-a8a4-4a78-8b46-afeb8594e316 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:11.540330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4b5a415b-a8a4-4a78-8b46-afeb8594e316 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 Aug 18 22:05:11.540876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 997/1985] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:11.577249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-af08636f-ce98-41c5-861b-11ae34be69f2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:11.579523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-af08636f-ce98-41c5-861b-11ae34be69f2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:11.586131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af08636f-ce98-41c5-861b-11ae34be69f2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:11.586610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af08636f-ce98-41c5-861b-11ae34be69f2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:11.587041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af08636f-ce98-41c5-861b-11ae34be69f2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:11.587768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af08636f-ce98-41c5-861b-11ae34be69f2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:11.588205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af08636f-ce98-41c5-861b-11ae34be69f2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:11.588625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af08636f-ce98-41c5-861b-11ae34be69f2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:11.619213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-af08636f-ce98-41c5-861b-11ae34be69f2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045805 Aug 18 22:05:11.619766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 989/1986] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:11.784544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e9d66292-9fa6-45ff-a27d-6fcf25419bc3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:11.786708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e9d66292-9fa6-45ff-a27d-6fcf25419bc3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:11.792576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9d66292-9fa6-45ff-a27d-6fcf25419bc3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:11.793082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9d66292-9fa6-45ff-a27d-6fcf25419bc3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:11.793522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9d66292-9fa6-45ff-a27d-6fcf25419bc3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:11.794234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9d66292-9fa6-45ff-a27d-6fcf25419bc3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:11.794688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9d66292-9fa6-45ff-a27d-6fcf25419bc3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:11.795229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9d66292-9fa6-45ff-a27d-6fcf25419bc3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:11.825374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e9d66292-9fa6-45ff-a27d-6fcf25419bc3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044917 Aug 18 22:05:11.825973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 998/1987] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:12.044496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-41d8e164-e30e-4e26-90fe-ed0ef08d6c1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:12.046582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-41d8e164-e30e-4e26-90fe-ed0ef08d6c1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:12.052696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41d8e164-e30e-4e26-90fe-ed0ef08d6c1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:12.053683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41d8e164-e30e-4e26-90fe-ed0ef08d6c1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:12.054134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41d8e164-e30e-4e26-90fe-ed0ef08d6c1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:12.054801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41d8e164-e30e-4e26-90fe-ed0ef08d6c1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:12.055269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41d8e164-e30e-4e26-90fe-ed0ef08d6c1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:12.055674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41d8e164-e30e-4e26-90fe-ed0ef08d6c1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:12.084616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-41d8e164-e30e-4e26-90fe-ed0ef08d6c1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Aug 18 22:05:12.085180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 990/1988] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:12 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:12.552267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-12186337-ff3b-4b0b-96b1-9e7d2268e41c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:12.555039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-12186337-ff3b-4b0b-96b1-9e7d2268e41c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:12.561316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12186337-ff3b-4b0b-96b1-9e7d2268e41c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:12.561828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12186337-ff3b-4b0b-96b1-9e7d2268e41c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:12.562267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12186337-ff3b-4b0b-96b1-9e7d2268e41c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:12.562944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12186337-ff3b-4b0b-96b1-9e7d2268e41c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:12.563393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12186337-ff3b-4b0b-96b1-9e7d2268e41c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:12.563811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12186337-ff3b-4b0b-96b1-9e7d2268e41c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:12.591980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-12186337-ff3b-4b0b-96b1-9e7d2268e41c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043867 Aug 18 22:05:12.592524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 999/1989] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:12 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:12.631088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-32b12027-94e0-49e9-b4e3-5488c389a532 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:12.633270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-32b12027-94e0-49e9-b4e3-5488c389a532 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:12.639414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32b12027-94e0-49e9-b4e3-5488c389a532 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:12.639906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32b12027-94e0-49e9-b4e3-5488c389a532 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:12.640346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32b12027-94e0-49e9-b4e3-5488c389a532 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:12.641047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32b12027-94e0-49e9-b4e3-5488c389a532 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:12.641505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32b12027-94e0-49e9-b4e3-5488c389a532 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:12.642099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32b12027-94e0-49e9-b4e3-5488c389a532 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:12.672327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-32b12027-94e0-49e9-b4e3-5488c389a532 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045099 Aug 18 22:05:12.672887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 991/1990] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:12 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:12.837541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-28b99686-5fa7-40c2-a45b-33a3bab90e1d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:12.839646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-28b99686-5fa7-40c2-a45b-33a3bab90e1d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:12.845568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28b99686-5fa7-40c2-a45b-33a3bab90e1d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:12.846074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28b99686-5fa7-40c2-a45b-33a3bab90e1d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:12.846512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28b99686-5fa7-40c2-a45b-33a3bab90e1d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:12.847208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28b99686-5fa7-40c2-a45b-33a3bab90e1d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:12.847698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28b99686-5fa7-40c2-a45b-33a3bab90e1d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:12.848129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28b99686-5fa7-40c2-a45b-33a3bab90e1d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:12.877836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-28b99686-5fa7-40c2-a45b-33a3bab90e1d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044730 Aug 18 22:05:12.878389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1000/1991] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:12 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:13.096433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-905feddd-83d1-4c8f-b1fd-b0822b8575f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:13.098551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-905feddd-83d1-4c8f-b1fd-b0822b8575f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:13.104483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905feddd-83d1-4c8f-b1fd-b0822b8575f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:13.104966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905feddd-83d1-4c8f-b1fd-b0822b8575f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:13.105406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905feddd-83d1-4c8f-b1fd-b0822b8575f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:13.106127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905feddd-83d1-4c8f-b1fd-b0822b8575f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:13.106586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905feddd-83d1-4c8f-b1fd-b0822b8575f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:13.107013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905feddd-83d1-4c8f-b1fd-b0822b8575f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:13.131194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:13.137014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-905feddd-83d1-4c8f-b1fd-b0822b8575f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044626 Aug 18 22:05:13.137573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 992/1992] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:13 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:13.604414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4ba0dd66-2607-4bfb-a9ef-10646a15f359 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:13.606587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4ba0dd66-2607-4bfb-a9ef-10646a15f359 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:13.613247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ba0dd66-2607-4bfb-a9ef-10646a15f359 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:13.613771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ba0dd66-2607-4bfb-a9ef-10646a15f359 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:13.614207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ba0dd66-2607-4bfb-a9ef-10646a15f359 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:13.614912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ba0dd66-2607-4bfb-a9ef-10646a15f359 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:13.615442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ba0dd66-2607-4bfb-a9ef-10646a15f359 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:13.616365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ba0dd66-2607-4bfb-a9ef-10646a15f359 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:13.645803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4ba0dd66-2607-4bfb-a9ef-10646a15f359 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Aug 18 22:05:13.646357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1001/1993] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:13.684270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-12912595-b08a-4d6a-b5c4-3a84e6f06893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:13.686536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-12912595-b08a-4d6a-b5c4-3a84e6f06893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:13.692857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12912595-b08a-4d6a-b5c4-3a84e6f06893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:13.693340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12912595-b08a-4d6a-b5c4-3a84e6f06893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:13.694470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12912595-b08a-4d6a-b5c4-3a84e6f06893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:13.695176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12912595-b08a-4d6a-b5c4-3a84e6f06893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:13.695630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12912595-b08a-4d6a-b5c4-3a84e6f06893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:13.696056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12912595-b08a-4d6a-b5c4-3a84e6f06893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:13.731593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-12912595-b08a-4d6a-b5c4-3a84e6f06893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051383 Aug 18 22:05:13.732292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 993/1994] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:13 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:13.890083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a7134637-ee0d-4235-9163-9a1022fc9ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:13.892168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a7134637-ee0d-4235-9163-9a1022fc9ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:13.898033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a7134637-ee0d-4235-9163-9a1022fc9ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:13.898511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a7134637-ee0d-4235-9163-9a1022fc9ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:13.898946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a7134637-ee0d-4235-9163-9a1022fc9ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:13.899636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a7134637-ee0d-4235-9163-9a1022fc9ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:13.900091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a7134637-ee0d-4235-9163-9a1022fc9ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:13.900517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a7134637-ee0d-4235-9163-9a1022fc9ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:13.930330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a7134637-ee0d-4235-9163-9a1022fc9ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Aug 18 22:05:13.930895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1002/1995] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:14.148908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e0be4e66-63e8-4499-a6dc-eecb12dbdd2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:14.150988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e0be4e66-63e8-4499-a6dc-eecb12dbdd2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:14.156882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0be4e66-63e8-4499-a6dc-eecb12dbdd2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:14.157358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0be4e66-63e8-4499-a6dc-eecb12dbdd2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:14.157831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0be4e66-63e8-4499-a6dc-eecb12dbdd2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:14.158513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0be4e66-63e8-4499-a6dc-eecb12dbdd2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:14.158963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0be4e66-63e8-4499-a6dc-eecb12dbdd2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:14.159386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0be4e66-63e8-4499-a6dc-eecb12dbdd2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:14.188558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e0be4e66-63e8-4499-a6dc-eecb12dbdd2c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044091 Aug 18 22:05:14.189114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 994/1996] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:14 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:14.658216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-05dad99b-f56a-4173-bcf2-f56dab716c8a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:14.660354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-05dad99b-f56a-4173-bcf2-f56dab716c8a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:14.666707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05dad99b-f56a-4173-bcf2-f56dab716c8a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:14.667185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05dad99b-f56a-4173-bcf2-f56dab716c8a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:14.667626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05dad99b-f56a-4173-bcf2-f56dab716c8a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:14.668313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05dad99b-f56a-4173-bcf2-f56dab716c8a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:14.668770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05dad99b-f56a-4173-bcf2-f56dab716c8a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:14.669196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05dad99b-f56a-4173-bcf2-f56dab716c8a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:14.698853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-05dad99b-f56a-4173-bcf2-f56dab716c8a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044569 Aug 18 22:05:14.699417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1003/1997] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:14.743523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f45b7149-68b1-4639-9ebf-3e412c746cd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:14.745682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f45b7149-68b1-4639-9ebf-3e412c746cd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:14.752005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f45b7149-68b1-4639-9ebf-3e412c746cd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:14.752489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f45b7149-68b1-4639-9ebf-3e412c746cd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:14.752923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f45b7149-68b1-4639-9ebf-3e412c746cd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:14.753649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f45b7149-68b1-4639-9ebf-3e412c746cd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:14.754107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f45b7149-68b1-4639-9ebf-3e412c746cd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:14.754537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f45b7149-68b1-4639-9ebf-3e412c746cd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:14.784436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f45b7149-68b1-4639-9ebf-3e412c746cd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 Aug 18 22:05:14.784998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 995/1998] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:14.942556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a4ed5f47-face-485e-bedc-fffb817b3edf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:14.945264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a4ed5f47-face-485e-bedc-fffb817b3edf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:14.947143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:14.952340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4ed5f47-face-485e-bedc-fffb817b3edf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:14.952821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4ed5f47-face-485e-bedc-fffb817b3edf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:14.953256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4ed5f47-face-485e-bedc-fffb817b3edf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:14.953981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4ed5f47-face-485e-bedc-fffb817b3edf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:14.954439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4ed5f47-face-485e-bedc-fffb817b3edf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:14.954864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4ed5f47-face-485e-bedc-fffb817b3edf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:14.983274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a4ed5f47-face-485e-bedc-fffb817b3edf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044751 Aug 18 22:05:14.983831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1004/1999] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:15.201237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07e0cb0d-ce57-4ccf-a0d8-5a438c40e988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:15.203331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07e0cb0d-ce57-4ccf-a0d8-5a438c40e988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:15.209195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07e0cb0d-ce57-4ccf-a0d8-5a438c40e988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:15.209715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07e0cb0d-ce57-4ccf-a0d8-5a438c40e988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:15.210148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07e0cb0d-ce57-4ccf-a0d8-5a438c40e988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:15.210832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07e0cb0d-ce57-4ccf-a0d8-5a438c40e988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:15.211281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07e0cb0d-ce57-4ccf-a0d8-5a438c40e988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:15.211700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07e0cb0d-ce57-4ccf-a0d8-5a438c40e988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:15.240254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07e0cb0d-ce57-4ccf-a0d8-5a438c40e988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043057 Aug 18 22:05:15.241468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 996/2000] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:15 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:05:15.711451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-56c87b95-0926-4758-bcf6-7aefc7d73d4b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:15.713616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-56c87b95-0926-4758-bcf6-7aefc7d73d4b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:15.719957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56c87b95-0926-4758-bcf6-7aefc7d73d4b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:15.720439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56c87b95-0926-4758-bcf6-7aefc7d73d4b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:15.720869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56c87b95-0926-4758-bcf6-7aefc7d73d4b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:15.721566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56c87b95-0926-4758-bcf6-7aefc7d73d4b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:15.722039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56c87b95-0926-4758-bcf6-7aefc7d73d4b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:15.722463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-56c87b95-0926-4758-bcf6-7aefc7d73d4b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:15.752184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-56c87b95-0926-4758-bcf6-7aefc7d73d4b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045341 Aug 18 22:05:15.752737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1005/2001] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:15 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:15.796371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-36b01ab0-8eb1-44f0-a6ba-cd1c46646f2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:15.798664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-36b01ab0-8eb1-44f0-a6ba-cd1c46646f2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:15.805534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36b01ab0-8eb1-44f0-a6ba-cd1c46646f2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:15.806099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36b01ab0-8eb1-44f0-a6ba-cd1c46646f2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:15.806546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36b01ab0-8eb1-44f0-a6ba-cd1c46646f2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:15.807255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36b01ab0-8eb1-44f0-a6ba-cd1c46646f2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:15.807716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36b01ab0-8eb1-44f0-a6ba-cd1c46646f2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:15.808145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36b01ab0-8eb1-44f0-a6ba-cd1c46646f2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:15.840269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-36b01ab0-8eb1-44f0-a6ba-cd1c46646f2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046967 Aug 18 22:05:15.840269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 997/2002] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:15 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:15.995582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-54aa7eb8-d796-41b1-92be-9a9f1aea5a25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:15.997686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-54aa7eb8-d796-41b1-92be-9a9f1aea5a25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:16.003562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54aa7eb8-d796-41b1-92be-9a9f1aea5a25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:16.004047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54aa7eb8-d796-41b1-92be-9a9f1aea5a25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:16.004480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54aa7eb8-d796-41b1-92be-9a9f1aea5a25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:16.005163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54aa7eb8-d796-41b1-92be-9a9f1aea5a25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:16.005620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54aa7eb8-d796-41b1-92be-9a9f1aea5a25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:16.006061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-54aa7eb8-d796-41b1-92be-9a9f1aea5a25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:16.035744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-54aa7eb8-d796-41b1-92be-9a9f1aea5a25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044138 Aug 18 22:05:16.036306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1006/2003] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:15 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:16.252538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4181de8b-3416-4b0f-ba96-622b62ec942f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:16.254660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4181de8b-3416-4b0f-ba96-622b62ec942f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:16.261022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4181de8b-3416-4b0f-ba96-622b62ec942f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:16.261512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4181de8b-3416-4b0f-ba96-622b62ec942f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:16.261987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4181de8b-3416-4b0f-ba96-622b62ec942f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:16.262685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4181de8b-3416-4b0f-ba96-622b62ec942f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:16.263145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4181de8b-3416-4b0f-ba96-622b62ec942f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:16.263575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4181de8b-3416-4b0f-ba96-622b62ec942f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:16.293196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4181de8b-3416-4b0f-ba96-622b62ec942f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044813 Aug 18 22:05:16.293782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 998/2004] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:16 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:16.764417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d09b42d-5a4a-46ed-8c54-e6c47c2a3880 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:16.766579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1d09b42d-5a4a-46ed-8c54-e6c47c2a3880 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:16.773111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d09b42d-5a4a-46ed-8c54-e6c47c2a3880 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:16.773590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d09b42d-5a4a-46ed-8c54-e6c47c2a3880 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:16.774065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d09b42d-5a4a-46ed-8c54-e6c47c2a3880 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:16.774758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d09b42d-5a4a-46ed-8c54-e6c47c2a3880 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:16.775215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d09b42d-5a4a-46ed-8c54-e6c47c2a3880 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:16.775641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d09b42d-5a4a-46ed-8c54-e6c47c2a3880 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:16.805334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1d09b42d-5a4a-46ed-8c54-e6c47c2a3880 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Aug 18 22:05:16.805919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1007/2005] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:16.851797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8adf1fdd-a9b9-49ae-a12b-229d5acf2666 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:16.854041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8adf1fdd-a9b9-49ae-a12b-229d5acf2666 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:16.860577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8adf1fdd-a9b9-49ae-a12b-229d5acf2666 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:16.861065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8adf1fdd-a9b9-49ae-a12b-229d5acf2666 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:16.861509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8adf1fdd-a9b9-49ae-a12b-229d5acf2666 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:16.862245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8adf1fdd-a9b9-49ae-a12b-229d5acf2666 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:16.862707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8adf1fdd-a9b9-49ae-a12b-229d5acf2666 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:16.863139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8adf1fdd-a9b9-49ae-a12b-229d5acf2666 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:16.892380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8adf1fdd-a9b9-49ae-a12b-229d5acf2666 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044963 Aug 18 22:05:16.892958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 999/2006] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:17.047914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c05a6c8d-d830-4109-9a1d-fe22efb022d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:17.050099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c05a6c8d-d830-4109-9a1d-fe22efb022d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:17.056901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c05a6c8d-d830-4109-9a1d-fe22efb022d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:17.057375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c05a6c8d-d830-4109-9a1d-fe22efb022d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:17.057837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c05a6c8d-d830-4109-9a1d-fe22efb022d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:17.058524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c05a6c8d-d830-4109-9a1d-fe22efb022d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:17.058969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c05a6c8d-d830-4109-9a1d-fe22efb022d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:17.059389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c05a6c8d-d830-4109-9a1d-fe22efb022d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:17.088078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c05a6c8d-d830-4109-9a1d-fe22efb022d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044116 Aug 18 22:05:17.088625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1008/2007] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:17 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:17.305963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e0b2a39c-d14a-40be-983b-6cb7979cfb3e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:05:17.308072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e0b2a39c-d14a-40be-983b-6cb7979cfb3e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:17.314412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0b2a39c-d14a-40be-983b-6cb7979cfb3e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:17.314894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0b2a39c-d14a-40be-983b-6cb7979cfb3e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:17.315326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0b2a39c-d14a-40be-983b-6cb7979cfb3e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:17.316076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0b2a39c-d14a-40be-983b-6cb7979cfb3e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:17.316523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0b2a39c-d14a-40be-983b-6cb7979cfb3e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:17.317057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0b2a39c-d14a-40be-983b-6cb7979cfb3e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:17.388803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e0b2a39c-d14a-40be-983b-6cb7979cfb3e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "POST /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/action" status: 200 len: 41309 microversion: 2.1 time: 0.086720 Aug 18 22:05:17.389509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1000/2008] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 22:05:17 2022] POST /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e/action => generated 41309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:05:17.816669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8df53164-8b50-4922-b714-d8b85f8b35ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:17.819450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8df53164-8b50-4922-b714-d8b85f8b35ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:17.825890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8df53164-8b50-4922-b714-d8b85f8b35ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:17.826569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8df53164-8b50-4922-b714-d8b85f8b35ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:17.826801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8df53164-8b50-4922-b714-d8b85f8b35ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:17.827489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8df53164-8b50-4922-b714-d8b85f8b35ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:17.827938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8df53164-8b50-4922-b714-d8b85f8b35ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:17.828359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8df53164-8b50-4922-b714-d8b85f8b35ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:17.852328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:17.858991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8df53164-8b50-4922-b714-d8b85f8b35ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046280 Aug 18 22:05:17.859562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1009/2009] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:17 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:17.905061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2345b148-0b1a-4beb-be17-0a1182b2291a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:05:17.907351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2345b148-0b1a-4beb-be17-0a1182b2291a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:17.914543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2345b148-0b1a-4beb-be17-0a1182b2291a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:17.915023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2345b148-0b1a-4beb-be17-0a1182b2291a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:17.915464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2345b148-0b1a-4beb-be17-0a1182b2291a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:17.916169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2345b148-0b1a-4beb-be17-0a1182b2291a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:17.916657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2345b148-0b1a-4beb-be17-0a1182b2291a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:17.917080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2345b148-0b1a-4beb-be17-0a1182b2291a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:17.991680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2345b148-0b1a-4beb-be17-0a1182b2291a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "POST /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/action" status: 200 len: 82922 microversion: 2.1 time: 0.090776 Aug 18 22:05:17.992623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1001/2010] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 22:05:17 2022] POST /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/action => generated 82922 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:05:18.005852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:18.006903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:18.012922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:18.013398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:18.013867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:18.014561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:18.015009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:18.015434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:18.100797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-870ca209-9603-492f-8400-a30fc83f2726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:18.103074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-870ca209-9603-492f-8400-a30fc83f2726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:18.110055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-870ca209-9603-492f-8400-a30fc83f2726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:18.110535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-870ca209-9603-492f-8400-a30fc83f2726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:18.110968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-870ca209-9603-492f-8400-a30fc83f2726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:18.111663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-870ca209-9603-492f-8400-a30fc83f2726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:18.112113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-870ca209-9603-492f-8400-a30fc83f2726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:18.112535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-870ca209-9603-492f-8400-a30fc83f2726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:18.144761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-870ca209-9603-492f-8400-a30fc83f2726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048146 Aug 18 22:05:18.144942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lazy-loading 'services' on Instance uuid e7b11b63-0232-4f27-bacb-2e3872f6ae18 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:05:18.145311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1002/2011] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:18 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:05:18.200273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f99e73c3-43d5-4dbe-8163-5a880e224e24) Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Request method failure captured: Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments/a9793aeb-8666-4b6c-9f30-e26675b395f9 HTTP/1.1 Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rWGRspIdr02nr4y1cG80zQFZ5KpEG1Sf8dmSYk7Ty7QJVpSiAlduIFd48CAgmXakouGGB8bXNwxWmo4Orw-CWAe5cws1OClG0Hs7b_pOSvZdxWV1PfGgiscW7qexNl1vEw5cDl5ZezPJyTD31skj3d0gj6Pq-RVNNnD8tShFbWj9wc Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 740832491e454b40a6cd87be4ca40384 Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestMinimumBasicScenario-248629472 Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:05:18.203588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:05:18.205285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_740832491e454b40a6cd87be4ca40384", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/740832491e454b40a6cd87be4ca40384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/740832491e454b40a6cd87be4ca40384"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/740832491e454b40a6cd87be4ca40384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:05:18.205285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestMinimumBasicScenario-248629472 Aug 18 22:05:18.205285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 740832491e454b40a6cd87be4ca40384 Aug 18 22:05:18.205285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestMinimumBasicScenario-248629472 Aug 18 22:05:18.205285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-TestMinimumBasicScenario-248629472-project Aug 18 22:05:18.205285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:05:18.205285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:05:18.205285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: b51990c984e24a18a85534b121f3d9a0 Aug 18 22:05:18.205285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestMinimumBasicScenario-248629472-project Aug 18 22:05:18.205285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f99e73c3-43d5-4dbe-8163-5a880e224e24) Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'server_id': 'e7b11b63-0232-4f27-bacb-2e3872f6ae18', 'id': 'a9793aeb-8666-4b6c-9f30-e26675b395f9'} Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 18 22:05:18.206278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f99e73c3-43d5-4dbe-8163-5a880e224e24) Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5186, in _detach_volume Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:05:18.207651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f99e73c3-43d5-4dbe-8163-5a880e224e24) Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:05:18.209143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5208, in detach_volume Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5188, in _detach_volume Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f99e73c3-43d5-4dbe-8163-5a880e224e24) Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:05:18.210630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f99e73c3-43d5-4dbe-8163-5a880e224e24) Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f99e73c3-43d5-4dbe-8163-5a880e224e24) Aug 18 22:05:18.212001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:05:18.213415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f99e73c3-43d5-4dbe-8163-5a880e224e24) {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:05:18.213415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-586c8290-860d-4657-9c8e-867ca95fe62a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "DELETE /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments/a9793aeb-8666-4b6c-9f30-e26675b395f9" status: 400 len: 269 microversion: 2.1 time: 0.203181 Aug 18 22:05:18.213415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1010/2012] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 22:05:18 2022] DELETE /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18/os-volume_attachments/a9793aeb-8666-4b6c-9f30-e26675b395f9 => generated 269 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 22:05:18.871276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9b9faaea-510d-4596-bf7e-7ce45ad07eb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:18.873426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9b9faaea-510d-4596-bf7e-7ce45ad07eb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:18.879841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b9faaea-510d-4596-bf7e-7ce45ad07eb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:18.880318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b9faaea-510d-4596-bf7e-7ce45ad07eb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:18.880754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b9faaea-510d-4596-bf7e-7ce45ad07eb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:18.881443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b9faaea-510d-4596-bf7e-7ce45ad07eb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:18.881922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b9faaea-510d-4596-bf7e-7ce45ad07eb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:18.882345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b9faaea-510d-4596-bf7e-7ce45ad07eb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:18.911360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9b9faaea-510d-4596-bf7e-7ce45ad07eb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044032 Aug 18 22:05:18.911949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1003/2013] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:18 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:19.157392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d2e055d0-15c3-4c3f-a827-6bd9c7244364 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:19.159476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d2e055d0-15c3-4c3f-a827-6bd9c7244364 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:19.166538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2e055d0-15c3-4c3f-a827-6bd9c7244364 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:19.167022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2e055d0-15c3-4c3f-a827-6bd9c7244364 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:19.167462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2e055d0-15c3-4c3f-a827-6bd9c7244364 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:19.168155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2e055d0-15c3-4c3f-a827-6bd9c7244364 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:19.168635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2e055d0-15c3-4c3f-a827-6bd9c7244364 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:19.169062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2e055d0-15c3-4c3f-a827-6bd9c7244364 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:19.197477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d2e055d0-15c3-4c3f-a827-6bd9c7244364 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044723 Aug 18 22:05:19.198061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1011/2014] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:19 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:19.923886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f1136cf0-85fc-44f6-bea3-892f1fae8a9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:19.926340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f1136cf0-85fc-44f6-bea3-892f1fae8a9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:19.933294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f1136cf0-85fc-44f6-bea3-892f1fae8a9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:19.933802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f1136cf0-85fc-44f6-bea3-892f1fae8a9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:19.934233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f1136cf0-85fc-44f6-bea3-892f1fae8a9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:19.934915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f1136cf0-85fc-44f6-bea3-892f1fae8a9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:19.935365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f1136cf0-85fc-44f6-bea3-892f1fae8a9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:19.935785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f1136cf0-85fc-44f6-bea3-892f1fae8a9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:19.963795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f1136cf0-85fc-44f6-bea3-892f1fae8a9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Aug 18 22:05:19.964325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1004/2015] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:19 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:20.210362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ad415241-72fd-432c-bd41-60d367ec475a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:20.212442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ad415241-72fd-432c-bd41-60d367ec475a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:20.218949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad415241-72fd-432c-bd41-60d367ec475a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:20.219434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad415241-72fd-432c-bd41-60d367ec475a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:20.219878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad415241-72fd-432c-bd41-60d367ec475a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:20.220576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad415241-72fd-432c-bd41-60d367ec475a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:20.221038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad415241-72fd-432c-bd41-60d367ec475a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:20.221470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad415241-72fd-432c-bd41-60d367ec475a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:20.250422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ad415241-72fd-432c-bd41-60d367ec475a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Aug 18 22:05:20.250979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1012/2016] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:20.976591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0154a3bf-749f-42a8-9a7e-a42fe19a855c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:20.978803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0154a3bf-749f-42a8-9a7e-a42fe19a855c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:20.985181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0154a3bf-749f-42a8-9a7e-a42fe19a855c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:20.985699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0154a3bf-749f-42a8-9a7e-a42fe19a855c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:20.986140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0154a3bf-749f-42a8-9a7e-a42fe19a855c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:20.986840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0154a3bf-749f-42a8-9a7e-a42fe19a855c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:20.987294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0154a3bf-749f-42a8-9a7e-a42fe19a855c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:20.987720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0154a3bf-749f-42a8-9a7e-a42fe19a855c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:21.015862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0154a3bf-749f-42a8-9a7e-a42fe19a855c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Aug 18 22:05:21.016415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1005/2017] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:20 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:21.265083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b97fe60a-bbb3-490a-a7c3-363c80712a03 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:21.267283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b97fe60a-bbb3-490a-a7c3-363c80712a03 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:21.275937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b97fe60a-bbb3-490a-a7c3-363c80712a03 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:21.276418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b97fe60a-bbb3-490a-a7c3-363c80712a03 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:21.276857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b97fe60a-bbb3-490a-a7c3-363c80712a03 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:21.277558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b97fe60a-bbb3-490a-a7c3-363c80712a03 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:21.278046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b97fe60a-bbb3-490a-a7c3-363c80712a03 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:21.278474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b97fe60a-bbb3-490a-a7c3-363c80712a03 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:21.308256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b97fe60a-bbb3-490a-a7c3-363c80712a03 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048934 Aug 18 22:05:21.308893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1013/2018] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:22.028264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-651916e2-3065-4b94-92bf-12ecf43fc2ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:22.030421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-651916e2-3065-4b94-92bf-12ecf43fc2ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:22.036764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-651916e2-3065-4b94-92bf-12ecf43fc2ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:22.037774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-651916e2-3065-4b94-92bf-12ecf43fc2ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:22.038211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-651916e2-3065-4b94-92bf-12ecf43fc2ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:22.038905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-651916e2-3065-4b94-92bf-12ecf43fc2ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:22.039355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-651916e2-3065-4b94-92bf-12ecf43fc2ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:22.039832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-651916e2-3065-4b94-92bf-12ecf43fc2ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:22.069053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-651916e2-3065-4b94-92bf-12ecf43fc2ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044757 Aug 18 22:05:22.069693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1006/2019] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:05:22.320381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e3425d8c-09c1-4c0e-aa44-afde4c3e0c7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:22.322457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e3425d8c-09c1-4c0e-aa44-afde4c3e0c7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:22.328877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3425d8c-09c1-4c0e-aa44-afde4c3e0c7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:22.329360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3425d8c-09c1-4c0e-aa44-afde4c3e0c7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:22.329849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3425d8c-09c1-4c0e-aa44-afde4c3e0c7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:22.330549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3425d8c-09c1-4c0e-aa44-afde4c3e0c7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:22.331003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3425d8c-09c1-4c0e-aa44-afde4c3e0c7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:22.331428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3425d8c-09c1-4c0e-aa44-afde4c3e0c7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:22.361021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e3425d8c-09c1-4c0e-aa44-afde4c3e0c7f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044638 Aug 18 22:05:22.361572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1014/2020] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:22 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:23.080506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-12014aee-9e55-412f-b0c8-43aa8290a37f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:23.082672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-12014aee-9e55-412f-b0c8-43aa8290a37f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:23.089121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12014aee-9e55-412f-b0c8-43aa8290a37f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:23.089618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12014aee-9e55-412f-b0c8-43aa8290a37f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:23.090071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12014aee-9e55-412f-b0c8-43aa8290a37f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:23.090770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12014aee-9e55-412f-b0c8-43aa8290a37f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:23.091228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12014aee-9e55-412f-b0c8-43aa8290a37f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:23.091660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-12014aee-9e55-412f-b0c8-43aa8290a37f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:23.121668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-12014aee-9e55-412f-b0c8-43aa8290a37f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045045 Aug 18 22:05:23.122232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1007/2021] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:23 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:23.373137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bb897174-cb01-462e-a2d1-a271ae3219da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:23.375242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bb897174-cb01-462e-a2d1-a271ae3219da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:23.382185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb897174-cb01-462e-a2d1-a271ae3219da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:23.382684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb897174-cb01-462e-a2d1-a271ae3219da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:23.383115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb897174-cb01-462e-a2d1-a271ae3219da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:23.383799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb897174-cb01-462e-a2d1-a271ae3219da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:23.384248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb897174-cb01-462e-a2d1-a271ae3219da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:23.384669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb897174-cb01-462e-a2d1-a271ae3219da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:23.412748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bb897174-cb01-462e-a2d1-a271ae3219da tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043569 Aug 18 22:05:23.413291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1015/2022] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:23 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:24.133585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6b55c69d-8e5c-4782-9bb1-7adcc3a4aeb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:24.135788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6b55c69d-8e5c-4782-9bb1-7adcc3a4aeb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:24.142335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b55c69d-8e5c-4782-9bb1-7adcc3a4aeb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:24.142819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b55c69d-8e5c-4782-9bb1-7adcc3a4aeb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:24.143258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b55c69d-8e5c-4782-9bb1-7adcc3a4aeb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:24.143961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b55c69d-8e5c-4782-9bb1-7adcc3a4aeb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:24.144413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b55c69d-8e5c-4782-9bb1-7adcc3a4aeb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:24.144841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6b55c69d-8e5c-4782-9bb1-7adcc3a4aeb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:24.176098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6b55c69d-8e5c-4782-9bb1-7adcc3a4aeb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046466 Aug 18 22:05:24.176658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1008/2023] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:24.424826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4bf723eb-7359-4b0f-8932-b3676c50fac9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:24.427200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4bf723eb-7359-4b0f-8932-b3676c50fac9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:24.433631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bf723eb-7359-4b0f-8932-b3676c50fac9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:24.434110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bf723eb-7359-4b0f-8932-b3676c50fac9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:24.434550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bf723eb-7359-4b0f-8932-b3676c50fac9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:24.435245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bf723eb-7359-4b0f-8932-b3676c50fac9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:24.435792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bf723eb-7359-4b0f-8932-b3676c50fac9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:24.436222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bf723eb-7359-4b0f-8932-b3676c50fac9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:24.465667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4bf723eb-7359-4b0f-8932-b3676c50fac9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044794 Aug 18 22:05:24.466223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1016/2024] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:24 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:25.188312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6ed40773-c2f6-4f6e-9328-ff8e93c8a138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:25.190519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6ed40773-c2f6-4f6e-9328-ff8e93c8a138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:25.199543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ed40773-c2f6-4f6e-9328-ff8e93c8a138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:25.200396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ed40773-c2f6-4f6e-9328-ff8e93c8a138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:25.201094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ed40773-c2f6-4f6e-9328-ff8e93c8a138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:25.201910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ed40773-c2f6-4f6e-9328-ff8e93c8a138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:25.202461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ed40773-c2f6-4f6e-9328-ff8e93c8a138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:25.202945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ed40773-c2f6-4f6e-9328-ff8e93c8a138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:25.232994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6ed40773-c2f6-4f6e-9328-ff8e93c8a138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048586 Aug 18 22:05:25.233557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1009/2025] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:25.478838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6157c4e8-d50d-404c-9ba4-6be3a8b03e54 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:25.480878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6157c4e8-d50d-404c-9ba4-6be3a8b03e54 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:25.487462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6157c4e8-d50d-404c-9ba4-6be3a8b03e54 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:25.487959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6157c4e8-d50d-404c-9ba4-6be3a8b03e54 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:25.488395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6157c4e8-d50d-404c-9ba4-6be3a8b03e54 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:25.489099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6157c4e8-d50d-404c-9ba4-6be3a8b03e54 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:25.489561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6157c4e8-d50d-404c-9ba4-6be3a8b03e54 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:25.490027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6157c4e8-d50d-404c-9ba4-6be3a8b03e54 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:25.519428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6157c4e8-d50d-404c-9ba4-6be3a8b03e54 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045118 Aug 18 22:05:25.519995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1017/2026] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:25 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:26.245859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8140c371-d57a-46bd-9d12-96e8eb29bb53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:26.247999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8140c371-d57a-46bd-9d12-96e8eb29bb53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:26.254357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8140c371-d57a-46bd-9d12-96e8eb29bb53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:26.254839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8140c371-d57a-46bd-9d12-96e8eb29bb53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:26.255280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8140c371-d57a-46bd-9d12-96e8eb29bb53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:26.256638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8140c371-d57a-46bd-9d12-96e8eb29bb53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:26.257088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8140c371-d57a-46bd-9d12-96e8eb29bb53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:26.257517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8140c371-d57a-46bd-9d12-96e8eb29bb53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:26.261268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:26.286117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8140c371-d57a-46bd-9d12-96e8eb29bb53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044178 Aug 18 22:05:26.286673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1010/2027] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:26 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:26.532134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d1e35549-76a7-4888-9d3f-3538b544629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:26.534331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d1e35549-76a7-4888-9d3f-3538b544629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:26.541351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1e35549-76a7-4888-9d3f-3538b544629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:26.541869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1e35549-76a7-4888-9d3f-3538b544629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:26.542308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1e35549-76a7-4888-9d3f-3538b544629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:26.543000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1e35549-76a7-4888-9d3f-3538b544629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:26.543453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1e35549-76a7-4888-9d3f-3538b544629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:26.543877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1e35549-76a7-4888-9d3f-3538b544629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:26.572748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d1e35549-76a7-4888-9d3f-3538b544629c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044570 Aug 18 22:05:26.573289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1018/2028] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:26 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:27.298265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3ecd1ed1-2eab-4bd2-bfb1-3cc7466db283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:27.300652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3ecd1ed1-2eab-4bd2-bfb1-3cc7466db283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:27.307080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ecd1ed1-2eab-4bd2-bfb1-3cc7466db283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:27.307588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ecd1ed1-2eab-4bd2-bfb1-3cc7466db283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:27.308024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ecd1ed1-2eab-4bd2-bfb1-3cc7466db283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:27.308717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ecd1ed1-2eab-4bd2-bfb1-3cc7466db283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:27.309170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ecd1ed1-2eab-4bd2-bfb1-3cc7466db283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:27.309627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ecd1ed1-2eab-4bd2-bfb1-3cc7466db283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:27.339415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3ecd1ed1-2eab-4bd2-bfb1-3cc7466db283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045062 Aug 18 22:05:27.339979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1011/2029] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:27.585145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1c41c13f-0824-4c72-825f-5010b7429781 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:27.587239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1c41c13f-0824-4c72-825f-5010b7429781 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:27.593749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c41c13f-0824-4c72-825f-5010b7429781 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:27.594226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c41c13f-0824-4c72-825f-5010b7429781 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:27.594659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c41c13f-0824-4c72-825f-5010b7429781 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:27.595346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c41c13f-0824-4c72-825f-5010b7429781 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:27.595795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c41c13f-0824-4c72-825f-5010b7429781 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:27.596217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c41c13f-0824-4c72-825f-5010b7429781 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:27.626383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1c41c13f-0824-4c72-825f-5010b7429781 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Aug 18 22:05:27.626943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1019/2030] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:27 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:28.351964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-efaf4b0c-791f-4bf7-a09c-e0ab8da99795 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:28.354141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-efaf4b0c-791f-4bf7-a09c-e0ab8da99795 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:28.360745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efaf4b0c-791f-4bf7-a09c-e0ab8da99795 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:28.361230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efaf4b0c-791f-4bf7-a09c-e0ab8da99795 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:28.361702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efaf4b0c-791f-4bf7-a09c-e0ab8da99795 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:28.362402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efaf4b0c-791f-4bf7-a09c-e0ab8da99795 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:28.362856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efaf4b0c-791f-4bf7-a09c-e0ab8da99795 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:28.363284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-efaf4b0c-791f-4bf7-a09c-e0ab8da99795 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:28.391544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-efaf4b0c-791f-4bf7-a09c-e0ab8da99795 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Aug 18 22:05:28.392101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1012/2031] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:28.638652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e7ec5a68-e02a-498d-bf21-7821936e802c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:28.640796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e7ec5a68-e02a-498d-bf21-7821936e802c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:28.647644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7ec5a68-e02a-498d-bf21-7821936e802c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:28.648123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7ec5a68-e02a-498d-bf21-7821936e802c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:28.648548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7ec5a68-e02a-498d-bf21-7821936e802c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:28.649230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7ec5a68-e02a-498d-bf21-7821936e802c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:28.649702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7ec5a68-e02a-498d-bf21-7821936e802c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:28.650121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7ec5a68-e02a-498d-bf21-7821936e802c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:28.679721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e7ec5a68-e02a-498d-bf21-7821936e802c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Aug 18 22:05:28.680277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1020/2032] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:28 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:29.403736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9bf5d9a2-c401-4175-8e3a-bece463fba6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:29.405908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9bf5d9a2-c401-4175-8e3a-bece463fba6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:29.412323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bf5d9a2-c401-4175-8e3a-bece463fba6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:29.412811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bf5d9a2-c401-4175-8e3a-bece463fba6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:29.413251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bf5d9a2-c401-4175-8e3a-bece463fba6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:29.413976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bf5d9a2-c401-4175-8e3a-bece463fba6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:29.414441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bf5d9a2-c401-4175-8e3a-bece463fba6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:29.414872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bf5d9a2-c401-4175-8e3a-bece463fba6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:29.444562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9bf5d9a2-c401-4175-8e3a-bece463fba6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Aug 18 22:05:29.445114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1013/2033] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:29 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:29.692038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4b5848d5-ef44-4cd3-89ae-a5a827afa0ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:29.694196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4b5848d5-ef44-4cd3-89ae-a5a827afa0ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:29.700615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b5848d5-ef44-4cd3-89ae-a5a827afa0ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:29.701101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b5848d5-ef44-4cd3-89ae-a5a827afa0ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:29.701540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b5848d5-ef44-4cd3-89ae-a5a827afa0ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:29.702266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b5848d5-ef44-4cd3-89ae-a5a827afa0ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:29.702723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b5848d5-ef44-4cd3-89ae-a5a827afa0ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:29.703153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b5848d5-ef44-4cd3-89ae-a5a827afa0ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:29.732266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4b5848d5-ef44-4cd3-89ae-a5a827afa0ee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044305 Aug 18 22:05:29.732826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1021/2034] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:29 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:30.457184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e51f2707-0fff-44a5-9813-2b7feb76d219 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:30.460015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e51f2707-0fff-44a5-9813-2b7feb76d219 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:30.466413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e51f2707-0fff-44a5-9813-2b7feb76d219 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:30.466903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e51f2707-0fff-44a5-9813-2b7feb76d219 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:30.467339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e51f2707-0fff-44a5-9813-2b7feb76d219 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:30.468030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e51f2707-0fff-44a5-9813-2b7feb76d219 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:30.468489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e51f2707-0fff-44a5-9813-2b7feb76d219 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:30.468920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e51f2707-0fff-44a5-9813-2b7feb76d219 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:30.497361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e51f2707-0fff-44a5-9813-2b7feb76d219 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044273 Aug 18 22:05:30.497954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1014/2035] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:30.744907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6a96f3a0-2ddf-4bd0-bc04-0dd6f39e0f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:30.747093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6a96f3a0-2ddf-4bd0-bc04-0dd6f39e0f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:30.753428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a96f3a0-2ddf-4bd0-bc04-0dd6f39e0f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:30.753913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a96f3a0-2ddf-4bd0-bc04-0dd6f39e0f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:30.754343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a96f3a0-2ddf-4bd0-bc04-0dd6f39e0f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:30.755029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a96f3a0-2ddf-4bd0-bc04-0dd6f39e0f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:30.755479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a96f3a0-2ddf-4bd0-bc04-0dd6f39e0f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:30.756543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a96f3a0-2ddf-4bd0-bc04-0dd6f39e0f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:30.785344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6a96f3a0-2ddf-4bd0-bc04-0dd6f39e0f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044940 Aug 18 22:05:30.785936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1022/2036] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:30 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:31.509742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c2d99d71-fe37-4c19-b5bb-5ec5cd7295d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:31.511932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c2d99d71-fe37-4c19-b5bb-5ec5cd7295d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:31.518475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d99d71-fe37-4c19-b5bb-5ec5cd7295d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:31.518946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d99d71-fe37-4c19-b5bb-5ec5cd7295d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:31.519384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d99d71-fe37-4c19-b5bb-5ec5cd7295d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:31.520085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d99d71-fe37-4c19-b5bb-5ec5cd7295d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:31.520539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d99d71-fe37-4c19-b5bb-5ec5cd7295d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:31.520992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2d99d71-fe37-4c19-b5bb-5ec5cd7295d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:31.550655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c2d99d71-fe37-4c19-b5bb-5ec5cd7295d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044589 Aug 18 22:05:31.551207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1015/2037] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:31.797066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3590fcbc-5215-4f36-af45-d536d03a8161 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:31.799226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3590fcbc-5215-4f36-af45-d536d03a8161 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:31.805921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3590fcbc-5215-4f36-af45-d536d03a8161 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:31.806396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3590fcbc-5215-4f36-af45-d536d03a8161 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:31.806828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3590fcbc-5215-4f36-af45-d536d03a8161 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:31.807510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3590fcbc-5215-4f36-af45-d536d03a8161 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:31.807959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3590fcbc-5215-4f36-af45-d536d03a8161 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:31.808377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3590fcbc-5215-4f36-af45-d536d03a8161 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:31.837539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3590fcbc-5215-4f36-af45-d536d03a8161 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Aug 18 22:05:31.838114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1023/2038] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:32.563033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d8f51b86-394d-4912-a8d1-cbdb38b21c5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:32.565205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d8f51b86-394d-4912-a8d1-cbdb38b21c5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:32.571636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d8f51b86-394d-4912-a8d1-cbdb38b21c5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:32.572119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d8f51b86-394d-4912-a8d1-cbdb38b21c5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:32.572562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d8f51b86-394d-4912-a8d1-cbdb38b21c5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:32.573250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d8f51b86-394d-4912-a8d1-cbdb38b21c5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:32.573733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d8f51b86-394d-4912-a8d1-cbdb38b21c5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:32.574161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d8f51b86-394d-4912-a8d1-cbdb38b21c5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:32.603192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d8f51b86-394d-4912-a8d1-cbdb38b21c5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044095 Aug 18 22:05:32.603756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1016/2039] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:32.850135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3fa80063-d909-47e9-a618-76cfe75d2fd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:05:32.852377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3fa80063-d909-47e9-a618-76cfe75d2fd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:32.858746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fa80063-d909-47e9-a618-76cfe75d2fd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:32.859227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fa80063-d909-47e9-a618-76cfe75d2fd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:32.859663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fa80063-d909-47e9-a618-76cfe75d2fd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:32.860352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fa80063-d909-47e9-a618-76cfe75d2fd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:32.860803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fa80063-d909-47e9-a618-76cfe75d2fd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:32.861226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3fa80063-d909-47e9-a618-76cfe75d2fd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:32.939875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3fa80063-d909-47e9-a618-76cfe75d2fd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "POST /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/action" status: 200 len: 76286 microversion: 2.1 time: 0.094031 Aug 18 22:05:32.940554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1024/2040] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 22:05:32 2022] POST /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162/action => generated 76286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:05:33.616311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b46e7f53-1833-49bd-94b7-dd13fee50951 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:33.618393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b46e7f53-1833-49bd-94b7-dd13fee50951 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:33.624811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b46e7f53-1833-49bd-94b7-dd13fee50951 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:33.625361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b46e7f53-1833-49bd-94b7-dd13fee50951 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:33.625834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b46e7f53-1833-49bd-94b7-dd13fee50951 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:33.626530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b46e7f53-1833-49bd-94b7-dd13fee50951 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:33.626992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b46e7f53-1833-49bd-94b7-dd13fee50951 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:33.627423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b46e7f53-1833-49bd-94b7-dd13fee50951 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:33.656401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b46e7f53-1833-49bd-94b7-dd13fee50951 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Aug 18 22:05:33.656957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1017/2041] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:34.669897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3f31fdf6-efaa-421d-a113-9b306ce81ba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:34.672050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3f31fdf6-efaa-421d-a113-9b306ce81ba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:34.679332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f31fdf6-efaa-421d-a113-9b306ce81ba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:34.679816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f31fdf6-efaa-421d-a113-9b306ce81ba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:34.680257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f31fdf6-efaa-421d-a113-9b306ce81ba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:34.680958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f31fdf6-efaa-421d-a113-9b306ce81ba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:34.681419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f31fdf6-efaa-421d-a113-9b306ce81ba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:34.681877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f31fdf6-efaa-421d-a113-9b306ce81ba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:34.712743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3f31fdf6-efaa-421d-a113-9b306ce81ba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047299 Aug 18 22:05:34.713311 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1025/2042] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:35.724905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8482d71b-d6a9-4064-b423-b344e52081bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:35.727107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8482d71b-d6a9-4064-b423-b344e52081bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:35.733513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8482d71b-d6a9-4064-b423-b344e52081bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:35.734036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8482d71b-d6a9-4064-b423-b344e52081bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:35.734477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8482d71b-d6a9-4064-b423-b344e52081bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:35.735172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8482d71b-d6a9-4064-b423-b344e52081bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:35.735628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8482d71b-d6a9-4064-b423-b344e52081bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:35.736059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8482d71b-d6a9-4064-b423-b344e52081bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:35.765305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8482d71b-d6a9-4064-b423-b344e52081bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044796 Aug 18 22:05:35.765960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1018/2043] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:35 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:36.777546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-55418dc4-a6e5-4814-85ff-0ced484e4807 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:36.779713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-55418dc4-a6e5-4814-85ff-0ced484e4807 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:36.786136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55418dc4-a6e5-4814-85ff-0ced484e4807 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:36.786618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55418dc4-a6e5-4814-85ff-0ced484e4807 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:36.787053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55418dc4-a6e5-4814-85ff-0ced484e4807 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:36.787741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55418dc4-a6e5-4814-85ff-0ced484e4807 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:36.788193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55418dc4-a6e5-4814-85ff-0ced484e4807 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:36.788624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55418dc4-a6e5-4814-85ff-0ced484e4807 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:36.802715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:36.819144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-55418dc4-a6e5-4814-85ff-0ced484e4807 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045549 Aug 18 22:05:36.819708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1026/2044] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:37.831414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bfcdb1ae-e4c0-4e22-b39f-9c594566a76d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:37.834168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bfcdb1ae-e4c0-4e22-b39f-9c594566a76d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:37.840519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfcdb1ae-e4c0-4e22-b39f-9c594566a76d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:37.840998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfcdb1ae-e4c0-4e22-b39f-9c594566a76d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:37.841446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfcdb1ae-e4c0-4e22-b39f-9c594566a76d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:37.842164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfcdb1ae-e4c0-4e22-b39f-9c594566a76d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:37.842619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfcdb1ae-e4c0-4e22-b39f-9c594566a76d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:37.843044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfcdb1ae-e4c0-4e22-b39f-9c594566a76d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:37.871612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bfcdb1ae-e4c0-4e22-b39f-9c594566a76d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044093 Aug 18 22:05:37.872101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1019/2045] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:37 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:38.883809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b0a190f6-705f-4f06-8f73-ff4d7dca3c2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:38.885885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b0a190f6-705f-4f06-8f73-ff4d7dca3c2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:38.892265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0a190f6-705f-4f06-8f73-ff4d7dca3c2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:38.892741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0a190f6-705f-4f06-8f73-ff4d7dca3c2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:38.893173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0a190f6-705f-4f06-8f73-ff4d7dca3c2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:38.893884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0a190f6-705f-4f06-8f73-ff4d7dca3c2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:38.894804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0a190f6-705f-4f06-8f73-ff4d7dca3c2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:38.894804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0a190f6-705f-4f06-8f73-ff4d7dca3c2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:38.924723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b0a190f6-705f-4f06-8f73-ff4d7dca3c2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044905 Aug 18 22:05:38.925556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1027/2046] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:38 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:39.936985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-847544b1-d282-48f4-a3a9-5c27989f3500 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:39.939104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-847544b1-d282-48f4-a3a9-5c27989f3500 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:39.946115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-847544b1-d282-48f4-a3a9-5c27989f3500 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:39.946595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-847544b1-d282-48f4-a3a9-5c27989f3500 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:39.947035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-847544b1-d282-48f4-a3a9-5c27989f3500 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:39.947724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-847544b1-d282-48f4-a3a9-5c27989f3500 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:39.948176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-847544b1-d282-48f4-a3a9-5c27989f3500 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:39.948594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-847544b1-d282-48f4-a3a9-5c27989f3500 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:39.978080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-847544b1-d282-48f4-a3a9-5c27989f3500 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045042 Aug 18 22:05:39.978646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1020/2047] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:39 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:40.990454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f54cafc0-6f6e-4193-9141-f89670af3ac6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:40.992591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f54cafc0-6f6e-4193-9141-f89670af3ac6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:40.998976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f54cafc0-6f6e-4193-9141-f89670af3ac6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:40.999461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f54cafc0-6f6e-4193-9141-f89670af3ac6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:40.999899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f54cafc0-6f6e-4193-9141-f89670af3ac6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:41.000592 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f54cafc0-6f6e-4193-9141-f89670af3ac6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:41.001049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f54cafc0-6f6e-4193-9141-f89670af3ac6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:41.001768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f54cafc0-6f6e-4193-9141-f89670af3ac6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:41.042408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f54cafc0-6f6e-4193-9141-f89670af3ac6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056146 Aug 18 22:05:41.042982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1028/2048] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:40 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:42.054853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4eb43319-3256-4d36-a793-e9af1b0d19da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:42.056980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4eb43319-3256-4d36-a793-e9af1b0d19da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:42.059477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=70 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:42.064628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eb43319-3256-4d36-a793-e9af1b0d19da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:42.065109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eb43319-3256-4d36-a793-e9af1b0d19da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:42.065570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eb43319-3256-4d36-a793-e9af1b0d19da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:42.066294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eb43319-3256-4d36-a793-e9af1b0d19da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:42.066749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eb43319-3256-4d36-a793-e9af1b0d19da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:42.067167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eb43319-3256-4d36-a793-e9af1b0d19da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:42.097031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4eb43319-3256-4d36-a793-e9af1b0d19da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046144 Aug 18 22:05:42.097584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1021/2049] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:43.109999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-47695aef-555d-426b-8658-0c69cd8fc19b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:43.112151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-47695aef-555d-426b-8658-0c69cd8fc19b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:43.118560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47695aef-555d-426b-8658-0c69cd8fc19b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:43.119047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47695aef-555d-426b-8658-0c69cd8fc19b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:43.119480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47695aef-555d-426b-8658-0c69cd8fc19b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:43.120167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47695aef-555d-426b-8658-0c69cd8fc19b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:43.120620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47695aef-555d-426b-8658-0c69cd8fc19b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:43.121042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47695aef-555d-426b-8658-0c69cd8fc19b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:43.150673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-47695aef-555d-426b-8658-0c69cd8fc19b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044629 Aug 18 22:05:43.151231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1029/2050] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:43 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:44.163603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-40ed676a-76db-4f1d-bb3c-5c4b518973ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:44.165686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-40ed676a-76db-4f1d-bb3c-5c4b518973ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:44.172129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40ed676a-76db-4f1d-bb3c-5c4b518973ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:44.172610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40ed676a-76db-4f1d-bb3c-5c4b518973ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:44.173147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40ed676a-76db-4f1d-bb3c-5c4b518973ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:44.173770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40ed676a-76db-4f1d-bb3c-5c4b518973ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:44.174228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40ed676a-76db-4f1d-bb3c-5c4b518973ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:44.174653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40ed676a-76db-4f1d-bb3c-5c4b518973ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:44.203118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-40ed676a-76db-4f1d-bb3c-5c4b518973ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044174 Aug 18 22:05:44.203681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1022/2051] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:44 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:45.215419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a1d124bb-8f1a-4bff-b91e-43d6228a7eac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:45.217435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a1d124bb-8f1a-4bff-b91e-43d6228a7eac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:45.219814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=52 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:45.225332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a1d124bb-8f1a-4bff-b91e-43d6228a7eac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:45.225853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a1d124bb-8f1a-4bff-b91e-43d6228a7eac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:45.226285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a1d124bb-8f1a-4bff-b91e-43d6228a7eac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:45.226969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a1d124bb-8f1a-4bff-b91e-43d6228a7eac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:45.227417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a1d124bb-8f1a-4bff-b91e-43d6228a7eac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:45.227836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a1d124bb-8f1a-4bff-b91e-43d6228a7eac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:45.257120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a1d124bb-8f1a-4bff-b91e-43d6228a7eac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045710 Aug 18 22:05:45.257686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1030/2052] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:46.269390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-22f429fc-b1cd-422d-9afa-22fcd382d4fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:46.272050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-22f429fc-b1cd-422d-9afa-22fcd382d4fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:46.278511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22f429fc-b1cd-422d-9afa-22fcd382d4fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:46.278996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22f429fc-b1cd-422d-9afa-22fcd382d4fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:46.279428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22f429fc-b1cd-422d-9afa-22fcd382d4fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:46.280129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22f429fc-b1cd-422d-9afa-22fcd382d4fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:46.280585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22f429fc-b1cd-422d-9afa-22fcd382d4fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:46.281013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-22f429fc-b1cd-422d-9afa-22fcd382d4fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:46.310095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-22f429fc-b1cd-422d-9afa-22fcd382d4fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044695 Aug 18 22:05:46.310650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1023/2053] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:46 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:47.322919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2b21f6b7-1bec-4659-96c1-4cfa92c02e96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:47.325012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2b21f6b7-1bec-4659-96c1-4cfa92c02e96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:47.331584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b21f6b7-1bec-4659-96c1-4cfa92c02e96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:47.332067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b21f6b7-1bec-4659-96c1-4cfa92c02e96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:47.332499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b21f6b7-1bec-4659-96c1-4cfa92c02e96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:47.333201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b21f6b7-1bec-4659-96c1-4cfa92c02e96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:47.334194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b21f6b7-1bec-4659-96c1-4cfa92c02e96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:47.334622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b21f6b7-1bec-4659-96c1-4cfa92c02e96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:47.364157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2b21f6b7-1bec-4659-96c1-4cfa92c02e96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045213 Aug 18 22:05:47.364725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1031/2054] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:47 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:48.376838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4b68c366-75a6-4ade-b8a8-e8c7714dbc8d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:48.379002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4b68c366-75a6-4ade-b8a8-e8c7714dbc8d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:48.385944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b68c366-75a6-4ade-b8a8-e8c7714dbc8d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:48.386428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b68c366-75a6-4ade-b8a8-e8c7714dbc8d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:48.386866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b68c366-75a6-4ade-b8a8-e8c7714dbc8d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:48.387560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b68c366-75a6-4ade-b8a8-e8c7714dbc8d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:48.388017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b68c366-75a6-4ade-b8a8-e8c7714dbc8d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:48.388442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b68c366-75a6-4ade-b8a8-e8c7714dbc8d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:48.417569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4b68c366-75a6-4ade-b8a8-e8c7714dbc8d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044586 Aug 18 22:05:48.418158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1024/2055] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:48 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:49.430046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-44c1aa23-6891-4232-85c3-6427bee054be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:49.432254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-44c1aa23-6891-4232-85c3-6427bee054be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:49.438538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44c1aa23-6891-4232-85c3-6427bee054be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:49.439014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44c1aa23-6891-4232-85c3-6427bee054be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:49.439447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44c1aa23-6891-4232-85c3-6427bee054be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:49.440129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44c1aa23-6891-4232-85c3-6427bee054be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:49.440579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44c1aa23-6891-4232-85c3-6427bee054be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:49.440996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44c1aa23-6891-4232-85c3-6427bee054be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:49.469320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-44c1aa23-6891-4232-85c3-6427bee054be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043283 Aug 18 22:05:49.469909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1032/2056] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:49 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:50.481718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4c364713-8ff0-44c3-903a-ab6c1e30ff71 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:50.483853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4c364713-8ff0-44c3-903a-ab6c1e30ff71 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:50.490369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4c364713-8ff0-44c3-903a-ab6c1e30ff71 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:50.490852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4c364713-8ff0-44c3-903a-ab6c1e30ff71 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:50.491296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4c364713-8ff0-44c3-903a-ab6c1e30ff71 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:50.491996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4c364713-8ff0-44c3-903a-ab6c1e30ff71 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:50.492456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4c364713-8ff0-44c3-903a-ab6c1e30ff71 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:50.492891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4c364713-8ff0-44c3-903a-ab6c1e30ff71 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:50.522447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4c364713-8ff0-44c3-903a-ab6c1e30ff71 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Aug 18 22:05:50.522999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1025/2057] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:50 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:51.534052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d7e2885-1870-4458-9bcd-4b6fef253fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:51.536203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7d7e2885-1870-4458-9bcd-4b6fef253fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:51.542596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d7e2885-1870-4458-9bcd-4b6fef253fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:51.543078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d7e2885-1870-4458-9bcd-4b6fef253fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:51.543508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d7e2885-1870-4458-9bcd-4b6fef253fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:51.544206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d7e2885-1870-4458-9bcd-4b6fef253fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:51.544654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d7e2885-1870-4458-9bcd-4b6fef253fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:51.545071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d7e2885-1870-4458-9bcd-4b6fef253fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:51.575615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d7e2885-1870-4458-9bcd-4b6fef253fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045448 Aug 18 22:05:51.576204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1033/2058] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:51 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:52.588262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-505fc760-db65-433c-bccb-3b2e0f63cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:52.590371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-505fc760-db65-433c-bccb-3b2e0f63cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:52.596843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-505fc760-db65-433c-bccb-3b2e0f63cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:52.597318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-505fc760-db65-433c-bccb-3b2e0f63cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:52.597805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-505fc760-db65-433c-bccb-3b2e0f63cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:52.598499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-505fc760-db65-433c-bccb-3b2e0f63cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:52.598953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-505fc760-db65-433c-bccb-3b2e0f63cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:52.599988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-505fc760-db65-433c-bccb-3b2e0f63cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:52.623911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:05:52.629293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-505fc760-db65-433c-bccb-3b2e0f63cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045551 Aug 18 22:05:52.629883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1026/2059] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:52 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:53.641760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3a67f603-5f28-4dbf-8cab-b62fee7014d6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:53.643793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3a67f603-5f28-4dbf-8cab-b62fee7014d6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:53.650161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a67f603-5f28-4dbf-8cab-b62fee7014d6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:53.650633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a67f603-5f28-4dbf-8cab-b62fee7014d6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:53.651064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a67f603-5f28-4dbf-8cab-b62fee7014d6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:53.651749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a67f603-5f28-4dbf-8cab-b62fee7014d6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:53.652198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a67f603-5f28-4dbf-8cab-b62fee7014d6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:53.652619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a67f603-5f28-4dbf-8cab-b62fee7014d6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:53.682493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3a67f603-5f28-4dbf-8cab-b62fee7014d6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044898 Aug 18 22:05:53.683072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1034/2060] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:53 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:54.695004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-865068a2-6ed1-4a0d-bc23-ffe7646e33fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:54.697067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-865068a2-6ed1-4a0d-bc23-ffe7646e33fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:54.703513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-865068a2-6ed1-4a0d-bc23-ffe7646e33fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:54.704000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-865068a2-6ed1-4a0d-bc23-ffe7646e33fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:54.704444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-865068a2-6ed1-4a0d-bc23-ffe7646e33fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:54.705173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-865068a2-6ed1-4a0d-bc23-ffe7646e33fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:54.705657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-865068a2-6ed1-4a0d-bc23-ffe7646e33fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:54.706090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-865068a2-6ed1-4a0d-bc23-ffe7646e33fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:54.737476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-865068a2-6ed1-4a0d-bc23-ffe7646e33fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047377 Aug 18 22:05:54.738106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1027/2061] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:54 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:05:55.751094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0bf1c6f7-87a4-41cd-930a-f39f378102ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:55.753212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0bf1c6f7-87a4-41cd-930a-f39f378102ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:55.760042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bf1c6f7-87a4-41cd-930a-f39f378102ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:55.760512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bf1c6f7-87a4-41cd-930a-f39f378102ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:55.760940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bf1c6f7-87a4-41cd-930a-f39f378102ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:55.761638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bf1c6f7-87a4-41cd-930a-f39f378102ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:55.762089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bf1c6f7-87a4-41cd-930a-f39f378102ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:55.762516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0bf1c6f7-87a4-41cd-930a-f39f378102ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:55.791636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0bf1c6f7-87a4-41cd-930a-f39f378102ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Aug 18 22:05:55.792197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1035/2062] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:55 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:56.805136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4ba1ceaa-7af0-4a70-aeca-a9bc02e1370f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:56.807279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4ba1ceaa-7af0-4a70-aeca-a9bc02e1370f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:56.813884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ba1ceaa-7af0-4a70-aeca-a9bc02e1370f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:56.814361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ba1ceaa-7af0-4a70-aeca-a9bc02e1370f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:56.814792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ba1ceaa-7af0-4a70-aeca-a9bc02e1370f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:56.815479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ba1ceaa-7af0-4a70-aeca-a9bc02e1370f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:56.815930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ba1ceaa-7af0-4a70-aeca-a9bc02e1370f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:56.816353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ba1ceaa-7af0-4a70-aeca-a9bc02e1370f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:56.846935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4ba1ceaa-7af0-4a70-aeca-a9bc02e1370f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046669 Aug 18 22:05:56.847489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1028/2063] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:56 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:57.860073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5c959ce4-db52-4a4b-93ea-7fde9173c1a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:57.862148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5c959ce4-db52-4a4b-93ea-7fde9173c1a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:57.869048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c959ce4-db52-4a4b-93ea-7fde9173c1a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:57.869527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c959ce4-db52-4a4b-93ea-7fde9173c1a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:57.870002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c959ce4-db52-4a4b-93ea-7fde9173c1a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:57.870689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c959ce4-db52-4a4b-93ea-7fde9173c1a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:57.871144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c959ce4-db52-4a4b-93ea-7fde9173c1a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:57.871571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c959ce4-db52-4a4b-93ea-7fde9173c1a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:57.900823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5c959ce4-db52-4a4b-93ea-7fde9173c1a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044760 Aug 18 22:05:57.901391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1036/2064] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:57 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:58.912484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b21d7e0e-7c0c-42fa-a94f-077ce9355836 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:58.914700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b21d7e0e-7c0c-42fa-a94f-077ce9355836 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:58.920946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b21d7e0e-7c0c-42fa-a94f-077ce9355836 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:58.921432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b21d7e0e-7c0c-42fa-a94f-077ce9355836 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:58.921906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b21d7e0e-7c0c-42fa-a94f-077ce9355836 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:58.922649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b21d7e0e-7c0c-42fa-a94f-077ce9355836 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:58.923108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b21d7e0e-7c0c-42fa-a94f-077ce9355836 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:58.923547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b21d7e0e-7c0c-42fa-a94f-077ce9355836 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:58.953723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b21d7e0e-7c0c-42fa-a94f-077ce9355836 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 Aug 18 22:05:58.954289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1029/2065] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:58 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:05:59.968643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7f0b564e-49c9-4228-a741-2128b3cf81c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:05:59.970713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7f0b564e-49c9-4228-a741-2128b3cf81c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:05:59.977963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f0b564e-49c9-4228-a741-2128b3cf81c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:59.978442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f0b564e-49c9-4228-a741-2128b3cf81c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:59.978875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f0b564e-49c9-4228-a741-2128b3cf81c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:05:59.979573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f0b564e-49c9-4228-a741-2128b3cf81c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:05:59.980136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f0b564e-49c9-4228-a741-2128b3cf81c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:05:59.980556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f0b564e-49c9-4228-a741-2128b3cf81c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:00.010394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7f0b564e-49c9-4228-a741-2128b3cf81c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045886 Aug 18 22:06:00.010963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1037/2066] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:05:59 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:01.022753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-56820fbb-0724-4b00-894a-fe361a8bef70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:01.024874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-56820fbb-0724-4b00-894a-fe361a8bef70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:01.031468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56820fbb-0724-4b00-894a-fe361a8bef70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:01.031949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56820fbb-0724-4b00-894a-fe361a8bef70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:01.032413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56820fbb-0724-4b00-894a-fe361a8bef70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:01.033117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56820fbb-0724-4b00-894a-fe361a8bef70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:01.033576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56820fbb-0724-4b00-894a-fe361a8bef70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:01.034019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56820fbb-0724-4b00-894a-fe361a8bef70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:01.067234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-56820fbb-0724-4b00-894a-fe361a8bef70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048438 Aug 18 22:06:01.067834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1030/2067] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:01 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:02.079333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3b962897-e147-45a6-b2f5-a265895a19c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:02.081414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3b962897-e147-45a6-b2f5-a265895a19c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:02.087731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b962897-e147-45a6-b2f5-a265895a19c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:02.088208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b962897-e147-45a6-b2f5-a265895a19c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:02.088639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b962897-e147-45a6-b2f5-a265895a19c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:02.089318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b962897-e147-45a6-b2f5-a265895a19c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:02.089803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b962897-e147-45a6-b2f5-a265895a19c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:02.090224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b962897-e147-45a6-b2f5-a265895a19c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:02.119830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3b962897-e147-45a6-b2f5-a265895a19c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Aug 18 22:06:02.120680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1038/2068] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:03.132805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a33edb2e-79fd-4845-8b56-74483cad80a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:03.134920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a33edb2e-79fd-4845-8b56-74483cad80a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:03.141373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a33edb2e-79fd-4845-8b56-74483cad80a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:03.141881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a33edb2e-79fd-4845-8b56-74483cad80a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:03.142314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a33edb2e-79fd-4845-8b56-74483cad80a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:03.143025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a33edb2e-79fd-4845-8b56-74483cad80a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:03.143479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a33edb2e-79fd-4845-8b56-74483cad80a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:03.143899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a33edb2e-79fd-4845-8b56-74483cad80a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:03.173551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a33edb2e-79fd-4845-8b56-74483cad80a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045039 Aug 18 22:06:03.174127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1031/2069] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:04.186690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f960bcff-a6cc-42e4-bf12-3e520f2292bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:04.188780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f960bcff-a6cc-42e4-bf12-3e520f2292bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:04.195280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f960bcff-a6cc-42e4-bf12-3e520f2292bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:04.195760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f960bcff-a6cc-42e4-bf12-3e520f2292bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:04.196201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f960bcff-a6cc-42e4-bf12-3e520f2292bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:04.196895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f960bcff-a6cc-42e4-bf12-3e520f2292bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:04.197354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f960bcff-a6cc-42e4-bf12-3e520f2292bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:04.197818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f960bcff-a6cc-42e4-bf12-3e520f2292bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:04.226841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f960bcff-a6cc-42e4-bf12-3e520f2292bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044101 Aug 18 22:06:04.227403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1039/2070] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:05.239395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c9d69bca-2454-4210-933a-d42a6b14e743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:05.241436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c9d69bca-2454-4210-933a-d42a6b14e743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:05.247800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9d69bca-2454-4210-933a-d42a6b14e743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:05.248276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9d69bca-2454-4210-933a-d42a6b14e743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:05.248710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9d69bca-2454-4210-933a-d42a6b14e743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:05.249392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9d69bca-2454-4210-933a-d42a6b14e743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:05.249895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9d69bca-2454-4210-933a-d42a6b14e743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:05.250315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9d69bca-2454-4210-933a-d42a6b14e743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:05.280141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c9d69bca-2454-4210-933a-d42a6b14e743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044737 Aug 18 22:06:05.280693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1032/2071] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:06.292796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f720826d-ec90-4c4c-93d6-2e66025ec76f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:06.295049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f720826d-ec90-4c4c-93d6-2e66025ec76f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:06.302423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f720826d-ec90-4c4c-93d6-2e66025ec76f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:06.302903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f720826d-ec90-4c4c-93d6-2e66025ec76f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:06.303339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f720826d-ec90-4c4c-93d6-2e66025ec76f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:06.304032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f720826d-ec90-4c4c-93d6-2e66025ec76f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:06.304480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f720826d-ec90-4c4c-93d6-2e66025ec76f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:06.304901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f720826d-ec90-4c4c-93d6-2e66025ec76f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:06.333244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f720826d-ec90-4c4c-93d6-2e66025ec76f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Aug 18 22:06:06.333843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1040/2072] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:07.345550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bf48ad47-1187-4381-b71a-29e107ae792d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:07.347630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bf48ad47-1187-4381-b71a-29e107ae792d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:07.354058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf48ad47-1187-4381-b71a-29e107ae792d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:07.354542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf48ad47-1187-4381-b71a-29e107ae792d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:07.354980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf48ad47-1187-4381-b71a-29e107ae792d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:07.355726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf48ad47-1187-4381-b71a-29e107ae792d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:07.356211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf48ad47-1187-4381-b71a-29e107ae792d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:07.356706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf48ad47-1187-4381-b71a-29e107ae792d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:07.387026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bf48ad47-1187-4381-b71a-29e107ae792d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045397 Aug 18 22:06:07.387603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1033/2073] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:07 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:08.399938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf8b214e-7033-41a3-9951-a567d17c07bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:08.402060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf8b214e-7033-41a3-9951-a567d17c07bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:08.408512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf8b214e-7033-41a3-9951-a567d17c07bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:08.408992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf8b214e-7033-41a3-9951-a567d17c07bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:08.409431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf8b214e-7033-41a3-9951-a567d17c07bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:08.410161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf8b214e-7033-41a3-9951-a567d17c07bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:08.410623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf8b214e-7033-41a3-9951-a567d17c07bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:08.411653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf8b214e-7033-41a3-9951-a567d17c07bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:08.414013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=88 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:08.440982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf8b214e-7033-41a3-9951-a567d17c07bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045600 Aug 18 22:06:08.441532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1041/2074] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:09.453941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-afab1287-ee11-4e68-89c6-168446548fd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:09.456014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-afab1287-ee11-4e68-89c6-168446548fd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:09.462617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-afab1287-ee11-4e68-89c6-168446548fd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:09.463103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-afab1287-ee11-4e68-89c6-168446548fd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:09.463542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-afab1287-ee11-4e68-89c6-168446548fd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:09.464241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-afab1287-ee11-4e68-89c6-168446548fd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:09.464697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-afab1287-ee11-4e68-89c6-168446548fd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:09.465124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-afab1287-ee11-4e68-89c6-168446548fd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:09.496087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-afab1287-ee11-4e68-89c6-168446548fd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046180 Aug 18 22:06:09.496629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1034/2075] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:10.508145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f4ee39f8-9e87-45f8-a559-f1d7a4d1bdee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:10.510232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f4ee39f8-9e87-45f8-a559-f1d7a4d1bdee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:10.516671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ee39f8-9e87-45f8-a559-f1d7a4d1bdee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:10.517150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ee39f8-9e87-45f8-a559-f1d7a4d1bdee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:10.517587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ee39f8-9e87-45f8-a559-f1d7a4d1bdee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:10.518297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ee39f8-9e87-45f8-a559-f1d7a4d1bdee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:10.518754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ee39f8-9e87-45f8-a559-f1d7a4d1bdee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:10.519181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4ee39f8-9e87-45f8-a559-f1d7a4d1bdee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:10.549242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f4ee39f8-9e87-45f8-a559-f1d7a4d1bdee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045122 Aug 18 22:06:10.549821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1042/2076] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:10 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:11.561992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a79e6e73-6e80-4c70-853b-b395ef160a2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:11.564124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a79e6e73-6e80-4c70-853b-b395ef160a2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:11.570539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a79e6e73-6e80-4c70-853b-b395ef160a2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:11.571018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a79e6e73-6e80-4c70-853b-b395ef160a2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:11.571471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a79e6e73-6e80-4c70-853b-b395ef160a2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:11.572144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a79e6e73-6e80-4c70-853b-b395ef160a2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:11.572601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a79e6e73-6e80-4c70-853b-b395ef160a2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:11.573026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a79e6e73-6e80-4c70-853b-b395ef160a2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:11.601796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a79e6e73-6e80-4c70-853b-b395ef160a2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043826 Aug 18 22:06:11.602352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1035/2077] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:12.614776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b16f1dc8-c2c7-45e2-a5c0-60a81913aaa0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:12.616778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b16f1dc8-c2c7-45e2-a5c0-60a81913aaa0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:12.623034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b16f1dc8-c2c7-45e2-a5c0-60a81913aaa0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:12.623513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b16f1dc8-c2c7-45e2-a5c0-60a81913aaa0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:12.623944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b16f1dc8-c2c7-45e2-a5c0-60a81913aaa0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:12.624651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b16f1dc8-c2c7-45e2-a5c0-60a81913aaa0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:12.625098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b16f1dc8-c2c7-45e2-a5c0-60a81913aaa0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:12.625519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b16f1dc8-c2c7-45e2-a5c0-60a81913aaa0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:12.654509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b16f1dc8-c2c7-45e2-a5c0-60a81913aaa0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Aug 18 22:06:12.655059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1043/2078] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:12 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:13.667515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-59819cb2-673a-41d5-bac9-aff8e0e1e74b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:13.669684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-59819cb2-673a-41d5-bac9-aff8e0e1e74b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:13.672154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:13.677886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59819cb2-673a-41d5-bac9-aff8e0e1e74b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:13.678370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59819cb2-673a-41d5-bac9-aff8e0e1e74b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:13.678809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59819cb2-673a-41d5-bac9-aff8e0e1e74b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:13.679506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59819cb2-673a-41d5-bac9-aff8e0e1e74b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:13.679963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59819cb2-673a-41d5-bac9-aff8e0e1e74b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:13.680393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59819cb2-673a-41d5-bac9-aff8e0e1e74b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:13.711393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-59819cb2-673a-41d5-bac9-aff8e0e1e74b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047781 Aug 18 22:06:13.711957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1036/2079] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:14.724236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6c1bd052-2fb9-4e61-ae30-8937d4ece523 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:14.726471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6c1bd052-2fb9-4e61-ae30-8937d4ece523 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:14.732867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c1bd052-2fb9-4e61-ae30-8937d4ece523 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:14.733294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c1bd052-2fb9-4e61-ae30-8937d4ece523 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:14.733787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c1bd052-2fb9-4e61-ae30-8937d4ece523 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:14.734759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c1bd052-2fb9-4e61-ae30-8937d4ece523 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:14.735291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c1bd052-2fb9-4e61-ae30-8937d4ece523 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:14.735723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c1bd052-2fb9-4e61-ae30-8937d4ece523 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:14.764818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6c1bd052-2fb9-4e61-ae30-8937d4ece523 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044955 Aug 18 22:06:14.765392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1044/2080] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:15.777115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-52524391-9081-4779-a7bd-9d0b03c036e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:15.779275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-52524391-9081-4779-a7bd-9d0b03c036e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:15.785710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52524391-9081-4779-a7bd-9d0b03c036e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:15.786270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52524391-9081-4779-a7bd-9d0b03c036e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:15.786710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52524391-9081-4779-a7bd-9d0b03c036e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:15.787410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52524391-9081-4779-a7bd-9d0b03c036e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:15.787863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52524391-9081-4779-a7bd-9d0b03c036e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:15.788307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52524391-9081-4779-a7bd-9d0b03c036e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:15.817973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-52524391-9081-4779-a7bd-9d0b03c036e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044167 Aug 18 22:06:15.818542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1037/2081] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:15 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:16.830624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3d51bdd8-a972-41e5-ba93-4416f2413291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:16.833363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3d51bdd8-a972-41e5-ba93-4416f2413291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:16.835243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=30 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:16.840581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d51bdd8-a972-41e5-ba93-4416f2413291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:16.841001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d51bdd8-a972-41e5-ba93-4416f2413291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:16.841439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d51bdd8-a972-41e5-ba93-4416f2413291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:16.842167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d51bdd8-a972-41e5-ba93-4416f2413291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:16.842632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d51bdd8-a972-41e5-ba93-4416f2413291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:16.843061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d51bdd8-a972-41e5-ba93-4416f2413291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:16.872755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3d51bdd8-a972-41e5-ba93-4416f2413291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Aug 18 22:06:16.873324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1045/2082] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:17.885432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-378a7977-187b-4da0-add0-77425911298c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:17.887840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-378a7977-187b-4da0-add0-77425911298c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:17.894495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-378a7977-187b-4da0-add0-77425911298c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:17.894918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-378a7977-187b-4da0-add0-77425911298c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:17.895902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-378a7977-187b-4da0-add0-77425911298c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:17.897095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-378a7977-187b-4da0-add0-77425911298c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:17.897962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-378a7977-187b-4da0-add0-77425911298c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:17.898762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-378a7977-187b-4da0-add0-77425911298c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:17.931550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-378a7977-187b-4da0-add0-77425911298c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049933 Aug 18 22:06:17.932127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1038/2083] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:17 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:18.944644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-96a55a3e-576a-42b7-9821-bdda6bab1183 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:18.946810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-96a55a3e-576a-42b7-9821-bdda6bab1183 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:18.953226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96a55a3e-576a-42b7-9821-bdda6bab1183 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:18.953753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96a55a3e-576a-42b7-9821-bdda6bab1183 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:18.954196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96a55a3e-576a-42b7-9821-bdda6bab1183 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:18.954893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96a55a3e-576a-42b7-9821-bdda6bab1183 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:18.955353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96a55a3e-576a-42b7-9821-bdda6bab1183 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:18.955785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96a55a3e-576a-42b7-9821-bdda6bab1183 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:18.985194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-96a55a3e-576a-42b7-9821-bdda6bab1183 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045175 Aug 18 22:06:18.985704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1046/2084] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:18 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:19.998051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-73c3eac8-9098-4dd2-b6ed-953a52ca66ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:20.000188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-73c3eac8-9098-4dd2-b6ed-953a52ca66ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:20.007333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73c3eac8-9098-4dd2-b6ed-953a52ca66ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:20.007820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73c3eac8-9098-4dd2-b6ed-953a52ca66ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:20.008259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73c3eac8-9098-4dd2-b6ed-953a52ca66ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:20.008955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73c3eac8-9098-4dd2-b6ed-953a52ca66ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:20.009412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73c3eac8-9098-4dd2-b6ed-953a52ca66ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:20.009873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73c3eac8-9098-4dd2-b6ed-953a52ca66ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:20.039156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-73c3eac8-9098-4dd2-b6ed-953a52ca66ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Aug 18 22:06:20.039711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1039/2085] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:19 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:21.052065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-807f08d1-68cc-4a5f-89ff-88a8a01f3fc2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:21.054200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-807f08d1-68cc-4a5f-89ff-88a8a01f3fc2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:21.060913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-807f08d1-68cc-4a5f-89ff-88a8a01f3fc2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:21.061384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-807f08d1-68cc-4a5f-89ff-88a8a01f3fc2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:21.061846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-807f08d1-68cc-4a5f-89ff-88a8a01f3fc2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:21.062532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-807f08d1-68cc-4a5f-89ff-88a8a01f3fc2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:21.062984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-807f08d1-68cc-4a5f-89ff-88a8a01f3fc2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:21.063404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-807f08d1-68cc-4a5f-89ff-88a8a01f3fc2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:21.092364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-807f08d1-68cc-4a5f-89ff-88a8a01f3fc2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Aug 18 22:06:21.092910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1047/2086] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:22.104946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-932863b3-d482-4c68-9ba8-2599df8dc34d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:22.107262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-932863b3-d482-4c68-9ba8-2599df8dc34d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:22.114227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-932863b3-d482-4c68-9ba8-2599df8dc34d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:22.114719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-932863b3-d482-4c68-9ba8-2599df8dc34d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:22.115157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-932863b3-d482-4c68-9ba8-2599df8dc34d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:22.115846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-932863b3-d482-4c68-9ba8-2599df8dc34d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:22.116303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-932863b3-d482-4c68-9ba8-2599df8dc34d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:22.116729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-932863b3-d482-4c68-9ba8-2599df8dc34d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:22.145833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-932863b3-d482-4c68-9ba8-2599df8dc34d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044765 Aug 18 22:06:22.146394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1040/2087] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:23.158144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-34eeac36-6922-416e-86f1-db4cce828607 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:23.160380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-34eeac36-6922-416e-86f1-db4cce828607 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:23.166822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34eeac36-6922-416e-86f1-db4cce828607 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:23.167264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34eeac36-6922-416e-86f1-db4cce828607 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:23.167679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34eeac36-6922-416e-86f1-db4cce828607 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:23.168367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34eeac36-6922-416e-86f1-db4cce828607 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:23.168822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34eeac36-6922-416e-86f1-db4cce828607 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:23.169246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34eeac36-6922-416e-86f1-db4cce828607 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:23.199335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-34eeac36-6922-416e-86f1-db4cce828607 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045024 Aug 18 22:06:23.199888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1048/2088] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:23 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:24.211876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8f56fbb1-5542-4155-a92e-8b5cab235687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:24.214054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8f56fbb1-5542-4155-a92e-8b5cab235687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:24.220615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f56fbb1-5542-4155-a92e-8b5cab235687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:24.221136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f56fbb1-5542-4155-a92e-8b5cab235687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:24.221630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f56fbb1-5542-4155-a92e-8b5cab235687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:24.222329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f56fbb1-5542-4155-a92e-8b5cab235687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:24.222792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f56fbb1-5542-4155-a92e-8b5cab235687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:24.223224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f56fbb1-5542-4155-a92e-8b5cab235687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:24.252343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8f56fbb1-5542-4155-a92e-8b5cab235687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045029 Aug 18 22:06:24.252908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1041/2089] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:25.267331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1af79188-78c3-406c-a5e9-c9131b22e591 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:25.270510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1af79188-78c3-406c-a5e9-c9131b22e591 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:25.279864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1af79188-78c3-406c-a5e9-c9131b22e591 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:25.280589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1af79188-78c3-406c-a5e9-c9131b22e591 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:25.281252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1af79188-78c3-406c-a5e9-c9131b22e591 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:25.282337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1af79188-78c3-406c-a5e9-c9131b22e591 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:25.283040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1af79188-78c3-406c-a5e9-c9131b22e591 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:25.283700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1af79188-78c3-406c-a5e9-c9131b22e591 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:25.324469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1af79188-78c3-406c-a5e9-c9131b22e591 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063103 Aug 18 22:06:25.325306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1049/2090] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:26.338821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d084e4c8-1e77-4b96-9d3d-b8d357bbf3fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:26.340974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d084e4c8-1e77-4b96-9d3d-b8d357bbf3fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:26.347344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d084e4c8-1e77-4b96-9d3d-b8d357bbf3fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:26.347832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d084e4c8-1e77-4b96-9d3d-b8d357bbf3fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:26.348269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d084e4c8-1e77-4b96-9d3d-b8d357bbf3fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:26.348961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d084e4c8-1e77-4b96-9d3d-b8d357bbf3fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:26.349417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d084e4c8-1e77-4b96-9d3d-b8d357bbf3fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:26.349866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d084e4c8-1e77-4b96-9d3d-b8d357bbf3fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:26.352282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=91 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:26.380556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d084e4c8-1e77-4b96-9d3d-b8d357bbf3fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045660 Aug 18 22:06:26.381115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1042/2091] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:26 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:27.392281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c694fcf4-196d-4aff-9374-86e0f82f24cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:27.394453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c694fcf4-196d-4aff-9374-86e0f82f24cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:27.401464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c694fcf4-196d-4aff-9374-86e0f82f24cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:27.401985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c694fcf4-196d-4aff-9374-86e0f82f24cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:27.402425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c694fcf4-196d-4aff-9374-86e0f82f24cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:27.403123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c694fcf4-196d-4aff-9374-86e0f82f24cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:27.403588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c694fcf4-196d-4aff-9374-86e0f82f24cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:27.404019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c694fcf4-196d-4aff-9374-86e0f82f24cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:27.433016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c694fcf4-196d-4aff-9374-86e0f82f24cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Aug 18 22:06:27.433867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1050/2092] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:28.445710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8806f757-8bcb-431c-9311-1cd220f651a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:28.447853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8806f757-8bcb-431c-9311-1cd220f651a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:28.453851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8806f757-8bcb-431c-9311-1cd220f651a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:28.454338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8806f757-8bcb-431c-9311-1cd220f651a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:28.454779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8806f757-8bcb-431c-9311-1cd220f651a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:28.455474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8806f757-8bcb-431c-9311-1cd220f651a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:28.455933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8806f757-8bcb-431c-9311-1cd220f651a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:28.456365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8806f757-8bcb-431c-9311-1cd220f651a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:28.486165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8806f757-8bcb-431c-9311-1cd220f651a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044568 Aug 18 22:06:28.486767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1043/2093] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:29.498465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-95069106-99a4-49f9-a310-c808058f0d59 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:29.500647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-95069106-99a4-49f9-a310-c808058f0d59 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:29.507264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95069106-99a4-49f9-a310-c808058f0d59 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:29.507745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95069106-99a4-49f9-a310-c808058f0d59 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:29.508177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95069106-99a4-49f9-a310-c808058f0d59 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:29.508858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95069106-99a4-49f9-a310-c808058f0d59 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:29.509307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95069106-99a4-49f9-a310-c808058f0d59 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:29.509756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95069106-99a4-49f9-a310-c808058f0d59 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:29.540861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-95069106-99a4-49f9-a310-c808058f0d59 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046332 Aug 18 22:06:29.541414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1051/2094] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:29 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:30.553758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bae70ec4-6cfb-4bdd-957c-589a22711ee3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:30.555878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bae70ec4-6cfb-4bdd-957c-589a22711ee3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:30.562374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bae70ec4-6cfb-4bdd-957c-589a22711ee3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:30.562859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bae70ec4-6cfb-4bdd-957c-589a22711ee3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:30.563296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bae70ec4-6cfb-4bdd-957c-589a22711ee3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:30.563989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bae70ec4-6cfb-4bdd-957c-589a22711ee3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:30.564445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bae70ec4-6cfb-4bdd-957c-589a22711ee3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:30.564872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bae70ec4-6cfb-4bdd-957c-589a22711ee3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:30.594755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bae70ec4-6cfb-4bdd-957c-589a22711ee3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045708 Aug 18 22:06:30.595321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1044/2095] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:31.607173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ebe094ad-0e08-48d2-9357-5589dae5a6a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:31.609523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ebe094ad-0e08-48d2-9357-5589dae5a6a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:31.616203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebe094ad-0e08-48d2-9357-5589dae5a6a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:31.616715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebe094ad-0e08-48d2-9357-5589dae5a6a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:31.617121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebe094ad-0e08-48d2-9357-5589dae5a6a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:31.617845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebe094ad-0e08-48d2-9357-5589dae5a6a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:31.618307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebe094ad-0e08-48d2-9357-5589dae5a6a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:31.618733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebe094ad-0e08-48d2-9357-5589dae5a6a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:31.648012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ebe094ad-0e08-48d2-9357-5589dae5a6a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044737 Aug 18 22:06:31.648567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1052/2096] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:32.660832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f79d6508-2fdf-4d1d-bb84-2b5c96f3a0ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:32.663007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f79d6508-2fdf-4d1d-bb84-2b5c96f3a0ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:32.669389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f79d6508-2fdf-4d1d-bb84-2b5c96f3a0ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:32.669905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f79d6508-2fdf-4d1d-bb84-2b5c96f3a0ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:32.670348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f79d6508-2fdf-4d1d-bb84-2b5c96f3a0ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:32.671074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f79d6508-2fdf-4d1d-bb84-2b5c96f3a0ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:32.671535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f79d6508-2fdf-4d1d-bb84-2b5c96f3a0ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:32.671967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f79d6508-2fdf-4d1d-bb84-2b5c96f3a0ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:32.702431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f79d6508-2fdf-4d1d-bb84-2b5c96f3a0ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046032 Aug 18 22:06:32.703010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1045/2097] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:33.714303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f3b9417c-a4fd-493b-86fd-20be80e35f98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:33.716479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f3b9417c-a4fd-493b-86fd-20be80e35f98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:33.723671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3b9417c-a4fd-493b-86fd-20be80e35f98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:33.724149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3b9417c-a4fd-493b-86fd-20be80e35f98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:33.724583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3b9417c-a4fd-493b-86fd-20be80e35f98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:33.725276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3b9417c-a4fd-493b-86fd-20be80e35f98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:33.725765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3b9417c-a4fd-493b-86fd-20be80e35f98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:33.726196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3b9417c-a4fd-493b-86fd-20be80e35f98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:33.756262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f3b9417c-a4fd-493b-86fd-20be80e35f98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045895 Aug 18 22:06:33.756821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1053/2098] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:34.768479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cc48bfdf-ed91-4b33-8813-ea683b546c98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:34.770673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cc48bfdf-ed91-4b33-8813-ea683b546c98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:34.777207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc48bfdf-ed91-4b33-8813-ea683b546c98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:34.777723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc48bfdf-ed91-4b33-8813-ea683b546c98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:34.778168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc48bfdf-ed91-4b33-8813-ea683b546c98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:34.778860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc48bfdf-ed91-4b33-8813-ea683b546c98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:34.779319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc48bfdf-ed91-4b33-8813-ea683b546c98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:34.779748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc48bfdf-ed91-4b33-8813-ea683b546c98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:34.809774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cc48bfdf-ed91-4b33-8813-ea683b546c98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045185 Aug 18 22:06:34.810324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1046/2099] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:35.822642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-21dc46b0-de23-4d8e-bd77-0c5a24d28991 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:35.824808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-21dc46b0-de23-4d8e-bd77-0c5a24d28991 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:35.831192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21dc46b0-de23-4d8e-bd77-0c5a24d28991 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:35.831675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21dc46b0-de23-4d8e-bd77-0c5a24d28991 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:35.832116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21dc46b0-de23-4d8e-bd77-0c5a24d28991 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:35.832808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21dc46b0-de23-4d8e-bd77-0c5a24d28991 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:35.833264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21dc46b0-de23-4d8e-bd77-0c5a24d28991 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:35.833734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21dc46b0-de23-4d8e-bd77-0c5a24d28991 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:35.861836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-21dc46b0-de23-4d8e-bd77-0c5a24d28991 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043187 Aug 18 22:06:35.862383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1054/2100] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:35 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:36.873908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a88a27ee-db3c-4fa0-877d-5018312e9207 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:36.876070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a88a27ee-db3c-4fa0-877d-5018312e9207 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:36.882503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a88a27ee-db3c-4fa0-877d-5018312e9207 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:36.882991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a88a27ee-db3c-4fa0-877d-5018312e9207 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:36.883432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a88a27ee-db3c-4fa0-877d-5018312e9207 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:36.884123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a88a27ee-db3c-4fa0-877d-5018312e9207 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:36.884579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a88a27ee-db3c-4fa0-877d-5018312e9207 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:36.885005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a88a27ee-db3c-4fa0-877d-5018312e9207 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:36.914760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a88a27ee-db3c-4fa0-877d-5018312e9207 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044812 Aug 18 22:06:36.915323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1047/2101] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:37.027389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:06:37.027571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:06:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:06:37.440317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:06:37.440470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:06:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:06:37.929173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bab62d82-d401-491d-baa5-67de2a16586d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:37.931331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bab62d82-d401-491d-baa5-67de2a16586d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:37.937862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bab62d82-d401-491d-baa5-67de2a16586d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:37.938388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bab62d82-d401-491d-baa5-67de2a16586d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:37.938780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bab62d82-d401-491d-baa5-67de2a16586d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:37.939474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bab62d82-d401-491d-baa5-67de2a16586d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:37.940041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bab62d82-d401-491d-baa5-67de2a16586d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:37.940474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bab62d82-d401-491d-baa5-67de2a16586d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:37.969168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bab62d82-d401-491d-baa5-67de2a16586d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Aug 18 22:06:37.969743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1055/2102] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:37 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:38.980932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c3c9f4cf-cf96-45cc-9b29-8fa4633ca4c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:38.983132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c3c9f4cf-cf96-45cc-9b29-8fa4633ca4c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:38.990154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3c9f4cf-cf96-45cc-9b29-8fa4633ca4c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:38.990647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3c9f4cf-cf96-45cc-9b29-8fa4633ca4c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:38.991088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3c9f4cf-cf96-45cc-9b29-8fa4633ca4c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:38.991813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3c9f4cf-cf96-45cc-9b29-8fa4633ca4c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:38.992272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3c9f4cf-cf96-45cc-9b29-8fa4633ca4c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:38.992706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3c9f4cf-cf96-45cc-9b29-8fa4633ca4c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:39.022001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c3c9f4cf-cf96-45cc-9b29-8fa4633ca4c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Aug 18 22:06:39.022556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1048/2103] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:38 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:40.034031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-21a37ba3-8392-4b06-952d-dd709fbec8a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:40.036187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-21a37ba3-8392-4b06-952d-dd709fbec8a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:40.042734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21a37ba3-8392-4b06-952d-dd709fbec8a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:40.043205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21a37ba3-8392-4b06-952d-dd709fbec8a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:40.043637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21a37ba3-8392-4b06-952d-dd709fbec8a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:40.044327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21a37ba3-8392-4b06-952d-dd709fbec8a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:40.044767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21a37ba3-8392-4b06-952d-dd709fbec8a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:40.045187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21a37ba3-8392-4b06-952d-dd709fbec8a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:40.047530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=90 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:40.075230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-21a37ba3-8392-4b06-952d-dd709fbec8a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045080 Aug 18 22:06:40.075783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1056/2104] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:40 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:41.088031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bdcbde08-002d-42ee-89a6-eba1381f3132 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:41.090628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bdcbde08-002d-42ee-89a6-eba1381f3132 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:41.097077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bdcbde08-002d-42ee-89a6-eba1381f3132 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:41.097576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bdcbde08-002d-42ee-89a6-eba1381f3132 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:41.098050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bdcbde08-002d-42ee-89a6-eba1381f3132 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:41.099409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bdcbde08-002d-42ee-89a6-eba1381f3132 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:41.099861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bdcbde08-002d-42ee-89a6-eba1381f3132 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:41.100292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bdcbde08-002d-42ee-89a6-eba1381f3132 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:41.128759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bdcbde08-002d-42ee-89a6-eba1381f3132 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Aug 18 22:06:41.129318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1049/2105] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:41 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:42.140440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d491d8fc-a90e-4486-8c75-10349dbebcad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:42.142634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d491d8fc-a90e-4486-8c75-10349dbebcad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:42.149024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d491d8fc-a90e-4486-8c75-10349dbebcad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:42.149506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d491d8fc-a90e-4486-8c75-10349dbebcad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:42.149984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d491d8fc-a90e-4486-8c75-10349dbebcad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:42.150675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d491d8fc-a90e-4486-8c75-10349dbebcad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:42.151135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d491d8fc-a90e-4486-8c75-10349dbebcad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:42.151568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d491d8fc-a90e-4486-8c75-10349dbebcad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:42.181912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d491d8fc-a90e-4486-8c75-10349dbebcad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045422 Aug 18 22:06:42.182475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1057/2106] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:42.687071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:06:42.687265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:06:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:06:43.194163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7705e90a-0358-4148-8e84-b2c09c62a696 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:43.196293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7705e90a-0358-4148-8e84-b2c09c62a696 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:43.202702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7705e90a-0358-4148-8e84-b2c09c62a696 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:43.203185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7705e90a-0358-4148-8e84-b2c09c62a696 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:43.203625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7705e90a-0358-4148-8e84-b2c09c62a696 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:43.204315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7705e90a-0358-4148-8e84-b2c09c62a696 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:43.204772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7705e90a-0358-4148-8e84-b2c09c62a696 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:43.205201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7705e90a-0358-4148-8e84-b2c09c62a696 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:43.234719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7705e90a-0358-4148-8e84-b2c09c62a696 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045039 Aug 18 22:06:43.235297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1050/2107] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:43 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:44.246847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7e217f92-0cc9-4d48-88f5-cfe44cecd80c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:44.248983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7e217f92-0cc9-4d48-88f5-cfe44cecd80c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:44.256055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e217f92-0cc9-4d48-88f5-cfe44cecd80c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:44.256525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e217f92-0cc9-4d48-88f5-cfe44cecd80c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:44.256959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e217f92-0cc9-4d48-88f5-cfe44cecd80c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:44.257674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e217f92-0cc9-4d48-88f5-cfe44cecd80c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:44.258130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e217f92-0cc9-4d48-88f5-cfe44cecd80c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:44.258553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e217f92-0cc9-4d48-88f5-cfe44cecd80c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:44.287033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7e217f92-0cc9-4d48-88f5-cfe44cecd80c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044101 Aug 18 22:06:44.287579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1058/2108] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:44 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:45.298088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-759c89bc-aea2-497c-93d8-412e0ff70589 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:45.300491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-759c89bc-aea2-497c-93d8-412e0ff70589 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:45.302893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:45.308191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-759c89bc-aea2-497c-93d8-412e0ff70589 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:45.308673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-759c89bc-aea2-497c-93d8-412e0ff70589 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:45.309113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-759c89bc-aea2-497c-93d8-412e0ff70589 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:45.309827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-759c89bc-aea2-497c-93d8-412e0ff70589 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:45.310285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-759c89bc-aea2-497c-93d8-412e0ff70589 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:45.310712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-759c89bc-aea2-497c-93d8-412e0ff70589 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:45.340399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-759c89bc-aea2-497c-93d8-412e0ff70589 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046154 Aug 18 22:06:45.340945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1051/2109] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:46.352609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0d9c0b0e-134b-46a1-86f9-964b715537c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:46.354787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0d9c0b0e-134b-46a1-86f9-964b715537c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:46.360874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d9c0b0e-134b-46a1-86f9-964b715537c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:46.361350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d9c0b0e-134b-46a1-86f9-964b715537c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:46.361821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d9c0b0e-134b-46a1-86f9-964b715537c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:46.362504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d9c0b0e-134b-46a1-86f9-964b715537c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:46.362955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d9c0b0e-134b-46a1-86f9-964b715537c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:46.363378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d9c0b0e-134b-46a1-86f9-964b715537c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:46.391212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0d9c0b0e-134b-46a1-86f9-964b715537c3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043113 Aug 18 22:06:46.391764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1059/2110] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:46 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:47.403879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-283c21a6-ac5a-461e-98b7-60274305046a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:47.406023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-283c21a6-ac5a-461e-98b7-60274305046a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:47.412868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-283c21a6-ac5a-461e-98b7-60274305046a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:47.413348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-283c21a6-ac5a-461e-98b7-60274305046a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:47.413814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-283c21a6-ac5a-461e-98b7-60274305046a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:47.414506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-283c21a6-ac5a-461e-98b7-60274305046a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:47.414964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-283c21a6-ac5a-461e-98b7-60274305046a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:47.415389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-283c21a6-ac5a-461e-98b7-60274305046a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:47.444386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-283c21a6-ac5a-461e-98b7-60274305046a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044483 Aug 18 22:06:47.444925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1052/2111] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:47 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:48.456695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-871f75dd-00fa-47b1-8c02-b6afd420af21 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:48.459616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-871f75dd-00fa-47b1-8c02-b6afd420af21 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:48.461922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=30 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:48.467442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871f75dd-00fa-47b1-8c02-b6afd420af21 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:48.467923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871f75dd-00fa-47b1-8c02-b6afd420af21 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:48.468360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871f75dd-00fa-47b1-8c02-b6afd420af21 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:48.469056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871f75dd-00fa-47b1-8c02-b6afd420af21 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:48.469512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871f75dd-00fa-47b1-8c02-b6afd420af21 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:48.469958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-871f75dd-00fa-47b1-8c02-b6afd420af21 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:48.498799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-871f75dd-00fa-47b1-8c02-b6afd420af21 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046016 Aug 18 22:06:48.499367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1060/2112] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:48 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:49.510517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2eb48e51-a844-4b0a-9360-79eaee0d8bcb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:49.512619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2eb48e51-a844-4b0a-9360-79eaee0d8bcb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:49.519147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2eb48e51-a844-4b0a-9360-79eaee0d8bcb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:49.519625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2eb48e51-a844-4b0a-9360-79eaee0d8bcb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:49.520058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2eb48e51-a844-4b0a-9360-79eaee0d8bcb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:49.521235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2eb48e51-a844-4b0a-9360-79eaee0d8bcb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:49.521717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2eb48e51-a844-4b0a-9360-79eaee0d8bcb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:49.522141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2eb48e51-a844-4b0a-9360-79eaee0d8bcb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:49.551093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2eb48e51-a844-4b0a-9360-79eaee0d8bcb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Aug 18 22:06:49.551639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1053/2113] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:49 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:50.563297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c2de9257-a52c-402b-9ef6-f288d0949272 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:50.565473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c2de9257-a52c-402b-9ef6-f288d0949272 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:50.572314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2de9257-a52c-402b-9ef6-f288d0949272 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:50.572788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2de9257-a52c-402b-9ef6-f288d0949272 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:50.573615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2de9257-a52c-402b-9ef6-f288d0949272 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:50.573936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2de9257-a52c-402b-9ef6-f288d0949272 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:50.574386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2de9257-a52c-402b-9ef6-f288d0949272 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:50.574807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c2de9257-a52c-402b-9ef6-f288d0949272 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:50.606089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c2de9257-a52c-402b-9ef6-f288d0949272 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046611 Aug 18 22:06:50.606653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1061/2114] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:50 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:51.618230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3d4cd4f5-4653-4186-a1f5-a058be7ffbaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:51.620348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3d4cd4f5-4653-4186-a1f5-a058be7ffbaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:51.626677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d4cd4f5-4653-4186-a1f5-a058be7ffbaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:51.627154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d4cd4f5-4653-4186-a1f5-a058be7ffbaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:51.627588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d4cd4f5-4653-4186-a1f5-a058be7ffbaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:51.628268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d4cd4f5-4653-4186-a1f5-a058be7ffbaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:51.628718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d4cd4f5-4653-4186-a1f5-a058be7ffbaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:51.629138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d4cd4f5-4653-4186-a1f5-a058be7ffbaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:51.658218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3d4cd4f5-4653-4186-a1f5-a058be7ffbaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044034 Aug 18 22:06:51.658773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1054/2115] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:51 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:52.670922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0fc18a88-d87b-408c-a8bb-a27897d4ef2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:52.673163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0fc18a88-d87b-408c-a8bb-a27897d4ef2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:52.680434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fc18a88-d87b-408c-a8bb-a27897d4ef2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:52.680919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fc18a88-d87b-408c-a8bb-a27897d4ef2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:52.681365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fc18a88-d87b-408c-a8bb-a27897d4ef2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:52.682087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fc18a88-d87b-408c-a8bb-a27897d4ef2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:52.682547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fc18a88-d87b-408c-a8bb-a27897d4ef2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:52.682978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fc18a88-d87b-408c-a8bb-a27897d4ef2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:52.711925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0fc18a88-d87b-408c-a8bb-a27897d4ef2c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044840 Aug 18 22:06:52.712482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1062/2116] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:52 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:53.723498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-835f5710-8015-4805-95e5-c50ef685e660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:53.725711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-835f5710-8015-4805-95e5-c50ef685e660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:53.732284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-835f5710-8015-4805-95e5-c50ef685e660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:53.732766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-835f5710-8015-4805-95e5-c50ef685e660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:53.733215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-835f5710-8015-4805-95e5-c50ef685e660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:53.733945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-835f5710-8015-4805-95e5-c50ef685e660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:53.734409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-835f5710-8015-4805-95e5-c50ef685e660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:53.734837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-835f5710-8015-4805-95e5-c50ef685e660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:53.765739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-835f5710-8015-4805-95e5-c50ef685e660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046215 Aug 18 22:06:53.766310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1055/2117] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:53 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:54.777561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-070c3673-9637-485d-91e8-a97e3274f57b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:54.779769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-070c3673-9637-485d-91e8-a97e3274f57b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:54.786703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-070c3673-9637-485d-91e8-a97e3274f57b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:54.787177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-070c3673-9637-485d-91e8-a97e3274f57b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:54.787606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-070c3673-9637-485d-91e8-a97e3274f57b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:54.788283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-070c3673-9637-485d-91e8-a97e3274f57b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:54.788731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-070c3673-9637-485d-91e8-a97e3274f57b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:54.789151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-070c3673-9637-485d-91e8-a97e3274f57b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:54.817920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-070c3673-9637-485d-91e8-a97e3274f57b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044239 Aug 18 22:06:54.818469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1063/2118] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:54 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:55.828905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6f7d8aa6-4081-4f10-b464-290bcc2962b1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:55.831128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6f7d8aa6-4081-4f10-b464-290bcc2962b1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:55.837531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f7d8aa6-4081-4f10-b464-290bcc2962b1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:55.838051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f7d8aa6-4081-4f10-b464-290bcc2962b1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:55.838492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f7d8aa6-4081-4f10-b464-290bcc2962b1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:55.839181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f7d8aa6-4081-4f10-b464-290bcc2962b1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:55.839641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f7d8aa6-4081-4f10-b464-290bcc2962b1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:55.840071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f7d8aa6-4081-4f10-b464-290bcc2962b1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:55.871341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6f7d8aa6-4081-4f10-b464-290bcc2962b1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046274 Aug 18 22:06:55.871900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1056/2119] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:55 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:56.884017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-85047817-36c2-48e1-86c9-4b76fd13cc4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:56.886189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-85047817-36c2-48e1-86c9-4b76fd13cc4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:56.892497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-85047817-36c2-48e1-86c9-4b76fd13cc4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:56.892969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-85047817-36c2-48e1-86c9-4b76fd13cc4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:56.893400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-85047817-36c2-48e1-86c9-4b76fd13cc4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:56.894108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-85047817-36c2-48e1-86c9-4b76fd13cc4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:56.894558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-85047817-36c2-48e1-86c9-4b76fd13cc4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:56.894976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-85047817-36c2-48e1-86c9-4b76fd13cc4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:56.922970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-85047817-36c2-48e1-86c9-4b76fd13cc4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 Aug 18 22:06:56.923518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1064/2120] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:56 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:57.935780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0a2144b9-d6c4-4618-a9e3-51aa4de81894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:57.937939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0a2144b9-d6c4-4618-a9e3-51aa4de81894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:57.944294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a2144b9-d6c4-4618-a9e3-51aa4de81894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:57.944776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a2144b9-d6c4-4618-a9e3-51aa4de81894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:57.945214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a2144b9-d6c4-4618-a9e3-51aa4de81894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:57.945925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a2144b9-d6c4-4618-a9e3-51aa4de81894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:57.946387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a2144b9-d6c4-4618-a9e3-51aa4de81894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:57.946830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a2144b9-d6c4-4618-a9e3-51aa4de81894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:57.950377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=90 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:06:57.976058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0a2144b9-d6c4-4618-a9e3-51aa4de81894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044259 Aug 18 22:06:57.976613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1057/2121] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:57 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:06:58.987904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3b0690d6-85fa-40b9-9727-0e41bbb807fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:06:58.990073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3b0690d6-85fa-40b9-9727-0e41bbb807fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:06:58.996403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b0690d6-85fa-40b9-9727-0e41bbb807fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:58.996890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b0690d6-85fa-40b9-9727-0e41bbb807fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:58.997327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b0690d6-85fa-40b9-9727-0e41bbb807fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:58.998061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b0690d6-85fa-40b9-9727-0e41bbb807fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:06:58.998527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b0690d6-85fa-40b9-9727-0e41bbb807fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:06:58.998958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b0690d6-85fa-40b9-9727-0e41bbb807fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:06:59.028733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3b0690d6-85fa-40b9-9727-0e41bbb807fb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044674 Aug 18 22:06:59.029804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1065/2122] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:06:58 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:00.042585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a6cb840b-f70f-4aac-9601-8334dcb8ea2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:00.044756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a6cb840b-f70f-4aac-9601-8334dcb8ea2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:00.051840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6cb840b-f70f-4aac-9601-8334dcb8ea2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:00.052420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6cb840b-f70f-4aac-9601-8334dcb8ea2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:00.052872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6cb840b-f70f-4aac-9601-8334dcb8ea2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:00.053796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6cb840b-f70f-4aac-9601-8334dcb8ea2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:00.054266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6cb840b-f70f-4aac-9601-8334dcb8ea2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:00.054707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6cb840b-f70f-4aac-9601-8334dcb8ea2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:00.084146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a6cb840b-f70f-4aac-9601-8334dcb8ea2d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Aug 18 22:07:00.084700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1058/2123] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:00 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:01.096303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c7e459e6-6671-4039-bbd3-07f63fe6b6ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:01.098501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c7e459e6-6671-4039-bbd3-07f63fe6b6ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:01.104858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7e459e6-6671-4039-bbd3-07f63fe6b6ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:01.105341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7e459e6-6671-4039-bbd3-07f63fe6b6ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:01.105833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7e459e6-6671-4039-bbd3-07f63fe6b6ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:01.106543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7e459e6-6671-4039-bbd3-07f63fe6b6ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:01.107004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7e459e6-6671-4039-bbd3-07f63fe6b6ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:01.107436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7e459e6-6671-4039-bbd3-07f63fe6b6ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:01.136067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c7e459e6-6671-4039-bbd3-07f63fe6b6ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043670 Aug 18 22:07:01.136637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1066/2124] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:01 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:02.148789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2616627c-1a69-4503-8e96-531d750b1cf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:02.151063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2616627c-1a69-4503-8e96-531d750b1cf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:02.157447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2616627c-1a69-4503-8e96-531d750b1cf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:02.157963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2616627c-1a69-4503-8e96-531d750b1cf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:02.158404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2616627c-1a69-4503-8e96-531d750b1cf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:02.159101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2616627c-1a69-4503-8e96-531d750b1cf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:02.159563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2616627c-1a69-4503-8e96-531d750b1cf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:02.159993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2616627c-1a69-4503-8e96-531d750b1cf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:02.189386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2616627c-1a69-4503-8e96-531d750b1cf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045196 Aug 18 22:07:02.189976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1059/2125] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:03.201657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e5a5748a-7e8c-4e47-ab55-79902ff6146e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:03.203865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e5a5748a-7e8c-4e47-ab55-79902ff6146e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:03.210382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5a5748a-7e8c-4e47-ab55-79902ff6146e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:03.210861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5a5748a-7e8c-4e47-ab55-79902ff6146e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:03.211299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5a5748a-7e8c-4e47-ab55-79902ff6146e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:03.211980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5a5748a-7e8c-4e47-ab55-79902ff6146e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:03.212435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5a5748a-7e8c-4e47-ab55-79902ff6146e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:03.212859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5a5748a-7e8c-4e47-ab55-79902ff6146e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:03.242186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e5a5748a-7e8c-4e47-ab55-79902ff6146e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044444 Aug 18 22:07:03.242739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1067/2126] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:04.254280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-45a2c244-2abe-48d3-b891-18f08a753687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:04.256397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-45a2c244-2abe-48d3-b891-18f08a753687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:04.262781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45a2c244-2abe-48d3-b891-18f08a753687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:04.263256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45a2c244-2abe-48d3-b891-18f08a753687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:04.263689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45a2c244-2abe-48d3-b891-18f08a753687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:04.264369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45a2c244-2abe-48d3-b891-18f08a753687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:04.264818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45a2c244-2abe-48d3-b891-18f08a753687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:04.265239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45a2c244-2abe-48d3-b891-18f08a753687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:04.294289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-45a2c244-2abe-48d3-b891-18f08a753687 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044297 Aug 18 22:07:04.294834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1060/2127] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:05.307211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-35cf0356-d49d-4225-8050-3d83cbe66e42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:05.309479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-35cf0356-d49d-4225-8050-3d83cbe66e42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:05.315824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35cf0356-d49d-4225-8050-3d83cbe66e42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:05.316305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35cf0356-d49d-4225-8050-3d83cbe66e42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:05.316794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35cf0356-d49d-4225-8050-3d83cbe66e42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:05.318037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35cf0356-d49d-4225-8050-3d83cbe66e42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:05.318494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35cf0356-d49d-4225-8050-3d83cbe66e42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:05.318917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35cf0356-d49d-4225-8050-3d83cbe66e42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:05.348221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-35cf0356-d49d-4225-8050-3d83cbe66e42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044974 Aug 18 22:07:05.348766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1068/2128] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:07:06.360509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4ccd0447-8784-40f1-bc42-dcfa4b28d222 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:06.362793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4ccd0447-8784-40f1-bc42-dcfa4b28d222 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:06.369159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccd0447-8784-40f1-bc42-dcfa4b28d222 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:06.369671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccd0447-8784-40f1-bc42-dcfa4b28d222 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:06.370106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccd0447-8784-40f1-bc42-dcfa4b28d222 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:06.370794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccd0447-8784-40f1-bc42-dcfa4b28d222 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:06.371245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccd0447-8784-40f1-bc42-dcfa4b28d222 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:06.371665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccd0447-8784-40f1-bc42-dcfa4b28d222 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:06.401021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4ccd0447-8784-40f1-bc42-dcfa4b28d222 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 Aug 18 22:07:06.401561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1061/2129] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:07.413008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-33ac60e1-9141-43bf-97f2-68250380c14b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:07.415328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-33ac60e1-9141-43bf-97f2-68250380c14b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:07.421671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33ac60e1-9141-43bf-97f2-68250380c14b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:07.422231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33ac60e1-9141-43bf-97f2-68250380c14b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:07.422737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33ac60e1-9141-43bf-97f2-68250380c14b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:07.423444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33ac60e1-9141-43bf-97f2-68250380c14b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:07.423906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33ac60e1-9141-43bf-97f2-68250380c14b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:07.424360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33ac60e1-9141-43bf-97f2-68250380c14b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:07.453052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-33ac60e1-9141-43bf-97f2-68250380c14b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044492 Aug 18 22:07:07.453620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1069/2130] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:07 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:08.465841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8be6c0b1-4858-4fe9-9ff1-707effd8834e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:08.468164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8be6c0b1-4858-4fe9-9ff1-707effd8834e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:08.474657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8be6c0b1-4858-4fe9-9ff1-707effd8834e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:08.475141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8be6c0b1-4858-4fe9-9ff1-707effd8834e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:08.475579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8be6c0b1-4858-4fe9-9ff1-707effd8834e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:08.476277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8be6c0b1-4858-4fe9-9ff1-707effd8834e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:08.476840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8be6c0b1-4858-4fe9-9ff1-707effd8834e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:08.477174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8be6c0b1-4858-4fe9-9ff1-707effd8834e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:08.506960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8be6c0b1-4858-4fe9-9ff1-707effd8834e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045051 Aug 18 22:07:08.507516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1062/2131] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:09.519171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1152e3a6-de10-4355-a8e7-a4bd50138c9b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:09.521928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1152e3a6-de10-4355-a8e7-a4bd50138c9b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:09.528339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1152e3a6-de10-4355-a8e7-a4bd50138c9b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:09.528826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1152e3a6-de10-4355-a8e7-a4bd50138c9b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:09.529265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1152e3a6-de10-4355-a8e7-a4bd50138c9b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:09.529988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1152e3a6-de10-4355-a8e7-a4bd50138c9b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:09.530451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1152e3a6-de10-4355-a8e7-a4bd50138c9b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:09.530886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1152e3a6-de10-4355-a8e7-a4bd50138c9b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:09.560655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1152e3a6-de10-4355-a8e7-a4bd50138c9b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045311 Aug 18 22:07:09.561208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1070/2132] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:10.572314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b72e4135-1a90-4911-b062-9a5ebb959fdb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:10.574492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b72e4135-1a90-4911-b062-9a5ebb959fdb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:10.581093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b72e4135-1a90-4911-b062-9a5ebb959fdb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:10.581518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b72e4135-1a90-4911-b062-9a5ebb959fdb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:10.581992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b72e4135-1a90-4911-b062-9a5ebb959fdb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:10.583190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b72e4135-1a90-4911-b062-9a5ebb959fdb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:10.583658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b72e4135-1a90-4911-b062-9a5ebb959fdb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:10.584091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b72e4135-1a90-4911-b062-9a5ebb959fdb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:10.614165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b72e4135-1a90-4911-b062-9a5ebb959fdb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045396 Aug 18 22:07:10.614536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1063/2133] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:10 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:11.626075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dbbdd7b6-b11d-4dea-94d4-2411eb7f4995 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:11.628224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dbbdd7b6-b11d-4dea-94d4-2411eb7f4995 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:11.634526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbbdd7b6-b11d-4dea-94d4-2411eb7f4995 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:11.635015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbbdd7b6-b11d-4dea-94d4-2411eb7f4995 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:11.635456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbbdd7b6-b11d-4dea-94d4-2411eb7f4995 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:11.636157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbbdd7b6-b11d-4dea-94d4-2411eb7f4995 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:11.636614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbbdd7b6-b11d-4dea-94d4-2411eb7f4995 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:11.637049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbbdd7b6-b11d-4dea-94d4-2411eb7f4995 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:11.640682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=90 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:11.666909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dbbdd7b6-b11d-4dea-94d4-2411eb7f4995 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044741 Aug 18 22:07:11.667455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1071/2134] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:12.678666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-506d497b-b860-4e85-8c9f-6591afddd99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:12.680805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-506d497b-b860-4e85-8c9f-6591afddd99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:12.687361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-506d497b-b860-4e85-8c9f-6591afddd99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:12.687852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-506d497b-b860-4e85-8c9f-6591afddd99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:12.688300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-506d497b-b860-4e85-8c9f-6591afddd99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:12.689006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-506d497b-b860-4e85-8c9f-6591afddd99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:12.689468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-506d497b-b860-4e85-8c9f-6591afddd99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:12.689924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-506d497b-b860-4e85-8c9f-6591afddd99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:12.720813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-506d497b-b860-4e85-8c9f-6591afddd99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046733 Aug 18 22:07:12.721295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1064/2135] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:12 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:13.732242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-99fba931-a5db-4dc6-9a8d-2af73e3d436a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:13.734726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-99fba931-a5db-4dc6-9a8d-2af73e3d436a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:13.740928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99fba931-a5db-4dc6-9a8d-2af73e3d436a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:13.741404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99fba931-a5db-4dc6-9a8d-2af73e3d436a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:13.741877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99fba931-a5db-4dc6-9a8d-2af73e3d436a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:13.742563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99fba931-a5db-4dc6-9a8d-2af73e3d436a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:13.743014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99fba931-a5db-4dc6-9a8d-2af73e3d436a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:13.743435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99fba931-a5db-4dc6-9a8d-2af73e3d436a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:13.772849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-99fba931-a5db-4dc6-9a8d-2af73e3d436a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044495 Aug 18 22:07:13.773398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1072/2136] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:14.785049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-70e90312-e52b-4075-bb5f-9bd76df81667 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:14.787881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-70e90312-e52b-4075-bb5f-9bd76df81667 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:14.794484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70e90312-e52b-4075-bb5f-9bd76df81667 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:14.794971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70e90312-e52b-4075-bb5f-9bd76df81667 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:14.795416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70e90312-e52b-4075-bb5f-9bd76df81667 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:14.796123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70e90312-e52b-4075-bb5f-9bd76df81667 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:14.796584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70e90312-e52b-4075-bb5f-9bd76df81667 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:14.797016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70e90312-e52b-4075-bb5f-9bd76df81667 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:14.826403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-70e90312-e52b-4075-bb5f-9bd76df81667 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 Aug 18 22:07:14.826966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1065/2137] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:15.838489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d41eeb76-b853-43bb-ba66-39425feca2af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:15.840617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d41eeb76-b853-43bb-ba66-39425feca2af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:15.848203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d41eeb76-b853-43bb-ba66-39425feca2af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:15.848700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d41eeb76-b853-43bb-ba66-39425feca2af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:15.849141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d41eeb76-b853-43bb-ba66-39425feca2af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:15.849880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d41eeb76-b853-43bb-ba66-39425feca2af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:15.850371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d41eeb76-b853-43bb-ba66-39425feca2af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:15.850804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d41eeb76-b853-43bb-ba66-39425feca2af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:15.881241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d41eeb76-b853-43bb-ba66-39425feca2af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046756 Aug 18 22:07:15.881846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1073/2138] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:15 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:16.893777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0be7d60d-5a21-4015-9024-fd566fb16acf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:16.896607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0be7d60d-5a21-4015-9024-fd566fb16acf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:16.899284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:16.904725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0be7d60d-5a21-4015-9024-fd566fb16acf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:16.905211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0be7d60d-5a21-4015-9024-fd566fb16acf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:16.905683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0be7d60d-5a21-4015-9024-fd566fb16acf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:16.906388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0be7d60d-5a21-4015-9024-fd566fb16acf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:16.906849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0be7d60d-5a21-4015-9024-fd566fb16acf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:16.907280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0be7d60d-5a21-4015-9024-fd566fb16acf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:16.936850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0be7d60d-5a21-4015-9024-fd566fb16acf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047071 Aug 18 22:07:16.937452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1066/2139] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:17.949722 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-950116f7-6ccc-441a-b391-49471489e1f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:17.951802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-950116f7-6ccc-441a-b391-49471489e1f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:17.958899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-950116f7-6ccc-441a-b391-49471489e1f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:17.959381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-950116f7-6ccc-441a-b391-49471489e1f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:17.959820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-950116f7-6ccc-441a-b391-49471489e1f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:17.960522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-950116f7-6ccc-441a-b391-49471489e1f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:17.960978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-950116f7-6ccc-441a-b391-49471489e1f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:17.961410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-950116f7-6ccc-441a-b391-49471489e1f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:17.991491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-950116f7-6ccc-441a-b391-49471489e1f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045545 Aug 18 22:07:17.992100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1074/2140] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:17 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:19.003805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a7e9511b-0eb9-4b31-8e28-644a093d1e69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:19.005904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a7e9511b-0eb9-4b31-8e28-644a093d1e69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:19.012398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7e9511b-0eb9-4b31-8e28-644a093d1e69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:19.012878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7e9511b-0eb9-4b31-8e28-644a093d1e69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:19.013548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7e9511b-0eb9-4b31-8e28-644a093d1e69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:19.014023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7e9511b-0eb9-4b31-8e28-644a093d1e69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:19.014474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7e9511b-0eb9-4b31-8e28-644a093d1e69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:19.014896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7e9511b-0eb9-4b31-8e28-644a093d1e69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:19.045642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a7e9511b-0eb9-4b31-8e28-644a093d1e69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045795 Aug 18 22:07:19.046211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1067/2141] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:18 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:20.058473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7ca0649c-50ef-4010-bbb4-8b0f7ab98116 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:20.060643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7ca0649c-50ef-4010-bbb4-8b0f7ab98116 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:20.062931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=30 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:20.068899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ca0649c-50ef-4010-bbb4-8b0f7ab98116 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:20.069388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ca0649c-50ef-4010-bbb4-8b0f7ab98116 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:20.069860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ca0649c-50ef-4010-bbb4-8b0f7ab98116 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:20.070560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ca0649c-50ef-4010-bbb4-8b0f7ab98116 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:20.071017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ca0649c-50ef-4010-bbb4-8b0f7ab98116 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:20.071449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ca0649c-50ef-4010-bbb4-8b0f7ab98116 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:20.101423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7ca0649c-50ef-4010-bbb4-8b0f7ab98116 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046863 Aug 18 22:07:20.102005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1075/2142] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:20 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:21.113768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d456d455-de0a-492c-bd2a-cb2c1254c62b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:21.115971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d456d455-de0a-492c-bd2a-cb2c1254c62b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:21.122739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d456d455-de0a-492c-bd2a-cb2c1254c62b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:21.123230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d456d455-de0a-492c-bd2a-cb2c1254c62b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:21.123675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d456d455-de0a-492c-bd2a-cb2c1254c62b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:21.124379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d456d455-de0a-492c-bd2a-cb2c1254c62b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:21.124841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d456d455-de0a-492c-bd2a-cb2c1254c62b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:21.125275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d456d455-de0a-492c-bd2a-cb2c1254c62b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:21.156243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d456d455-de0a-492c-bd2a-cb2c1254c62b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046460 Aug 18 22:07:21.156816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1068/2143] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:22.169120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d37eac9d-4916-4823-a52c-754354cb1262 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:22.171251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d37eac9d-4916-4823-a52c-754354cb1262 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:22.178584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d37eac9d-4916-4823-a52c-754354cb1262 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:22.179066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d37eac9d-4916-4823-a52c-754354cb1262 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:22.179505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d37eac9d-4916-4823-a52c-754354cb1262 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:22.180193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d37eac9d-4916-4823-a52c-754354cb1262 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:22.180651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d37eac9d-4916-4823-a52c-754354cb1262 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:22.181078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d37eac9d-4916-4823-a52c-754354cb1262 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:22.211364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d37eac9d-4916-4823-a52c-754354cb1262 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Aug 18 22:07:22.211917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1076/2144] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:23.222726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ca0d425d-a792-47a1-a81c-04cbe0ee9c11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:23.224922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ca0d425d-a792-47a1-a81c-04cbe0ee9c11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:23.231427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca0d425d-a792-47a1-a81c-04cbe0ee9c11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:23.231910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca0d425d-a792-47a1-a81c-04cbe0ee9c11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:23.232349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca0d425d-a792-47a1-a81c-04cbe0ee9c11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:23.233043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca0d425d-a792-47a1-a81c-04cbe0ee9c11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:23.233516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca0d425d-a792-47a1-a81c-04cbe0ee9c11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:23.233949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca0d425d-a792-47a1-a81c-04cbe0ee9c11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:23.264074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ca0d425d-a792-47a1-a81c-04cbe0ee9c11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Aug 18 22:07:23.264641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1069/2145] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:23 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:24.276946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4cf8ff1d-bddb-498c-b1fc-e0578dab6769 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:24.279118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4cf8ff1d-bddb-498c-b1fc-e0578dab6769 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:24.285441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cf8ff1d-bddb-498c-b1fc-e0578dab6769 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:24.285952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cf8ff1d-bddb-498c-b1fc-e0578dab6769 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:24.286385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cf8ff1d-bddb-498c-b1fc-e0578dab6769 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:24.287064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cf8ff1d-bddb-498c-b1fc-e0578dab6769 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:24.287512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cf8ff1d-bddb-498c-b1fc-e0578dab6769 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:24.287932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4cf8ff1d-bddb-498c-b1fc-e0578dab6769 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:24.317488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4cf8ff1d-bddb-498c-b1fc-e0578dab6769 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043942 Aug 18 22:07:24.318100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1077/2146] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:07:25.329819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b7bf984a-6197-4827-ac33-b780a60d910c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:25.331988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b7bf984a-6197-4827-ac33-b780a60d910c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:25.338953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7bf984a-6197-4827-ac33-b780a60d910c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:25.339434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7bf984a-6197-4827-ac33-b780a60d910c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:25.339869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7bf984a-6197-4827-ac33-b780a60d910c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:25.340556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7bf984a-6197-4827-ac33-b780a60d910c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:25.341009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7bf984a-6197-4827-ac33-b780a60d910c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:25.341434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7bf984a-6197-4827-ac33-b780a60d910c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:25.370843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b7bf984a-6197-4827-ac33-b780a60d910c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045043 Aug 18 22:07:25.371402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1070/2147] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:26.383922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a06bbfb2-e166-45ff-8b87-7426695597dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:26.386039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a06bbfb2-e166-45ff-8b87-7426695597dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:26.392354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a06bbfb2-e166-45ff-8b87-7426695597dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:26.392826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a06bbfb2-e166-45ff-8b87-7426695597dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:26.393257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a06bbfb2-e166-45ff-8b87-7426695597dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:26.393978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a06bbfb2-e166-45ff-8b87-7426695597dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:26.394430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a06bbfb2-e166-45ff-8b87-7426695597dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:26.394875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a06bbfb2-e166-45ff-8b87-7426695597dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:26.424125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a06bbfb2-e166-45ff-8b87-7426695597dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044861 Aug 18 22:07:26.425164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1078/2148] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:26 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:27.437349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-982b7e88-27f5-4265-8c1f-a0a028f18753 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:27.439432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-982b7e88-27f5-4265-8c1f-a0a028f18753 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:27.446405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-982b7e88-27f5-4265-8c1f-a0a028f18753 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:27.446883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-982b7e88-27f5-4265-8c1f-a0a028f18753 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:27.447317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-982b7e88-27f5-4265-8c1f-a0a028f18753 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:27.448000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-982b7e88-27f5-4265-8c1f-a0a028f18753 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:27.448453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-982b7e88-27f5-4265-8c1f-a0a028f18753 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:27.448878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-982b7e88-27f5-4265-8c1f-a0a028f18753 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:27.480491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-982b7e88-27f5-4265-8c1f-a0a028f18753 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047057 Aug 18 22:07:27.481056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1071/2149] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:28.492677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cd2cd8e7-46b6-4f82-908b-ed24b21ab585 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:28.494741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cd2cd8e7-46b6-4f82-908b-ed24b21ab585 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:28.501262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd2cd8e7-46b6-4f82-908b-ed24b21ab585 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:28.501773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd2cd8e7-46b6-4f82-908b-ed24b21ab585 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:28.502213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd2cd8e7-46b6-4f82-908b-ed24b21ab585 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:28.502894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd2cd8e7-46b6-4f82-908b-ed24b21ab585 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:28.503342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd2cd8e7-46b6-4f82-908b-ed24b21ab585 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:28.503758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd2cd8e7-46b6-4f82-908b-ed24b21ab585 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:28.533894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cd2cd8e7-46b6-4f82-908b-ed24b21ab585 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045132 Aug 18 22:07:28.534473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1079/2150] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:29.547097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f93d2097-942e-4030-8fbe-25a6c14f1ce3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:29.549231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f93d2097-942e-4030-8fbe-25a6c14f1ce3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:29.556274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f93d2097-942e-4030-8fbe-25a6c14f1ce3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:29.556752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f93d2097-942e-4030-8fbe-25a6c14f1ce3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:29.557188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f93d2097-942e-4030-8fbe-25a6c14f1ce3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:29.557980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f93d2097-942e-4030-8fbe-25a6c14f1ce3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:29.558435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f93d2097-942e-4030-8fbe-25a6c14f1ce3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:29.558861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f93d2097-942e-4030-8fbe-25a6c14f1ce3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:29.561204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=90 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:29.589696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f93d2097-942e-4030-8fbe-25a6c14f1ce3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046558 Aug 18 22:07:29.590267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1072/2151] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:29 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:30.602002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d08af6fb-d9b5-46ae-87c2-44c0722789da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:30.604165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d08af6fb-d9b5-46ae-87c2-44c0722789da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:30.610540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d08af6fb-d9b5-46ae-87c2-44c0722789da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:30.611022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d08af6fb-d9b5-46ae-87c2-44c0722789da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:30.611462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d08af6fb-d9b5-46ae-87c2-44c0722789da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:30.612155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d08af6fb-d9b5-46ae-87c2-44c0722789da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:30.612611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d08af6fb-d9b5-46ae-87c2-44c0722789da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:30.613043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d08af6fb-d9b5-46ae-87c2-44c0722789da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:30.643516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d08af6fb-d9b5-46ae-87c2-44c0722789da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045515 Aug 18 22:07:30.644083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1080/2152] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:31.655819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7381608f-0ee2-4836-8d0c-27342536295c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:31.657945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7381608f-0ee2-4836-8d0c-27342536295c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:31.664308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7381608f-0ee2-4836-8d0c-27342536295c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:31.664794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7381608f-0ee2-4836-8d0c-27342536295c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:31.665239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7381608f-0ee2-4836-8d0c-27342536295c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:31.665992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7381608f-0ee2-4836-8d0c-27342536295c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:31.666454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7381608f-0ee2-4836-8d0c-27342536295c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:31.666885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7381608f-0ee2-4836-8d0c-27342536295c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:31.697085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7381608f-0ee2-4836-8d0c-27342536295c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044781 Aug 18 22:07:31.697208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1073/2153] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:32.708526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-923b13f4-95b1-4e2e-a300-a02395388fc4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:32.710626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-923b13f4-95b1-4e2e-a300-a02395388fc4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:32.717151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-923b13f4-95b1-4e2e-a300-a02395388fc4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:32.717656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-923b13f4-95b1-4e2e-a300-a02395388fc4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:32.718100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-923b13f4-95b1-4e2e-a300-a02395388fc4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:32.719141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-923b13f4-95b1-4e2e-a300-a02395388fc4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:32.719267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-923b13f4-95b1-4e2e-a300-a02395388fc4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:32.719660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-923b13f4-95b1-4e2e-a300-a02395388fc4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:32.749572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-923b13f4-95b1-4e2e-a300-a02395388fc4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045074 Aug 18 22:07:32.750154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1081/2154] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:33.761953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ffe2b286-23c3-43be-ba8d-6ee695ab2345 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:33.764408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ffe2b286-23c3-43be-ba8d-6ee695ab2345 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:33.770826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe2b286-23c3-43be-ba8d-6ee695ab2345 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:33.771315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe2b286-23c3-43be-ba8d-6ee695ab2345 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:33.771761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe2b286-23c3-43be-ba8d-6ee695ab2345 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:33.772452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe2b286-23c3-43be-ba8d-6ee695ab2345 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:33.772912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe2b286-23c3-43be-ba8d-6ee695ab2345 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:33.773342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe2b286-23c3-43be-ba8d-6ee695ab2345 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:33.802531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ffe2b286-23c3-43be-ba8d-6ee695ab2345 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Aug 18 22:07:33.803081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1074/2155] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:34.814778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-371240c1-2bb0-4790-b3b9-bf5743221b74 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:34.817028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-371240c1-2bb0-4790-b3b9-bf5743221b74 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:34.823398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-371240c1-2bb0-4790-b3b9-bf5743221b74 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:34.823881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-371240c1-2bb0-4790-b3b9-bf5743221b74 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:34.824318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-371240c1-2bb0-4790-b3b9-bf5743221b74 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:34.825010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-371240c1-2bb0-4790-b3b9-bf5743221b74 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:34.825497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-371240c1-2bb0-4790-b3b9-bf5743221b74 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:34.825952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-371240c1-2bb0-4790-b3b9-bf5743221b74 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:34.855754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-371240c1-2bb0-4790-b3b9-bf5743221b74 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044830 Aug 18 22:07:34.856338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1082/2156] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:35.868423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-158e99c7-0945-4065-bdb0-f1108b8ad66b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:35.870550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-158e99c7-0945-4065-bdb0-f1108b8ad66b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:35.876892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-158e99c7-0945-4065-bdb0-f1108b8ad66b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:35.877411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-158e99c7-0945-4065-bdb0-f1108b8ad66b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:35.877879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-158e99c7-0945-4065-bdb0-f1108b8ad66b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:35.878570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-158e99c7-0945-4065-bdb0-f1108b8ad66b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:35.879028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-158e99c7-0945-4065-bdb0-f1108b8ad66b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:35.879458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-158e99c7-0945-4065-bdb0-f1108b8ad66b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:35.908263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-158e99c7-0945-4065-bdb0-f1108b8ad66b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Aug 18 22:07:35.908807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1075/2157] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:35 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:36.920539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-169e57fb-aa18-4b3b-9b77-8aa7ce6dd558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:36.922616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-169e57fb-aa18-4b3b-9b77-8aa7ce6dd558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:36.929404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169e57fb-aa18-4b3b-9b77-8aa7ce6dd558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:36.929909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169e57fb-aa18-4b3b-9b77-8aa7ce6dd558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:36.930343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169e57fb-aa18-4b3b-9b77-8aa7ce6dd558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:36.931024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169e57fb-aa18-4b3b-9b77-8aa7ce6dd558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:36.931472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169e57fb-aa18-4b3b-9b77-8aa7ce6dd558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:36.931893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-169e57fb-aa18-4b3b-9b77-8aa7ce6dd558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:36.961250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-169e57fb-aa18-4b3b-9b77-8aa7ce6dd558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044752 Aug 18 22:07:36.961853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1083/2158] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:37.973667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9a795334-0bdd-4826-b97b-8236c0c3cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:37.976332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9a795334-0bdd-4826-b97b-8236c0c3cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:37.982818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a795334-0bdd-4826-b97b-8236c0c3cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:37.983295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a795334-0bdd-4826-b97b-8236c0c3cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:37.983723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a795334-0bdd-4826-b97b-8236c0c3cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:37.984442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a795334-0bdd-4826-b97b-8236c0c3cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:37.984892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a795334-0bdd-4826-b97b-8236c0c3cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:37.985314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a795334-0bdd-4826-b97b-8236c0c3cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:38.013445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9a795334-0bdd-4826-b97b-8236c0c3cd05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043840 Aug 18 22:07:38.014002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1076/2159] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:37 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:39.025544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1666c16c-569c-4947-b940-b43befff9b7d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:39.027820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1666c16c-569c-4947-b940-b43befff9b7d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:39.034345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1666c16c-569c-4947-b940-b43befff9b7d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:39.034822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1666c16c-569c-4947-b940-b43befff9b7d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:39.035254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1666c16c-569c-4947-b940-b43befff9b7d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:39.035932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1666c16c-569c-4947-b940-b43befff9b7d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:39.036378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1666c16c-569c-4947-b940-b43befff9b7d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:39.036826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1666c16c-569c-4947-b940-b43befff9b7d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:39.065520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1666c16c-569c-4947-b940-b43befff9b7d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043905 Aug 18 22:07:39.066098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1084/2160] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:39 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:40.078471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8d4d8ef9-f696-4753-a6c5-16bdb35cc1fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:40.080633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8d4d8ef9-f696-4753-a6c5-16bdb35cc1fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:40.087631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d4d8ef9-f696-4753-a6c5-16bdb35cc1fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:40.088110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d4d8ef9-f696-4753-a6c5-16bdb35cc1fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:40.088544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d4d8ef9-f696-4753-a6c5-16bdb35cc1fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:40.089224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d4d8ef9-f696-4753-a6c5-16bdb35cc1fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:40.089703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d4d8ef9-f696-4753-a6c5-16bdb35cc1fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:40.090125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d4d8ef9-f696-4753-a6c5-16bdb35cc1fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:40.118497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8d4d8ef9-f696-4753-a6c5-16bdb35cc1fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Aug 18 22:07:40.119062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1077/2161] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:40 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:41.130717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-586e25d0-0d4b-4611-9c33-76d672a1061c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:41.132759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-586e25d0-0d4b-4611-9c33-76d672a1061c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:41.139087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-586e25d0-0d4b-4611-9c33-76d672a1061c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:41.139562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-586e25d0-0d4b-4611-9c33-76d672a1061c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:41.139992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-586e25d0-0d4b-4611-9c33-76d672a1061c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:41.140667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-586e25d0-0d4b-4611-9c33-76d672a1061c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:41.141115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-586e25d0-0d4b-4611-9c33-76d672a1061c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:41.141534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-586e25d0-0d4b-4611-9c33-76d672a1061c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:41.170716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-586e25d0-0d4b-4611-9c33-76d672a1061c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Aug 18 22:07:41.171260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1085/2162] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:41 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:42.183778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ec47240c-6753-4f7b-b053-3b9ec47d55c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:42.185878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ec47240c-6753-4f7b-b053-3b9ec47d55c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:42.192215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec47240c-6753-4f7b-b053-3b9ec47d55c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:42.192700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec47240c-6753-4f7b-b053-3b9ec47d55c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:42.193141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec47240c-6753-4f7b-b053-3b9ec47d55c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:42.193866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec47240c-6753-4f7b-b053-3b9ec47d55c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:42.194331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec47240c-6753-4f7b-b053-3b9ec47d55c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:42.194760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec47240c-6753-4f7b-b053-3b9ec47d55c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:42.222940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ec47240c-6753-4f7b-b053-3b9ec47d55c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043175 Aug 18 22:07:42.223495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1078/2163] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:43.235852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ee5da58e-3415-4133-add2-4679dddf5c93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:43.237972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ee5da58e-3415-4133-add2-4679dddf5c93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:43.244894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee5da58e-3415-4133-add2-4679dddf5c93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:43.245375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee5da58e-3415-4133-add2-4679dddf5c93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:43.245849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee5da58e-3415-4133-add2-4679dddf5c93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:43.246539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee5da58e-3415-4133-add2-4679dddf5c93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:43.246992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee5da58e-3415-4133-add2-4679dddf5c93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:43.247417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ee5da58e-3415-4133-add2-4679dddf5c93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:43.250938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=90 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:43.277418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ee5da58e-3415-4133-add2-4679dddf5c93 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045751 Aug 18 22:07:43.277998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1086/2164] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:43 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:44.289947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-201bd6d5-0991-4c0c-900e-6648da00b315 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:44.292096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-201bd6d5-0991-4c0c-900e-6648da00b315 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:44.298473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-201bd6d5-0991-4c0c-900e-6648da00b315 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:44.298948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-201bd6d5-0991-4c0c-900e-6648da00b315 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:44.299378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-201bd6d5-0991-4c0c-900e-6648da00b315 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:44.300312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-201bd6d5-0991-4c0c-900e-6648da00b315 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:44.300757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-201bd6d5-0991-4c0c-900e-6648da00b315 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:44.301176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-201bd6d5-0991-4c0c-900e-6648da00b315 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:44.330614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-201bd6d5-0991-4c0c-900e-6648da00b315 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 Aug 18 22:07:44.331179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1079/2165] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:44 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:45.343740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7fceae0d-15b4-4f73-8a0d-931274ff9b97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:45.345826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7fceae0d-15b4-4f73-8a0d-931274ff9b97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:45.352201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fceae0d-15b4-4f73-8a0d-931274ff9b97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:45.352691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fceae0d-15b4-4f73-8a0d-931274ff9b97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:45.353133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fceae0d-15b4-4f73-8a0d-931274ff9b97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:45.353844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fceae0d-15b4-4f73-8a0d-931274ff9b97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:45.354297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fceae0d-15b4-4f73-8a0d-931274ff9b97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:45.354721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fceae0d-15b4-4f73-8a0d-931274ff9b97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:45.390587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7fceae0d-15b4-4f73-8a0d-931274ff9b97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050969 Aug 18 22:07:45.391146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1087/2166] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:46.402846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7a7323ba-da1f-427a-8613-270afa864210 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:46.404928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7a7323ba-da1f-427a-8613-270afa864210 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:46.411309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a7323ba-da1f-427a-8613-270afa864210 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:46.411799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a7323ba-da1f-427a-8613-270afa864210 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:46.412247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a7323ba-da1f-427a-8613-270afa864210 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:46.412943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a7323ba-da1f-427a-8613-270afa864210 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:46.413407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a7323ba-da1f-427a-8613-270afa864210 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:46.413876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a7323ba-da1f-427a-8613-270afa864210 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:46.443194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7a7323ba-da1f-427a-8613-270afa864210 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Aug 18 22:07:46.443743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1080/2167] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:46 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:47.456187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-48c733fb-4c80-4990-b36e-1cd7ac2ef246 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:47.458360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-48c733fb-4c80-4990-b36e-1cd7ac2ef246 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:47.465294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c733fb-4c80-4990-b36e-1cd7ac2ef246 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:47.465807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c733fb-4c80-4990-b36e-1cd7ac2ef246 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:47.466236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c733fb-4c80-4990-b36e-1cd7ac2ef246 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:47.466915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c733fb-4c80-4990-b36e-1cd7ac2ef246 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:47.467364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c733fb-4c80-4990-b36e-1cd7ac2ef246 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:47.467782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48c733fb-4c80-4990-b36e-1cd7ac2ef246 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:47.495889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-48c733fb-4c80-4990-b36e-1cd7ac2ef246 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043629 Aug 18 22:07:47.496359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1088/2168] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:47 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:48.508168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e23e214e-d7cc-4850-94bb-c02bdf08f7f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:48.510246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e23e214e-d7cc-4850-94bb-c02bdf08f7f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:48.512666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:48.517882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e23e214e-d7cc-4850-94bb-c02bdf08f7f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:48.518359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e23e214e-d7cc-4850-94bb-c02bdf08f7f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:48.518808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e23e214e-d7cc-4850-94bb-c02bdf08f7f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:48.519472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e23e214e-d7cc-4850-94bb-c02bdf08f7f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:48.519932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e23e214e-d7cc-4850-94bb-c02bdf08f7f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:48.520355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e23e214e-d7cc-4850-94bb-c02bdf08f7f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:48.550265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e23e214e-d7cc-4850-94bb-c02bdf08f7f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045826 Aug 18 22:07:48.550812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1081/2169] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:48 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:49.562556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-faa2b48b-d6c1-4a51-8d0c-3a221b82ab67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:49.564648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-faa2b48b-d6c1-4a51-8d0c-3a221b82ab67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:49.571053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faa2b48b-d6c1-4a51-8d0c-3a221b82ab67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:49.571532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faa2b48b-d6c1-4a51-8d0c-3a221b82ab67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:49.571962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faa2b48b-d6c1-4a51-8d0c-3a221b82ab67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:49.572643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faa2b48b-d6c1-4a51-8d0c-3a221b82ab67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:49.573091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faa2b48b-d6c1-4a51-8d0c-3a221b82ab67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:49.573509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-faa2b48b-d6c1-4a51-8d0c-3a221b82ab67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:49.602726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-faa2b48b-d6c1-4a51-8d0c-3a221b82ab67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Aug 18 22:07:49.603548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1089/2170] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:49 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:50.615249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7a9d678-1b9f-4d16-a5a6-1c7f29afb52c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:50.617352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f7a9d678-1b9f-4d16-a5a6-1c7f29afb52c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:50.624118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7a9d678-1b9f-4d16-a5a6-1c7f29afb52c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:50.624657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7a9d678-1b9f-4d16-a5a6-1c7f29afb52c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:50.625118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7a9d678-1b9f-4d16-a5a6-1c7f29afb52c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:50.625837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7a9d678-1b9f-4d16-a5a6-1c7f29afb52c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:50.626290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7a9d678-1b9f-4d16-a5a6-1c7f29afb52c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:50.626710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7a9d678-1b9f-4d16-a5a6-1c7f29afb52c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:50.656973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f7a9d678-1b9f-4d16-a5a6-1c7f29afb52c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045680 Aug 18 22:07:50.657529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1082/2171] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:50 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:51.669853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fe0bc218-124e-4aae-967e-39abfc312e0b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:51.672058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fe0bc218-124e-4aae-967e-39abfc312e0b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:51.674441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=30 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:07:51.679891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe0bc218-124e-4aae-967e-39abfc312e0b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:51.680371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe0bc218-124e-4aae-967e-39abfc312e0b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:51.680799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe0bc218-124e-4aae-967e-39abfc312e0b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:51.681480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe0bc218-124e-4aae-967e-39abfc312e0b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:51.681960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe0bc218-124e-4aae-967e-39abfc312e0b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:51.682382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe0bc218-124e-4aae-967e-39abfc312e0b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:51.713183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fe0bc218-124e-4aae-967e-39abfc312e0b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047235 Aug 18 22:07:51.714072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1090/2172] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:51 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:52.724417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4bbdc2f9-bdc3-454e-a198-ac413b2ba680 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:52.727173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4bbdc2f9-bdc3-454e-a198-ac413b2ba680 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:52.733580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bbdc2f9-bdc3-454e-a198-ac413b2ba680 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:52.734096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bbdc2f9-bdc3-454e-a198-ac413b2ba680 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:52.734538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bbdc2f9-bdc3-454e-a198-ac413b2ba680 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:52.735228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bbdc2f9-bdc3-454e-a198-ac413b2ba680 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:52.735690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bbdc2f9-bdc3-454e-a198-ac413b2ba680 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:52.736121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bbdc2f9-bdc3-454e-a198-ac413b2ba680 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:52.765058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4bbdc2f9-bdc3-454e-a198-ac413b2ba680 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Aug 18 22:07:52.765624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1083/2173] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:52 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:53.777099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3f012629-fa11-493d-83d9-7b59583f69c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:53.779243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3f012629-fa11-493d-83d9-7b59583f69c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:53.785742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f012629-fa11-493d-83d9-7b59583f69c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:53.786232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f012629-fa11-493d-83d9-7b59583f69c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:53.786677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f012629-fa11-493d-83d9-7b59583f69c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:53.787373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f012629-fa11-493d-83d9-7b59583f69c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:53.787832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f012629-fa11-493d-83d9-7b59583f69c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:53.788259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3f012629-fa11-493d-83d9-7b59583f69c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:53.817663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3f012629-fa11-493d-83d9-7b59583f69c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Aug 18 22:07:53.818223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1091/2174] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:53 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:54.830065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-20bc8fb3-a55a-4960-8699-63ef81524af4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:54.832143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-20bc8fb3-a55a-4960-8699-63ef81524af4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:54.839183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20bc8fb3-a55a-4960-8699-63ef81524af4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:54.839662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20bc8fb3-a55a-4960-8699-63ef81524af4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:54.840096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20bc8fb3-a55a-4960-8699-63ef81524af4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:54.840774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20bc8fb3-a55a-4960-8699-63ef81524af4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:54.841223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20bc8fb3-a55a-4960-8699-63ef81524af4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:54.841666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20bc8fb3-a55a-4960-8699-63ef81524af4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:54.871510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-20bc8fb3-a55a-4960-8699-63ef81524af4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045464 Aug 18 22:07:54.872073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1084/2175] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:54 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:55.883316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aabace71-fc21-4e70-b704-230b2c17309b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:55.885516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aabace71-fc21-4e70-b704-230b2c17309b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:55.891939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aabace71-fc21-4e70-b704-230b2c17309b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:55.892423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aabace71-fc21-4e70-b704-230b2c17309b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:55.892865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aabace71-fc21-4e70-b704-230b2c17309b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:55.893911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aabace71-fc21-4e70-b704-230b2c17309b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:55.894380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aabace71-fc21-4e70-b704-230b2c17309b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:55.894810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aabace71-fc21-4e70-b704-230b2c17309b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:55.925643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aabace71-fc21-4e70-b704-230b2c17309b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046341 Aug 18 22:07:55.926213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1092/2176] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:55 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:56.937871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c7b61f02-a020-4d09-a43f-e75ccd850c63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:56.939955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c7b61f02-a020-4d09-a43f-e75ccd850c63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:56.947023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7b61f02-a020-4d09-a43f-e75ccd850c63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:56.947506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7b61f02-a020-4d09-a43f-e75ccd850c63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:56.947946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7b61f02-a020-4d09-a43f-e75ccd850c63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:56.948643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7b61f02-a020-4d09-a43f-e75ccd850c63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:56.949099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7b61f02-a020-4d09-a43f-e75ccd850c63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:56.949527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7b61f02-a020-4d09-a43f-e75ccd850c63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:56.978579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c7b61f02-a020-4d09-a43f-e75ccd850c63 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Aug 18 22:07:56.979151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1085/2177] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:56 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:57.990177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eb2b3c03-a9fc-42c6-9b1a-df450ad8c934 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:57.992230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eb2b3c03-a9fc-42c6-9b1a-df450ad8c934 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:57.998574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb2b3c03-a9fc-42c6-9b1a-df450ad8c934 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:57.999053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb2b3c03-a9fc-42c6-9b1a-df450ad8c934 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:57.999489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb2b3c03-a9fc-42c6-9b1a-df450ad8c934 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:58.000190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb2b3c03-a9fc-42c6-9b1a-df450ad8c934 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:58.000637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb2b3c03-a9fc-42c6-9b1a-df450ad8c934 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:58.001059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb2b3c03-a9fc-42c6-9b1a-df450ad8c934 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:58.032158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eb2b3c03-a9fc-42c6-9b1a-df450ad8c934 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046053 Aug 18 22:07:58.032720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1093/2178] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:57 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:07:59.044964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8db0864a-3efe-466c-968c-fd88e96f1958 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:07:59.047256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8db0864a-3efe-466c-968c-fd88e96f1958 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:07:59.053725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8db0864a-3efe-466c-968c-fd88e96f1958 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:59.054212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8db0864a-3efe-466c-968c-fd88e96f1958 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:59.054656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8db0864a-3efe-466c-968c-fd88e96f1958 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:59.055437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8db0864a-3efe-466c-968c-fd88e96f1958 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:07:59.055905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8db0864a-3efe-466c-968c-fd88e96f1958 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:07:59.056338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8db0864a-3efe-466c-968c-fd88e96f1958 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:07:59.085517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8db0864a-3efe-466c-968c-fd88e96f1958 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Aug 18 22:07:59.086606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1086/2179] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:07:59 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:00.098307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-20c1dbce-1837-4c1b-9b16-4318889220bb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:00.100508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-20c1dbce-1837-4c1b-9b16-4318889220bb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:00.107423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20c1dbce-1837-4c1b-9b16-4318889220bb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:00.107852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20c1dbce-1837-4c1b-9b16-4318889220bb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:00.108294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20c1dbce-1837-4c1b-9b16-4318889220bb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:00.109015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20c1dbce-1837-4c1b-9b16-4318889220bb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:00.109478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20c1dbce-1837-4c1b-9b16-4318889220bb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:00.109935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20c1dbce-1837-4c1b-9b16-4318889220bb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:00.139436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-20c1dbce-1837-4c1b-9b16-4318889220bb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045076 Aug 18 22:08:00.139995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1094/2180] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:00 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:01.152328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3a98ae25-0772-4063-815a-fd6fb1090660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:01.154497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3a98ae25-0772-4063-815a-fd6fb1090660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:01.160906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a98ae25-0772-4063-815a-fd6fb1090660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:01.161340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a98ae25-0772-4063-815a-fd6fb1090660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:01.161829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a98ae25-0772-4063-815a-fd6fb1090660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:01.162521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a98ae25-0772-4063-815a-fd6fb1090660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:01.162980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a98ae25-0772-4063-815a-fd6fb1090660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:01.163410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a98ae25-0772-4063-815a-fd6fb1090660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:01.165765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=90 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:08:01.193443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3a98ae25-0772-4063-815a-fd6fb1090660 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045659 Aug 18 22:08:01.194031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1087/2181] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:01 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:02.206404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8b906eff-bc5a-4a35-921e-35906cf56b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:02.208531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8b906eff-bc5a-4a35-921e-35906cf56b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:02.215424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b906eff-bc5a-4a35-921e-35906cf56b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:02.215835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b906eff-bc5a-4a35-921e-35906cf56b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:02.216267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b906eff-bc5a-4a35-921e-35906cf56b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:02.216945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b906eff-bc5a-4a35-921e-35906cf56b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:02.217391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b906eff-bc5a-4a35-921e-35906cf56b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:02.217854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b906eff-bc5a-4a35-921e-35906cf56b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:02.246461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8b906eff-bc5a-4a35-921e-35906cf56b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043943 Aug 18 22:08:02.247002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1095/2182] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:03.258537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-954695c0-1443-4e7f-9c2b-9484d09405a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:03.260658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-954695c0-1443-4e7f-9c2b-9484d09405a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:03.267019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-954695c0-1443-4e7f-9c2b-9484d09405a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:03.267497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-954695c0-1443-4e7f-9c2b-9484d09405a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:03.267930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-954695c0-1443-4e7f-9c2b-9484d09405a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:03.268608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-954695c0-1443-4e7f-9c2b-9484d09405a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:03.269058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-954695c0-1443-4e7f-9c2b-9484d09405a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:03.269479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-954695c0-1443-4e7f-9c2b-9484d09405a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:03.298208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-954695c0-1443-4e7f-9c2b-9484d09405a6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Aug 18 22:08:03.298694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1088/2183] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:04.311163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-36b4d9fd-f912-456a-9b48-9819145a8490 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:04.313323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-36b4d9fd-f912-456a-9b48-9819145a8490 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:04.320024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36b4d9fd-f912-456a-9b48-9819145a8490 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:04.321979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36b4d9fd-f912-456a-9b48-9819145a8490 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:04.321979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36b4d9fd-f912-456a-9b48-9819145a8490 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:04.322218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36b4d9fd-f912-456a-9b48-9819145a8490 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:04.322636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36b4d9fd-f912-456a-9b48-9819145a8490 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:04.323063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36b4d9fd-f912-456a-9b48-9819145a8490 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:04.353083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-36b4d9fd-f912-456a-9b48-9819145a8490 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045873 Aug 18 22:08:04.353570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1096/2184] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:05.364837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3ec7e4a4-eb37-4c99-9995-c5afa1d7b61e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:05.366994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3ec7e4a4-eb37-4c99-9995-c5afa1d7b61e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:05.373325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ec7e4a4-eb37-4c99-9995-c5afa1d7b61e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:05.373833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ec7e4a4-eb37-4c99-9995-c5afa1d7b61e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:05.374268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ec7e4a4-eb37-4c99-9995-c5afa1d7b61e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:05.374944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ec7e4a4-eb37-4c99-9995-c5afa1d7b61e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:05.375391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ec7e4a4-eb37-4c99-9995-c5afa1d7b61e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:05.375812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ec7e4a4-eb37-4c99-9995-c5afa1d7b61e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:05.405018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3ec7e4a4-eb37-4c99-9995-c5afa1d7b61e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044046 Aug 18 22:08:05.405580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1089/2185] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:06.417981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ece8a1a-5eed-46b1-aefc-4a001ae21104 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:06.420175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ece8a1a-5eed-46b1-aefc-4a001ae21104 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:06.426884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ece8a1a-5eed-46b1-aefc-4a001ae21104 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:06.427366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ece8a1a-5eed-46b1-aefc-4a001ae21104 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:06.427797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ece8a1a-5eed-46b1-aefc-4a001ae21104 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:06.428482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ece8a1a-5eed-46b1-aefc-4a001ae21104 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:06.428936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ece8a1a-5eed-46b1-aefc-4a001ae21104 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:06.429362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ece8a1a-5eed-46b1-aefc-4a001ae21104 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:06.457472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ece8a1a-5eed-46b1-aefc-4a001ae21104 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043854 Aug 18 22:08:06.457982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1097/2186] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:07.470187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-744e8e7e-798d-4f41-bf47-67ab2c98be65 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:07.472330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-744e8e7e-798d-4f41-bf47-67ab2c98be65 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:07.478773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-744e8e7e-798d-4f41-bf47-67ab2c98be65 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:07.479248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-744e8e7e-798d-4f41-bf47-67ab2c98be65 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:07.479687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-744e8e7e-798d-4f41-bf47-67ab2c98be65 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:07.480369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-744e8e7e-798d-4f41-bf47-67ab2c98be65 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:07.480816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-744e8e7e-798d-4f41-bf47-67ab2c98be65 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:07.481241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-744e8e7e-798d-4f41-bf47-67ab2c98be65 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:07.510371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-744e8e7e-798d-4f41-bf47-67ab2c98be65 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044014 Aug 18 22:08:07.510852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1090/2187] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:07 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:08.522310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fcfa6d4f-0bc5-4323-9d0f-17a453153ecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:08.525151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fcfa6d4f-0bc5-4323-9d0f-17a453153ecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:08.531551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcfa6d4f-0bc5-4323-9d0f-17a453153ecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:08.532032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcfa6d4f-0bc5-4323-9d0f-17a453153ecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:08.532472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcfa6d4f-0bc5-4323-9d0f-17a453153ecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:08.533164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcfa6d4f-0bc5-4323-9d0f-17a453153ecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:08.533641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcfa6d4f-0bc5-4323-9d0f-17a453153ecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:08.534074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcfa6d4f-0bc5-4323-9d0f-17a453153ecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:08.562566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fcfa6d4f-0bc5-4323-9d0f-17a453153ecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044113 Aug 18 22:08:08.563053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1098/2188] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:09.574986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0ffaeb82-9876-4df1-bab9-d391638b911c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:09.577156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0ffaeb82-9876-4df1-bab9-d391638b911c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:09.583708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ffaeb82-9876-4df1-bab9-d391638b911c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:09.584191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ffaeb82-9876-4df1-bab9-d391638b911c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:09.584635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ffaeb82-9876-4df1-bab9-d391638b911c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:09.585332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ffaeb82-9876-4df1-bab9-d391638b911c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:09.586309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ffaeb82-9876-4df1-bab9-d391638b911c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:09.586742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ffaeb82-9876-4df1-bab9-d391638b911c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:09.616461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0ffaeb82-9876-4df1-bab9-d391638b911c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045538 Aug 18 22:08:09.617022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1091/2189] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:10.628846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-825c6b4b-df53-4795-9687-08a35ecf4747 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:10.631028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-825c6b4b-df53-4795-9687-08a35ecf4747 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:10.637445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-825c6b4b-df53-4795-9687-08a35ecf4747 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:10.637959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-825c6b4b-df53-4795-9687-08a35ecf4747 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:10.638388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-825c6b4b-df53-4795-9687-08a35ecf4747 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:10.639065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-825c6b4b-df53-4795-9687-08a35ecf4747 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:10.639511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-825c6b4b-df53-4795-9687-08a35ecf4747 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:10.639963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-825c6b4b-df53-4795-9687-08a35ecf4747 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:10.668654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-825c6b4b-df53-4795-9687-08a35ecf4747 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043657 Aug 18 22:08:10.669111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1099/2190] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:10 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:11.682100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5eed69bc-7e9f-4402-acd5-fb63c80ee423 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:11.684302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5eed69bc-7e9f-4402-acd5-fb63c80ee423 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:11.690987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5eed69bc-7e9f-4402-acd5-fb63c80ee423 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:11.691481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5eed69bc-7e9f-4402-acd5-fb63c80ee423 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:11.691922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5eed69bc-7e9f-4402-acd5-fb63c80ee423 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:11.692632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5eed69bc-7e9f-4402-acd5-fb63c80ee423 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:11.693093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5eed69bc-7e9f-4402-acd5-fb63c80ee423 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:11.693529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5eed69bc-7e9f-4402-acd5-fb63c80ee423 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:11.723337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5eed69bc-7e9f-4402-acd5-fb63c80ee423 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046124 Aug 18 22:08:11.723901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1092/2191] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:12.735695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64c7cc9c-c961-46c5-a133-fd60105fc9d0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:12.737856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64c7cc9c-c961-46c5-a133-fd60105fc9d0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:12.744195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64c7cc9c-c961-46c5-a133-fd60105fc9d0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:12.744673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64c7cc9c-c961-46c5-a133-fd60105fc9d0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:12.745105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64c7cc9c-c961-46c5-a133-fd60105fc9d0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:12.745809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64c7cc9c-c961-46c5-a133-fd60105fc9d0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:12.746259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64c7cc9c-c961-46c5-a133-fd60105fc9d0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:12.746679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64c7cc9c-c961-46c5-a133-fd60105fc9d0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:12.775709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64c7cc9c-c961-46c5-a133-fd60105fc9d0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043919 Aug 18 22:08:12.776255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1100/2192] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:12 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:13.787898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5b14c6da-7902-4338-ab08-c0819b89a476 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:13.790698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5b14c6da-7902-4338-ab08-c0819b89a476 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:13.797187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b14c6da-7902-4338-ab08-c0819b89a476 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:13.797700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b14c6da-7902-4338-ab08-c0819b89a476 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:13.798146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b14c6da-7902-4338-ab08-c0819b89a476 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:13.798846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b14c6da-7902-4338-ab08-c0819b89a476 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:13.799309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b14c6da-7902-4338-ab08-c0819b89a476 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:13.799993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b14c6da-7902-4338-ab08-c0819b89a476 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:13.830029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5b14c6da-7902-4338-ab08-c0819b89a476 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046026 Aug 18 22:08:13.830914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1093/2193] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:14.842271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8cf0b314-c6a3-42b1-934d-ae780fd6f1bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:14.844433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8cf0b314-c6a3-42b1-934d-ae780fd6f1bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:14.850873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8cf0b314-c6a3-42b1-934d-ae780fd6f1bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:14.851358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8cf0b314-c6a3-42b1-934d-ae780fd6f1bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:14.851795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8cf0b314-c6a3-42b1-934d-ae780fd6f1bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:14.852487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8cf0b314-c6a3-42b1-934d-ae780fd6f1bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:14.852948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8cf0b314-c6a3-42b1-934d-ae780fd6f1bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:14.853378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8cf0b314-c6a3-42b1-934d-ae780fd6f1bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:14.855772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=90 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:08:14.884737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8cf0b314-c6a3-42b1-934d-ae780fd6f1bc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046371 Aug 18 22:08:14.885287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1101/2194] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:15.515900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:08:15.516111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:08:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:08:15.896749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-df511d75-5839-4a90-a648-a8097ea95fb2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:15.899637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-df511d75-5839-4a90-a648-a8097ea95fb2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:15.906002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df511d75-5839-4a90-a648-a8097ea95fb2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:15.906485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df511d75-5839-4a90-a648-a8097ea95fb2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:15.906941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df511d75-5839-4a90-a648-a8097ea95fb2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:15.907613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df511d75-5839-4a90-a648-a8097ea95fb2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:15.908067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df511d75-5839-4a90-a648-a8097ea95fb2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:15.908492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df511d75-5839-4a90-a648-a8097ea95fb2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:15.937449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-df511d75-5839-4a90-a648-a8097ea95fb2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Aug 18 22:08:15.938034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1094/2195] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:15 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:16.949702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cd362a46-3057-40a5-b2fc-1f1d23776d6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:16.951827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cd362a46-3057-40a5-b2fc-1f1d23776d6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:16.958173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd362a46-3057-40a5-b2fc-1f1d23776d6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:16.958660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd362a46-3057-40a5-b2fc-1f1d23776d6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:16.959100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd362a46-3057-40a5-b2fc-1f1d23776d6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:16.959797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd362a46-3057-40a5-b2fc-1f1d23776d6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:16.960815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd362a46-3057-40a5-b2fc-1f1d23776d6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:16.961253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd362a46-3057-40a5-b2fc-1f1d23776d6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:16.990922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cd362a46-3057-40a5-b2fc-1f1d23776d6c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045228 Aug 18 22:08:16.991502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1102/2196] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:18.003120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-793bbdfa-7e45-4dd0-bae6-a25df1c34aaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:18.005304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-793bbdfa-7e45-4dd0-bae6-a25df1c34aaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:18.012516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-793bbdfa-7e45-4dd0-bae6-a25df1c34aaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:18.013004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-793bbdfa-7e45-4dd0-bae6-a25df1c34aaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:18.013445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-793bbdfa-7e45-4dd0-bae6-a25df1c34aaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:18.014168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-793bbdfa-7e45-4dd0-bae6-a25df1c34aaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:18.014627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-793bbdfa-7e45-4dd0-bae6-a25df1c34aaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:18.015059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-793bbdfa-7e45-4dd0-bae6-a25df1c34aaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:18.044038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-793bbdfa-7e45-4dd0-bae6-a25df1c34aaa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044820 Aug 18 22:08:18.044592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1095/2197] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:17 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:19.056337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf3a399a-a5be-44b8-afb6-ad07c3724de1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:19.062326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf3a399a-a5be-44b8-afb6-ad07c3724de1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:19.064962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf3a399a-a5be-44b8-afb6-ad07c3724de1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:19.065439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf3a399a-a5be-44b8-afb6-ad07c3724de1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:19.065925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf3a399a-a5be-44b8-afb6-ad07c3724de1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:19.066616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf3a399a-a5be-44b8-afb6-ad07c3724de1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:19.067066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf3a399a-a5be-44b8-afb6-ad07c3724de1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:19.067487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf3a399a-a5be-44b8-afb6-ad07c3724de1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:19.097557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf3a399a-a5be-44b8-afb6-ad07c3724de1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Aug 18 22:08:19.098142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1103/2198] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:19 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:20.110266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-877cb6a9-d5e4-48db-90c7-eba4e0e1ad69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:20.112397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-877cb6a9-d5e4-48db-90c7-eba4e0e1ad69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:20.114796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:08:20.124239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-877cb6a9-d5e4-48db-90c7-eba4e0e1ad69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:20.124729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-877cb6a9-d5e4-48db-90c7-eba4e0e1ad69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:20.125169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-877cb6a9-d5e4-48db-90c7-eba4e0e1ad69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:20.125902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-877cb6a9-d5e4-48db-90c7-eba4e0e1ad69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:20.126357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-877cb6a9-d5e4-48db-90c7-eba4e0e1ad69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:20.126787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-877cb6a9-d5e4-48db-90c7-eba4e0e1ad69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:20.156479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-877cb6a9-d5e4-48db-90c7-eba4e0e1ad69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050115 Aug 18 22:08:20.157056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1096/2199] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:20 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:08:21.168947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-35706bdf-2b6d-4b79-96de-c908d49fa82d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:21.171096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-35706bdf-2b6d-4b79-96de-c908d49fa82d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:21.177664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35706bdf-2b6d-4b79-96de-c908d49fa82d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:21.178141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35706bdf-2b6d-4b79-96de-c908d49fa82d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:21.178572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35706bdf-2b6d-4b79-96de-c908d49fa82d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:21.179324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35706bdf-2b6d-4b79-96de-c908d49fa82d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:21.179762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35706bdf-2b6d-4b79-96de-c908d49fa82d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:21.180096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35706bdf-2b6d-4b79-96de-c908d49fa82d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:21.209213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-35706bdf-2b6d-4b79-96de-c908d49fa82d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Aug 18 22:08:21.209783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1104/2200] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:22.221994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-43c6697a-7a3f-4b26-9604-8d79deaece53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:22.224146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-43c6697a-7a3f-4b26-9604-8d79deaece53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:22.231322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-43c6697a-7a3f-4b26-9604-8d79deaece53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:22.231812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-43c6697a-7a3f-4b26-9604-8d79deaece53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:22.232255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-43c6697a-7a3f-4b26-9604-8d79deaece53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:22.232976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-43c6697a-7a3f-4b26-9604-8d79deaece53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:22.233436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-43c6697a-7a3f-4b26-9604-8d79deaece53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:22.233892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-43c6697a-7a3f-4b26-9604-8d79deaece53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:22.262463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-43c6697a-7a3f-4b26-9604-8d79deaece53 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044459 Aug 18 22:08:22.263026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1097/2201] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:23.274550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cbcd654d-9f46-4039-861a-1d487694bab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:23.276717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cbcd654d-9f46-4039-861a-1d487694bab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:23.279058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=30 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:08:23.284396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbcd654d-9f46-4039-861a-1d487694bab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:23.284870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbcd654d-9f46-4039-861a-1d487694bab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:23.285296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbcd654d-9f46-4039-861a-1d487694bab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:23.286003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbcd654d-9f46-4039-861a-1d487694bab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:23.286449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbcd654d-9f46-4039-861a-1d487694bab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:23.286867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbcd654d-9f46-4039-861a-1d487694bab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:23.316678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cbcd654d-9f46-4039-861a-1d487694bab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046074 Aug 18 22:08:23.317225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1105/2202] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:23 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:24.327936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c6592b35-d405-4a9b-aa82-74650696b7b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:24.330109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c6592b35-d405-4a9b-aa82-74650696b7b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:24.336571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6592b35-d405-4a9b-aa82-74650696b7b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:24.337060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6592b35-d405-4a9b-aa82-74650696b7b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:24.337499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6592b35-d405-4a9b-aa82-74650696b7b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:24.338221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6592b35-d405-4a9b-aa82-74650696b7b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:24.338680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6592b35-d405-4a9b-aa82-74650696b7b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:24.339110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6592b35-d405-4a9b-aa82-74650696b7b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:24.368474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c6592b35-d405-4a9b-aa82-74650696b7b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044449 Aug 18 22:08:24.369028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1098/2203] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:25.379771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-86451973-c759-46b3-ae59-129147a5c7da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:25.382621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-86451973-c759-46b3-ae59-129147a5c7da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:25.388979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86451973-c759-46b3-ae59-129147a5c7da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:25.389451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86451973-c759-46b3-ae59-129147a5c7da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:25.389914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86451973-c759-46b3-ae59-129147a5c7da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:25.390594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86451973-c759-46b3-ae59-129147a5c7da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:25.391043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86451973-c759-46b3-ae59-129147a5c7da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:25.391461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86451973-c759-46b3-ae59-129147a5c7da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:25.420169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-86451973-c759-46b3-ae59-129147a5c7da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Aug 18 22:08:25.420744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1106/2204] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:26.432869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7a37c226-4383-4724-9ddd-fe609cbfb1c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:26.435084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7a37c226-4383-4724-9ddd-fe609cbfb1c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:26.441854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a37c226-4383-4724-9ddd-fe609cbfb1c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:26.442339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a37c226-4383-4724-9ddd-fe609cbfb1c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:26.442778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a37c226-4383-4724-9ddd-fe609cbfb1c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:26.443470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a37c226-4383-4724-9ddd-fe609cbfb1c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:26.443927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a37c226-4383-4724-9ddd-fe609cbfb1c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:26.444908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a37c226-4383-4724-9ddd-fe609cbfb1c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:26.474652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7a37c226-4383-4724-9ddd-fe609cbfb1c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045604 Aug 18 22:08:26.475226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1099/2205] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:26 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:27.486867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-77fe34c5-dd04-4125-88ca-c2c54d6200a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:27.488979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-77fe34c5-dd04-4125-88ca-c2c54d6200a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:27.495417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77fe34c5-dd04-4125-88ca-c2c54d6200a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:27.495886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77fe34c5-dd04-4125-88ca-c2c54d6200a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:27.496316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77fe34c5-dd04-4125-88ca-c2c54d6200a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:27.496991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77fe34c5-dd04-4125-88ca-c2c54d6200a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:27.497437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77fe34c5-dd04-4125-88ca-c2c54d6200a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:27.497888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77fe34c5-dd04-4125-88ca-c2c54d6200a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:27.526326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-77fe34c5-dd04-4125-88ca-c2c54d6200a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043367 Aug 18 22:08:27.526881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1107/2206] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:28.538793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0697c8e7-1730-4b7d-b070-fa1d73598f52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:28.540968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0697c8e7-1730-4b7d-b070-fa1d73598f52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:28.546955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0697c8e7-1730-4b7d-b070-fa1d73598f52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:28.547447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0697c8e7-1730-4b7d-b070-fa1d73598f52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:28.547889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0697c8e7-1730-4b7d-b070-fa1d73598f52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:28.548583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0697c8e7-1730-4b7d-b070-fa1d73598f52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:28.549044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0697c8e7-1730-4b7d-b070-fa1d73598f52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:28.549476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0697c8e7-1730-4b7d-b070-fa1d73598f52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:28.578973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0697c8e7-1730-4b7d-b070-fa1d73598f52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Aug 18 22:08:28.579520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1100/2207] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:29.590749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1f0ba6da-b087-41a1-a265-f4f7a30d5430 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:29.592876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1f0ba6da-b087-41a1-a265-f4f7a30d5430 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:29.599338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f0ba6da-b087-41a1-a265-f4f7a30d5430 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:29.599819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f0ba6da-b087-41a1-a265-f4f7a30d5430 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:29.600256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f0ba6da-b087-41a1-a265-f4f7a30d5430 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:29.600947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f0ba6da-b087-41a1-a265-f4f7a30d5430 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:29.601406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f0ba6da-b087-41a1-a265-f4f7a30d5430 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:29.601866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f0ba6da-b087-41a1-a265-f4f7a30d5430 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:29.630227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1f0ba6da-b087-41a1-a265-f4f7a30d5430 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043443 Aug 18 22:08:29.630785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1108/2208] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:29 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:08:30.216532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:08:30.216833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:08:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:08:30.642772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8325e368-2d27-419c-95da-2b77e18c1fd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:30.644920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8325e368-2d27-419c-95da-2b77e18c1fd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:30.651979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8325e368-2d27-419c-95da-2b77e18c1fd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:30.652460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8325e368-2d27-419c-95da-2b77e18c1fd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:30.652903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8325e368-2d27-419c-95da-2b77e18c1fd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:30.653616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8325e368-2d27-419c-95da-2b77e18c1fd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:30.654075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8325e368-2d27-419c-95da-2b77e18c1fd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:30.654507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8325e368-2d27-419c-95da-2b77e18c1fd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:30.683660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8325e368-2d27-419c-95da-2b77e18c1fd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044759 Aug 18 22:08:30.684209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1101/2209] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:31.695682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e3112c45-e35b-4b78-b35e-ad0c05258cd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:31.697836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e3112c45-e35b-4b78-b35e-ad0c05258cd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:31.704227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3112c45-e35b-4b78-b35e-ad0c05258cd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:31.704705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3112c45-e35b-4b78-b35e-ad0c05258cd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:31.705141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3112c45-e35b-4b78-b35e-ad0c05258cd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:31.705864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3112c45-e35b-4b78-b35e-ad0c05258cd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:31.706317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3112c45-e35b-4b78-b35e-ad0c05258cd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:31.706742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3112c45-e35b-4b78-b35e-ad0c05258cd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:31.736832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e3112c45-e35b-4b78-b35e-ad0c05258cd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045019 Aug 18 22:08:31.737387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1109/2210] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:32.749661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-79f5cf39-c94b-4682-9d25-a807d525d97b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:32.751783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-79f5cf39-c94b-4682-9d25-a807d525d97b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:32.758830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79f5cf39-c94b-4682-9d25-a807d525d97b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:32.759310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79f5cf39-c94b-4682-9d25-a807d525d97b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:32.759741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79f5cf39-c94b-4682-9d25-a807d525d97b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:32.760418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79f5cf39-c94b-4682-9d25-a807d525d97b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:32.760867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79f5cf39-c94b-4682-9d25-a807d525d97b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:32.761283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79f5cf39-c94b-4682-9d25-a807d525d97b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:32.763584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=90 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:08:32.790349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-79f5cf39-c94b-4682-9d25-a807d525d97b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Aug 18 22:08:32.790904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1102/2211] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:33.803050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c769922a-df64-4a7a-a595-a3302a9f2f97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:33.805553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c769922a-df64-4a7a-a595-a3302a9f2f97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:33.811982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c769922a-df64-4a7a-a595-a3302a9f2f97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:33.812489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c769922a-df64-4a7a-a595-a3302a9f2f97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:33.812929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c769922a-df64-4a7a-a595-a3302a9f2f97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:33.813647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c769922a-df64-4a7a-a595-a3302a9f2f97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:33.814108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c769922a-df64-4a7a-a595-a3302a9f2f97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:33.814539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c769922a-df64-4a7a-a595-a3302a9f2f97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:33.843704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c769922a-df64-4a7a-a595-a3302a9f2f97 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Aug 18 22:08:33.844257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1110/2212] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:34.856426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-139453c0-4baa-4d81-b297-4a88d898b053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:34.858725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-139453c0-4baa-4d81-b297-4a88d898b053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:34.865250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-139453c0-4baa-4d81-b297-4a88d898b053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:34.865772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-139453c0-4baa-4d81-b297-4a88d898b053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:34.867107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-139453c0-4baa-4d81-b297-4a88d898b053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:34.867891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-139453c0-4baa-4d81-b297-4a88d898b053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:34.868356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-139453c0-4baa-4d81-b297-4a88d898b053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:34.868806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-139453c0-4baa-4d81-b297-4a88d898b053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:34.898947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-139453c0-4baa-4d81-b297-4a88d898b053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046416 Aug 18 22:08:34.899509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1103/2213] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:35.911149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a13761c7-0855-4532-b4b1-d71b1bd2f291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:35.913337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a13761c7-0855-4532-b4b1-d71b1bd2f291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:35.919679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a13761c7-0855-4532-b4b1-d71b1bd2f291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:35.920157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a13761c7-0855-4532-b4b1-d71b1bd2f291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:35.920593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a13761c7-0855-4532-b4b1-d71b1bd2f291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:35.921281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a13761c7-0855-4532-b4b1-d71b1bd2f291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:35.921765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a13761c7-0855-4532-b4b1-d71b1bd2f291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:35.922189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a13761c7-0855-4532-b4b1-d71b1bd2f291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:35.952327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a13761c7-0855-4532-b4b1-d71b1bd2f291 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 Aug 18 22:08:35.952887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1111/2214] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:35 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:36.964887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-023dfb6f-67d1-4ce0-b248-c8c35fe4f68a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:36.967104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-023dfb6f-67d1-4ce0-b248-c8c35fe4f68a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:36.973549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023dfb6f-67d1-4ce0-b248-c8c35fe4f68a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:36.973870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023dfb6f-67d1-4ce0-b248-c8c35fe4f68a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:36.974305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023dfb6f-67d1-4ce0-b248-c8c35fe4f68a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:36.974988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023dfb6f-67d1-4ce0-b248-c8c35fe4f68a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:36.975438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023dfb6f-67d1-4ce0-b248-c8c35fe4f68a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:36.976006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023dfb6f-67d1-4ce0-b248-c8c35fe4f68a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:37.004333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-023dfb6f-67d1-4ce0-b248-c8c35fe4f68a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043274 Aug 18 22:08:37.004889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1104/2215] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:38.016530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c50b1553-304d-4b70-82fd-f192a5169234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:38.018700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c50b1553-304d-4b70-82fd-f192a5169234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:38.025518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c50b1553-304d-4b70-82fd-f192a5169234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:38.026026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c50b1553-304d-4b70-82fd-f192a5169234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:38.026467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c50b1553-304d-4b70-82fd-f192a5169234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:38.027155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c50b1553-304d-4b70-82fd-f192a5169234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:38.027609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c50b1553-304d-4b70-82fd-f192a5169234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:38.028033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c50b1553-304d-4b70-82fd-f192a5169234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:38.057357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c50b1553-304d-4b70-82fd-f192a5169234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044778 Aug 18 22:08:38.057929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1112/2216] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:38 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:39.068844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fc73d3ca-8fb4-45e3-90a7-0552060eb665 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:39.071119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fc73d3ca-8fb4-45e3-90a7-0552060eb665 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:39.077579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc73d3ca-8fb4-45e3-90a7-0552060eb665 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:39.078100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc73d3ca-8fb4-45e3-90a7-0552060eb665 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:39.078547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc73d3ca-8fb4-45e3-90a7-0552060eb665 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:39.079250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc73d3ca-8fb4-45e3-90a7-0552060eb665 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:39.079714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc73d3ca-8fb4-45e3-90a7-0552060eb665 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:39.080350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc73d3ca-8fb4-45e3-90a7-0552060eb665 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:39.109071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fc73d3ca-8fb4-45e3-90a7-0552060eb665 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044193 Aug 18 22:08:39.109633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1105/2217] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:39 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:40.120969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-90b49195-91c1-4f39-859e-80514b1f8894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:40.123143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-90b49195-91c1-4f39-859e-80514b1f8894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:40.129689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90b49195-91c1-4f39-859e-80514b1f8894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:40.130163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90b49195-91c1-4f39-859e-80514b1f8894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:40.130596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90b49195-91c1-4f39-859e-80514b1f8894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:40.131273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90b49195-91c1-4f39-859e-80514b1f8894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:40.132232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90b49195-91c1-4f39-859e-80514b1f8894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:40.132628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90b49195-91c1-4f39-859e-80514b1f8894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:40.162268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-90b49195-91c1-4f39-859e-80514b1f8894 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045141 Aug 18 22:08:40.162846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1113/2218] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:40 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:41.173604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5dc555de-26d9-4f92-a3c2-21cfe94fe5a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:41.176098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5dc555de-26d9-4f92-a3c2-21cfe94fe5a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:41.182780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5dc555de-26d9-4f92-a3c2-21cfe94fe5a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:41.183266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5dc555de-26d9-4f92-a3c2-21cfe94fe5a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:41.183709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5dc555de-26d9-4f92-a3c2-21cfe94fe5a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:41.184407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5dc555de-26d9-4f92-a3c2-21cfe94fe5a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:41.184873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5dc555de-26d9-4f92-a3c2-21cfe94fe5a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:41.185305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5dc555de-26d9-4f92-a3c2-21cfe94fe5a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:41.216070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5dc555de-26d9-4f92-a3c2-21cfe94fe5a2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046343 Aug 18 22:08:41.216635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1106/2219] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:41 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:42.228681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb1bba6b-0d04-4be4-9596-32652f559b42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:42.230827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fb1bba6b-0d04-4be4-9596-32652f559b42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:42.237238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb1bba6b-0d04-4be4-9596-32652f559b42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:42.237747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb1bba6b-0d04-4be4-9596-32652f559b42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:42.238178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb1bba6b-0d04-4be4-9596-32652f559b42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:42.238917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb1bba6b-0d04-4be4-9596-32652f559b42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:42.239370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb1bba6b-0d04-4be4-9596-32652f559b42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:42.239790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb1bba6b-0d04-4be4-9596-32652f559b42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:42.268465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fb1bba6b-0d04-4be4-9596-32652f559b42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044167 Aug 18 22:08:42.269011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1114/2220] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:43.279492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-04a13607-e9ff-4723-8cb4-492b82752906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:43.281764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-04a13607-e9ff-4723-8cb4-492b82752906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:43.288171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04a13607-e9ff-4723-8cb4-492b82752906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:43.288651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04a13607-e9ff-4723-8cb4-492b82752906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:43.289087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04a13607-e9ff-4723-8cb4-492b82752906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:43.289809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04a13607-e9ff-4723-8cb4-492b82752906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:43.290268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04a13607-e9ff-4723-8cb4-492b82752906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:43.290697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04a13607-e9ff-4723-8cb4-492b82752906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:43.320500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-04a13607-e9ff-4723-8cb4-492b82752906 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Aug 18 22:08:43.321044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1107/2221] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:43 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:44.332999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d23e91e8-40d1-441f-b9a6-7d4b3f3ba287 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:44.335790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d23e91e8-40d1-441f-b9a6-7d4b3f3ba287 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:44.342159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d23e91e8-40d1-441f-b9a6-7d4b3f3ba287 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:44.342630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d23e91e8-40d1-441f-b9a6-7d4b3f3ba287 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:44.343064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d23e91e8-40d1-441f-b9a6-7d4b3f3ba287 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:44.343746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d23e91e8-40d1-441f-b9a6-7d4b3f3ba287 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:44.344199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d23e91e8-40d1-441f-b9a6-7d4b3f3ba287 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:44.344620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d23e91e8-40d1-441f-b9a6-7d4b3f3ba287 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:44.373496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d23e91e8-40d1-441f-b9a6-7d4b3f3ba287 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Aug 18 22:08:44.374149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1115/2222] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:44 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:45.385482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fb8f2d5d-a68b-44b4-a494-8430009afff9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:45.387705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fb8f2d5d-a68b-44b4-a494-8430009afff9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:45.394088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb8f2d5d-a68b-44b4-a494-8430009afff9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:45.394571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb8f2d5d-a68b-44b4-a494-8430009afff9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:45.395010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb8f2d5d-a68b-44b4-a494-8430009afff9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:45.395699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb8f2d5d-a68b-44b4-a494-8430009afff9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:45.396154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb8f2d5d-a68b-44b4-a494-8430009afff9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:45.396582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb8f2d5d-a68b-44b4-a494-8430009afff9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:45.426277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fb8f2d5d-a68b-44b4-a494-8430009afff9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Aug 18 22:08:45.426818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1108/2223] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:46.438562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7016edd7-c0ee-43d1-91d4-24e632820fc9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:46.440719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7016edd7-c0ee-43d1-91d4-24e632820fc9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:46.447402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7016edd7-c0ee-43d1-91d4-24e632820fc9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:46.447877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7016edd7-c0ee-43d1-91d4-24e632820fc9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:46.448312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7016edd7-c0ee-43d1-91d4-24e632820fc9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:46.448991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7016edd7-c0ee-43d1-91d4-24e632820fc9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:46.449445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7016edd7-c0ee-43d1-91d4-24e632820fc9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:46.449920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7016edd7-c0ee-43d1-91d4-24e632820fc9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:46.453410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=90 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:08:46.478470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7016edd7-c0ee-43d1-91d4-24e632820fc9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043947 Aug 18 22:08:46.479027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1116/2224] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:46 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:47.490490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d606fafe-8835-4b71-947e-76dbb37e3437 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:47.492804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d606fafe-8835-4b71-947e-76dbb37e3437 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:47.499274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d606fafe-8835-4b71-947e-76dbb37e3437 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:47.499760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d606fafe-8835-4b71-947e-76dbb37e3437 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:47.500194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d606fafe-8835-4b71-947e-76dbb37e3437 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:47.500884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d606fafe-8835-4b71-947e-76dbb37e3437 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:47.501339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d606fafe-8835-4b71-947e-76dbb37e3437 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:47.501805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d606fafe-8835-4b71-947e-76dbb37e3437 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:47.531820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d606fafe-8835-4b71-947e-76dbb37e3437 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Aug 18 22:08:47.532384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1109/2225] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:47 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:48.544476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8e51364c-df3a-42fc-8e78-46f7843d7367 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:48.546656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8e51364c-df3a-42fc-8e78-46f7843d7367 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:48.553249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e51364c-df3a-42fc-8e78-46f7843d7367 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:48.554051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e51364c-df3a-42fc-8e78-46f7843d7367 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:48.554798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e51364c-df3a-42fc-8e78-46f7843d7367 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:48.555569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e51364c-df3a-42fc-8e78-46f7843d7367 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:48.556035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e51364c-df3a-42fc-8e78-46f7843d7367 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:48.556466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e51364c-df3a-42fc-8e78-46f7843d7367 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:48.586289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8e51364c-df3a-42fc-8e78-46f7843d7367 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 Aug 18 22:08:48.586844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1117/2226] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:48 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:49.598253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e35c9c27-5858-4cb6-a253-94dcc2ba338c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:49.600993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e35c9c27-5858-4cb6-a253-94dcc2ba338c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:49.607469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e35c9c27-5858-4cb6-a253-94dcc2ba338c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:49.607957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e35c9c27-5858-4cb6-a253-94dcc2ba338c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:49.608398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e35c9c27-5858-4cb6-a253-94dcc2ba338c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:49.609094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e35c9c27-5858-4cb6-a253-94dcc2ba338c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:49.609554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e35c9c27-5858-4cb6-a253-94dcc2ba338c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:49.610010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e35c9c27-5858-4cb6-a253-94dcc2ba338c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:49.639201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e35c9c27-5858-4cb6-a253-94dcc2ba338c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044780 Aug 18 22:08:49.639770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1110/2227] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:49 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:50.650923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-903769ce-56ef-491b-ac80-a66182611dbe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:50.653165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-903769ce-56ef-491b-ac80-a66182611dbe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:50.659382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-903769ce-56ef-491b-ac80-a66182611dbe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:50.659855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-903769ce-56ef-491b-ac80-a66182611dbe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:50.660282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-903769ce-56ef-491b-ac80-a66182611dbe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:50.660962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-903769ce-56ef-491b-ac80-a66182611dbe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:50.661408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-903769ce-56ef-491b-ac80-a66182611dbe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:50.661848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-903769ce-56ef-491b-ac80-a66182611dbe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:50.690380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-903769ce-56ef-491b-ac80-a66182611dbe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043262 Aug 18 22:08:50.690934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1118/2228] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:50 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:51.703067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-988ed03a-79ef-4a75-90ae-52b549be76f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:51.705287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-988ed03a-79ef-4a75-90ae-52b549be76f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:51.707708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:08:51.712912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-988ed03a-79ef-4a75-90ae-52b549be76f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:51.713397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-988ed03a-79ef-4a75-90ae-52b549be76f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:51.713862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-988ed03a-79ef-4a75-90ae-52b549be76f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:51.714555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-988ed03a-79ef-4a75-90ae-52b549be76f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:51.715008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-988ed03a-79ef-4a75-90ae-52b549be76f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:51.715427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-988ed03a-79ef-4a75-90ae-52b549be76f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:51.745781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-988ed03a-79ef-4a75-90ae-52b549be76f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046558 Aug 18 22:08:51.746470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1111/2229] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:51 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:52.758013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c565f5f-ec5f-43d2-bf4d-dad77a070698 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:52.760182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c565f5f-ec5f-43d2-bf4d-dad77a070698 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:52.766620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c565f5f-ec5f-43d2-bf4d-dad77a070698 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:52.767099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c565f5f-ec5f-43d2-bf4d-dad77a070698 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:52.767535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c565f5f-ec5f-43d2-bf4d-dad77a070698 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:52.768229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c565f5f-ec5f-43d2-bf4d-dad77a070698 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:52.768686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c565f5f-ec5f-43d2-bf4d-dad77a070698 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:52.769116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c565f5f-ec5f-43d2-bf4d-dad77a070698 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:52.798290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c565f5f-ec5f-43d2-bf4d-dad77a070698 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044800 Aug 18 22:08:52.798844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1119/2230] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:52 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:53.810468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c9385596-f138-4448-a7ce-756405befe19 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:53.812694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c9385596-f138-4448-a7ce-756405befe19 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:53.819083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9385596-f138-4448-a7ce-756405befe19 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:53.819514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9385596-f138-4448-a7ce-756405befe19 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:53.819956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9385596-f138-4448-a7ce-756405befe19 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:53.820646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9385596-f138-4448-a7ce-756405befe19 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:53.821098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9385596-f138-4448-a7ce-756405befe19 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:53.821525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9385596-f138-4448-a7ce-756405befe19 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:53.851705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c9385596-f138-4448-a7ce-756405befe19 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Aug 18 22:08:53.852271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1112/2231] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:53 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:54.863921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2994a3fe-8cc9-4cd9-8af8-6c732c0aac90 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:54.877757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2994a3fe-8cc9-4cd9-8af8-6c732c0aac90 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:54.880300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=30 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:08:54.886239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2994a3fe-8cc9-4cd9-8af8-6c732c0aac90 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:54.886726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2994a3fe-8cc9-4cd9-8af8-6c732c0aac90 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:54.887167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2994a3fe-8cc9-4cd9-8af8-6c732c0aac90 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:54.887869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2994a3fe-8cc9-4cd9-8af8-6c732c0aac90 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:54.888324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2994a3fe-8cc9-4cd9-8af8-6c732c0aac90 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:54.888751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2994a3fe-8cc9-4cd9-8af8-6c732c0aac90 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:54.921431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2994a3fe-8cc9-4cd9-8af8-6c732c0aac90 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061453 Aug 18 22:08:54.922027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1120/2232] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:54 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:08:55.934207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1b95c47f-a205-4637-84ed-3ff7d45b75f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:55.936408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1b95c47f-a205-4637-84ed-3ff7d45b75f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:55.942737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b95c47f-a205-4637-84ed-3ff7d45b75f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:55.943217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b95c47f-a205-4637-84ed-3ff7d45b75f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:55.943651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b95c47f-a205-4637-84ed-3ff7d45b75f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:55.944994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b95c47f-a205-4637-84ed-3ff7d45b75f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:55.945446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b95c47f-a205-4637-84ed-3ff7d45b75f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:55.945901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b95c47f-a205-4637-84ed-3ff7d45b75f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:55.974284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1b95c47f-a205-4637-84ed-3ff7d45b75f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Aug 18 22:08:55.974833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1113/2233] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:55 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:56.986524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-41b49016-60f3-4155-acab-318121da47cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:56.988661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-41b49016-60f3-4155-acab-318121da47cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:56.995099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41b49016-60f3-4155-acab-318121da47cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:56.995583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41b49016-60f3-4155-acab-318121da47cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:56.996021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41b49016-60f3-4155-acab-318121da47cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:56.996712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41b49016-60f3-4155-acab-318121da47cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:56.997176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41b49016-60f3-4155-acab-318121da47cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:56.997630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41b49016-60f3-4155-acab-318121da47cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:57.027738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-41b49016-60f3-4155-acab-318121da47cc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045272 Aug 18 22:08:57.028302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1121/2234] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:56 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:58.040403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5f8bbb67-d46b-4cbc-8416-6997bb414fed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:58.042627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5f8bbb67-d46b-4cbc-8416-6997bb414fed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:58.048729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f8bbb67-d46b-4cbc-8416-6997bb414fed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:58.049214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f8bbb67-d46b-4cbc-8416-6997bb414fed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:58.049944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f8bbb67-d46b-4cbc-8416-6997bb414fed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:58.050638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f8bbb67-d46b-4cbc-8416-6997bb414fed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:58.051094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f8bbb67-d46b-4cbc-8416-6997bb414fed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:58.051524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f8bbb67-d46b-4cbc-8416-6997bb414fed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:58.080478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5f8bbb67-d46b-4cbc-8416-6997bb414fed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044495 Aug 18 22:08:58.081027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1114/2235] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:58 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:08:59.092272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f6bc8ba2-632c-4433-98e4-070336a7da28 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:08:59.094456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f6bc8ba2-632c-4433-98e4-070336a7da28 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:08:59.100468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6bc8ba2-632c-4433-98e4-070336a7da28 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:59.100950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6bc8ba2-632c-4433-98e4-070336a7da28 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:59.101385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6bc8ba2-632c-4433-98e4-070336a7da28 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:59.102122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6bc8ba2-632c-4433-98e4-070336a7da28 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:08:59.102583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6bc8ba2-632c-4433-98e4-070336a7da28 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:08:59.103008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6bc8ba2-632c-4433-98e4-070336a7da28 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:08:59.132227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f6bc8ba2-632c-4433-98e4-070336a7da28 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043167 Aug 18 22:08:59.132773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1122/2236] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:08:59 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:00.146747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5bafb523-2f54-47cc-9ee7-419679fd9257 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:00.149966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5bafb523-2f54-47cc-9ee7-419679fd9257 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:00.156981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bafb523-2f54-47cc-9ee7-419679fd9257 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:00.157675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bafb523-2f54-47cc-9ee7-419679fd9257 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:00.158152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bafb523-2f54-47cc-9ee7-419679fd9257 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:00.158973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bafb523-2f54-47cc-9ee7-419679fd9257 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:00.159537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bafb523-2f54-47cc-9ee7-419679fd9257 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:00.159972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bafb523-2f54-47cc-9ee7-419679fd9257 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:00.190651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5bafb523-2f54-47cc-9ee7-419679fd9257 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048627 Aug 18 22:09:00.191313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1115/2237] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:00 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:01.203742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c223c6a6-3ee0-460c-8057-15cbf835d3b8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:01.205980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c223c6a6-3ee0-460c-8057-15cbf835d3b8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:01.212830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c223c6a6-3ee0-460c-8057-15cbf835d3b8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:01.213315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c223c6a6-3ee0-460c-8057-15cbf835d3b8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:01.213788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c223c6a6-3ee0-460c-8057-15cbf835d3b8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:01.214486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c223c6a6-3ee0-460c-8057-15cbf835d3b8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:01.214946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c223c6a6-3ee0-460c-8057-15cbf835d3b8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:01.215398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c223c6a6-3ee0-460c-8057-15cbf835d3b8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:01.244819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c223c6a6-3ee0-460c-8057-15cbf835d3b8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044929 Aug 18 22:09:01.245378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1123/2238] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:01 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:02.256265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1c09a9e5-7637-475d-8737-4f7f9a95654e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:02.259359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1c09a9e5-7637-475d-8737-4f7f9a95654e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:02.265969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c09a9e5-7637-475d-8737-4f7f9a95654e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:02.266460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c09a9e5-7637-475d-8737-4f7f9a95654e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:02.266899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c09a9e5-7637-475d-8737-4f7f9a95654e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:02.267797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c09a9e5-7637-475d-8737-4f7f9a95654e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:02.268265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c09a9e5-7637-475d-8737-4f7f9a95654e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:02.268699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c09a9e5-7637-475d-8737-4f7f9a95654e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:02.298529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1c09a9e5-7637-475d-8737-4f7f9a95654e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046179 Aug 18 22:09:02.299090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1116/2239] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:03.310534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ed4bc9e-06ae-403d-a770-649231cbe0c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:03.312685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ed4bc9e-06ae-403d-a770-649231cbe0c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:03.319046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ed4bc9e-06ae-403d-a770-649231cbe0c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:03.319522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ed4bc9e-06ae-403d-a770-649231cbe0c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:03.319953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ed4bc9e-06ae-403d-a770-649231cbe0c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:03.320638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ed4bc9e-06ae-403d-a770-649231cbe0c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:03.321089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ed4bc9e-06ae-403d-a770-649231cbe0c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:03.321511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ed4bc9e-06ae-403d-a770-649231cbe0c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:03.349359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ed4bc9e-06ae-403d-a770-649231cbe0c8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042705 Aug 18 22:09:03.350442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1124/2240] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:04.361976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7e5cae2-f5bd-4bd7-9402-9331f9380cda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:04.364220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f7e5cae2-f5bd-4bd7-9402-9331f9380cda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:04.371796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7e5cae2-f5bd-4bd7-9402-9331f9380cda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:04.372311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7e5cae2-f5bd-4bd7-9402-9331f9380cda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:04.372761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7e5cae2-f5bd-4bd7-9402-9331f9380cda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:04.373689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7e5cae2-f5bd-4bd7-9402-9331f9380cda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:04.374157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7e5cae2-f5bd-4bd7-9402-9331f9380cda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:04.374595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7e5cae2-f5bd-4bd7-9402-9331f9380cda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:04.377014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=90 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:09:04.404822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f7e5cae2-f5bd-4bd7-9402-9331f9380cda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046717 Aug 18 22:09:04.405436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1117/2241] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:05.416315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6c5c9334-e355-45f6-95e9-23a4f86c3133 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:05.418481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6c5c9334-e355-45f6-95e9-23a4f86c3133 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:05.425018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c5c9334-e355-45f6-95e9-23a4f86c3133 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:05.425496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c5c9334-e355-45f6-95e9-23a4f86c3133 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:05.425960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c5c9334-e355-45f6-95e9-23a4f86c3133 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:05.426678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c5c9334-e355-45f6-95e9-23a4f86c3133 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:05.427134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c5c9334-e355-45f6-95e9-23a4f86c3133 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:05.427561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c5c9334-e355-45f6-95e9-23a4f86c3133 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:05.456560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6c5c9334-e355-45f6-95e9-23a4f86c3133 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044121 Aug 18 22:09:05.457105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1125/2242] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:06.468543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-46d4a6a4-be36-4eb9-897d-d3a48a6533af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:06.471005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46d4a6a4-be36-4eb9-897d-d3a48a6533af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:06.478049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46d4a6a4-be36-4eb9-897d-d3a48a6533af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:06.478542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46d4a6a4-be36-4eb9-897d-d3a48a6533af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:06.478987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46d4a6a4-be36-4eb9-897d-d3a48a6533af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:06.479732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46d4a6a4-be36-4eb9-897d-d3a48a6533af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:06.480188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46d4a6a4-be36-4eb9-897d-d3a48a6533af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:06.480617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46d4a6a4-be36-4eb9-897d-d3a48a6533af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:06.509566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-46d4a6a4-be36-4eb9-897d-d3a48a6533af tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045160 Aug 18 22:09:06.510147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1118/2243] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:07.521494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9bd8a054-36a0-4cde-ae5a-6e3033b86461 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:07.523746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9bd8a054-36a0-4cde-ae5a-6e3033b86461 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:07.530265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd8a054-36a0-4cde-ae5a-6e3033b86461 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:07.530748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd8a054-36a0-4cde-ae5a-6e3033b86461 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:07.531254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd8a054-36a0-4cde-ae5a-6e3033b86461 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:07.531868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd8a054-36a0-4cde-ae5a-6e3033b86461 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:07.532322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd8a054-36a0-4cde-ae5a-6e3033b86461 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:07.532746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd8a054-36a0-4cde-ae5a-6e3033b86461 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:07.562912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9bd8a054-36a0-4cde-ae5a-6e3033b86461 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045289 Aug 18 22:09:07.563465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1126/2244] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:07 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:08.575367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0c2fccdf-4590-4b4d-b452-f168fbbbf3d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:08.577684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0c2fccdf-4590-4b4d-b452-f168fbbbf3d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:08.584876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c2fccdf-4590-4b4d-b452-f168fbbbf3d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:08.585343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c2fccdf-4590-4b4d-b452-f168fbbbf3d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:08.585829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c2fccdf-4590-4b4d-b452-f168fbbbf3d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:08.586529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c2fccdf-4590-4b4d-b452-f168fbbbf3d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:08.586988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c2fccdf-4590-4b4d-b452-f168fbbbf3d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:08.587422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c2fccdf-4590-4b4d-b452-f168fbbbf3d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:08.617872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0c2fccdf-4590-4b4d-b452-f168fbbbf3d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046360 Aug 18 22:09:08.618445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1119/2245] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:09.629631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b228fdc0-f65d-491a-8ae4-25be69bb5019 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:09.631762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b228fdc0-f65d-491a-8ae4-25be69bb5019 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:09.638028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b228fdc0-f65d-491a-8ae4-25be69bb5019 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:09.638188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b228fdc0-f65d-491a-8ae4-25be69bb5019 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:09.638618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b228fdc0-f65d-491a-8ae4-25be69bb5019 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:09.639302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b228fdc0-f65d-491a-8ae4-25be69bb5019 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:09.639746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b228fdc0-f65d-491a-8ae4-25be69bb5019 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:09.640165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b228fdc0-f65d-491a-8ae4-25be69bb5019 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:09.670842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b228fdc0-f65d-491a-8ae4-25be69bb5019 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044957 Aug 18 22:09:09.671591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1127/2246] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:10.683957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6bbaf2cc-ad21-4cac-903a-1b1ee28cf3bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:10.686191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6bbaf2cc-ad21-4cac-903a-1b1ee28cf3bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:10.692525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bbaf2cc-ad21-4cac-903a-1b1ee28cf3bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:10.693003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bbaf2cc-ad21-4cac-903a-1b1ee28cf3bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:10.693883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bbaf2cc-ad21-4cac-903a-1b1ee28cf3bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:10.694792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bbaf2cc-ad21-4cac-903a-1b1ee28cf3bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:10.695261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bbaf2cc-ad21-4cac-903a-1b1ee28cf3bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:10.695672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bbaf2cc-ad21-4cac-903a-1b1ee28cf3bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:10.725825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6bbaf2cc-ad21-4cac-903a-1b1ee28cf3bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045030 Aug 18 22:09:10.726422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1120/2247] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:10 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:11.737513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bb58be1f-9130-4454-a7f7-cbd55d2f81c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:11.739784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bb58be1f-9130-4454-a7f7-cbd55d2f81c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:11.746815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb58be1f-9130-4454-a7f7-cbd55d2f81c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:11.747303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb58be1f-9130-4454-a7f7-cbd55d2f81c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:11.747743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb58be1f-9130-4454-a7f7-cbd55d2f81c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:11.748443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb58be1f-9130-4454-a7f7-cbd55d2f81c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:11.748901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb58be1f-9130-4454-a7f7-cbd55d2f81c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:11.749327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb58be1f-9130-4454-a7f7-cbd55d2f81c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:11.779034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bb58be1f-9130-4454-a7f7-cbd55d2f81c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045497 Aug 18 22:09:11.779593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1128/2248] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:12.791083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-79f99acb-2b68-4590-bb5c-184ab3483e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:12.793395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-79f99acb-2b68-4590-bb5c-184ab3483e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:12.800294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79f99acb-2b68-4590-bb5c-184ab3483e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:12.800775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79f99acb-2b68-4590-bb5c-184ab3483e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:12.801212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79f99acb-2b68-4590-bb5c-184ab3483e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:12.801929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79f99acb-2b68-4590-bb5c-184ab3483e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:12.802410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79f99acb-2b68-4590-bb5c-184ab3483e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:12.802844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-79f99acb-2b68-4590-bb5c-184ab3483e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:12.831834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-79f99acb-2b68-4590-bb5c-184ab3483e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044646 Aug 18 22:09:12.832341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1121/2249] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:12 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:13.843886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8f549916-a04f-45e9-89fe-b0fe09b8e3f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:13.846140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8f549916-a04f-45e9-89fe-b0fe09b8e3f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:13.859683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f549916-a04f-45e9-89fe-b0fe09b8e3f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:13.860824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f549916-a04f-45e9-89fe-b0fe09b8e3f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:13.860824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f549916-a04f-45e9-89fe-b0fe09b8e3f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:13.861340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f549916-a04f-45e9-89fe-b0fe09b8e3f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:13.861834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f549916-a04f-45e9-89fe-b0fe09b8e3f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:13.862262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f549916-a04f-45e9-89fe-b0fe09b8e3f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:13.895928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8f549916-a04f-45e9-89fe-b0fe09b8e3f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055853 Aug 18 22:09:13.896514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1129/2250] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:14.908738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3b15b96e-808f-40b0-b883-1244c17bdb57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:14.911052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3b15b96e-808f-40b0-b883-1244c17bdb57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:14.918750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b15b96e-808f-40b0-b883-1244c17bdb57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:14.919231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b15b96e-808f-40b0-b883-1244c17bdb57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:14.919668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b15b96e-808f-40b0-b883-1244c17bdb57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:14.920365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b15b96e-808f-40b0-b883-1244c17bdb57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:14.921442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b15b96e-808f-40b0-b883-1244c17bdb57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:14.922359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b15b96e-808f-40b0-b883-1244c17bdb57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:14.956499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3b15b96e-808f-40b0-b883-1244c17bdb57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051721 Aug 18 22:09:14.957071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1122/2251] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:15.968454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-96dafd17-6756-4a25-92c6-55e112fe4f22 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:15.970609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-96dafd17-6756-4a25-92c6-55e112fe4f22 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:15.976693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96dafd17-6756-4a25-92c6-55e112fe4f22 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:15.977660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96dafd17-6756-4a25-92c6-55e112fe4f22 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:15.978102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96dafd17-6756-4a25-92c6-55e112fe4f22 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:15.978801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96dafd17-6756-4a25-92c6-55e112fe4f22 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:15.979258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96dafd17-6756-4a25-92c6-55e112fe4f22 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:15.979689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96dafd17-6756-4a25-92c6-55e112fe4f22 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:16.009168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-96dafd17-6756-4a25-92c6-55e112fe4f22 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044702 Aug 18 22:09:16.009758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1130/2252] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:15 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:17.020263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-02e2598c-72e6-4325-84fb-577fe5289e1a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:17.022504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-02e2598c-72e6-4325-84fb-577fe5289e1a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:17.028833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02e2598c-72e6-4325-84fb-577fe5289e1a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:17.029316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02e2598c-72e6-4325-84fb-577fe5289e1a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:17.029790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02e2598c-72e6-4325-84fb-577fe5289e1a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:17.030479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02e2598c-72e6-4325-84fb-577fe5289e1a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:17.030942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02e2598c-72e6-4325-84fb-577fe5289e1a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:17.031368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02e2598c-72e6-4325-84fb-577fe5289e1a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:17.061539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-02e2598c-72e6-4325-84fb-577fe5289e1a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045126 Aug 18 22:09:17.062132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1123/2253] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:17 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:18.074462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ff245d13-57a2-4c30-955e-a1419e0e66dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:18.076584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ff245d13-57a2-4c30-955e-a1419e0e66dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:18.083036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff245d13-57a2-4c30-955e-a1419e0e66dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:18.083506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff245d13-57a2-4c30-955e-a1419e0e66dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:18.083981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff245d13-57a2-4c30-955e-a1419e0e66dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:18.084644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff245d13-57a2-4c30-955e-a1419e0e66dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:18.085094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff245d13-57a2-4c30-955e-a1419e0e66dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:18.085512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff245d13-57a2-4c30-955e-a1419e0e66dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:18.088578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=90 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:09:18.116134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ff245d13-57a2-4c30-955e-a1419e0e66dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046024 Aug 18 22:09:18.116914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1131/2254] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:18 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:19.128150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2faa82a2-8576-4dc8-afc3-accf629de46e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:19.130579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2faa82a2-8576-4dc8-afc3-accf629de46e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:19.137930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2faa82a2-8576-4dc8-afc3-accf629de46e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:19.138419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2faa82a2-8576-4dc8-afc3-accf629de46e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:19.138861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2faa82a2-8576-4dc8-afc3-accf629de46e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:19.139563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2faa82a2-8576-4dc8-afc3-accf629de46e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:19.140021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2faa82a2-8576-4dc8-afc3-accf629de46e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:19.140446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2faa82a2-8576-4dc8-afc3-accf629de46e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:19.171721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2faa82a2-8576-4dc8-afc3-accf629de46e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047373 Aug 18 22:09:19.172473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1124/2255] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:19 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:20.184462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6443130b-f6c0-495f-9278-93754909e140 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:20.186747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6443130b-f6c0-495f-9278-93754909e140 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:20.192947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6443130b-f6c0-495f-9278-93754909e140 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:20.194100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6443130b-f6c0-495f-9278-93754909e140 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:20.194100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6443130b-f6c0-495f-9278-93754909e140 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:20.194559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6443130b-f6c0-495f-9278-93754909e140 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:20.195009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6443130b-f6c0-495f-9278-93754909e140 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:20.196146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6443130b-f6c0-495f-9278-93754909e140 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:20.224906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6443130b-f6c0-495f-9278-93754909e140 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Aug 18 22:09:20.225385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1132/2256] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:20 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:21.237641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-786b66c3-5d69-40a3-b47d-0afd897e0bb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:21.239924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-786b66c3-5d69-40a3-b47d-0afd897e0bb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:21.246372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-786b66c3-5d69-40a3-b47d-0afd897e0bb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:21.246860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-786b66c3-5d69-40a3-b47d-0afd897e0bb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:21.247296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-786b66c3-5d69-40a3-b47d-0afd897e0bb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:21.247987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-786b66c3-5d69-40a3-b47d-0afd897e0bb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:21.248443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-786b66c3-5d69-40a3-b47d-0afd897e0bb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:21.248870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-786b66c3-5d69-40a3-b47d-0afd897e0bb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:21.278736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-786b66c3-5d69-40a3-b47d-0afd897e0bb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Aug 18 22:09:21.279312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1125/2257] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:22.290530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6495b549-466a-4b39-857e-f7f040f1e7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:22.292674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6495b549-466a-4b39-857e-f7f040f1e7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:22.299012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6495b549-466a-4b39-857e-f7f040f1e7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:22.299753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6495b549-466a-4b39-857e-f7f040f1e7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:22.300181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6495b549-466a-4b39-857e-f7f040f1e7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:22.300900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6495b549-466a-4b39-857e-f7f040f1e7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:22.301359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6495b549-466a-4b39-857e-f7f040f1e7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:22.301812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6495b549-466a-4b39-857e-f7f040f1e7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:22.330197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6495b549-466a-4b39-857e-f7f040f1e7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Aug 18 22:09:22.330763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1133/2258] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:23.342579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fcdf4bad-6458-48a2-9559-648e024b1ec5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:23.344806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fcdf4bad-6458-48a2-9559-648e024b1ec5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:23.347231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:09:23.353258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcdf4bad-6458-48a2-9559-648e024b1ec5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:23.353781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcdf4bad-6458-48a2-9559-648e024b1ec5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:23.354221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcdf4bad-6458-48a2-9559-648e024b1ec5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:23.355136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcdf4bad-6458-48a2-9559-648e024b1ec5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:23.355616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcdf4bad-6458-48a2-9559-648e024b1ec5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:23.356079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcdf4bad-6458-48a2-9559-648e024b1ec5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:23.391082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fcdf4bad-6458-48a2-9559-648e024b1ec5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052349 Aug 18 22:09:23.391818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1126/2259] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:23 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:24.403175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-71b6d2ab-5fde-4f1a-a55b-da3823ae7157 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:24.405392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-71b6d2ab-5fde-4f1a-a55b-da3823ae7157 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:24.411824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71b6d2ab-5fde-4f1a-a55b-da3823ae7157 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:24.412306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71b6d2ab-5fde-4f1a-a55b-da3823ae7157 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:24.412792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71b6d2ab-5fde-4f1a-a55b-da3823ae7157 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:24.413436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71b6d2ab-5fde-4f1a-a55b-da3823ae7157 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:24.413925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71b6d2ab-5fde-4f1a-a55b-da3823ae7157 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:24.414354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71b6d2ab-5fde-4f1a-a55b-da3823ae7157 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:24.444087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-71b6d2ab-5fde-4f1a-a55b-da3823ae7157 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044866 Aug 18 22:09:24.444649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1134/2260] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:25.456237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1e01f781-c86e-480f-b5cb-50fc1eb4d987 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:25.458671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1e01f781-c86e-480f-b5cb-50fc1eb4d987 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:25.465848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e01f781-c86e-480f-b5cb-50fc1eb4d987 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:25.466325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e01f781-c86e-480f-b5cb-50fc1eb4d987 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:25.466756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e01f781-c86e-480f-b5cb-50fc1eb4d987 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:25.467448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e01f781-c86e-480f-b5cb-50fc1eb4d987 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:25.467899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e01f781-c86e-480f-b5cb-50fc1eb4d987 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:25.468319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e01f781-c86e-480f-b5cb-50fc1eb4d987 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:25.498356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1e01f781-c86e-480f-b5cb-50fc1eb4d987 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045903 Aug 18 22:09:25.498935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1127/2261] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:26.511117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4777aaa6-407b-41bf-8ec6-d7c48e218c9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:26.513260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4777aaa6-407b-41bf-8ec6-d7c48e218c9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:26.515601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=30 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:09:26.520831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4777aaa6-407b-41bf-8ec6-d7c48e218c9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:26.521369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4777aaa6-407b-41bf-8ec6-d7c48e218c9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:26.522056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4777aaa6-407b-41bf-8ec6-d7c48e218c9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:26.522668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4777aaa6-407b-41bf-8ec6-d7c48e218c9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:26.523129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4777aaa6-407b-41bf-8ec6-d7c48e218c9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:26.523557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4777aaa6-407b-41bf-8ec6-d7c48e218c9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:26.553830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4777aaa6-407b-41bf-8ec6-d7c48e218c9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046943 Aug 18 22:09:26.554395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1135/2262] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:26 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:27.566691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4f7b5b09-4aeb-4792-b635-68322eebd794 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:27.569260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4f7b5b09-4aeb-4792-b635-68322eebd794 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:27.576343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f7b5b09-4aeb-4792-b635-68322eebd794 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:27.576832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f7b5b09-4aeb-4792-b635-68322eebd794 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:27.577273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f7b5b09-4aeb-4792-b635-68322eebd794 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:27.578134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f7b5b09-4aeb-4792-b635-68322eebd794 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:27.578595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f7b5b09-4aeb-4792-b635-68322eebd794 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:27.579032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f7b5b09-4aeb-4792-b635-68322eebd794 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:27.608583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4f7b5b09-4aeb-4792-b635-68322eebd794 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045758 Aug 18 22:09:27.612783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1128/2263] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:28.620907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1388fd98-b432-4537-a171-78dffd975fff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:28.623100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1388fd98-b432-4537-a171-78dffd975fff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:28.630295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1388fd98-b432-4537-a171-78dffd975fff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:28.630775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1388fd98-b432-4537-a171-78dffd975fff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:28.631208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1388fd98-b432-4537-a171-78dffd975fff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:28.631895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1388fd98-b432-4537-a171-78dffd975fff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:28.632344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1388fd98-b432-4537-a171-78dffd975fff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:28.633257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1388fd98-b432-4537-a171-78dffd975fff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:28.663730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1388fd98-b432-4537-a171-78dffd975fff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046741 Aug 18 22:09:28.664975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1136/2264] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:29.676424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-96dbc78b-a59f-4291-81a7-477a8a7e15e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:29.678886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-96dbc78b-a59f-4291-81a7-477a8a7e15e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:29.685103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-96dbc78b-a59f-4291-81a7-477a8a7e15e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:29.685711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-96dbc78b-a59f-4291-81a7-477a8a7e15e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:29.686154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-96dbc78b-a59f-4291-81a7-477a8a7e15e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:29.686882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-96dbc78b-a59f-4291-81a7-477a8a7e15e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:29.687367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-96dbc78b-a59f-4291-81a7-477a8a7e15e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:29.687797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-96dbc78b-a59f-4291-81a7-477a8a7e15e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:29.719541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-96dbc78b-a59f-4291-81a7-477a8a7e15e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047197 Aug 18 22:09:29.720321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1129/2265] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:29 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:30.732123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b0ba4f58-1783-483b-8d9d-e57a6738b6ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:30.734293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b0ba4f58-1783-483b-8d9d-e57a6738b6ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:30.741106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0ba4f58-1783-483b-8d9d-e57a6738b6ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:30.741329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0ba4f58-1783-483b-8d9d-e57a6738b6ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:30.742196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0ba4f58-1783-483b-8d9d-e57a6738b6ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:30.742964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0ba4f58-1783-483b-8d9d-e57a6738b6ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:30.744022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0ba4f58-1783-483b-8d9d-e57a6738b6ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:30.744455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0ba4f58-1783-483b-8d9d-e57a6738b6ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:30.773620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b0ba4f58-1783-483b-8d9d-e57a6738b6ae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045359 Aug 18 22:09:30.774239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1137/2266] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:31.785546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5cf0c9af-2bcd-4b31-91ab-23b72a30cd50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:31.787984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5cf0c9af-2bcd-4b31-91ab-23b72a30cd50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:31.794620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cf0c9af-2bcd-4b31-91ab-23b72a30cd50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:31.795098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cf0c9af-2bcd-4b31-91ab-23b72a30cd50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:31.795534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cf0c9af-2bcd-4b31-91ab-23b72a30cd50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:31.796267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cf0c9af-2bcd-4b31-91ab-23b72a30cd50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:31.796754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cf0c9af-2bcd-4b31-91ab-23b72a30cd50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:31.797178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5cf0c9af-2bcd-4b31-91ab-23b72a30cd50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:31.828250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5cf0c9af-2bcd-4b31-91ab-23b72a30cd50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046487 Aug 18 22:09:31.828818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1130/2267] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:32.840800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f5053e15-4d14-4c51-9e11-0b6f3e34bdc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:32.843004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f5053e15-4d14-4c51-9e11-0b6f3e34bdc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:32.849347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5053e15-4d14-4c51-9e11-0b6f3e34bdc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:32.849879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5053e15-4d14-4c51-9e11-0b6f3e34bdc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:32.850323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5053e15-4d14-4c51-9e11-0b6f3e34bdc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:32.851026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5053e15-4d14-4c51-9e11-0b6f3e34bdc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:32.852062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5053e15-4d14-4c51-9e11-0b6f3e34bdc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:32.852497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5053e15-4d14-4c51-9e11-0b6f3e34bdc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:32.881896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f5053e15-4d14-4c51-9e11-0b6f3e34bdc1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044976 Aug 18 22:09:32.882607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1138/2268] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:33.894269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ece0c141-7383-478c-a3ac-9a349b444db9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:33.897325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ece0c141-7383-478c-a3ac-9a349b444db9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:33.903675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ece0c141-7383-478c-a3ac-9a349b444db9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:33.904238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ece0c141-7383-478c-a3ac-9a349b444db9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:33.904745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ece0c141-7383-478c-a3ac-9a349b444db9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:33.905481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ece0c141-7383-478c-a3ac-9a349b444db9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:33.905983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ece0c141-7383-478c-a3ac-9a349b444db9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:33.906410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ece0c141-7383-478c-a3ac-9a349b444db9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:33.937279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ece0c141-7383-478c-a3ac-9a349b444db9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047085 Aug 18 22:09:33.938105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1131/2269] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:34.949485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-763fc773-17e6-4667-9f97-8a94ae32cb7c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:34.951632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-763fc773-17e6-4667-9f97-8a94ae32cb7c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:34.958102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-763fc773-17e6-4667-9f97-8a94ae32cb7c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:34.958576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-763fc773-17e6-4667-9f97-8a94ae32cb7c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:34.959005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-763fc773-17e6-4667-9f97-8a94ae32cb7c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:34.959685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-763fc773-17e6-4667-9f97-8a94ae32cb7c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:34.960132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-763fc773-17e6-4667-9f97-8a94ae32cb7c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:34.960552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-763fc773-17e6-4667-9f97-8a94ae32cb7c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:34.990688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-763fc773-17e6-4667-9f97-8a94ae32cb7c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045670 Aug 18 22:09:34.991258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1139/2270] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:36.002806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07bcd666-c9da-449b-81bc-dc97186860c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:36.005197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07bcd666-c9da-449b-81bc-dc97186860c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:36.012152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07bcd666-c9da-449b-81bc-dc97186860c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:36.012650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07bcd666-c9da-449b-81bc-dc97186860c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:36.013093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07bcd666-c9da-449b-81bc-dc97186860c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:36.013880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07bcd666-c9da-449b-81bc-dc97186860c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:36.014338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07bcd666-c9da-449b-81bc-dc97186860c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:36.014793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07bcd666-c9da-449b-81bc-dc97186860c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:36.017188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=90 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:09:36.045958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07bcd666-c9da-449b-81bc-dc97186860c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047078 Aug 18 22:09:36.046526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1132/2271] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:35 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:37.058898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e6f8bc92-153b-4a30-9b63-6078c8c1908e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:37.061082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e6f8bc92-153b-4a30-9b63-6078c8c1908e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:37.067485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6f8bc92-153b-4a30-9b63-6078c8c1908e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:37.067975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6f8bc92-153b-4a30-9b63-6078c8c1908e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:37.068418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6f8bc92-153b-4a30-9b63-6078c8c1908e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:37.069318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6f8bc92-153b-4a30-9b63-6078c8c1908e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:37.069815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6f8bc92-153b-4a30-9b63-6078c8c1908e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:37.071724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6f8bc92-153b-4a30-9b63-6078c8c1908e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:37.102719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e6f8bc92-153b-4a30-9b63-6078c8c1908e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048397 Aug 18 22:09:37.103286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1140/2272] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:37 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:38.115178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4eae1a8c-eed4-455a-a762-454a28dd4dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:38.118147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4eae1a8c-eed4-455a-a762-454a28dd4dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:38.124597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eae1a8c-eed4-455a-a762-454a28dd4dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:38.125088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eae1a8c-eed4-455a-a762-454a28dd4dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:38.125531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eae1a8c-eed4-455a-a762-454a28dd4dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:38.126399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eae1a8c-eed4-455a-a762-454a28dd4dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:38.126720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eae1a8c-eed4-455a-a762-454a28dd4dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:38.127151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eae1a8c-eed4-455a-a762-454a28dd4dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:38.157220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4eae1a8c-eed4-455a-a762-454a28dd4dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045941 Aug 18 22:09:38.157817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1133/2273] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:38 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:39.170004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c63f53ae-fb5e-4ed1-a0dc-a31855acf623 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:39.172088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c63f53ae-fb5e-4ed1-a0dc-a31855acf623 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:39.178988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c63f53ae-fb5e-4ed1-a0dc-a31855acf623 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:39.179496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c63f53ae-fb5e-4ed1-a0dc-a31855acf623 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:39.180044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c63f53ae-fb5e-4ed1-a0dc-a31855acf623 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:39.180623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c63f53ae-fb5e-4ed1-a0dc-a31855acf623 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:39.181083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c63f53ae-fb5e-4ed1-a0dc-a31855acf623 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:39.181511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c63f53ae-fb5e-4ed1-a0dc-a31855acf623 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:39.211406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c63f53ae-fb5e-4ed1-a0dc-a31855acf623 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044871 Aug 18 22:09:39.211982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1141/2274] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:39 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:40.223726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c05eaa3a-44cf-45ba-a37f-6c8c71e073b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:40.226037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c05eaa3a-44cf-45ba-a37f-6c8c71e073b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:40.232970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c05eaa3a-44cf-45ba-a37f-6c8c71e073b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:40.233454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c05eaa3a-44cf-45ba-a37f-6c8c71e073b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:40.233926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c05eaa3a-44cf-45ba-a37f-6c8c71e073b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:40.234622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c05eaa3a-44cf-45ba-a37f-6c8c71e073b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:40.235080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c05eaa3a-44cf-45ba-a37f-6c8c71e073b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:40.235504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c05eaa3a-44cf-45ba-a37f-6c8c71e073b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:40.265012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c05eaa3a-44cf-45ba-a37f-6c8c71e073b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 Aug 18 22:09:40.265573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1134/2275] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:40 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:41.277237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b802156e-8429-48b4-9b04-fbb4742c3743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:41.279435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b802156e-8429-48b4-9b04-fbb4742c3743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:41.285739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b802156e-8429-48b4-9b04-fbb4742c3743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:41.286217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b802156e-8429-48b4-9b04-fbb4742c3743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:41.286653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b802156e-8429-48b4-9b04-fbb4742c3743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:41.287344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b802156e-8429-48b4-9b04-fbb4742c3743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:41.287800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b802156e-8429-48b4-9b04-fbb4742c3743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:41.288227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b802156e-8429-48b4-9b04-fbb4742c3743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:41.318501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b802156e-8429-48b4-9b04-fbb4742c3743 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045173 Aug 18 22:09:41.319070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1142/2276] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:41 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:42.330764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-97aa3f8a-2cb1-4819-be16-2b0a8f9f211a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:42.333040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-97aa3f8a-2cb1-4819-be16-2b0a8f9f211a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:42.339602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97aa3f8a-2cb1-4819-be16-2b0a8f9f211a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:42.340089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97aa3f8a-2cb1-4819-be16-2b0a8f9f211a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:42.340559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97aa3f8a-2cb1-4819-be16-2b0a8f9f211a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:42.341255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97aa3f8a-2cb1-4819-be16-2b0a8f9f211a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:42.341743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97aa3f8a-2cb1-4819-be16-2b0a8f9f211a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:42.342177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97aa3f8a-2cb1-4819-be16-2b0a8f9f211a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:42.374968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-97aa3f8a-2cb1-4819-be16-2b0a8f9f211a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048169 Aug 18 22:09:42.375526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1135/2277] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:43.387177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-575a05e0-b1fb-45d4-ba43-3e1dae1ea6de tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:43.389293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-575a05e0-b1fb-45d4-ba43-3e1dae1ea6de tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:43.395769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-575a05e0-b1fb-45d4-ba43-3e1dae1ea6de tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:43.396243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-575a05e0-b1fb-45d4-ba43-3e1dae1ea6de tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:43.396674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-575a05e0-b1fb-45d4-ba43-3e1dae1ea6de tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:43.397348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-575a05e0-b1fb-45d4-ba43-3e1dae1ea6de tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:43.397836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-575a05e0-b1fb-45d4-ba43-3e1dae1ea6de tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:43.398746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-575a05e0-b1fb-45d4-ba43-3e1dae1ea6de tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:43.428446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-575a05e0-b1fb-45d4-ba43-3e1dae1ea6de tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045184 Aug 18 22:09:43.429007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1143/2278] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:43 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:44.440073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f61953c3-e72c-4d5c-be76-01428e831078 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:44.442414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f61953c3-e72c-4d5c-be76-01428e831078 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:44.448902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f61953c3-e72c-4d5c-be76-01428e831078 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:44.449392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f61953c3-e72c-4d5c-be76-01428e831078 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:44.449877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f61953c3-e72c-4d5c-be76-01428e831078 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:44.450576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f61953c3-e72c-4d5c-be76-01428e831078 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:44.451036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f61953c3-e72c-4d5c-be76-01428e831078 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:44.451468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f61953c3-e72c-4d5c-be76-01428e831078 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:44.480356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f61953c3-e72c-4d5c-be76-01428e831078 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044271 Aug 18 22:09:44.480920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1136/2279] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:44 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:45.492888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-597c717b-59c2-4af7-9ecc-f0edb8a34e8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:45.494942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-597c717b-59c2-4af7-9ecc-f0edb8a34e8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:45.500994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-597c717b-59c2-4af7-9ecc-f0edb8a34e8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:45.501469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-597c717b-59c2-4af7-9ecc-f0edb8a34e8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:45.501933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-597c717b-59c2-4af7-9ecc-f0edb8a34e8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:45.502614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-597c717b-59c2-4af7-9ecc-f0edb8a34e8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:45.503064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-597c717b-59c2-4af7-9ecc-f0edb8a34e8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:45.503485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-597c717b-59c2-4af7-9ecc-f0edb8a34e8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:45.533781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-597c717b-59c2-4af7-9ecc-f0edb8a34e8e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045322 Aug 18 22:09:45.534335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1144/2280] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:46.544838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6ea68fef-d356-487c-a7b1-50d383695044 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:46.547153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6ea68fef-d356-487c-a7b1-50d383695044 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:46.553833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ea68fef-d356-487c-a7b1-50d383695044 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:46.554358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ea68fef-d356-487c-a7b1-50d383695044 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:46.554796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ea68fef-d356-487c-a7b1-50d383695044 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:46.555492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ea68fef-d356-487c-a7b1-50d383695044 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:46.555956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ea68fef-d356-487c-a7b1-50d383695044 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:46.556389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ea68fef-d356-487c-a7b1-50d383695044 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:46.585162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6ea68fef-d356-487c-a7b1-50d383695044 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Aug 18 22:09:46.586310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1137/2281] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:46 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:47.597917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8d78063b-cdc9-49ed-9538-a683fe44bd06 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:47.600100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8d78063b-cdc9-49ed-9538-a683fe44bd06 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:47.606995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d78063b-cdc9-49ed-9538-a683fe44bd06 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:47.607471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d78063b-cdc9-49ed-9538-a683fe44bd06 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:47.607908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d78063b-cdc9-49ed-9538-a683fe44bd06 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:47.608590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d78063b-cdc9-49ed-9538-a683fe44bd06 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:47.609044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d78063b-cdc9-49ed-9538-a683fe44bd06 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:47.609468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d78063b-cdc9-49ed-9538-a683fe44bd06 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:47.637986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8d78063b-cdc9-49ed-9538-a683fe44bd06 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043923 Aug 18 22:09:47.638550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1145/2282] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:47 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:48.650201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-04fb47b3-d322-4803-a7bb-aa44a651ca7f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:48.652584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-04fb47b3-d322-4803-a7bb-aa44a651ca7f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:48.659029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04fb47b3-d322-4803-a7bb-aa44a651ca7f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:48.659461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04fb47b3-d322-4803-a7bb-aa44a651ca7f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:48.659901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04fb47b3-d322-4803-a7bb-aa44a651ca7f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:48.660592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04fb47b3-d322-4803-a7bb-aa44a651ca7f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:48.661048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04fb47b3-d322-4803-a7bb-aa44a651ca7f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:48.661479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04fb47b3-d322-4803-a7bb-aa44a651ca7f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:48.691502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-04fb47b3-d322-4803-a7bb-aa44a651ca7f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Aug 18 22:09:48.692056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1138/2283] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:48 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:49.704438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c7a13e88-7c03-4f9a-9056-e5ff30c826c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:49.706708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c7a13e88-7c03-4f9a-9056-e5ff30c826c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:49.713924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7a13e88-7c03-4f9a-9056-e5ff30c826c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:49.714337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7a13e88-7c03-4f9a-9056-e5ff30c826c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:49.714763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7a13e88-7c03-4f9a-9056-e5ff30c826c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:49.715478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7a13e88-7c03-4f9a-9056-e5ff30c826c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:49.715928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7a13e88-7c03-4f9a-9056-e5ff30c826c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:49.716350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7a13e88-7c03-4f9a-9056-e5ff30c826c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:49.719201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=90 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:09:49.745727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c7a13e88-7c03-4f9a-9056-e5ff30c826c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Aug 18 22:09:49.746275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1146/2284] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:49 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:50.757905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cd36354c-b193-4f2b-9057-3f10a7596964 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:50.760248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cd36354c-b193-4f2b-9057-3f10a7596964 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:50.766686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd36354c-b193-4f2b-9057-3f10a7596964 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:50.767177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd36354c-b193-4f2b-9057-3f10a7596964 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:50.767625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd36354c-b193-4f2b-9057-3f10a7596964 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:50.768367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd36354c-b193-4f2b-9057-3f10a7596964 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:50.768776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd36354c-b193-4f2b-9057-3f10a7596964 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:50.769207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd36354c-b193-4f2b-9057-3f10a7596964 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:50.800155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cd36354c-b193-4f2b-9057-3f10a7596964 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Aug 18 22:09:50.800727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1139/2285] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:50 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:51.812405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb079d2c-904d-442f-bc97-f3683291a06a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:51.814591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fb079d2c-904d-442f-bc97-f3683291a06a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:51.821020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb079d2c-904d-442f-bc97-f3683291a06a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:51.821503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb079d2c-904d-442f-bc97-f3683291a06a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:51.821978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb079d2c-904d-442f-bc97-f3683291a06a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:51.822673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb079d2c-904d-442f-bc97-f3683291a06a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:51.823128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb079d2c-904d-442f-bc97-f3683291a06a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:51.823552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb079d2c-904d-442f-bc97-f3683291a06a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:51.854350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fb079d2c-904d-442f-bc97-f3683291a06a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045891 Aug 18 22:09:51.854911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1147/2286] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:51 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:52.866993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6919a9c4-fc77-4d38-be80-8abd06c9ab7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:52.869336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6919a9c4-fc77-4d38-be80-8abd06c9ab7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:52.875675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6919a9c4-fc77-4d38-be80-8abd06c9ab7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:52.876153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6919a9c4-fc77-4d38-be80-8abd06c9ab7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:52.876589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6919a9c4-fc77-4d38-be80-8abd06c9ab7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:52.877270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6919a9c4-fc77-4d38-be80-8abd06c9ab7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:52.877752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6919a9c4-fc77-4d38-be80-8abd06c9ab7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:52.878179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6919a9c4-fc77-4d38-be80-8abd06c9ab7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:52.907141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6919a9c4-fc77-4d38-be80-8abd06c9ab7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044474 Aug 18 22:09:52.907613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1140/2287] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:52 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:53.920012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-46cb437c-ab91-41d5-b99e-5172148ebed9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:53.922168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-46cb437c-ab91-41d5-b99e-5172148ebed9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:53.928856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46cb437c-ab91-41d5-b99e-5172148ebed9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:53.929336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46cb437c-ab91-41d5-b99e-5172148ebed9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:53.929804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46cb437c-ab91-41d5-b99e-5172148ebed9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:53.930496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46cb437c-ab91-41d5-b99e-5172148ebed9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:53.930953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46cb437c-ab91-41d5-b99e-5172148ebed9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:53.931381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46cb437c-ab91-41d5-b99e-5172148ebed9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:53.960941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-46cb437c-ab91-41d5-b99e-5172148ebed9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044227 Aug 18 22:09:53.961513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1148/2288] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:53 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:54.973136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-64ff3c36-2e84-41da-9647-edd333728b0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:54.975484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-64ff3c36-2e84-41da-9647-edd333728b0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:54.978726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:09:54.984118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64ff3c36-2e84-41da-9647-edd333728b0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:54.984630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64ff3c36-2e84-41da-9647-edd333728b0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:54.985055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64ff3c36-2e84-41da-9647-edd333728b0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:54.985778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64ff3c36-2e84-41da-9647-edd333728b0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:54.986240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64ff3c36-2e84-41da-9647-edd333728b0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:54.986674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64ff3c36-2e84-41da-9647-edd333728b0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:55.018648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-64ff3c36-2e84-41da-9647-edd333728b0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049530 Aug 18 22:09:55.019206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1141/2289] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:54 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:56.200433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fe2d2226-4e75-490d-a407-7419517e1fdd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:56.202608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fe2d2226-4e75-490d-a407-7419517e1fdd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:56.208447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe2d2226-4e75-490d-a407-7419517e1fdd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:56.208917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe2d2226-4e75-490d-a407-7419517e1fdd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:56.209350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe2d2226-4e75-490d-a407-7419517e1fdd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:56.210059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe2d2226-4e75-490d-a407-7419517e1fdd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:56.210511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe2d2226-4e75-490d-a407-7419517e1fdd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:56.210920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe2d2226-4e75-490d-a407-7419517e1fdd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:56.239979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fe2d2226-4e75-490d-a407-7419517e1fdd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213236 Aug 18 22:09:56.240556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1149/2290] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:56 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:57.035323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:09:57.035778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:09:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:09:57.252316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9c9b0282-5430-473f-b2cf-342218353603 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:57.254946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9c9b0282-5430-473f-b2cf-342218353603 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:57.261623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c9b0282-5430-473f-b2cf-342218353603 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:57.262066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c9b0282-5430-473f-b2cf-342218353603 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:57.262503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c9b0282-5430-473f-b2cf-342218353603 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:57.263213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c9b0282-5430-473f-b2cf-342218353603 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:57.263668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c9b0282-5430-473f-b2cf-342218353603 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:57.264094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c9b0282-5430-473f-b2cf-342218353603 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:57.293239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9c9b0282-5430-473f-b2cf-342218353603 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Aug 18 22:09:57.293812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1142/2291] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:57 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:57.449995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:09:57.450199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:09:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:09:58.305776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9388d3ba-143e-4c08-b526-464d44f100e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:58.307964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9388d3ba-143e-4c08-b526-464d44f100e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:58.310255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=30 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:09:58.315965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9388d3ba-143e-4c08-b526-464d44f100e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:58.316452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9388d3ba-143e-4c08-b526-464d44f100e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:58.316887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9388d3ba-143e-4c08-b526-464d44f100e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:58.317579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9388d3ba-143e-4c08-b526-464d44f100e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:58.318058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9388d3ba-143e-4c08-b526-464d44f100e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:58.318482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9388d3ba-143e-4c08-b526-464d44f100e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:58.348178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9388d3ba-143e-4c08-b526-464d44f100e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046325 Aug 18 22:09:58.348740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1150/2292] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:58 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:09:59.360679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-375d96a0-4311-4ff4-aa8e-9d3a8cd2e9ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:09:59.362889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-375d96a0-4311-4ff4-aa8e-9d3a8cd2e9ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:09:59.369424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375d96a0-4311-4ff4-aa8e-9d3a8cd2e9ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:59.369958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375d96a0-4311-4ff4-aa8e-9d3a8cd2e9ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:59.370402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375d96a0-4311-4ff4-aa8e-9d3a8cd2e9ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:59.371100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375d96a0-4311-4ff4-aa8e-9d3a8cd2e9ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:09:59.371561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375d96a0-4311-4ff4-aa8e-9d3a8cd2e9ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:09:59.371994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-375d96a0-4311-4ff4-aa8e-9d3a8cd2e9ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:09:59.400534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-375d96a0-4311-4ff4-aa8e-9d3a8cd2e9ac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044167 Aug 18 22:09:59.401086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1143/2293] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:09:59 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:00.412415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1acccefc-d63d-4111-bdfa-cb09c903c1a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:00.414587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1acccefc-d63d-4111-bdfa-cb09c903c1a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:00.421144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1acccefc-d63d-4111-bdfa-cb09c903c1a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:00.421670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1acccefc-d63d-4111-bdfa-cb09c903c1a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:00.422159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1acccefc-d63d-4111-bdfa-cb09c903c1a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:00.422808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1acccefc-d63d-4111-bdfa-cb09c903c1a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:00.423270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1acccefc-d63d-4111-bdfa-cb09c903c1a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:00.423701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1acccefc-d63d-4111-bdfa-cb09c903c1a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:00.454968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1acccefc-d63d-4111-bdfa-cb09c903c1a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046600 Aug 18 22:10:00.455542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1151/2294] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:00 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:10:01.467557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-acc55931-3e78-49cd-ac4b-3173e2b770e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:01.469760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-acc55931-3e78-49cd-ac4b-3173e2b770e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:01.476200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-acc55931-3e78-49cd-ac4b-3173e2b770e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:01.476691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-acc55931-3e78-49cd-ac4b-3173e2b770e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:01.477136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-acc55931-3e78-49cd-ac4b-3173e2b770e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:01.477863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-acc55931-3e78-49cd-ac4b-3173e2b770e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:01.478325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-acc55931-3e78-49cd-ac4b-3173e2b770e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:01.478758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-acc55931-3e78-49cd-ac4b-3173e2b770e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:01.508545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-acc55931-3e78-49cd-ac4b-3173e2b770e6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044857 Aug 18 22:10:01.509119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1144/2295] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:01 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:02.521238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ea5f5dac-42d5-4026-9f55-a6e72c3a9805 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:02.523397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ea5f5dac-42d5-4026-9f55-a6e72c3a9805 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:02.529722 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea5f5dac-42d5-4026-9f55-a6e72c3a9805 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:02.530196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea5f5dac-42d5-4026-9f55-a6e72c3a9805 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:02.530627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea5f5dac-42d5-4026-9f55-a6e72c3a9805 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:02.531306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea5f5dac-42d5-4026-9f55-a6e72c3a9805 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:02.531755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea5f5dac-42d5-4026-9f55-a6e72c3a9805 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:02.532180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea5f5dac-42d5-4026-9f55-a6e72c3a9805 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:02.561923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea5f5dac-42d5-4026-9f55-a6e72c3a9805 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044616 Aug 18 22:10:02.562657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1152/2296] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:10:02.697299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:10:02.697473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:10:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:10:03.574619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8947b335-a28f-4820-a6e5-0d0770827022 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:03.576744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8947b335-a28f-4820-a6e5-0d0770827022 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:03.583057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8947b335-a28f-4820-a6e5-0d0770827022 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:03.583539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8947b335-a28f-4820-a6e5-0d0770827022 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:03.583978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8947b335-a28f-4820-a6e5-0d0770827022 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:03.584665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8947b335-a28f-4820-a6e5-0d0770827022 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:03.585122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8947b335-a28f-4820-a6e5-0d0770827022 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:03.585548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8947b335-a28f-4820-a6e5-0d0770827022 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:03.614285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8947b335-a28f-4820-a6e5-0d0770827022 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043633 Aug 18 22:10:03.614858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1145/2297] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:04.626152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fc16af93-e6e8-4736-9b0e-91c6377caef4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:04.628300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fc16af93-e6e8-4736-9b0e-91c6377caef4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:04.635283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc16af93-e6e8-4736-9b0e-91c6377caef4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:04.635758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc16af93-e6e8-4736-9b0e-91c6377caef4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:04.636196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc16af93-e6e8-4736-9b0e-91c6377caef4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:04.636876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc16af93-e6e8-4736-9b0e-91c6377caef4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:04.637345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc16af93-e6e8-4736-9b0e-91c6377caef4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:04.637800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc16af93-e6e8-4736-9b0e-91c6377caef4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:04.666991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fc16af93-e6e8-4736-9b0e-91c6377caef4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Aug 18 22:10:04.667543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1153/2298] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:05.679283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-41a1e7d9-f4d5-4e6a-b227-0431cbab2213 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:05.681433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-41a1e7d9-f4d5-4e6a-b227-0431cbab2213 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:05.687937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41a1e7d9-f4d5-4e6a-b227-0431cbab2213 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:05.688412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41a1e7d9-f4d5-4e6a-b227-0431cbab2213 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:05.688846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41a1e7d9-f4d5-4e6a-b227-0431cbab2213 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:05.689529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41a1e7d9-f4d5-4e6a-b227-0431cbab2213 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:05.690011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41a1e7d9-f4d5-4e6a-b227-0431cbab2213 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:05.690433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41a1e7d9-f4d5-4e6a-b227-0431cbab2213 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:05.720133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-41a1e7d9-f4d5-4e6a-b227-0431cbab2213 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044708 Aug 18 22:10:05.720694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1146/2299] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:06.732888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d79b41e9-7a3c-4ea8-9def-606e13f3f7e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:06.735129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d79b41e9-7a3c-4ea8-9def-606e13f3f7e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:06.742431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d79b41e9-7a3c-4ea8-9def-606e13f3f7e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:06.742913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d79b41e9-7a3c-4ea8-9def-606e13f3f7e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:06.743354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d79b41e9-7a3c-4ea8-9def-606e13f3f7e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:06.744056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d79b41e9-7a3c-4ea8-9def-606e13f3f7e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:06.744512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d79b41e9-7a3c-4ea8-9def-606e13f3f7e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:06.744942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d79b41e9-7a3c-4ea8-9def-606e13f3f7e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:06.773194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d79b41e9-7a3c-4ea8-9def-606e13f3f7e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044494 Aug 18 22:10:06.773782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1154/2300] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:07.785305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-90c55cd8-6f47-41d6-8822-56177967b498 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:07.787484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-90c55cd8-6f47-41d6-8822-56177967b498 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:07.794711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90c55cd8-6f47-41d6-8822-56177967b498 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:07.795207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90c55cd8-6f47-41d6-8822-56177967b498 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:07.795646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90c55cd8-6f47-41d6-8822-56177967b498 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:07.796347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90c55cd8-6f47-41d6-8822-56177967b498 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:07.796800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90c55cd8-6f47-41d6-8822-56177967b498 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:07.797226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90c55cd8-6f47-41d6-8822-56177967b498 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:07.801136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=90 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:10:07.827335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-90c55cd8-6f47-41d6-8822-56177967b498 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045863 Aug 18 22:10:07.827812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1147/2301] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:07 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:08.839655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e8d3c112-bff8-4bcb-ab59-f3edc51a3025 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:08.841844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e8d3c112-bff8-4bcb-ab59-f3edc51a3025 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:08.848189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8d3c112-bff8-4bcb-ab59-f3edc51a3025 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:08.848670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8d3c112-bff8-4bcb-ab59-f3edc51a3025 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:08.849101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8d3c112-bff8-4bcb-ab59-f3edc51a3025 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:08.849813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8d3c112-bff8-4bcb-ab59-f3edc51a3025 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:08.850269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8d3c112-bff8-4bcb-ab59-f3edc51a3025 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:08.850696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8d3c112-bff8-4bcb-ab59-f3edc51a3025 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:08.879433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e8d3c112-bff8-4bcb-ab59-f3edc51a3025 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043714 Aug 18 22:10:08.879923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1155/2302] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:09.892879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cd5b32df-74dd-415f-9066-87f5fe9ecd3b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:09.895063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cd5b32df-74dd-415f-9066-87f5fe9ecd3b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:09.902245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd5b32df-74dd-415f-9066-87f5fe9ecd3b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:09.902736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd5b32df-74dd-415f-9066-87f5fe9ecd3b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:09.903184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd5b32df-74dd-415f-9066-87f5fe9ecd3b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:09.903884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd5b32df-74dd-415f-9066-87f5fe9ecd3b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:09.904346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd5b32df-74dd-415f-9066-87f5fe9ecd3b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:09.904778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cd5b32df-74dd-415f-9066-87f5fe9ecd3b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:09.936452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cd5b32df-74dd-415f-9066-87f5fe9ecd3b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047689 Aug 18 22:10:09.936937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1148/2303] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:10.948654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f307e203-667c-41a8-a9d3-881747d40740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:10.950944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f307e203-667c-41a8-a9d3-881747d40740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:10.957382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f307e203-667c-41a8-a9d3-881747d40740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:10.957896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f307e203-667c-41a8-a9d3-881747d40740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:10.958338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f307e203-667c-41a8-a9d3-881747d40740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:10.959028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f307e203-667c-41a8-a9d3-881747d40740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:10.959493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f307e203-667c-41a8-a9d3-881747d40740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:10.960405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f307e203-667c-41a8-a9d3-881747d40740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:10.989493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f307e203-667c-41a8-a9d3-881747d40740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044790 Aug 18 22:10:10.990008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1156/2304] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:10 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:12.001154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f641a8f1-45ac-44ed-974e-b167466f8a39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:12.003302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f641a8f1-45ac-44ed-974e-b167466f8a39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:12.010099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f641a8f1-45ac-44ed-974e-b167466f8a39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:12.010578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f641a8f1-45ac-44ed-974e-b167466f8a39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:12.011012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f641a8f1-45ac-44ed-974e-b167466f8a39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:12.011705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f641a8f1-45ac-44ed-974e-b167466f8a39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:12.012157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f641a8f1-45ac-44ed-974e-b167466f8a39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:12.012579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f641a8f1-45ac-44ed-974e-b167466f8a39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:12.042934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f641a8f1-45ac-44ed-974e-b167466f8a39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045739 Aug 18 22:10:12.043505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1149/2305] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:13.056435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3941c1f3-6ca6-4b1c-bd54-35499e45a609 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:13.058730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3941c1f3-6ca6-4b1c-bd54-35499e45a609 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:13.065038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3941c1f3-6ca6-4b1c-bd54-35499e45a609 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:13.065512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3941c1f3-6ca6-4b1c-bd54-35499e45a609 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:13.065975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3941c1f3-6ca6-4b1c-bd54-35499e45a609 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:13.066652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3941c1f3-6ca6-4b1c-bd54-35499e45a609 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:13.067131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3941c1f3-6ca6-4b1c-bd54-35499e45a609 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:13.067549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3941c1f3-6ca6-4b1c-bd54-35499e45a609 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:13.096644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3941c1f3-6ca6-4b1c-bd54-35499e45a609 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045052 Aug 18 22:10:13.097180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1157/2306] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:14.109472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2773b8de-3db6-4423-8c2f-198d1a5dea42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:14.111662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2773b8de-3db6-4423-8c2f-198d1a5dea42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:14.118592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2773b8de-3db6-4423-8c2f-198d1a5dea42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:14.119084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2773b8de-3db6-4423-8c2f-198d1a5dea42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:14.119533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2773b8de-3db6-4423-8c2f-198d1a5dea42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:14.120231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2773b8de-3db6-4423-8c2f-198d1a5dea42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:14.120692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2773b8de-3db6-4423-8c2f-198d1a5dea42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:14.121125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2773b8de-3db6-4423-8c2f-198d1a5dea42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:14.152039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2773b8de-3db6-4423-8c2f-198d1a5dea42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046445 Aug 18 22:10:14.152599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1150/2307] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:15.164592 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-55eb4c38-8d53-4c92-a0c7-ecbe6af864f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:15.166763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-55eb4c38-8d53-4c92-a0c7-ecbe6af864f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:15.172823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55eb4c38-8d53-4c92-a0c7-ecbe6af864f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:15.173307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55eb4c38-8d53-4c92-a0c7-ecbe6af864f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:15.173774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55eb4c38-8d53-4c92-a0c7-ecbe6af864f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:15.174471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55eb4c38-8d53-4c92-a0c7-ecbe6af864f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:15.175183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55eb4c38-8d53-4c92-a0c7-ecbe6af864f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:15.175614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55eb4c38-8d53-4c92-a0c7-ecbe6af864f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:15.204500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-55eb4c38-8d53-4c92-a0c7-ecbe6af864f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044145 Aug 18 22:10:15.205050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1158/2308] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:15 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:16.216838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-23186a21-9ea2-4592-9e3f-c67c0397e5aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:16.219026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-23186a21-9ea2-4592-9e3f-c67c0397e5aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:16.226932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-23186a21-9ea2-4592-9e3f-c67c0397e5aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:16.227407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-23186a21-9ea2-4592-9e3f-c67c0397e5aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:16.227842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-23186a21-9ea2-4592-9e3f-c67c0397e5aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:16.228590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-23186a21-9ea2-4592-9e3f-c67c0397e5aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:16.228980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-23186a21-9ea2-4592-9e3f-c67c0397e5aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:16.229395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-23186a21-9ea2-4592-9e3f-c67c0397e5aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:16.257516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-23186a21-9ea2-4592-9e3f-c67c0397e5aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044596 Aug 18 22:10:16.258095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1151/2309] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:17.269692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-24db0768-1a6f-4159-ae95-9319e8246950 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:17.272091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-24db0768-1a6f-4159-ae95-9319e8246950 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:17.278438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24db0768-1a6f-4159-ae95-9319e8246950 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:17.278917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24db0768-1a6f-4159-ae95-9319e8246950 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:17.279347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24db0768-1a6f-4159-ae95-9319e8246950 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:17.280021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24db0768-1a6f-4159-ae95-9319e8246950 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:17.280469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24db0768-1a6f-4159-ae95-9319e8246950 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:17.280889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24db0768-1a6f-4159-ae95-9319e8246950 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:17.310286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-24db0768-1a6f-4159-ae95-9319e8246950 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044628 Aug 18 22:10:17.310851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1159/2310] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:17 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:18.322884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1a0f77de-e47c-441a-811c-298735dee3f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:18.325091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1a0f77de-e47c-441a-811c-298735dee3f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:18.331534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a0f77de-e47c-441a-811c-298735dee3f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:18.332021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a0f77de-e47c-441a-811c-298735dee3f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:18.332463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a0f77de-e47c-441a-811c-298735dee3f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:18.333154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a0f77de-e47c-441a-811c-298735dee3f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:18.333632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a0f77de-e47c-441a-811c-298735dee3f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:18.334064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a0f77de-e47c-441a-811c-298735dee3f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:18.362166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1a0f77de-e47c-441a-811c-298735dee3f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Aug 18 22:10:18.362719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1152/2311] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:18 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:19.374677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-29bfe20b-98a4-4d7a-aa32-a3759d387ed5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:19.376829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-29bfe20b-98a4-4d7a-aa32-a3759d387ed5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:19.383323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29bfe20b-98a4-4d7a-aa32-a3759d387ed5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:19.383802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29bfe20b-98a4-4d7a-aa32-a3759d387ed5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:19.384238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29bfe20b-98a4-4d7a-aa32-a3759d387ed5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:19.384931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29bfe20b-98a4-4d7a-aa32-a3759d387ed5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:19.385388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29bfe20b-98a4-4d7a-aa32-a3759d387ed5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:19.385839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29bfe20b-98a4-4d7a-aa32-a3759d387ed5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:19.416216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-29bfe20b-98a4-4d7a-aa32-a3759d387ed5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045424 Aug 18 22:10:19.416786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1160/2312] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:19 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:20.428548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bd3e94bf-1cff-4864-b99c-48cc392782df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:20.431365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bd3e94bf-1cff-4864-b99c-48cc392782df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:20.437693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd3e94bf-1cff-4864-b99c-48cc392782df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:20.438170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd3e94bf-1cff-4864-b99c-48cc392782df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:20.438609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd3e94bf-1cff-4864-b99c-48cc392782df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:20.439288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd3e94bf-1cff-4864-b99c-48cc392782df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:20.439738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd3e94bf-1cff-4864-b99c-48cc392782df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:20.440156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd3e94bf-1cff-4864-b99c-48cc392782df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:20.468070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bd3e94bf-1cff-4864-b99c-48cc392782df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043673 Aug 18 22:10:20.468616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1153/2313] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:20 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:21.481189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-00e3d768-f135-48c6-af5b-dc2c1fe2e21d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:21.483322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-00e3d768-f135-48c6-af5b-dc2c1fe2e21d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:21.489774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00e3d768-f135-48c6-af5b-dc2c1fe2e21d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:21.490247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00e3d768-f135-48c6-af5b-dc2c1fe2e21d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:21.490676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00e3d768-f135-48c6-af5b-dc2c1fe2e21d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:21.491383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00e3d768-f135-48c6-af5b-dc2c1fe2e21d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:21.492318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00e3d768-f135-48c6-af5b-dc2c1fe2e21d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:21.492736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00e3d768-f135-48c6-af5b-dc2c1fe2e21d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:21.495257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=90 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:10:21.524197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-00e3d768-f135-48c6-af5b-dc2c1fe2e21d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046902 Aug 18 22:10:21.524754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1161/2314] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:22.536221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5ba5535c-e42e-4fba-b1a4-350f003cbef9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:22.538444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5ba5535c-e42e-4fba-b1a4-350f003cbef9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:22.544751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ba5535c-e42e-4fba-b1a4-350f003cbef9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:22.545329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ba5535c-e42e-4fba-b1a4-350f003cbef9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:22.545804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ba5535c-e42e-4fba-b1a4-350f003cbef9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:22.546498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ba5535c-e42e-4fba-b1a4-350f003cbef9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:22.546963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ba5535c-e42e-4fba-b1a4-350f003cbef9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:22.547396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ba5535c-e42e-4fba-b1a4-350f003cbef9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:22.576372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5ba5535c-e42e-4fba-b1a4-350f003cbef9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044035 Aug 18 22:10:22.576919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1154/2315] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:22.719707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:10:22.719879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:10:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:10:23.588793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6af1d371-380d-4298-b4ba-a67a77b92737 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:23.590953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6af1d371-380d-4298-b4ba-a67a77b92737 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:23.597296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6af1d371-380d-4298-b4ba-a67a77b92737 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:23.597820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6af1d371-380d-4298-b4ba-a67a77b92737 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:23.598267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6af1d371-380d-4298-b4ba-a67a77b92737 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:23.598955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6af1d371-380d-4298-b4ba-a67a77b92737 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:23.599418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6af1d371-380d-4298-b4ba-a67a77b92737 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:23.599847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6af1d371-380d-4298-b4ba-a67a77b92737 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:23.628932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6af1d371-380d-4298-b4ba-a67a77b92737 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044540 Aug 18 22:10:23.629481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1162/2316] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:23 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:24.642552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4557abed-17d9-441f-94f7-803e4d560a70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:24.645142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4557abed-17d9-441f-94f7-803e4d560a70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:24.653085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4557abed-17d9-441f-94f7-803e4d560a70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:24.653704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4557abed-17d9-441f-94f7-803e4d560a70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:24.654144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4557abed-17d9-441f-94f7-803e4d560a70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:24.654838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4557abed-17d9-441f-94f7-803e4d560a70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:24.655296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4557abed-17d9-441f-94f7-803e4d560a70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:24.655727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4557abed-17d9-441f-94f7-803e4d560a70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:24.686232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4557abed-17d9-441f-94f7-803e4d560a70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048882 Aug 18 22:10:24.686780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1155/2317] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:25.700712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f578d4ba-3d6f-40c6-a8e4-595082676cf9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:25.702893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f578d4ba-3d6f-40c6-a8e4-595082676cf9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:25.709209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f578d4ba-3d6f-40c6-a8e4-595082676cf9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:25.709721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f578d4ba-3d6f-40c6-a8e4-595082676cf9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:25.710156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f578d4ba-3d6f-40c6-a8e4-595082676cf9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:25.711416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f578d4ba-3d6f-40c6-a8e4-595082676cf9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:25.711873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f578d4ba-3d6f-40c6-a8e4-595082676cf9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:25.712327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f578d4ba-3d6f-40c6-a8e4-595082676cf9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:25.743745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f578d4ba-3d6f-40c6-a8e4-595082676cf9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046873 Aug 18 22:10:25.744309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1163/2318] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:26.756223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c0f99c08-4696-43d0-91af-5b5645e5ffe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:26.759025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c0f99c08-4696-43d0-91af-5b5645e5ffe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:26.761491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:10:26.767022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0f99c08-4696-43d0-91af-5b5645e5ffe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:26.767511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0f99c08-4696-43d0-91af-5b5645e5ffe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:26.767954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0f99c08-4696-43d0-91af-5b5645e5ffe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:26.768659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0f99c08-4696-43d0-91af-5b5645e5ffe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:26.769119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0f99c08-4696-43d0-91af-5b5645e5ffe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:26.769650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0f99c08-4696-43d0-91af-5b5645e5ffe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:26.798788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c0f99c08-4696-43d0-91af-5b5645e5ffe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046585 Aug 18 22:10:26.799335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1156/2319] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:26 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:27.810174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0739f691-963c-47c8-ba14-5be059de405a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:27.812320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0739f691-963c-47c8-ba14-5be059de405a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:27.819168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0739f691-963c-47c8-ba14-5be059de405a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:27.820137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0739f691-963c-47c8-ba14-5be059de405a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:27.820566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0739f691-963c-47c8-ba14-5be059de405a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:27.821254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0739f691-963c-47c8-ba14-5be059de405a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:27.821726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0739f691-963c-47c8-ba14-5be059de405a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:27.822147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0739f691-963c-47c8-ba14-5be059de405a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:27.851616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0739f691-963c-47c8-ba14-5be059de405a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045280 Aug 18 22:10:27.856060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1164/2320] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:10:28.863929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4bed1850-bc3b-4660-b8f4-192b58ca8b50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:28.866069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4bed1850-bc3b-4660-b8f4-192b58ca8b50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:28.872127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bed1850-bc3b-4660-b8f4-192b58ca8b50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:28.872608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bed1850-bc3b-4660-b8f4-192b58ca8b50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:28.873043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bed1850-bc3b-4660-b8f4-192b58ca8b50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:28.873765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bed1850-bc3b-4660-b8f4-192b58ca8b50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:28.874225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bed1850-bc3b-4660-b8f4-192b58ca8b50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:28.874649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4bed1850-bc3b-4660-b8f4-192b58ca8b50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:28.905058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4bed1850-bc3b-4660-b8f4-192b58ca8b50 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044998 Aug 18 22:10:28.905625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1157/2321] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:10:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:10:29.924480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-502f26d6-9265-4046-9882-127d3d673e2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:10:29.926989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-502f26d6-9265-4046-9882-127d3d673e2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:29.929294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=30 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:10:29.934940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-502f26d6-9265-4046-9882-127d3d673e2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:29.935432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-502f26d6-9265-4046-9882-127d3d673e2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:29.935880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-502f26d6-9265-4046-9882-127d3d673e2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:29.936585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-502f26d6-9265-4046-9882-127d3d673e2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:29.937044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-502f26d6-9265-4046-9882-127d3d673e2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:29.937474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-502f26d6-9265-4046-9882-127d3d673e2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:30.015623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-502f26d6-9265-4046-9882-127d3d673e2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "POST /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/action" status: 200 len: 76381 microversion: 2.1 time: 0.094751 Aug 18 22:10:30.016287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1165/2322] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 22:10:29 2022] POST /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3/action => generated 76381 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:10:37.415959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0ffe1072-b230-4daf-9313-4562ac5f575c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:37.416471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0ffe1072-b230-4daf-9313-4562ac5f575c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:37.423136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ffe1072-b230-4daf-9313-4562ac5f575c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:37.423615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ffe1072-b230-4daf-9313-4562ac5f575c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:37.424051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ffe1072-b230-4daf-9313-4562ac5f575c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:37.424990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ffe1072-b230-4daf-9313-4562ac5f575c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:37.425435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ffe1072-b230-4daf-9313-4562ac5f575c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:37.425879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ffe1072-b230-4daf-9313-4562ac5f575c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:37.452011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0ffe1072-b230-4daf-9313-4562ac5f575c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:10:37.540587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0ffe1072-b230-4daf-9313-4562ac5f575c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "DELETE /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 204 len: 0 microversion: 2.1 time: 0.128733 Aug 18 22:10:37.541469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1158/2323] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:10:37 2022] DELETE /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:10:37.554798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e9c15253-50f2-4e64-b1c7-66887e604614 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:37.555511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e9c15253-50f2-4e64-b1c7-66887e604614 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:37.562586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9c15253-50f2-4e64-b1c7-66887e604614 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:37.563067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9c15253-50f2-4e64-b1c7-66887e604614 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:37.563504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9c15253-50f2-4e64-b1c7-66887e604614 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:37.564194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9c15253-50f2-4e64-b1c7-66887e604614 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:37.564647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9c15253-50f2-4e64-b1c7-66887e604614 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:37.565072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9c15253-50f2-4e64-b1c7-66887e604614 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:37.806287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e9c15253-50f2-4e64-b1c7-66887e604614 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:37.814258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e9c15253-50f2-4e64-b1c7-66887e604614 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.263686 Aug 18 22:10:37.814820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1166/2324] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:37 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:38.836298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-97356af4-d867-42fa-ab45-9bc765217178 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:38.836993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-97356af4-d867-42fa-ab45-9bc765217178 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:38.843229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97356af4-d867-42fa-ab45-9bc765217178 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:38.843706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97356af4-d867-42fa-ab45-9bc765217178 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:38.844135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97356af4-d867-42fa-ab45-9bc765217178 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:38.844842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97356af4-d867-42fa-ab45-9bc765217178 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:38.845292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97356af4-d867-42fa-ab45-9bc765217178 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:38.845734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97356af4-d867-42fa-ab45-9bc765217178 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:38.848288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:10:39.026477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97356af4-d867-42fa-ab45-9bc765217178 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:39.034768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-97356af4-d867-42fa-ab45-9bc765217178 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.202594 Aug 18 22:10:39.035343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1159/2325] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:38 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:40.056339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1ee0e9e6-8abc-46d9-898a-aa8c9ccc0b0e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:40.056955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1ee0e9e6-8abc-46d9-898a-aa8c9ccc0b0e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:40.063470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ee0e9e6-8abc-46d9-898a-aa8c9ccc0b0e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:40.063958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ee0e9e6-8abc-46d9-898a-aa8c9ccc0b0e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:40.064396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ee0e9e6-8abc-46d9-898a-aa8c9ccc0b0e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:40.065084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ee0e9e6-8abc-46d9-898a-aa8c9ccc0b0e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:40.065536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ee0e9e6-8abc-46d9-898a-aa8c9ccc0b0e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:40.065990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ee0e9e6-8abc-46d9-898a-aa8c9ccc0b0e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:40.194088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1ee0e9e6-8abc-46d9-898a-aa8c9ccc0b0e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:40.202644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1ee0e9e6-8abc-46d9-898a-aa8c9ccc0b0e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149780 Aug 18 22:10:40.203221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1167/2326] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:40 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:41.223894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-faa36185-53c6-44c0-9c41-1defe08a54e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:41.224441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-faa36185-53c6-44c0-9c41-1defe08a54e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:41.231364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa36185-53c6-44c0-9c41-1defe08a54e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:41.231848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa36185-53c6-44c0-9c41-1defe08a54e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:41.232288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa36185-53c6-44c0-9c41-1defe08a54e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:41.232982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa36185-53c6-44c0-9c41-1defe08a54e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:41.233480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa36185-53c6-44c0-9c41-1defe08a54e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:41.233941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faa36185-53c6-44c0-9c41-1defe08a54e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:41.364199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-faa36185-53c6-44c0-9c41-1defe08a54e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:41.373108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-faa36185-53c6-44c0-9c41-1defe08a54e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153162 Aug 18 22:10:41.373700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1160/2327] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:41 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:42.393836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0d833d5b-a523-4c7d-940f-25af77c36dd5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:42.394637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0d833d5b-a523-4c7d-940f-25af77c36dd5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:42.400429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d833d5b-a523-4c7d-940f-25af77c36dd5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:42.400908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d833d5b-a523-4c7d-940f-25af77c36dd5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:42.401342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d833d5b-a523-4c7d-940f-25af77c36dd5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:42.402060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d833d5b-a523-4c7d-940f-25af77c36dd5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:42.402514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d833d5b-a523-4c7d-940f-25af77c36dd5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:42.402974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d833d5b-a523-4c7d-940f-25af77c36dd5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:42.763121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0d833d5b-a523-4c7d-940f-25af77c36dd5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:42.771585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0d833d5b-a523-4c7d-940f-25af77c36dd5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.382126 Aug 18 22:10:42.772162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1168/2328] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:42 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:43.792359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-42b2419c-f6e9-4808-b7ff-4358e2bf0afd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:43.792992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-42b2419c-f6e9-4808-b7ff-4358e2bf0afd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:43.799357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42b2419c-f6e9-4808-b7ff-4358e2bf0afd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:43.800093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42b2419c-f6e9-4808-b7ff-4358e2bf0afd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:43.800530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42b2419c-f6e9-4808-b7ff-4358e2bf0afd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:43.801214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42b2419c-f6e9-4808-b7ff-4358e2bf0afd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:43.801687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42b2419c-f6e9-4808-b7ff-4358e2bf0afd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:43.802421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-42b2419c-f6e9-4808-b7ff-4358e2bf0afd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:43.934354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-42b2419c-f6e9-4808-b7ff-4358e2bf0afd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:43.942572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-42b2419c-f6e9-4808-b7ff-4358e2bf0afd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154081 Aug 18 22:10:43.943143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1161/2329] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:43 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:44.964184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da8fde5f-36cf-498c-a2c3-0173318d20c7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:44.965286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-da8fde5f-36cf-498c-a2c3-0173318d20c7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:44.974778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da8fde5f-36cf-498c-a2c3-0173318d20c7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:44.975449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da8fde5f-36cf-498c-a2c3-0173318d20c7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:44.976141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da8fde5f-36cf-498c-a2c3-0173318d20c7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:44.977191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da8fde5f-36cf-498c-a2c3-0173318d20c7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:44.977924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da8fde5f-36cf-498c-a2c3-0173318d20c7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:44.978581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da8fde5f-36cf-498c-a2c3-0173318d20c7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:45.112615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-da8fde5f-36cf-498c-a2c3-0173318d20c7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:45.120784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da8fde5f-36cf-498c-a2c3-0173318d20c7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.161042 Aug 18 22:10:45.121351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1169/2330] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:44 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:10:46.141828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-969aab54-8c4e-4caa-9694-3d88dd2a027c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:46.142451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-969aab54-8c4e-4caa-9694-3d88dd2a027c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:46.149755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-969aab54-8c4e-4caa-9694-3d88dd2a027c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:46.150239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-969aab54-8c4e-4caa-9694-3d88dd2a027c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:46.150675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-969aab54-8c4e-4caa-9694-3d88dd2a027c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:46.151359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-969aab54-8c4e-4caa-9694-3d88dd2a027c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:46.151811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-969aab54-8c4e-4caa-9694-3d88dd2a027c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:46.152237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-969aab54-8c4e-4caa-9694-3d88dd2a027c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:46.278939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-969aab54-8c4e-4caa-9694-3d88dd2a027c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:46.287068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-969aab54-8c4e-4caa-9694-3d88dd2a027c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149085 Aug 18 22:10:46.287641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1162/2331] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:46 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:47.308788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-16229fa1-2ab0-44f1-ba04-9b2a960e8840 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:47.309429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-16229fa1-2ab0-44f1-ba04-9b2a960e8840 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:47.315787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16229fa1-2ab0-44f1-ba04-9b2a960e8840 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:47.316262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16229fa1-2ab0-44f1-ba04-9b2a960e8840 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:47.316690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16229fa1-2ab0-44f1-ba04-9b2a960e8840 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:47.317367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16229fa1-2ab0-44f1-ba04-9b2a960e8840 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:47.317840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16229fa1-2ab0-44f1-ba04-9b2a960e8840 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:47.318257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16229fa1-2ab0-44f1-ba04-9b2a960e8840 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:47.448294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-16229fa1-2ab0-44f1-ba04-9b2a960e8840 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:47.456419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-16229fa1-2ab0-44f1-ba04-9b2a960e8840 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151486 Aug 18 22:10:47.456977 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1170/2332] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:47 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:48.478395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fe310965-18e7-4d90-aed5-fb4859617aec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:48.479014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fe310965-18e7-4d90-aed5-fb4859617aec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:48.485582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe310965-18e7-4d90-aed5-fb4859617aec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:48.486042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe310965-18e7-4d90-aed5-fb4859617aec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:48.486480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe310965-18e7-4d90-aed5-fb4859617aec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:48.487169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe310965-18e7-4d90-aed5-fb4859617aec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:48.487632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe310965-18e7-4d90-aed5-fb4859617aec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:48.488309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe310965-18e7-4d90-aed5-fb4859617aec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:48.616888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fe310965-18e7-4d90-aed5-fb4859617aec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:48.624994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fe310965-18e7-4d90-aed5-fb4859617aec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151174 Aug 18 22:10:48.625568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1163/2333] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:48 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:49.644946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9c63ed01-2cca-453a-8b24-2e54491980a6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:49.645566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9c63ed01-2cca-453a-8b24-2e54491980a6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:49.652088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c63ed01-2cca-453a-8b24-2e54491980a6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:49.652572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c63ed01-2cca-453a-8b24-2e54491980a6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:49.653012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c63ed01-2cca-453a-8b24-2e54491980a6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:49.653735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c63ed01-2cca-453a-8b24-2e54491980a6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:49.654195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c63ed01-2cca-453a-8b24-2e54491980a6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:49.654623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c63ed01-2cca-453a-8b24-2e54491980a6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:49.789309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9c63ed01-2cca-453a-8b24-2e54491980a6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:49.797437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9c63ed01-2cca-453a-8b24-2e54491980a6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156516 Aug 18 22:10:49.798030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1171/2334] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:49 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:50.818954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-03db146d-9b7a-4ac3-9df2-6e1ae67f1843 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:50.820172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-03db146d-9b7a-4ac3-9df2-6e1ae67f1843 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:50.826586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03db146d-9b7a-4ac3-9df2-6e1ae67f1843 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:50.827068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03db146d-9b7a-4ac3-9df2-6e1ae67f1843 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:50.827502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03db146d-9b7a-4ac3-9df2-6e1ae67f1843 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:50.828190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03db146d-9b7a-4ac3-9df2-6e1ae67f1843 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:50.828682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03db146d-9b7a-4ac3-9df2-6e1ae67f1843 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:50.829059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03db146d-9b7a-4ac3-9df2-6e1ae67f1843 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:50.959156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-03db146d-9b7a-4ac3-9df2-6e1ae67f1843 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:50.967458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-03db146d-9b7a-4ac3-9df2-6e1ae67f1843 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152341 Aug 18 22:10:50.968033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1164/2335] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:50 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:51.988334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e7d72b2a-5c9d-4b52-a52f-dfa96a4e7e63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:51.988860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e7d72b2a-5c9d-4b52-a52f-dfa96a4e7e63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:51.995424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7d72b2a-5c9d-4b52-a52f-dfa96a4e7e63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:51.995935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7d72b2a-5c9d-4b52-a52f-dfa96a4e7e63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:51.996377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7d72b2a-5c9d-4b52-a52f-dfa96a4e7e63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:51.997071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7d72b2a-5c9d-4b52-a52f-dfa96a4e7e63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:51.997530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7d72b2a-5c9d-4b52-a52f-dfa96a4e7e63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:51.997990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7d72b2a-5c9d-4b52-a52f-dfa96a4e7e63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:52.000647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=64 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:10:52.128558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e7d72b2a-5c9d-4b52-a52f-dfa96a4e7e63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:52.137345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e7d72b2a-5c9d-4b52-a52f-dfa96a4e7e63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152944 Aug 18 22:10:52.138562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1172/2336] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:51 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:53.158680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7d2e2029-d160-4ab8-8679-79070ed08ad2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:53.159340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7d2e2029-d160-4ab8-8679-79070ed08ad2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:53.166454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d2e2029-d160-4ab8-8679-79070ed08ad2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:53.166948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d2e2029-d160-4ab8-8679-79070ed08ad2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:53.167395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d2e2029-d160-4ab8-8679-79070ed08ad2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:53.168092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d2e2029-d160-4ab8-8679-79070ed08ad2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:53.168554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d2e2029-d160-4ab8-8679-79070ed08ad2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:53.168983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7d2e2029-d160-4ab8-8679-79070ed08ad2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:53.302377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7d2e2029-d160-4ab8-8679-79070ed08ad2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:53.310685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7d2e2029-d160-4ab8-8679-79070ed08ad2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155906 Aug 18 22:10:53.311239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1165/2337] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:53 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:54.331939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-74eb34a9-16bc-40b6-aab7-94106dcb26fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:54.332549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-74eb34a9-16bc-40b6-aab7-94106dcb26fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:54.339339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74eb34a9-16bc-40b6-aab7-94106dcb26fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:54.339820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74eb34a9-16bc-40b6-aab7-94106dcb26fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:54.340254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74eb34a9-16bc-40b6-aab7-94106dcb26fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:54.340936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74eb34a9-16bc-40b6-aab7-94106dcb26fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:54.341388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74eb34a9-16bc-40b6-aab7-94106dcb26fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:54.341837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-74eb34a9-16bc-40b6-aab7-94106dcb26fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:54.471388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-74eb34a9-16bc-40b6-aab7-94106dcb26fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:54.480141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-74eb34a9-16bc-40b6-aab7-94106dcb26fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151881 Aug 18 22:10:54.480708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1173/2338] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:54 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:55.500135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5104f391-4608-4dea-b2e8-81756fb8a946 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:55.500760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5104f391-4608-4dea-b2e8-81756fb8a946 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:55.507051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5104f391-4608-4dea-b2e8-81756fb8a946 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:55.507539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5104f391-4608-4dea-b2e8-81756fb8a946 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:55.507977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5104f391-4608-4dea-b2e8-81756fb8a946 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:55.508666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5104f391-4608-4dea-b2e8-81756fb8a946 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:55.509118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5104f391-4608-4dea-b2e8-81756fb8a946 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:55.509544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5104f391-4608-4dea-b2e8-81756fb8a946 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:55.640641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5104f391-4608-4dea-b2e8-81756fb8a946 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:55.649025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5104f391-4608-4dea-b2e8-81756fb8a946 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152666 Aug 18 22:10:55.649582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1166/2339] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:55 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:56.669834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0fde13aa-f5ac-4c77-8930-afebef7726c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:56.670457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0fde13aa-f5ac-4c77-8930-afebef7726c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:56.677003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fde13aa-f5ac-4c77-8930-afebef7726c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:56.677482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fde13aa-f5ac-4c77-8930-afebef7726c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:56.677985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fde13aa-f5ac-4c77-8930-afebef7726c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:56.679184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fde13aa-f5ac-4c77-8930-afebef7726c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:56.679611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fde13aa-f5ac-4c77-8930-afebef7726c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:56.680035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0fde13aa-f5ac-4c77-8930-afebef7726c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:56.810077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0fde13aa-f5ac-4c77-8930-afebef7726c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:56.818819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0fde13aa-f5ac-4c77-8930-afebef7726c9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152883 Aug 18 22:10:56.820009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1174/2340] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:56 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:57.840326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8507c324-f8ee-40e5-9360-974153ee5e5c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:57.840952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8507c324-f8ee-40e5-9360-974153ee5e5c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:57.843002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:10:57.848423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8507c324-f8ee-40e5-9360-974153ee5e5c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:57.848908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8507c324-f8ee-40e5-9360-974153ee5e5c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:57.849349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8507c324-f8ee-40e5-9360-974153ee5e5c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:57.850075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8507c324-f8ee-40e5-9360-974153ee5e5c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:57.850536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8507c324-f8ee-40e5-9360-974153ee5e5c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:57.850969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8507c324-f8ee-40e5-9360-974153ee5e5c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:57.977631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8507c324-f8ee-40e5-9360-974153ee5e5c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:57.985892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8507c324-f8ee-40e5-9360-974153ee5e5c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149331 Aug 18 22:10:57.986457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1167/2341] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:57 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:10:59.006355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-96401d6c-0826-4e6b-a280-bf331d22d547 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:10:59.006929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-96401d6c-0826-4e6b-a280-bf331d22d547 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:10:59.013357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96401d6c-0826-4e6b-a280-bf331d22d547 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:59.013878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96401d6c-0826-4e6b-a280-bf331d22d547 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:59.014321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96401d6c-0826-4e6b-a280-bf331d22d547 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:59.015013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96401d6c-0826-4e6b-a280-bf331d22d547 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:10:59.015471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96401d6c-0826-4e6b-a280-bf331d22d547 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:10:59.015903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96401d6c-0826-4e6b-a280-bf331d22d547 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:10:59.144717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-96401d6c-0826-4e6b-a280-bf331d22d547 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:10:59.153445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-96401d6c-0826-4e6b-a280-bf331d22d547 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150999 Aug 18 22:10:59.154049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1175/2342] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:10:59 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:00.175484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e97d4b36-4394-4643-bb16-d9405a79eb9b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:00.176066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e97d4b36-4394-4643-bb16-d9405a79eb9b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:00.183272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e97d4b36-4394-4643-bb16-d9405a79eb9b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:00.183755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e97d4b36-4394-4643-bb16-d9405a79eb9b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:00.184197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e97d4b36-4394-4643-bb16-d9405a79eb9b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:00.184889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e97d4b36-4394-4643-bb16-d9405a79eb9b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:00.185345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e97d4b36-4394-4643-bb16-d9405a79eb9b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:00.185807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e97d4b36-4394-4643-bb16-d9405a79eb9b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:00.316177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e97d4b36-4394-4643-bb16-d9405a79eb9b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:00.324049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e97d4b36-4394-4643-bb16-d9405a79eb9b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152852 Aug 18 22:11:00.324612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1168/2343] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:00 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:01.345054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-340b844b-7995-441a-8012-0e7250b45b3e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:01.345687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-340b844b-7995-441a-8012-0e7250b45b3e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:01.348114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=22 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:01.353499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-340b844b-7995-441a-8012-0e7250b45b3e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:01.354001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-340b844b-7995-441a-8012-0e7250b45b3e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:01.354432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-340b844b-7995-441a-8012-0e7250b45b3e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:01.355142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-340b844b-7995-441a-8012-0e7250b45b3e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:01.355590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-340b844b-7995-441a-8012-0e7250b45b3e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:01.356010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-340b844b-7995-441a-8012-0e7250b45b3e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:01.482427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-340b844b-7995-441a-8012-0e7250b45b3e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:01.490482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-340b844b-7995-441a-8012-0e7250b45b3e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149517 Aug 18 22:11:01.491094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1176/2344] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:01 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:02.512574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c5d6621d-5703-4f35-90a5-d8de346709f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:02.513192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c5d6621d-5703-4f35-90a5-d8de346709f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:02.519563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5d6621d-5703-4f35-90a5-d8de346709f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:02.520047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5d6621d-5703-4f35-90a5-d8de346709f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:02.520492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5d6621d-5703-4f35-90a5-d8de346709f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:02.521174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5d6621d-5703-4f35-90a5-d8de346709f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:02.521649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5d6621d-5703-4f35-90a5-d8de346709f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:02.522077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5d6621d-5703-4f35-90a5-d8de346709f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:02.651025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c5d6621d-5703-4f35-90a5-d8de346709f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:02.659218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c5d6621d-5703-4f35-90a5-d8de346709f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150478 Aug 18 22:11:02.659799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1169/2345] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:02 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:03.680399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ad91f3b0-0eb8-4dbf-994b-e909ae3d8b20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:03.681014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ad91f3b0-0eb8-4dbf-994b-e909ae3d8b20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:03.687519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad91f3b0-0eb8-4dbf-994b-e909ae3d8b20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:03.688002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad91f3b0-0eb8-4dbf-994b-e909ae3d8b20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:03.688443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad91f3b0-0eb8-4dbf-994b-e909ae3d8b20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:03.689129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad91f3b0-0eb8-4dbf-994b-e909ae3d8b20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:03.689584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad91f3b0-0eb8-4dbf-994b-e909ae3d8b20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:03.690034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad91f3b0-0eb8-4dbf-994b-e909ae3d8b20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:03.823973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ad91f3b0-0eb8-4dbf-994b-e909ae3d8b20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:03.832198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ad91f3b0-0eb8-4dbf-994b-e909ae3d8b20 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155669 Aug 18 22:11:03.832775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1177/2346] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:03 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:04.853976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b9bc7a28-f0c7-41b3-9975-90b6407ae084 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:04.854601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b9bc7a28-f0c7-41b3-9975-90b6407ae084 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:04.861019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9bc7a28-f0c7-41b3-9975-90b6407ae084 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:04.861507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9bc7a28-f0c7-41b3-9975-90b6407ae084 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:04.861974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9bc7a28-f0c7-41b3-9975-90b6407ae084 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:04.862661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9bc7a28-f0c7-41b3-9975-90b6407ae084 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:04.863118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9bc7a28-f0c7-41b3-9975-90b6407ae084 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:04.863544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9bc7a28-f0c7-41b3-9975-90b6407ae084 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:05.001846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b9bc7a28-f0c7-41b3-9975-90b6407ae084 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:05.010166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b9bc7a28-f0c7-41b3-9975-90b6407ae084 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.160733 Aug 18 22:11:05.010727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1170/2347] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:04 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:05.923461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5d12e8ba-7169-423a-93c5-0d422dddfaaf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:05.923973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5d12e8ba-7169-423a-93c5-0d422dddfaaf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:05.931154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d12e8ba-7169-423a-93c5-0d422dddfaaf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:05.931628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d12e8ba-7169-423a-93c5-0d422dddfaaf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:05.932057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d12e8ba-7169-423a-93c5-0d422dddfaaf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:05.932736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d12e8ba-7169-423a-93c5-0d422dddfaaf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:05.933182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d12e8ba-7169-423a-93c5-0d422dddfaaf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:05.933644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d12e8ba-7169-423a-93c5-0d422dddfaaf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:05.958413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5d12e8ba-7169-423a-93c5-0d422dddfaaf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:11:06.034332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8e36e880-d093-4507-81ed-9a1b4bd9876b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:06.035315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8e36e880-d093-4507-81ed-9a1b4bd9876b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:06.041943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5d12e8ba-7169-423a-93c5-0d422dddfaaf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 204 len: 0 microversion: 2.20 time: 0.121819 Aug 18 22:11:06.042864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1178/2348] 10.222.0.82 () {60 vars in 1280 bytes} [Thu Aug 18 22:11:05 2022] DELETE /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 22:11:06.043562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e36e880-d093-4507-81ed-9a1b4bd9876b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:06.044093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e36e880-d093-4507-81ed-9a1b4bd9876b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:06.044596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e36e880-d093-4507-81ed-9a1b4bd9876b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:06.045369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e36e880-d093-4507-81ed-9a1b4bd9876b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:06.049205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e36e880-d093-4507-81ed-9a1b4bd9876b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:06.050043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e36e880-d093-4507-81ed-9a1b4bd9876b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:06.056436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-22b01b80-09f5-4bb4-8d4a-bdd2eaad844a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:06.056436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-22b01b80-09f5-4bb4-8d4a-bdd2eaad844a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:06.061986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22b01b80-09f5-4bb4-8d4a-bdd2eaad844a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:06.062475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22b01b80-09f5-4bb4-8d4a-bdd2eaad844a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:06.062916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22b01b80-09f5-4bb4-8d4a-bdd2eaad844a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:06.063619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22b01b80-09f5-4bb4-8d4a-bdd2eaad844a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:06.064077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22b01b80-09f5-4bb4-8d4a-bdd2eaad844a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:06.064502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-22b01b80-09f5-4bb4-8d4a-bdd2eaad844a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:06.187692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8e36e880-d093-4507-81ed-9a1b4bd9876b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:06.198296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-22b01b80-09f5-4bb4-8d4a-bdd2eaad844a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:06.198682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8e36e880-d093-4507-81ed-9a1b4bd9876b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.170843 Aug 18 22:11:06.199271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1171/2349] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:06 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:06.207409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-22b01b80-09f5-4bb4-8d4a-bdd2eaad844a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:06.209188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-22b01b80-09f5-4bb4-8d4a-bdd2eaad844a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:06.210465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-22b01b80-09f5-4bb4-8d4a-bdd2eaad844a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159924 Aug 18 22:11:06.211087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1179/2350] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:06 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:07.219918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-211fbf28-ec8d-4818-8e73-b19b2d5fbdb9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:07.220539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-211fbf28-ec8d-4818-8e73-b19b2d5fbdb9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:07.227016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-211fbf28-ec8d-4818-8e73-b19b2d5fbdb9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:07.227500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-211fbf28-ec8d-4818-8e73-b19b2d5fbdb9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:07.227933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-211fbf28-ec8d-4818-8e73-b19b2d5fbdb9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:07.228704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-211fbf28-ec8d-4818-8e73-b19b2d5fbdb9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:07.229162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-211fbf28-ec8d-4818-8e73-b19b2d5fbdb9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:07.229588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-211fbf28-ec8d-4818-8e73-b19b2d5fbdb9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:07.233633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-27a194b9-0d4e-4625-944f-4b8927e32046 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:07.234258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-27a194b9-0d4e-4625-944f-4b8927e32046 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:07.240793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27a194b9-0d4e-4625-944f-4b8927e32046 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:07.241826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27a194b9-0d4e-4625-944f-4b8927e32046 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:07.242556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27a194b9-0d4e-4625-944f-4b8927e32046 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:07.243264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27a194b9-0d4e-4625-944f-4b8927e32046 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:07.243757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27a194b9-0d4e-4625-944f-4b8927e32046 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:07.244246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27a194b9-0d4e-4625-944f-4b8927e32046 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:07.371297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-211fbf28-ec8d-4818-8e73-b19b2d5fbdb9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:07.379453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-211fbf28-ec8d-4818-8e73-b19b2d5fbdb9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.163314 Aug 18 22:11:07.380219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1172/2351] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:07 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:07.387880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-27a194b9-0d4e-4625-944f-4b8927e32046 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:07.396850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-27a194b9-0d4e-4625-944f-4b8927e32046 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:07.398437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-27a194b9-0d4e-4625-944f-4b8927e32046 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:07.399884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-27a194b9-0d4e-4625-944f-4b8927e32046 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.170158 Aug 18 22:11:07.400512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1180/2352] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:08.401170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9a1b70f0-ebdb-4e72-8fee-b5c5b3ce7787 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:08.401810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9a1b70f0-ebdb-4e72-8fee-b5c5b3ce7787 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:08.408079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a1b70f0-ebdb-4e72-8fee-b5c5b3ce7787 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:08.408554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a1b70f0-ebdb-4e72-8fee-b5c5b3ce7787 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:08.408986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a1b70f0-ebdb-4e72-8fee-b5c5b3ce7787 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:08.409708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a1b70f0-ebdb-4e72-8fee-b5c5b3ce7787 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:08.410146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a1b70f0-ebdb-4e72-8fee-b5c5b3ce7787 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:08.410568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a1b70f0-ebdb-4e72-8fee-b5c5b3ce7787 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:08.422808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b24c62da-63ca-4746-999c-332e11512d1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:08.423426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b24c62da-63ca-4746-999c-332e11512d1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:08.430147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b24c62da-63ca-4746-999c-332e11512d1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:08.430629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b24c62da-63ca-4746-999c-332e11512d1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:08.431067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b24c62da-63ca-4746-999c-332e11512d1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:08.431753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b24c62da-63ca-4746-999c-332e11512d1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:08.432207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b24c62da-63ca-4746-999c-332e11512d1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:08.432633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b24c62da-63ca-4746-999c-332e11512d1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:08.542634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9a1b70f0-ebdb-4e72-8fee-b5c5b3ce7787 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:08.551036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9a1b70f0-ebdb-4e72-8fee-b5c5b3ce7787 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154289 Aug 18 22:11:08.551610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1173/2353] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:08 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:08.563587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b24c62da-63ca-4746-999c-332e11512d1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:08.572759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b24c62da-63ca-4746-999c-332e11512d1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:08.574283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b24c62da-63ca-4746-999c-332e11512d1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:08.575420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b24c62da-63ca-4746-999c-332e11512d1e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156516 Aug 18 22:11:08.575988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1181/2354] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:09.572189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-751d0f28-9a65-4ea6-8569-c0aa14e72e0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:09.572842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-751d0f28-9a65-4ea6-8569-c0aa14e72e0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:09.579243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-751d0f28-9a65-4ea6-8569-c0aa14e72e0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:09.579730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-751d0f28-9a65-4ea6-8569-c0aa14e72e0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:09.580172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-751d0f28-9a65-4ea6-8569-c0aa14e72e0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:09.580865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-751d0f28-9a65-4ea6-8569-c0aa14e72e0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:09.581397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-751d0f28-9a65-4ea6-8569-c0aa14e72e0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:09.581786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-751d0f28-9a65-4ea6-8569-c0aa14e72e0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:09.584293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=90 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:09.597353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f7aea5b6-1608-4d78-9fe9-7d4c1b746e41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:09.598086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f7aea5b6-1608-4d78-9fe9-7d4c1b746e41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:09.605062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7aea5b6-1608-4d78-9fe9-7d4c1b746e41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:09.605540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7aea5b6-1608-4d78-9fe9-7d4c1b746e41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:09.606057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7aea5b6-1608-4d78-9fe9-7d4c1b746e41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:09.606701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7aea5b6-1608-4d78-9fe9-7d4c1b746e41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:09.607152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7aea5b6-1608-4d78-9fe9-7d4c1b746e41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:09.607577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7aea5b6-1608-4d78-9fe9-7d4c1b746e41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:09.722080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-751d0f28-9a65-4ea6-8569-c0aa14e72e0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:09.730993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-751d0f28-9a65-4ea6-8569-c0aa14e72e0b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.162580 Aug 18 22:11:09.731577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1174/2355] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:09 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:09.754084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f7aea5b6-1608-4d78-9fe9-7d4c1b746e41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:09.764233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f7aea5b6-1608-4d78-9fe9-7d4c1b746e41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:09.765982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f7aea5b6-1608-4d78-9fe9-7d4c1b746e41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:09.767291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f7aea5b6-1608-4d78-9fe9-7d4c1b746e41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.173768 Aug 18 22:11:09.768110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1182/2356] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:10.751479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0d0dce12-6462-4a23-8a95-539928e73278 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:10.752094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0d0dce12-6462-4a23-8a95-539928e73278 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:10.758871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d0dce12-6462-4a23-8a95-539928e73278 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:10.759353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d0dce12-6462-4a23-8a95-539928e73278 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:10.759786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d0dce12-6462-4a23-8a95-539928e73278 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:10.760470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d0dce12-6462-4a23-8a95-539928e73278 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:10.760921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d0dce12-6462-4a23-8a95-539928e73278 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:10.761342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d0dce12-6462-4a23-8a95-539928e73278 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:10.791119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c6a17bf1-0435-47ce-ba6c-cf9a2b8e30c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:10.793197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c6a17bf1-0435-47ce-ba6c-cf9a2b8e30c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:10.800120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6a17bf1-0435-47ce-ba6c-cf9a2b8e30c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:10.800609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6a17bf1-0435-47ce-ba6c-cf9a2b8e30c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:10.801075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6a17bf1-0435-47ce-ba6c-cf9a2b8e30c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:10.801811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6a17bf1-0435-47ce-ba6c-cf9a2b8e30c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:10.802270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6a17bf1-0435-47ce-ba6c-cf9a2b8e30c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:10.802698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6a17bf1-0435-47ce-ba6c-cf9a2b8e30c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:10.894845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0d0dce12-6462-4a23-8a95-539928e73278 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:10.903697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0d0dce12-6462-4a23-8a95-539928e73278 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156007 Aug 18 22:11:10.904280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1175/2357] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:10 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:10.938532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c6a17bf1-0435-47ce-ba6c-cf9a2b8e30c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:10.947047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c6a17bf1-0435-47ce-ba6c-cf9a2b8e30c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:10.948524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c6a17bf1-0435-47ce-ba6c-cf9a2b8e30c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:10.949682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c6a17bf1-0435-47ce-ba6c-cf9a2b8e30c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.163001 Aug 18 22:11:10.950238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1183/2358] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:11.925710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7d1e5cc-edd4-41d4-b90c-155e2c8662f0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:11.926313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f7d1e5cc-edd4-41d4-b90c-155e2c8662f0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:11.933245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7d1e5cc-edd4-41d4-b90c-155e2c8662f0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:11.933764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7d1e5cc-edd4-41d4-b90c-155e2c8662f0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:11.934201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7d1e5cc-edd4-41d4-b90c-155e2c8662f0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:11.934882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7d1e5cc-edd4-41d4-b90c-155e2c8662f0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:11.935331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7d1e5cc-edd4-41d4-b90c-155e2c8662f0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:11.935757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7d1e5cc-edd4-41d4-b90c-155e2c8662f0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:11.972160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a3e834d7-bd70-4f01-8ec2-94eeabaf3398 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:11.972686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a3e834d7-bd70-4f01-8ec2-94eeabaf3398 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:11.979645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3e834d7-bd70-4f01-8ec2-94eeabaf3398 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:11.980119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3e834d7-bd70-4f01-8ec2-94eeabaf3398 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:11.980546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3e834d7-bd70-4f01-8ec2-94eeabaf3398 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:11.981231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3e834d7-bd70-4f01-8ec2-94eeabaf3398 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:11.981714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3e834d7-bd70-4f01-8ec2-94eeabaf3398 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:11.982135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3e834d7-bd70-4f01-8ec2-94eeabaf3398 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:12.071642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f7d1e5cc-edd4-41d4-b90c-155e2c8662f0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:12.080098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f7d1e5cc-edd4-41d4-b90c-155e2c8662f0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.158516 Aug 18 22:11:12.080681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1176/2359] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:11 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:12.113417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a3e834d7-bd70-4f01-8ec2-94eeabaf3398 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:12.122817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a3e834d7-bd70-4f01-8ec2-94eeabaf3398 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:12.124322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a3e834d7-bd70-4f01-8ec2-94eeabaf3398 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:12.125476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a3e834d7-bd70-4f01-8ec2-94eeabaf3398 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157170 Aug 18 22:11:12.126073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1184/2360] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:13.101142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e152bc9b-315c-4282-a4c6-964164b49e36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:13.101785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e152bc9b-315c-4282-a4c6-964164b49e36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:13.108098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e152bc9b-315c-4282-a4c6-964164b49e36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:13.108577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e152bc9b-315c-4282-a4c6-964164b49e36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:13.109008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e152bc9b-315c-4282-a4c6-964164b49e36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:13.109722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e152bc9b-315c-4282-a4c6-964164b49e36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:13.110172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e152bc9b-315c-4282-a4c6-964164b49e36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:13.110600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e152bc9b-315c-4282-a4c6-964164b49e36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:13.148136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dc40a3be-8eb7-465c-a435-6b2fbc3e91ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:13.148748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dc40a3be-8eb7-465c-a435-6b2fbc3e91ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:13.155057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc40a3be-8eb7-465c-a435-6b2fbc3e91ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:13.155533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc40a3be-8eb7-465c-a435-6b2fbc3e91ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:13.155962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc40a3be-8eb7-465c-a435-6b2fbc3e91ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:13.156645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc40a3be-8eb7-465c-a435-6b2fbc3e91ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:13.157095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc40a3be-8eb7-465c-a435-6b2fbc3e91ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:13.157513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc40a3be-8eb7-465c-a435-6b2fbc3e91ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:13.238453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e152bc9b-315c-4282-a4c6-964164b49e36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:13.247119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e152bc9b-315c-4282-a4c6-964164b49e36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149761 Aug 18 22:11:13.247697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1177/2361] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:13 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:13.289316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc40a3be-8eb7-465c-a435-6b2fbc3e91ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:13.297944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc40a3be-8eb7-465c-a435-6b2fbc3e91ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:13.299386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc40a3be-8eb7-465c-a435-6b2fbc3e91ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:13.300798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dc40a3be-8eb7-465c-a435-6b2fbc3e91ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156442 Aug 18 22:11:13.301355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1185/2362] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:13 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:14.268904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d81b189e-0dd5-4660-a245-ff4084f4f90d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:14.269867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d81b189e-0dd5-4660-a245-ff4084f4f90d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:14.277069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d81b189e-0dd5-4660-a245-ff4084f4f90d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:14.277565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d81b189e-0dd5-4660-a245-ff4084f4f90d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:14.278030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d81b189e-0dd5-4660-a245-ff4084f4f90d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:14.278738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d81b189e-0dd5-4660-a245-ff4084f4f90d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:14.279188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d81b189e-0dd5-4660-a245-ff4084f4f90d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:14.279612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d81b189e-0dd5-4660-a245-ff4084f4f90d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:14.324551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-504a7cf6-c4e4-43b7-aa19-39855698c517 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:14.325172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-504a7cf6-c4e4-43b7-aa19-39855698c517 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:14.331773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-504a7cf6-c4e4-43b7-aa19-39855698c517 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:14.332512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-504a7cf6-c4e4-43b7-aa19-39855698c517 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:14.334338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-504a7cf6-c4e4-43b7-aa19-39855698c517 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:14.334338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-504a7cf6-c4e4-43b7-aa19-39855698c517 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:14.334338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-504a7cf6-c4e4-43b7-aa19-39855698c517 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:14.335474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-504a7cf6-c4e4-43b7-aa19-39855698c517 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:14.430748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d81b189e-0dd5-4660-a245-ff4084f4f90d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:14.458440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d81b189e-0dd5-4660-a245-ff4084f4f90d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.193316 Aug 18 22:11:14.459039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1178/2363] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:14 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:14.483221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-504a7cf6-c4e4-43b7-aa19-39855698c517 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:14.492001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-504a7cf6-c4e4-43b7-aa19-39855698c517 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:14.493494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-504a7cf6-c4e4-43b7-aa19-39855698c517 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:14.494682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-504a7cf6-c4e4-43b7-aa19-39855698c517 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.174165 Aug 18 22:11:14.495237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1186/2364] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:15.480257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cc252377-56b8-4fc4-8d61-79cba615298d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:15.480971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cc252377-56b8-4fc4-8d61-79cba615298d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:15.487272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc252377-56b8-4fc4-8d61-79cba615298d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:15.487752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc252377-56b8-4fc4-8d61-79cba615298d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:15.488187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc252377-56b8-4fc4-8d61-79cba615298d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:15.488872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc252377-56b8-4fc4-8d61-79cba615298d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:15.489319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc252377-56b8-4fc4-8d61-79cba615298d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:15.489776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc252377-56b8-4fc4-8d61-79cba615298d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:15.517524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7914e199-d81a-48e2-914e-62151ca6648e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:15.518775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7914e199-d81a-48e2-914e-62151ca6648e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:15.526887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7914e199-d81a-48e2-914e-62151ca6648e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:15.527625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7914e199-d81a-48e2-914e-62151ca6648e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:15.528252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7914e199-d81a-48e2-914e-62151ca6648e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:15.528962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7914e199-d81a-48e2-914e-62151ca6648e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:15.529422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7914e199-d81a-48e2-914e-62151ca6648e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:15.529899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7914e199-d81a-48e2-914e-62151ca6648e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:15.534247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:15.638249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cc252377-56b8-4fc4-8d61-79cba615298d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:15.646680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cc252377-56b8-4fc4-8d61-79cba615298d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.170121 Aug 18 22:11:15.647744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1179/2365] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:15 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:15.676004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7914e199-d81a-48e2-914e-62151ca6648e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:15.684671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7914e199-d81a-48e2-914e-62151ca6648e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:15.686364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7914e199-d81a-48e2-914e-62151ca6648e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:15.687529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7914e199-d81a-48e2-914e-62151ca6648e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.173989 Aug 18 22:11:15.689568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1187/2366] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:16.667638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9a5af963-fa25-4cea-8185-a81a974c52af tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:16.668363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9a5af963-fa25-4cea-8185-a81a974c52af tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:16.675032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a5af963-fa25-4cea-8185-a81a974c52af tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:16.675586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a5af963-fa25-4cea-8185-a81a974c52af tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:16.676061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a5af963-fa25-4cea-8185-a81a974c52af tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:16.676748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a5af963-fa25-4cea-8185-a81a974c52af tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:16.677203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a5af963-fa25-4cea-8185-a81a974c52af tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:16.677652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a5af963-fa25-4cea-8185-a81a974c52af tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:16.710991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-960bf21b-468c-45b5-bce8-523470a31fb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:16.711615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-960bf21b-468c-45b5-bce8-523470a31fb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:16.718811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-960bf21b-468c-45b5-bce8-523470a31fb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:16.719310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-960bf21b-468c-45b5-bce8-523470a31fb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:16.719756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-960bf21b-468c-45b5-bce8-523470a31fb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:16.720915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-960bf21b-468c-45b5-bce8-523470a31fb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:16.720915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-960bf21b-468c-45b5-bce8-523470a31fb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:16.721683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-960bf21b-468c-45b5-bce8-523470a31fb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:16.829247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9a5af963-fa25-4cea-8185-a81a974c52af tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:16.838051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9a5af963-fa25-4cea-8185-a81a974c52af tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.174155 Aug 18 22:11:16.838638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1180/2367] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:16 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:16.867994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-960bf21b-468c-45b5-bce8-523470a31fb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:16.876766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-960bf21b-468c-45b5-bce8-523470a31fb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:16.878324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-960bf21b-468c-45b5-bce8-523470a31fb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:16.879480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-960bf21b-468c-45b5-bce8-523470a31fb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.172395 Aug 18 22:11:16.880067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1188/2368] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:17.858325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d5fb442d-7d9a-46f1-938f-04bbf44d4fe4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:17.858944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d5fb442d-7d9a-46f1-938f-04bbf44d4fe4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:17.865355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5fb442d-7d9a-46f1-938f-04bbf44d4fe4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:17.866360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5fb442d-7d9a-46f1-938f-04bbf44d4fe4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:17.866799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5fb442d-7d9a-46f1-938f-04bbf44d4fe4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:17.867482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5fb442d-7d9a-46f1-938f-04bbf44d4fe4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:17.867938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5fb442d-7d9a-46f1-938f-04bbf44d4fe4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:17.868360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5fb442d-7d9a-46f1-938f-04bbf44d4fe4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:17.903106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-11975fb9-4f9f-473d-a59b-31195c01445f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:17.903731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-11975fb9-4f9f-473d-a59b-31195c01445f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:17.909982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11975fb9-4f9f-473d-a59b-31195c01445f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:17.911065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11975fb9-4f9f-473d-a59b-31195c01445f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:17.911507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11975fb9-4f9f-473d-a59b-31195c01445f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:17.912936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11975fb9-4f9f-473d-a59b-31195c01445f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:17.913570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11975fb9-4f9f-473d-a59b-31195c01445f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:17.914026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11975fb9-4f9f-473d-a59b-31195c01445f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:18.003187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d5fb442d-7d9a-46f1-938f-04bbf44d4fe4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:18.011711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d5fb442d-7d9a-46f1-938f-04bbf44d4fe4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157145 Aug 18 22:11:18.012286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1181/2369] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:17 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:18.016884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-edaf5ca5-25f2-4f02-91c5-a192b41ae2ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:18.017384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-edaf5ca5-25f2-4f02-91c5-a192b41ae2ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:18.023290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-edaf5ca5-25f2-4f02-91c5-a192b41ae2ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:18.023780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-edaf5ca5-25f2-4f02-91c5-a192b41ae2ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:18.024212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-edaf5ca5-25f2-4f02-91c5-a192b41ae2ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:18.025073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-edaf5ca5-25f2-4f02-91c5-a192b41ae2ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:18.025792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-edaf5ca5-25f2-4f02-91c5-a192b41ae2ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:18.026221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-edaf5ca5-25f2-4f02-91c5-a192b41ae2ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:18.050118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-11975fb9-4f9f-473d-a59b-31195c01445f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:18.051136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-edaf5ca5-25f2-4f02-91c5-a192b41ae2ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:11:18.059437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-11975fb9-4f9f-473d-a59b-31195c01445f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:18.060922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-11975fb9-4f9f-473d-a59b-31195c01445f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:18.062096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-11975fb9-4f9f-473d-a59b-31195c01445f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.163802 Aug 18 22:11:18.062656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1189/2370] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:18.127787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-edaf5ca5-25f2-4f02-91c5-a192b41ae2ad tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 204 len: 0 microversion: 2.1 time: 0.114099 Aug 18 22:11:18.128350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1182/2371] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:11:18 2022] DELETE /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:11:18.136804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2c096866-7eb6-41d7-966b-41ac4b1ce0b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:18.137421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2c096866-7eb6-41d7-966b-41ac4b1ce0b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:18.143270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c096866-7eb6-41d7-966b-41ac4b1ce0b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:18.143751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c096866-7eb6-41d7-966b-41ac4b1ce0b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:18.144186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c096866-7eb6-41d7-966b-41ac4b1ce0b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:18.144870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c096866-7eb6-41d7-966b-41ac4b1ce0b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:18.145317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c096866-7eb6-41d7-966b-41ac4b1ce0b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:18.145776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c096866-7eb6-41d7-966b-41ac4b1ce0b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:18.275880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2c096866-7eb6-41d7-966b-41ac4b1ce0b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:18.284063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2c096866-7eb6-41d7-966b-41ac4b1ce0b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151155 Aug 18 22:11:18.284627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1190/2372] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:18 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:18.787301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b6f803ba-f915-409e-8d6d-7ecf904f5fd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:18.787917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b6f803ba-f915-409e-8d6d-7ecf904f5fd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:18.793847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6f803ba-f915-409e-8d6d-7ecf904f5fd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:18.794382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6f803ba-f915-409e-8d6d-7ecf904f5fd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:18.794755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6f803ba-f915-409e-8d6d-7ecf904f5fd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:18.795451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6f803ba-f915-409e-8d6d-7ecf904f5fd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:18.795898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6f803ba-f915-409e-8d6d-7ecf904f5fd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:18.796317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6f803ba-f915-409e-8d6d-7ecf904f5fd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:18.821077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b6f803ba-f915-409e-8d6d-7ecf904f5fd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:11:18.893354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b6f803ba-f915-409e-8d6d-7ecf904f5fd1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "DELETE /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 204 len: 0 microversion: 2.1 time: 0.110812 Aug 18 22:11:18.894076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1183/2373] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:11:18 2022] DELETE /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:11:18.902954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e085b0ca-42aa-4446-bd05-bfe073c9f1b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:18.903587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e085b0ca-42aa-4446-bd05-bfe073c9f1b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:18.909912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e085b0ca-42aa-4446-bd05-bfe073c9f1b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:18.910390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e085b0ca-42aa-4446-bd05-bfe073c9f1b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:18.910820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e085b0ca-42aa-4446-bd05-bfe073c9f1b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:18.911532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e085b0ca-42aa-4446-bd05-bfe073c9f1b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:18.911978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e085b0ca-42aa-4446-bd05-bfe073c9f1b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:18.912397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e085b0ca-42aa-4446-bd05-bfe073c9f1b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:19.032990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6cf820ba-433f-4bd9-be77-af3e0e62b306 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:19.034045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6cf820ba-433f-4bd9-be77-af3e0e62b306 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:19.039821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cf820ba-433f-4bd9-be77-af3e0e62b306 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:19.040321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cf820ba-433f-4bd9-be77-af3e0e62b306 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:19.040768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cf820ba-433f-4bd9-be77-af3e0e62b306 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:19.040965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e085b0ca-42aa-4446-bd05-bfe073c9f1b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:19.041474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cf820ba-433f-4bd9-be77-af3e0e62b306 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:19.041960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cf820ba-433f-4bd9-be77-af3e0e62b306 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:19.042393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cf820ba-433f-4bd9-be77-af3e0e62b306 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:19.050943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e085b0ca-42aa-4446-bd05-bfe073c9f1b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151620 Aug 18 22:11:19.051894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1191/2374] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:19.084121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-16e41fc9-17e0-44c9-b6a4-f440419b0c73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:19.085244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-16e41fc9-17e0-44c9-b6a4-f440419b0c73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:19.091324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16e41fc9-17e0-44c9-b6a4-f440419b0c73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:19.091881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16e41fc9-17e0-44c9-b6a4-f440419b0c73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:19.092320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16e41fc9-17e0-44c9-b6a4-f440419b0c73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:19.093010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16e41fc9-17e0-44c9-b6a4-f440419b0c73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:19.093461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16e41fc9-17e0-44c9-b6a4-f440419b0c73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:19.093911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16e41fc9-17e0-44c9-b6a4-f440419b0c73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:19.183961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6cf820ba-433f-4bd9-be77-af3e0e62b306 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:19.192330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6cf820ba-433f-4bd9-be77-af3e0e62b306 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.163544 Aug 18 22:11:19.192903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1184/2375] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:19 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:19.225538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-16e41fc9-17e0-44c9-b6a4-f440419b0c73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:19.234182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-16e41fc9-17e0-44c9-b6a4-f440419b0c73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:19.235741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-16e41fc9-17e0-44c9-b6a4-f440419b0c73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:19.236899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-16e41fc9-17e0-44c9-b6a4-f440419b0c73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156578 Aug 18 22:11:19.237468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1192/2376] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:19.305882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cb4e8bc1-87f1-452c-b510-b9da5d957d2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:19.306506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cb4e8bc1-87f1-452c-b510-b9da5d957d2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:19.312479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb4e8bc1-87f1-452c-b510-b9da5d957d2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:19.312965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb4e8bc1-87f1-452c-b510-b9da5d957d2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:19.313414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb4e8bc1-87f1-452c-b510-b9da5d957d2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:19.314137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb4e8bc1-87f1-452c-b510-b9da5d957d2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:19.314597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb4e8bc1-87f1-452c-b510-b9da5d957d2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:19.315044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb4e8bc1-87f1-452c-b510-b9da5d957d2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:19.445794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cb4e8bc1-87f1-452c-b510-b9da5d957d2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:19.453900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cb4e8bc1-87f1-452c-b510-b9da5d957d2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151869 Aug 18 22:11:19.454471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1185/2377] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:19 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:20.075439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e8acab67-3711-4caa-b003-178302f58587 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:20.076095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e8acab67-3711-4caa-b003-178302f58587 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:20.082467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8acab67-3711-4caa-b003-178302f58587 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:20.082961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8acab67-3711-4caa-b003-178302f58587 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:20.083402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8acab67-3711-4caa-b003-178302f58587 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:20.084098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8acab67-3711-4caa-b003-178302f58587 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:20.084559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8acab67-3711-4caa-b003-178302f58587 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:20.084988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8acab67-3711-4caa-b003-178302f58587 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:20.212052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e8acab67-3711-4caa-b003-178302f58587 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:20.212383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eafef145-85aa-4742-8903-64f390bb8e41 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:20.213005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eafef145-85aa-4742-8903-64f390bb8e41 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:20.219402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eafef145-85aa-4742-8903-64f390bb8e41 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:20.219906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eafef145-85aa-4742-8903-64f390bb8e41 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:20.220324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eafef145-85aa-4742-8903-64f390bb8e41 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:20.220431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e8acab67-3711-4caa-b003-178302f58587 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148761 Aug 18 22:11:20.220889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1193/2378] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:20 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:20.221035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eafef145-85aa-4742-8903-64f390bb8e41 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:20.221493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eafef145-85aa-4742-8903-64f390bb8e41 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:20.221932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eafef145-85aa-4742-8903-64f390bb8e41 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:20.259252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c32ebe63-77c4-401b-8e68-c9f2020eb421 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:20.259853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c32ebe63-77c4-401b-8e68-c9f2020eb421 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:20.265732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c32ebe63-77c4-401b-8e68-c9f2020eb421 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:20.266216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c32ebe63-77c4-401b-8e68-c9f2020eb421 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:20.266649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c32ebe63-77c4-401b-8e68-c9f2020eb421 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:20.267332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c32ebe63-77c4-401b-8e68-c9f2020eb421 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:20.267784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c32ebe63-77c4-401b-8e68-c9f2020eb421 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:20.268223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c32ebe63-77c4-401b-8e68-c9f2020eb421 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:20.351724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-eafef145-85aa-4742-8903-64f390bb8e41 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:20.361939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eafef145-85aa-4742-8903-64f390bb8e41 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153256 Aug 18 22:11:20.362523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1186/2379] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:20 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:20.395529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c32ebe63-77c4-401b-8e68-c9f2020eb421 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:20.404069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c32ebe63-77c4-401b-8e68-c9f2020eb421 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:20.405558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c32ebe63-77c4-401b-8e68-c9f2020eb421 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:20.407258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c32ebe63-77c4-401b-8e68-c9f2020eb421 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151512 Aug 18 22:11:20.408280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1194/2380] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:20 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:20.476190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ecb70bef-b9b8-4743-8576-aa81e457f999 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:20.476805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ecb70bef-b9b8-4743-8576-aa81e457f999 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:20.482771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecb70bef-b9b8-4743-8576-aa81e457f999 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:20.483258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecb70bef-b9b8-4743-8576-aa81e457f999 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:20.483698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecb70bef-b9b8-4743-8576-aa81e457f999 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:20.484391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecb70bef-b9b8-4743-8576-aa81e457f999 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:20.484849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecb70bef-b9b8-4743-8576-aa81e457f999 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:20.485277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecb70bef-b9b8-4743-8576-aa81e457f999 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:20.500732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:20.618700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ecb70bef-b9b8-4743-8576-aa81e457f999 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:20.626946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ecb70bef-b9b8-4743-8576-aa81e457f999 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155108 Aug 18 22:11:20.627516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1187/2381] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:20 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:21.241519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-619e3abd-1010-4b12-af47-1942ec8e0ee9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:21.242183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-619e3abd-1010-4b12-af47-1942ec8e0ee9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:21.248629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-619e3abd-1010-4b12-af47-1942ec8e0ee9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:21.249114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-619e3abd-1010-4b12-af47-1942ec8e0ee9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:21.249553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-619e3abd-1010-4b12-af47-1942ec8e0ee9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:21.250266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-619e3abd-1010-4b12-af47-1942ec8e0ee9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:21.250727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-619e3abd-1010-4b12-af47-1942ec8e0ee9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:21.251152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-619e3abd-1010-4b12-af47-1942ec8e0ee9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:21.378737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-619e3abd-1010-4b12-af47-1942ec8e0ee9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:21.383680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6d57773c-6f00-462b-9250-a02baac4a8ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:21.384293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6d57773c-6f00-462b-9250-a02baac4a8ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:21.387903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-619e3abd-1010-4b12-af47-1942ec8e0ee9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150216 Aug 18 22:11:21.388490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1195/2382] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:21 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:21.390845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d57773c-6f00-462b-9250-a02baac4a8ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:21.391325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d57773c-6f00-462b-9250-a02baac4a8ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:21.391755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d57773c-6f00-462b-9250-a02baac4a8ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:21.392440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d57773c-6f00-462b-9250-a02baac4a8ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:21.392888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d57773c-6f00-462b-9250-a02baac4a8ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:21.393312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6d57773c-6f00-462b-9250-a02baac4a8ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:21.434239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9028738f-640a-4824-8805-39352e1bccf4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:21.434879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9028738f-640a-4824-8805-39352e1bccf4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:21.440765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9028738f-640a-4824-8805-39352e1bccf4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:21.441250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9028738f-640a-4824-8805-39352e1bccf4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:21.441719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9028738f-640a-4824-8805-39352e1bccf4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:21.442422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9028738f-640a-4824-8805-39352e1bccf4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:21.442879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9028738f-640a-4824-8805-39352e1bccf4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:21.443308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9028738f-640a-4824-8805-39352e1bccf4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:21.524313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6d57773c-6f00-462b-9250-a02baac4a8ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:21.532557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6d57773c-6f00-462b-9250-a02baac4a8ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153143 Aug 18 22:11:21.533127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1188/2383] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:21 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:21.572977 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9028738f-640a-4824-8805-39352e1bccf4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:21.581464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9028738f-640a-4824-8805-39352e1bccf4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:21.582940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9028738f-640a-4824-8805-39352e1bccf4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:21.584080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9028738f-640a-4824-8805-39352e1bccf4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153739 Aug 18 22:11:21.584679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1196/2384] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:21.647978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-905f11aa-b19f-48ab-9561-7c930181562a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:21.648597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-905f11aa-b19f-48ab-9561-7c930181562a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:21.654620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905f11aa-b19f-48ab-9561-7c930181562a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:21.655109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905f11aa-b19f-48ab-9561-7c930181562a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:21.655551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905f11aa-b19f-48ab-9561-7c930181562a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:21.656239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905f11aa-b19f-48ab-9561-7c930181562a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:21.656724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905f11aa-b19f-48ab-9561-7c930181562a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:21.657133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-905f11aa-b19f-48ab-9561-7c930181562a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:21.788093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-905f11aa-b19f-48ab-9561-7c930181562a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:21.796654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-905f11aa-b19f-48ab-9561-7c930181562a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152550 Aug 18 22:11:21.797216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1189/2385] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:21 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:22.408780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-377ff21f-2bd6-4ae7-83c6-11c6cc059c1d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:22.409500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-377ff21f-2bd6-4ae7-83c6-11c6cc059c1d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:22.415989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-377ff21f-2bd6-4ae7-83c6-11c6cc059c1d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:22.416473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-377ff21f-2bd6-4ae7-83c6-11c6cc059c1d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:22.416910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-377ff21f-2bd6-4ae7-83c6-11c6cc059c1d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:22.417621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-377ff21f-2bd6-4ae7-83c6-11c6cc059c1d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:22.418080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-377ff21f-2bd6-4ae7-83c6-11c6cc059c1d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:22.418508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-377ff21f-2bd6-4ae7-83c6-11c6cc059c1d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:22.550991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-377ff21f-2bd6-4ae7-83c6-11c6cc059c1d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:22.553794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-72401666-e31e-4d7c-9a31-5249311d46cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:22.554445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-72401666-e31e-4d7c-9a31-5249311d46cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:22.559271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-377ff21f-2bd6-4ae7-83c6-11c6cc059c1d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154349 Aug 18 22:11:22.559971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1197/2386] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:22 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:22.560750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72401666-e31e-4d7c-9a31-5249311d46cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:22.561238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72401666-e31e-4d7c-9a31-5249311d46cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:22.561706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72401666-e31e-4d7c-9a31-5249311d46cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:22.562402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72401666-e31e-4d7c-9a31-5249311d46cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:22.562863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72401666-e31e-4d7c-9a31-5249311d46cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:22.563314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72401666-e31e-4d7c-9a31-5249311d46cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:22.606995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fdc3622e-eaab-4d7c-bee1-ed6d664a7b2d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:22.607616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fdc3622e-eaab-4d7c-bee1-ed6d664a7b2d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:22.613491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdc3622e-eaab-4d7c-bee1-ed6d664a7b2d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:22.614014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdc3622e-eaab-4d7c-bee1-ed6d664a7b2d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:22.614454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdc3622e-eaab-4d7c-bee1-ed6d664a7b2d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:22.615149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdc3622e-eaab-4d7c-bee1-ed6d664a7b2d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:22.615606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdc3622e-eaab-4d7c-bee1-ed6d664a7b2d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:22.616036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fdc3622e-eaab-4d7c-bee1-ed6d664a7b2d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:22.690774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-72401666-e31e-4d7c-9a31-5249311d46cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:22.699755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-72401666-e31e-4d7c-9a31-5249311d46cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150093 Aug 18 22:11:22.700338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1190/2387] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:22 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:22.744757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fdc3622e-eaab-4d7c-bee1-ed6d664a7b2d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:22.753290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fdc3622e-eaab-4d7c-bee1-ed6d664a7b2d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:22.754875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fdc3622e-eaab-4d7c-bee1-ed6d664a7b2d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:22.756034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fdc3622e-eaab-4d7c-bee1-ed6d664a7b2d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152914 Aug 18 22:11:22.756601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1198/2388] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:22.818715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f34a4a23-38fb-4c30-8eb8-fff3ba14c0e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:22.819339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f34a4a23-38fb-4c30-8eb8-fff3ba14c0e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:22.825875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f34a4a23-38fb-4c30-8eb8-fff3ba14c0e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:22.826365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f34a4a23-38fb-4c30-8eb8-fff3ba14c0e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:22.826842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f34a4a23-38fb-4c30-8eb8-fff3ba14c0e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:22.827537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f34a4a23-38fb-4c30-8eb8-fff3ba14c0e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:22.828000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f34a4a23-38fb-4c30-8eb8-fff3ba14c0e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:22.828460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f34a4a23-38fb-4c30-8eb8-fff3ba14c0e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:22.960613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f34a4a23-38fb-4c30-8eb8-fff3ba14c0e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:22.969050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f34a4a23-38fb-4c30-8eb8-fff3ba14c0e3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154137 Aug 18 22:11:22.969639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1191/2389] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:23.580921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2f3f1147-d4f9-46e9-a1c3-89dce6e23228 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:23.581540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2f3f1147-d4f9-46e9-a1c3-89dce6e23228 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:23.588559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f3f1147-d4f9-46e9-a1c3-89dce6e23228 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:23.589045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f3f1147-d4f9-46e9-a1c3-89dce6e23228 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:23.589482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f3f1147-d4f9-46e9-a1c3-89dce6e23228 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:23.590210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f3f1147-d4f9-46e9-a1c3-89dce6e23228 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:23.590679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f3f1147-d4f9-46e9-a1c3-89dce6e23228 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:23.591107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f3f1147-d4f9-46e9-a1c3-89dce6e23228 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:23.721567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2f3f1147-d4f9-46e9-a1c3-89dce6e23228 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:23.721780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9e1e6a05-e601-4b14-af70-a6c8337190c4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:23.722510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9e1e6a05-e601-4b14-af70-a6c8337190c4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:23.729625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e1e6a05-e601-4b14-af70-a6c8337190c4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:23.730236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e1e6a05-e601-4b14-af70-a6c8337190c4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:23.730671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2f3f1147-d4f9-46e9-a1c3-89dce6e23228 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153684 Aug 18 22:11:23.730786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e1e6a05-e601-4b14-af70-a6c8337190c4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:23.731251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1199/2390] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:23 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:23.731629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e1e6a05-e601-4b14-af70-a6c8337190c4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:23.732266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e1e6a05-e601-4b14-af70-a6c8337190c4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:23.732767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e1e6a05-e601-4b14-af70-a6c8337190c4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:23.779511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5e032de8-ac3d-4400-9c63-203b33ea83d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:23.780119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5e032de8-ac3d-4400-9c63-203b33ea83d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:23.786119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e032de8-ac3d-4400-9c63-203b33ea83d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:23.786597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e032de8-ac3d-4400-9c63-203b33ea83d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:23.787029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e032de8-ac3d-4400-9c63-203b33ea83d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:23.787716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e032de8-ac3d-4400-9c63-203b33ea83d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:23.788163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e032de8-ac3d-4400-9c63-203b33ea83d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:23.788582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e032de8-ac3d-4400-9c63-203b33ea83d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:23.863385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9e1e6a05-e601-4b14-af70-a6c8337190c4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:23.871721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9e1e6a05-e601-4b14-af70-a6c8337190c4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154328 Aug 18 22:11:23.872305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1192/2391] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:23 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:23.919805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5e032de8-ac3d-4400-9c63-203b33ea83d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:23.930479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5e032de8-ac3d-4400-9c63-203b33ea83d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:23.932007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5e032de8-ac3d-4400-9c63-203b33ea83d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:23.933171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5e032de8-ac3d-4400-9c63-203b33ea83d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157539 Aug 18 22:11:23.933948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1200/2392] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:23.990472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2f347370-1476-4d6d-af2b-c7948131dbbc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:23.991094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2f347370-1476-4d6d-af2b-c7948131dbbc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:23.996926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f347370-1476-4d6d-af2b-c7948131dbbc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:23.997406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f347370-1476-4d6d-af2b-c7948131dbbc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:23.997875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f347370-1476-4d6d-af2b-c7948131dbbc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:23.998561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f347370-1476-4d6d-af2b-c7948131dbbc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:23.999021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f347370-1476-4d6d-af2b-c7948131dbbc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:23.999462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f347370-1476-4d6d-af2b-c7948131dbbc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:24.125448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2f347370-1476-4d6d-af2b-c7948131dbbc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:24.134178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2f347370-1476-4d6d-af2b-c7948131dbbc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.147578 Aug 18 22:11:24.134784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1193/2393] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:23 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:24.751431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b50a7cf0-67d6-45ae-88aa-f53d7e42e32b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:24.752043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b50a7cf0-67d6-45ae-88aa-f53d7e42e32b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:24.758480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b50a7cf0-67d6-45ae-88aa-f53d7e42e32b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:24.758952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b50a7cf0-67d6-45ae-88aa-f53d7e42e32b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:24.759384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b50a7cf0-67d6-45ae-88aa-f53d7e42e32b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:24.760061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b50a7cf0-67d6-45ae-88aa-f53d7e42e32b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:24.760508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b50a7cf0-67d6-45ae-88aa-f53d7e42e32b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:24.760927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b50a7cf0-67d6-45ae-88aa-f53d7e42e32b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:24.889727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b50a7cf0-67d6-45ae-88aa-f53d7e42e32b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:24.893858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-52128170-0c54-4718-b3b9-81e6af4cab4a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:24.894614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-52128170-0c54-4718-b3b9-81e6af4cab4a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:24.899147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b50a7cf0-67d6-45ae-88aa-f53d7e42e32b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151430 Aug 18 22:11:24.899745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1201/2394] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:24.900972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52128170-0c54-4718-b3b9-81e6af4cab4a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:24.901452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52128170-0c54-4718-b3b9-81e6af4cab4a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:24.901905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52128170-0c54-4718-b3b9-81e6af4cab4a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:24.902603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52128170-0c54-4718-b3b9-81e6af4cab4a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:24.903053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52128170-0c54-4718-b3b9-81e6af4cab4a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:24.903475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-52128170-0c54-4718-b3b9-81e6af4cab4a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:24.956275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a879d7fc-bbdf-4299-9c9b-2da15a5e63c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:24.957141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a879d7fc-bbdf-4299-9c9b-2da15a5e63c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:24.963112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a879d7fc-bbdf-4299-9c9b-2da15a5e63c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:24.963591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a879d7fc-bbdf-4299-9c9b-2da15a5e63c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:24.964022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a879d7fc-bbdf-4299-9c9b-2da15a5e63c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:24.964705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a879d7fc-bbdf-4299-9c9b-2da15a5e63c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:24.965151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a879d7fc-bbdf-4299-9c9b-2da15a5e63c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:24.965569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a879d7fc-bbdf-4299-9c9b-2da15a5e63c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:25.059883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-52128170-0c54-4718-b3b9-81e6af4cab4a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:25.068327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-52128170-0c54-4718-b3b9-81e6af4cab4a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.178504 Aug 18 22:11:25.069173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1194/2395] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:24 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:25.111809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a879d7fc-bbdf-4299-9c9b-2da15a5e63c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:25.121161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a879d7fc-bbdf-4299-9c9b-2da15a5e63c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:25.122704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a879d7fc-bbdf-4299-9c9b-2da15a5e63c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:25.123854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a879d7fc-bbdf-4299-9c9b-2da15a5e63c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.171711 Aug 18 22:11:25.124415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1202/2396] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:24 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:25.155539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07c7b722-4ed6-4554-a241-f0aa2fea0e4b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:25.156185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07c7b722-4ed6-4554-a241-f0aa2fea0e4b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:25.162119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07c7b722-4ed6-4554-a241-f0aa2fea0e4b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:25.162612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07c7b722-4ed6-4554-a241-f0aa2fea0e4b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:25.163054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07c7b722-4ed6-4554-a241-f0aa2fea0e4b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:25.163749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07c7b722-4ed6-4554-a241-f0aa2fea0e4b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:25.164209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07c7b722-4ed6-4554-a241-f0aa2fea0e4b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:25.165183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07c7b722-4ed6-4554-a241-f0aa2fea0e4b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:25.294682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-07c7b722-4ed6-4554-a241-f0aa2fea0e4b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:25.303938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07c7b722-4ed6-4554-a241-f0aa2fea0e4b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152172 Aug 18 22:11:25.304905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1195/2397] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:25.919838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-50fa54ab-a17c-434c-b7b9-7bf595ae6b30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:25.920479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-50fa54ab-a17c-434c-b7b9-7bf595ae6b30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:25.927151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50fa54ab-a17c-434c-b7b9-7bf595ae6b30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:25.927625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50fa54ab-a17c-434c-b7b9-7bf595ae6b30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:25.928054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50fa54ab-a17c-434c-b7b9-7bf595ae6b30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:25.928734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50fa54ab-a17c-434c-b7b9-7bf595ae6b30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:25.929179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50fa54ab-a17c-434c-b7b9-7bf595ae6b30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:25.929618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-50fa54ab-a17c-434c-b7b9-7bf595ae6b30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:26.056012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-50fa54ab-a17c-434c-b7b9-7bf595ae6b30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:26.058253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:26.065930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-50fa54ab-a17c-434c-b7b9-7bf595ae6b30 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149803 Aug 18 22:11:26.066508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1203/2398] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:25 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:26.096202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-449fbc01-c47c-4d6f-8372-d736df2c87e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:26.096202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-449fbc01-c47c-4d6f-8372-d736df2c87e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:26.099880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-449fbc01-c47c-4d6f-8372-d736df2c87e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:26.100373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-449fbc01-c47c-4d6f-8372-d736df2c87e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:26.100817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-449fbc01-c47c-4d6f-8372-d736df2c87e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:26.101521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-449fbc01-c47c-4d6f-8372-d736df2c87e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:26.102055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-449fbc01-c47c-4d6f-8372-d736df2c87e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:26.102486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-449fbc01-c47c-4d6f-8372-d736df2c87e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:26.146295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b9372bf1-45f8-4de0-8f0f-72e4761aac71 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:26.146906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b9372bf1-45f8-4de0-8f0f-72e4761aac71 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:26.152956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9372bf1-45f8-4de0-8f0f-72e4761aac71 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:26.153440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9372bf1-45f8-4de0-8f0f-72e4761aac71 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:26.153908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9372bf1-45f8-4de0-8f0f-72e4761aac71 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:26.154601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9372bf1-45f8-4de0-8f0f-72e4761aac71 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:26.155057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9372bf1-45f8-4de0-8f0f-72e4761aac71 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:26.155485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9372bf1-45f8-4de0-8f0f-72e4761aac71 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:26.234775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-449fbc01-c47c-4d6f-8372-d736df2c87e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:26.243877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-449fbc01-c47c-4d6f-8372-d736df2c87e1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.158130 Aug 18 22:11:26.244575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1196/2399] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:26 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:26.287905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b9372bf1-45f8-4de0-8f0f-72e4761aac71 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:26.296423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b9372bf1-45f8-4de0-8f0f-72e4761aac71 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:26.297939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b9372bf1-45f8-4de0-8f0f-72e4761aac71 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:26.299187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b9372bf1-45f8-4de0-8f0f-72e4761aac71 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156712 Aug 18 22:11:26.299743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1204/2400] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:26 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:26.326008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f0c86ff8-aa54-4599-935e-235b52b8d54b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:26.326628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f0c86ff8-aa54-4599-935e-235b52b8d54b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:26.332500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0c86ff8-aa54-4599-935e-235b52b8d54b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:26.332992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0c86ff8-aa54-4599-935e-235b52b8d54b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:26.333436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0c86ff8-aa54-4599-935e-235b52b8d54b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:26.334161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0c86ff8-aa54-4599-935e-235b52b8d54b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:26.334624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0c86ff8-aa54-4599-935e-235b52b8d54b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:26.335056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0c86ff8-aa54-4599-935e-235b52b8d54b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:26.460030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f0c86ff8-aa54-4599-935e-235b52b8d54b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:26.469261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f0c86ff8-aa54-4599-935e-235b52b8d54b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.147007 Aug 18 22:11:26.469866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1197/2401] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:26 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:27.087371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f33b7e35-77ac-490e-9a38-7c14b92b2263 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:27.087983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f33b7e35-77ac-490e-9a38-7c14b92b2263 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:27.094669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f33b7e35-77ac-490e-9a38-7c14b92b2263 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:27.095152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f33b7e35-77ac-490e-9a38-7c14b92b2263 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:27.095589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f33b7e35-77ac-490e-9a38-7c14b92b2263 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:27.096281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f33b7e35-77ac-490e-9a38-7c14b92b2263 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:27.096745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f33b7e35-77ac-490e-9a38-7c14b92b2263 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:27.097152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f33b7e35-77ac-490e-9a38-7c14b92b2263 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:27.232753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f33b7e35-77ac-490e-9a38-7c14b92b2263 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:27.241456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f33b7e35-77ac-490e-9a38-7c14b92b2263 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.157922 Aug 18 22:11:27.242062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1205/2402] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:27 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:27.264821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-042acd57-7ed5-4aea-9e35-9a32c0c1fde0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:27.265435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-042acd57-7ed5-4aea-9e35-9a32c0c1fde0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:27.271824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-042acd57-7ed5-4aea-9e35-9a32c0c1fde0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:27.272300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-042acd57-7ed5-4aea-9e35-9a32c0c1fde0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:27.272734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-042acd57-7ed5-4aea-9e35-9a32c0c1fde0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:27.273413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-042acd57-7ed5-4aea-9e35-9a32c0c1fde0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:27.273891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-042acd57-7ed5-4aea-9e35-9a32c0c1fde0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:27.274311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-042acd57-7ed5-4aea-9e35-9a32c0c1fde0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:27.322339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f81d8bc4-cc4d-4ff7-901b-02e7f451bccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:27.322883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f81d8bc4-cc4d-4ff7-901b-02e7f451bccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:27.328712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f81d8bc4-cc4d-4ff7-901b-02e7f451bccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:27.329197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f81d8bc4-cc4d-4ff7-901b-02e7f451bccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:27.329654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f81d8bc4-cc4d-4ff7-901b-02e7f451bccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:27.330394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f81d8bc4-cc4d-4ff7-901b-02e7f451bccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:27.330851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f81d8bc4-cc4d-4ff7-901b-02e7f451bccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:27.331273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f81d8bc4-cc4d-4ff7-901b-02e7f451bccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:27.404198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-042acd57-7ed5-4aea-9e35-9a32c0c1fde0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:27.412743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-042acd57-7ed5-4aea-9e35-9a32c0c1fde0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151736 Aug 18 22:11:27.413328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1198/2403] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:27 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:27.466254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f81d8bc4-cc4d-4ff7-901b-02e7f451bccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:27.474878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f81d8bc4-cc4d-4ff7-901b-02e7f451bccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:27.476378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f81d8bc4-cc4d-4ff7-901b-02e7f451bccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:27.478210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f81d8bc4-cc4d-4ff7-901b-02e7f451bccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159901 Aug 18 22:11:27.478781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1206/2404] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:27 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:27.491594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-980de47f-075b-4a8c-b7da-e32bbdcfe7ff tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:27.492213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-980de47f-075b-4a8c-b7da-e32bbdcfe7ff tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:27.498737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-980de47f-075b-4a8c-b7da-e32bbdcfe7ff tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:27.499218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-980de47f-075b-4a8c-b7da-e32bbdcfe7ff tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:27.499655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-980de47f-075b-4a8c-b7da-e32bbdcfe7ff tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:27.500338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-980de47f-075b-4a8c-b7da-e32bbdcfe7ff tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:27.500792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-980de47f-075b-4a8c-b7da-e32bbdcfe7ff tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:27.501213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-980de47f-075b-4a8c-b7da-e32bbdcfe7ff tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:27.631302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-980de47f-075b-4a8c-b7da-e32bbdcfe7ff tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:27.639532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-980de47f-075b-4a8c-b7da-e32bbdcfe7ff tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151722 Aug 18 22:11:27.640110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1199/2405] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:28.263341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-83d28cb2-1826-4622-a1f4-8b26e6d897e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:28.263989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-83d28cb2-1826-4622-a1f4-8b26e6d897e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:28.270423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83d28cb2-1826-4622-a1f4-8b26e6d897e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:28.270908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83d28cb2-1826-4622-a1f4-8b26e6d897e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:28.271348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83d28cb2-1826-4622-a1f4-8b26e6d897e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:28.272045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83d28cb2-1826-4622-a1f4-8b26e6d897e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:28.272505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83d28cb2-1826-4622-a1f4-8b26e6d897e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:28.272953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83d28cb2-1826-4622-a1f4-8b26e6d897e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:28.403893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-83d28cb2-1826-4622-a1f4-8b26e6d897e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:28.411928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-83d28cb2-1826-4622-a1f4-8b26e6d897e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152510 Aug 18 22:11:28.412496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1207/2406] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:28 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:28.501188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-267a1d53-bdca-4d6d-bb45-d40a1a7718cb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:28.501924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-267a1d53-bdca-4d6d-bb45-d40a1a7718cb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:28.507628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-267a1d53-bdca-4d6d-bb45-d40a1a7718cb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:28.508111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-267a1d53-bdca-4d6d-bb45-d40a1a7718cb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:28.508545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-267a1d53-bdca-4d6d-bb45-d40a1a7718cb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:28.509234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-267a1d53-bdca-4d6d-bb45-d40a1a7718cb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:28.509712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-267a1d53-bdca-4d6d-bb45-d40a1a7718cb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:28.510138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-267a1d53-bdca-4d6d-bb45-d40a1a7718cb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:28.552896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c2e63f7b-e180-43bd-bd9c-4cc3a4a88f80 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:28.553523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c2e63f7b-e180-43bd-bd9c-4cc3a4a88f80 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:28.555492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:28.561037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2e63f7b-e180-43bd-bd9c-4cc3a4a88f80 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:28.561523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2e63f7b-e180-43bd-bd9c-4cc3a4a88f80 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:28.561993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2e63f7b-e180-43bd-bd9c-4cc3a4a88f80 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:28.562692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2e63f7b-e180-43bd-bd9c-4cc3a4a88f80 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:28.563152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2e63f7b-e180-43bd-bd9c-4cc3a4a88f80 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:28.563582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2e63f7b-e180-43bd-bd9c-4cc3a4a88f80 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:28.639297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-267a1d53-bdca-4d6d-bb45-d40a1a7718cb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:28.648242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-267a1d53-bdca-4d6d-bb45-d40a1a7718cb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:28.649772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-267a1d53-bdca-4d6d-bb45-d40a1a7718cb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:28.650937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-267a1d53-bdca-4d6d-bb45-d40a1a7718cb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153558 Aug 18 22:11:28.651501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1208/2407] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:28.660136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-619f14b9-d4a4-4550-bb60-fc324ab5f135 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:28.660821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-619f14b9-d4a4-4550-bb60-fc324ab5f135 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:28.666693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-619f14b9-d4a4-4550-bb60-fc324ab5f135 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:28.667175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-619f14b9-d4a4-4550-bb60-fc324ab5f135 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:28.667607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-619f14b9-d4a4-4550-bb60-fc324ab5f135 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:28.668297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-619f14b9-d4a4-4550-bb60-fc324ab5f135 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:28.668748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-619f14b9-d4a4-4550-bb60-fc324ab5f135 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:28.669174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-619f14b9-d4a4-4550-bb60-fc324ab5f135 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:28.696229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c2e63f7b-e180-43bd-bd9c-4cc3a4a88f80 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:28.704505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c2e63f7b-e180-43bd-bd9c-4cc3a4a88f80 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.274083 Aug 18 22:11:28.705550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1200/2408] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:28 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:28.800329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-619f14b9-d4a4-4550-bb60-fc324ab5f135 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:28.809168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-619f14b9-d4a4-4550-bb60-fc324ab5f135 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152666 Aug 18 22:11:28.809772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1209/2409] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:29.434233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3f8a7ca7-cdd3-4bf7-9128-b9021af11b1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:29.435064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3f8a7ca7-cdd3-4bf7-9128-b9021af11b1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:29.441428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f8a7ca7-cdd3-4bf7-9128-b9021af11b1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:29.441948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f8a7ca7-cdd3-4bf7-9128-b9021af11b1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:29.442391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f8a7ca7-cdd3-4bf7-9128-b9021af11b1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:29.443093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f8a7ca7-cdd3-4bf7-9128-b9021af11b1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:29.443558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f8a7ca7-cdd3-4bf7-9128-b9021af11b1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:29.443987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f8a7ca7-cdd3-4bf7-9128-b9021af11b1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:29.572651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3f8a7ca7-cdd3-4bf7-9128-b9021af11b1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:29.580796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3f8a7ca7-cdd3-4bf7-9128-b9021af11b1b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150544 Aug 18 22:11:29.581370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1201/2410] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:29 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:29.673403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fabde532-36d6-44ed-b058-d3ea708d2b5d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:29.674055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fabde532-36d6-44ed-b058-d3ea708d2b5d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:29.680736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fabde532-36d6-44ed-b058-d3ea708d2b5d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:29.681221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fabde532-36d6-44ed-b058-d3ea708d2b5d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:29.681689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fabde532-36d6-44ed-b058-d3ea708d2b5d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:29.682385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fabde532-36d6-44ed-b058-d3ea708d2b5d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:29.682843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fabde532-36d6-44ed-b058-d3ea708d2b5d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:29.683277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fabde532-36d6-44ed-b058-d3ea708d2b5d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:29.725466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-df9d7b48-5dea-447d-bf98-e7713044e280 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:29.726125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-df9d7b48-5dea-447d-bf98-e7713044e280 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:29.732168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df9d7b48-5dea-447d-bf98-e7713044e280 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:29.732656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df9d7b48-5dea-447d-bf98-e7713044e280 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:29.733099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df9d7b48-5dea-447d-bf98-e7713044e280 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:29.733839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df9d7b48-5dea-447d-bf98-e7713044e280 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:29.734298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df9d7b48-5dea-447d-bf98-e7713044e280 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:29.734732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df9d7b48-5dea-447d-bf98-e7713044e280 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:29.813706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fabde532-36d6-44ed-b058-d3ea708d2b5d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:29.822887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fabde532-36d6-44ed-b058-d3ea708d2b5d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:29.824349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fabde532-36d6-44ed-b058-d3ea708d2b5d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:29.825516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fabde532-36d6-44ed-b058-d3ea708d2b5d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156014 Aug 18 22:11:29.826101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1210/2411] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:29.830710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b7b3c1b5-3390-44aa-883a-31feb0574ab1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:29.831321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b7b3c1b5-3390-44aa-883a-31feb0574ab1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:29.838207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7b3c1b5-3390-44aa-883a-31feb0574ab1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:29.838686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7b3c1b5-3390-44aa-883a-31feb0574ab1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:29.839114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7b3c1b5-3390-44aa-883a-31feb0574ab1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:29.840005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7b3c1b5-3390-44aa-883a-31feb0574ab1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:29.840455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7b3c1b5-3390-44aa-883a-31feb0574ab1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:29.840879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7b3c1b5-3390-44aa-883a-31feb0574ab1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:29.870758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-df9d7b48-5dea-447d-bf98-e7713044e280 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:29.879347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-df9d7b48-5dea-447d-bf98-e7713044e280 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157675 Aug 18 22:11:29.879932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1202/2412] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:29 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:29.970753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b7b3c1b5-3390-44aa-883a-31feb0574ab1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:29.979274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b7b3c1b5-3390-44aa-883a-31feb0574ab1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152248 Aug 18 22:11:29.979846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1211/2413] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:29 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:30.602689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0131ae80-88a4-4ac3-a9cb-edf3abfdf47e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:30.603222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0131ae80-88a4-4ac3-a9cb-edf3abfdf47e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:30.609971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0131ae80-88a4-4ac3-a9cb-edf3abfdf47e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:30.610456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0131ae80-88a4-4ac3-a9cb-edf3abfdf47e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:30.610899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0131ae80-88a4-4ac3-a9cb-edf3abfdf47e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:30.611583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0131ae80-88a4-4ac3-a9cb-edf3abfdf47e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:30.612041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0131ae80-88a4-4ac3-a9cb-edf3abfdf47e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:30.612472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0131ae80-88a4-4ac3-a9cb-edf3abfdf47e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:30.783556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0131ae80-88a4-4ac3-a9cb-edf3abfdf47e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:30.792304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0131ae80-88a4-4ac3-a9cb-edf3abfdf47e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.194149 Aug 18 22:11:30.792870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1203/2414] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:30.849159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-97528340-46ba-4f36-92d5-b16bec41cf7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:30.849888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-97528340-46ba-4f36-92d5-b16bec41cf7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:30.857482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97528340-46ba-4f36-92d5-b16bec41cf7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:30.857944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97528340-46ba-4f36-92d5-b16bec41cf7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:30.858386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97528340-46ba-4f36-92d5-b16bec41cf7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:30.859343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97528340-46ba-4f36-92d5-b16bec41cf7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:30.859809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97528340-46ba-4f36-92d5-b16bec41cf7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:30.860239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97528340-46ba-4f36-92d5-b16bec41cf7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:30.901091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a0c95fa1-2916-470a-90b2-3cd47f8e7254 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:30.901923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a0c95fa1-2916-470a-90b2-3cd47f8e7254 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:30.907885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0c95fa1-2916-470a-90b2-3cd47f8e7254 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:30.908370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0c95fa1-2916-470a-90b2-3cd47f8e7254 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:30.908810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0c95fa1-2916-470a-90b2-3cd47f8e7254 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:30.909505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0c95fa1-2916-470a-90b2-3cd47f8e7254 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:30.909987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0c95fa1-2916-470a-90b2-3cd47f8e7254 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:30.910416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0c95fa1-2916-470a-90b2-3cd47f8e7254 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:30.914342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:30.991547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-97528340-46ba-4f36-92d5-b16bec41cf7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:31.000629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-97528340-46ba-4f36-92d5-b16bec41cf7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:31.002144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-97528340-46ba-4f36-92d5-b16bec41cf7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:31.003296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-97528340-46ba-4f36-92d5-b16bec41cf7a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.158736 Aug 18 22:11:31.003856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1212/2415] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:31.008901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9a8b4bd4-4b46-4769-8c4f-fd28cc78f36d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:31.009503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9a8b4bd4-4b46-4769-8c4f-fd28cc78f36d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:31.015441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a8b4bd4-4b46-4769-8c4f-fd28cc78f36d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:31.016133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a8b4bd4-4b46-4769-8c4f-fd28cc78f36d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:31.016569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a8b4bd4-4b46-4769-8c4f-fd28cc78f36d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:31.017250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a8b4bd4-4b46-4769-8c4f-fd28cc78f36d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:31.017909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a8b4bd4-4b46-4769-8c4f-fd28cc78f36d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:31.018328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a8b4bd4-4b46-4769-8c4f-fd28cc78f36d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:31.042159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a0c95fa1-2916-470a-90b2-3cd47f8e7254 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:31.050688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a0c95fa1-2916-470a-90b2-3cd47f8e7254 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154082 Aug 18 22:11:31.051352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1204/2416] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:30 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:31.144602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9a8b4bd4-4b46-4769-8c4f-fd28cc78f36d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:31.153286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9a8b4bd4-4b46-4769-8c4f-fd28cc78f36d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148480 Aug 18 22:11:31.153894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1213/2417] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:31 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:31.814018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2d5c31b1-1c0e-4684-a551-4cafa1f6dbbc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:31.814638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2d5c31b1-1c0e-4684-a551-4cafa1f6dbbc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:31.821530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d5c31b1-1c0e-4684-a551-4cafa1f6dbbc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:31.822041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d5c31b1-1c0e-4684-a551-4cafa1f6dbbc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:31.822472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d5c31b1-1c0e-4684-a551-4cafa1f6dbbc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:31.823148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d5c31b1-1c0e-4684-a551-4cafa1f6dbbc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:31.823597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d5c31b1-1c0e-4684-a551-4cafa1f6dbbc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:31.824017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d5c31b1-1c0e-4684-a551-4cafa1f6dbbc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:31.950958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2d5c31b1-1c0e-4684-a551-4cafa1f6dbbc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:31.959533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2d5c31b1-1c0e-4684-a551-4cafa1f6dbbc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149704 Aug 18 22:11:31.960120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1205/2418] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:31 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:32.026866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eb3b00ea-6016-4b3e-a6d9-b1a48c8723ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:32.027486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eb3b00ea-6016-4b3e-a6d9-b1a48c8723ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:32.029892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:32.035453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb3b00ea-6016-4b3e-a6d9-b1a48c8723ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:32.035932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb3b00ea-6016-4b3e-a6d9-b1a48c8723ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:32.036370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb3b00ea-6016-4b3e-a6d9-b1a48c8723ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:32.037061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb3b00ea-6016-4b3e-a6d9-b1a48c8723ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:32.037515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb3b00ea-6016-4b3e-a6d9-b1a48c8723ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:32.037965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb3b00ea-6016-4b3e-a6d9-b1a48c8723ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:32.071351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f4b1d615-d10e-45e6-9ede-b0ddc2b854a4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:32.072117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f4b1d615-d10e-45e6-9ede-b0ddc2b854a4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:32.078441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4b1d615-d10e-45e6-9ede-b0ddc2b854a4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:32.079002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4b1d615-d10e-45e6-9ede-b0ddc2b854a4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:32.079449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4b1d615-d10e-45e6-9ede-b0ddc2b854a4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:32.080174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4b1d615-d10e-45e6-9ede-b0ddc2b854a4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:32.080658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4b1d615-d10e-45e6-9ede-b0ddc2b854a4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:32.081074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4b1d615-d10e-45e6-9ede-b0ddc2b854a4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:32.178726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eb3b00ea-6016-4b3e-a6d9-b1a48c8723ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:32.187854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eb3b00ea-6016-4b3e-a6d9-b1a48c8723ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:32.189351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eb3b00ea-6016-4b3e-a6d9-b1a48c8723ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:32.190545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eb3b00ea-6016-4b3e-a6d9-b1a48c8723ee tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.167524 Aug 18 22:11:32.191104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1214/2419] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:32.195515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f42d0f6e-02ab-46a0-b5a1-5da2de99d5f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:32.196126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f42d0f6e-02ab-46a0-b5a1-5da2de99d5f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:32.202351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f42d0f6e-02ab-46a0-b5a1-5da2de99d5f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:32.202832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f42d0f6e-02ab-46a0-b5a1-5da2de99d5f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:32.203332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f42d0f6e-02ab-46a0-b5a1-5da2de99d5f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:32.204027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f42d0f6e-02ab-46a0-b5a1-5da2de99d5f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:32.204479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f42d0f6e-02ab-46a0-b5a1-5da2de99d5f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:32.204904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f42d0f6e-02ab-46a0-b5a1-5da2de99d5f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:32.223751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f4b1d615-d10e-45e6-9ede-b0ddc2b854a4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:32.232684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f4b1d615-d10e-45e6-9ede-b0ddc2b854a4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.165155 Aug 18 22:11:32.233271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1206/2420] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:32 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:32.332362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f42d0f6e-02ab-46a0-b5a1-5da2de99d5f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:32.341051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f42d0f6e-02ab-46a0-b5a1-5da2de99d5f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149022 Aug 18 22:11:32.341656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1215/2421] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:32 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:32.980684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2a4f6d4a-2af4-4f7b-b4cd-e4a32f76a39e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:32.981229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2a4f6d4a-2af4-4f7b-b4cd-e4a32f76a39e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:32.988138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a4f6d4a-2af4-4f7b-b4cd-e4a32f76a39e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:32.988626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a4f6d4a-2af4-4f7b-b4cd-e4a32f76a39e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:32.989075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a4f6d4a-2af4-4f7b-b4cd-e4a32f76a39e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:32.989818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a4f6d4a-2af4-4f7b-b4cd-e4a32f76a39e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:32.990287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a4f6d4a-2af4-4f7b-b4cd-e4a32f76a39e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:32.990718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a4f6d4a-2af4-4f7b-b4cd-e4a32f76a39e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:33.115556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2a4f6d4a-2af4-4f7b-b4cd-e4a32f76a39e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:33.124112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2a4f6d4a-2af4-4f7b-b4cd-e4a32f76a39e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147646 Aug 18 22:11:33.124686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1207/2422] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:33.213294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7b604f8f-7b2f-49a3-8681-7c52b90387c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:33.213930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7b604f8f-7b2f-49a3-8681-7c52b90387c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:33.220361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b604f8f-7b2f-49a3-8681-7c52b90387c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:33.220993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b604f8f-7b2f-49a3-8681-7c52b90387c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:33.221282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b604f8f-7b2f-49a3-8681-7c52b90387c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:33.222025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b604f8f-7b2f-49a3-8681-7c52b90387c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:33.222526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b604f8f-7b2f-49a3-8681-7c52b90387c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:33.222887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b604f8f-7b2f-49a3-8681-7c52b90387c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:33.253966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6805feda-d3b2-4961-8655-7c52b8997e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:33.254501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6805feda-d3b2-4961-8655-7c52b8997e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:33.261074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6805feda-d3b2-4961-8655-7c52b8997e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:33.261557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6805feda-d3b2-4961-8655-7c52b8997e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:33.262022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6805feda-d3b2-4961-8655-7c52b8997e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:33.262714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6805feda-d3b2-4961-8655-7c52b8997e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:33.263172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6805feda-d3b2-4961-8655-7c52b8997e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:33.263595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6805feda-d3b2-4961-8655-7c52b8997e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:33.354642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7b604f8f-7b2f-49a3-8681-7c52b90387c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:33.363465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7b604f8f-7b2f-49a3-8681-7c52b90387c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:33.364979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7b604f8f-7b2f-49a3-8681-7c52b90387c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:33.366206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7b604f8f-7b2f-49a3-8681-7c52b90387c9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156839 Aug 18 22:11:33.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1216/2423] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:33 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:33.371748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f0acfb5-db20-425a-b17b-c965971871cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:33.372367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f0acfb5-db20-425a-b17b-c965971871cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:33.378128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f0acfb5-db20-425a-b17b-c965971871cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:33.378621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f0acfb5-db20-425a-b17b-c965971871cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:33.379062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f0acfb5-db20-425a-b17b-c965971871cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:33.379764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f0acfb5-db20-425a-b17b-c965971871cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:33.380222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f0acfb5-db20-425a-b17b-c965971871cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:33.380662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f0acfb5-db20-425a-b17b-c965971871cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:33.397216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6805feda-d3b2-4961-8655-7c52b8997e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:33.405445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6805feda-d3b2-4961-8655-7c52b8997e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155411 Aug 18 22:11:33.406060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1208/2424] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:33 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:33.509990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4f0acfb5-db20-425a-b17b-c965971871cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:33.518546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f0acfb5-db20-425a-b17b-c965971871cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150423 Aug 18 22:11:33.518782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1217/2425] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:33 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:33.691917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-787bb1dc-a26e-4366-b068-c0bf4d7a827d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:33.692504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-787bb1dc-a26e-4366-b068-c0bf4d7a827d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:33.698883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-787bb1dc-a26e-4366-b068-c0bf4d7a827d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:33.699369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-787bb1dc-a26e-4366-b068-c0bf4d7a827d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:33.699806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-787bb1dc-a26e-4366-b068-c0bf4d7a827d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:33.700533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-787bb1dc-a26e-4366-b068-c0bf4d7a827d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:33.700987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-787bb1dc-a26e-4366-b068-c0bf4d7a827d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:33.701436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-787bb1dc-a26e-4366-b068-c0bf4d7a827d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:33.730192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-787bb1dc-a26e-4366-b068-c0bf4d7a827d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:11:33.808077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-787bb1dc-a26e-4366-b068-c0bf4d7a827d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 204 len: 0 microversion: 2.1 time: 0.120185 Aug 18 22:11:33.809091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1209/2426] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:11:33 2022] DELETE /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:11:33.817789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9da82af1-8b8b-4af0-996d-27e2733820a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:33.818407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9da82af1-8b8b-4af0-996d-27e2733820a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:33.824337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9da82af1-8b8b-4af0-996d-27e2733820a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:33.824814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9da82af1-8b8b-4af0-996d-27e2733820a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:33.825249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9da82af1-8b8b-4af0-996d-27e2733820a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:33.825954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9da82af1-8b8b-4af0-996d-27e2733820a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:33.826403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9da82af1-8b8b-4af0-996d-27e2733820a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:33.826822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9da82af1-8b8b-4af0-996d-27e2733820a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:33.952409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9da82af1-8b8b-4af0-996d-27e2733820a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:33.960733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9da82af1-8b8b-4af0-996d-27e2733820a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.147490 Aug 18 22:11:33.961823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1218/2427] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:34.146217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8b3dcd97-2d7f-44fb-934a-4273e57c78f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:34.146872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8b3dcd97-2d7f-44fb-934a-4273e57c78f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:34.153894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b3dcd97-2d7f-44fb-934a-4273e57c78f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:34.154379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b3dcd97-2d7f-44fb-934a-4273e57c78f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:34.154822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b3dcd97-2d7f-44fb-934a-4273e57c78f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:34.155509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b3dcd97-2d7f-44fb-934a-4273e57c78f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:34.155963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b3dcd97-2d7f-44fb-934a-4273e57c78f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:34.156392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b3dcd97-2d7f-44fb-934a-4273e57c78f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:34.285858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8b3dcd97-2d7f-44fb-934a-4273e57c78f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:34.294138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8b3dcd97-2d7f-44fb-934a-4273e57c78f7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152140 Aug 18 22:11:34.294729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1210/2428] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:34 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:34.390079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-28485202-e2ae-4169-a40a-0030ea51ecc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:34.390698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-28485202-e2ae-4169-a40a-0030ea51ecc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:34.397065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28485202-e2ae-4169-a40a-0030ea51ecc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:34.397495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28485202-e2ae-4169-a40a-0030ea51ecc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:34.397961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28485202-e2ae-4169-a40a-0030ea51ecc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:34.398667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28485202-e2ae-4169-a40a-0030ea51ecc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:34.399120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28485202-e2ae-4169-a40a-0030ea51ecc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:34.399542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28485202-e2ae-4169-a40a-0030ea51ecc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:34.426416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-477ef5d5-0dc8-417a-8667-4baf5ca4681a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:34.427188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-477ef5d5-0dc8-417a-8667-4baf5ca4681a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:34.433686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-477ef5d5-0dc8-417a-8667-4baf5ca4681a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:34.434176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-477ef5d5-0dc8-417a-8667-4baf5ca4681a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:34.434619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-477ef5d5-0dc8-417a-8667-4baf5ca4681a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:34.435320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-477ef5d5-0dc8-417a-8667-4baf5ca4681a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:34.435780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-477ef5d5-0dc8-417a-8667-4baf5ca4681a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:34.436209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-477ef5d5-0dc8-417a-8667-4baf5ca4681a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:34.536286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-28485202-e2ae-4169-a40a-0030ea51ecc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:34.545211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-28485202-e2ae-4169-a40a-0030ea51ecc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:34.546758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-28485202-e2ae-4169-a40a-0030ea51ecc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:34.547934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-28485202-e2ae-4169-a40a-0030ea51ecc4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.161742 Aug 18 22:11:34.548682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1219/2429] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:34.556517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-204e9310-0a71-4892-8e5a-3ce1fb6ad0b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:34.557483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-204e9310-0a71-4892-8e5a-3ce1fb6ad0b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:34.565867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-204e9310-0a71-4892-8e5a-3ce1fb6ad0b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:34.566359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-204e9310-0a71-4892-8e5a-3ce1fb6ad0b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:34.566802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-204e9310-0a71-4892-8e5a-3ce1fb6ad0b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:34.567509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-204e9310-0a71-4892-8e5a-3ce1fb6ad0b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:34.567993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-204e9310-0a71-4892-8e5a-3ce1fb6ad0b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:34.568426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-204e9310-0a71-4892-8e5a-3ce1fb6ad0b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:34.574400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-477ef5d5-0dc8-417a-8667-4baf5ca4681a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:34.583934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-477ef5d5-0dc8-417a-8667-4baf5ca4681a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.161595 Aug 18 22:11:34.584775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1211/2430] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:34 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:34.587516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:34.700811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-204e9310-0a71-4892-8e5a-3ce1fb6ad0b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:34.709087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-204e9310-0a71-4892-8e5a-3ce1fb6ad0b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.159444 Aug 18 22:11:34.709911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1220/2431] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:34 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:34.982581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-76157e2f-4764-4592-9c8d-a13b33082b42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:34.983414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-76157e2f-4764-4592-9c8d-a13b33082b42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:34.989463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76157e2f-4764-4592-9c8d-a13b33082b42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:34.989988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76157e2f-4764-4592-9c8d-a13b33082b42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:34.990434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76157e2f-4764-4592-9c8d-a13b33082b42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:34.991159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76157e2f-4764-4592-9c8d-a13b33082b42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:34.991624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76157e2f-4764-4592-9c8d-a13b33082b42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:34.992059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76157e2f-4764-4592-9c8d-a13b33082b42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:35.123742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-76157e2f-4764-4592-9c8d-a13b33082b42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:35.131875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-76157e2f-4764-4592-9c8d-a13b33082b42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153428 Aug 18 22:11:35.132446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1212/2432] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:35.315322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ff630321-0463-456a-87ac-4a8726a57008 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:35.315957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ff630321-0463-456a-87ac-4a8726a57008 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:35.322230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff630321-0463-456a-87ac-4a8726a57008 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:35.322707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff630321-0463-456a-87ac-4a8726a57008 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:35.323132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff630321-0463-456a-87ac-4a8726a57008 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:35.323813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff630321-0463-456a-87ac-4a8726a57008 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:35.324256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff630321-0463-456a-87ac-4a8726a57008 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:35.324670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff630321-0463-456a-87ac-4a8726a57008 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:35.452482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ff630321-0463-456a-87ac-4a8726a57008 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:35.460609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ff630321-0463-456a-87ac-4a8726a57008 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149183 Aug 18 22:11:35.461689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1221/2433] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:35 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:35.525363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:11:35.525562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:11:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:11:35.571937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bb6611fe-1681-4479-8347-8add8b9287be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:35.572482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bb6611fe-1681-4479-8347-8add8b9287be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:35.579414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb6611fe-1681-4479-8347-8add8b9287be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:35.579898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb6611fe-1681-4479-8347-8add8b9287be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:35.580339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb6611fe-1681-4479-8347-8add8b9287be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:35.581023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb6611fe-1681-4479-8347-8add8b9287be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:35.581477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb6611fe-1681-4479-8347-8add8b9287be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:35.581938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb6611fe-1681-4479-8347-8add8b9287be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:35.604126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cd5e8fbc-9d9e-433b-890b-710a99451c27 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:35.604755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cd5e8fbc-9d9e-433b-890b-710a99451c27 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:35.610914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd5e8fbc-9d9e-433b-890b-710a99451c27 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:35.611653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd5e8fbc-9d9e-433b-890b-710a99451c27 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:35.612121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd5e8fbc-9d9e-433b-890b-710a99451c27 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:35.612822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd5e8fbc-9d9e-433b-890b-710a99451c27 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:35.613281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd5e8fbc-9d9e-433b-890b-710a99451c27 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:35.613747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd5e8fbc-9d9e-433b-890b-710a99451c27 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:35.715721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bb6611fe-1681-4479-8347-8add8b9287be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:35.724549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bb6611fe-1681-4479-8347-8add8b9287be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:35.726358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bb6611fe-1681-4479-8347-8add8b9287be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:35.727594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bb6611fe-1681-4479-8347-8add8b9287be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.160142 Aug 18 22:11:35.728190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1213/2434] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:35.732498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-68492f35-3b28-49b1-8222-9811a6e0584c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:35.733425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-68492f35-3b28-49b1-8222-9811a6e0584c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:35.739310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68492f35-3b28-49b1-8222-9811a6e0584c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:35.739800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68492f35-3b28-49b1-8222-9811a6e0584c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:35.740241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68492f35-3b28-49b1-8222-9811a6e0584c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:35.740933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68492f35-3b28-49b1-8222-9811a6e0584c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:35.741387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68492f35-3b28-49b1-8222-9811a6e0584c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:35.741841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68492f35-3b28-49b1-8222-9811a6e0584c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:35.751652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cd5e8fbc-9d9e-433b-890b-710a99451c27 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:35.760279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cd5e8fbc-9d9e-433b-890b-710a99451c27 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.160027 Aug 18 22:11:35.760856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1222/2435] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:35 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:35.873035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-68492f35-3b28-49b1-8222-9811a6e0584c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:35.881314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-68492f35-3b28-49b1-8222-9811a6e0584c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152222 Aug 18 22:11:35.881909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1214/2436] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:36.152978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2fb5248a-fba6-4cd5-8d7e-46e6826b0e34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:36.153517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2fb5248a-fba6-4cd5-8d7e-46e6826b0e34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:36.159682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fb5248a-fba6-4cd5-8d7e-46e6826b0e34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:36.160282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fb5248a-fba6-4cd5-8d7e-46e6826b0e34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:36.160713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fb5248a-fba6-4cd5-8d7e-46e6826b0e34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:36.161395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fb5248a-fba6-4cd5-8d7e-46e6826b0e34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:36.161881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fb5248a-fba6-4cd5-8d7e-46e6826b0e34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:36.162305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2fb5248a-fba6-4cd5-8d7e-46e6826b0e34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:36.291440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2fb5248a-fba6-4cd5-8d7e-46e6826b0e34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:36.299735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2fb5248a-fba6-4cd5-8d7e-46e6826b0e34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150618 Aug 18 22:11:36.300557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1223/2437] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:36 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:36.482591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7565d8d5-830b-4e67-b6bf-b2ddd18bbff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:36.483132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7565d8d5-830b-4e67-b6bf-b2ddd18bbff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:36.489031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7565d8d5-830b-4e67-b6bf-b2ddd18bbff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:36.489511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7565d8d5-830b-4e67-b6bf-b2ddd18bbff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:36.489978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7565d8d5-830b-4e67-b6bf-b2ddd18bbff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:36.490661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7565d8d5-830b-4e67-b6bf-b2ddd18bbff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:36.491119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7565d8d5-830b-4e67-b6bf-b2ddd18bbff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:36.491550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7565d8d5-830b-4e67-b6bf-b2ddd18bbff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:36.616663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7565d8d5-830b-4e67-b6bf-b2ddd18bbff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:36.625698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7565d8d5-830b-4e67-b6bf-b2ddd18bbff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147035 Aug 18 22:11:36.626274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1215/2438] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:36 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:36.750189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b1de3401-5a8b-47b3-917b-89dafc7edf1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:36.750818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b1de3401-5a8b-47b3-917b-89dafc7edf1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:36.757318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1de3401-5a8b-47b3-917b-89dafc7edf1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:36.757843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1de3401-5a8b-47b3-917b-89dafc7edf1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:36.758285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1de3401-5a8b-47b3-917b-89dafc7edf1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:36.759251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1de3401-5a8b-47b3-917b-89dafc7edf1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:36.759707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1de3401-5a8b-47b3-917b-89dafc7edf1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:36.760132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b1de3401-5a8b-47b3-917b-89dafc7edf1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:36.781799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dc1e0dcb-df4f-4579-b793-aacd8237f271 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:36.782439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dc1e0dcb-df4f-4579-b793-aacd8237f271 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:36.788381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc1e0dcb-df4f-4579-b793-aacd8237f271 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:36.788868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc1e0dcb-df4f-4579-b793-aacd8237f271 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:36.789919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc1e0dcb-df4f-4579-b793-aacd8237f271 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:36.790612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc1e0dcb-df4f-4579-b793-aacd8237f271 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:36.791067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc1e0dcb-df4f-4579-b793-aacd8237f271 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:36.791491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc1e0dcb-df4f-4579-b793-aacd8237f271 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:36.890248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b1de3401-5a8b-47b3-917b-89dafc7edf1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:36.899784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b1de3401-5a8b-47b3-917b-89dafc7edf1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:36.901343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b1de3401-5a8b-47b3-917b-89dafc7edf1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:36.903067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b1de3401-5a8b-47b3-917b-89dafc7edf1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156321 Aug 18 22:11:36.903226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1224/2439] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:36.907447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-49d8c677-3035-4a64-843a-1dff1a2a8fc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:36.908063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-49d8c677-3035-4a64-843a-1dff1a2a8fc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:36.915649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49d8c677-3035-4a64-843a-1dff1a2a8fc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:36.916144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49d8c677-3035-4a64-843a-1dff1a2a8fc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:36.916585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49d8c677-3035-4a64-843a-1dff1a2a8fc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:36.917290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49d8c677-3035-4a64-843a-1dff1a2a8fc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:36.917850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49d8c677-3035-4a64-843a-1dff1a2a8fc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:36.918286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49d8c677-3035-4a64-843a-1dff1a2a8fc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:36.924660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dc1e0dcb-df4f-4579-b793-aacd8237f271 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:36.933371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dc1e0dcb-df4f-4579-b793-aacd8237f271 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155367 Aug 18 22:11:36.933985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1216/2440] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:36 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:37.044550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-49d8c677-3035-4a64-843a-1dff1a2a8fc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:37.052987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-49d8c677-3035-4a64-843a-1dff1a2a8fc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148951 Aug 18 22:11:37.053560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1225/2441] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:36 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:37.322429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0f20fac0-d0da-4626-9758-acf57c5d767e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:37.322988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0f20fac0-d0da-4626-9758-acf57c5d767e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:37.328952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f20fac0-d0da-4626-9758-acf57c5d767e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:37.329443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f20fac0-d0da-4626-9758-acf57c5d767e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:37.329929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f20fac0-d0da-4626-9758-acf57c5d767e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:37.330631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f20fac0-d0da-4626-9758-acf57c5d767e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:37.331097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f20fac0-d0da-4626-9758-acf57c5d767e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:37.331526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f20fac0-d0da-4626-9758-acf57c5d767e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:37.458873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0f20fac0-d0da-4626-9758-acf57c5d767e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:37.467430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0f20fac0-d0da-4626-9758-acf57c5d767e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149500 Aug 18 22:11:37.468028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1217/2442] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:37 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:37.646521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e3bba86d-130d-4729-b7e6-8eb2d8ad03fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:37.647052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e3bba86d-130d-4729-b7e6-8eb2d8ad03fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:37.653092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3bba86d-130d-4729-b7e6-8eb2d8ad03fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:37.653566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3bba86d-130d-4729-b7e6-8eb2d8ad03fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:37.654039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3bba86d-130d-4729-b7e6-8eb2d8ad03fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:37.654717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3bba86d-130d-4729-b7e6-8eb2d8ad03fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:37.655165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3bba86d-130d-4729-b7e6-8eb2d8ad03fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:37.655585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3bba86d-130d-4729-b7e6-8eb2d8ad03fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:37.796374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e3bba86d-130d-4729-b7e6-8eb2d8ad03fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:37.804682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e3bba86d-130d-4729-b7e6-8eb2d8ad03fd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.162055 Aug 18 22:11:37.805946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1226/2443] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:37 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:37.926110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b160853d-2866-400f-b23b-3afddbf9432f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:37.926637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b160853d-2866-400f-b23b-3afddbf9432f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:37.933695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b160853d-2866-400f-b23b-3afddbf9432f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:37.934182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b160853d-2866-400f-b23b-3afddbf9432f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:37.934623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b160853d-2866-400f-b23b-3afddbf9432f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:37.935314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b160853d-2866-400f-b23b-3afddbf9432f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:37.935772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b160853d-2866-400f-b23b-3afddbf9432f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:37.936200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b160853d-2866-400f-b23b-3afddbf9432f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:37.954300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b0860f35-9ff1-4d21-8558-1784d12c2f22 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:37.954917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b0860f35-9ff1-4d21-8558-1784d12c2f22 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:37.961203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0860f35-9ff1-4d21-8558-1784d12c2f22 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:37.961725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0860f35-9ff1-4d21-8558-1784d12c2f22 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:37.962164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0860f35-9ff1-4d21-8558-1784d12c2f22 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:37.962852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0860f35-9ff1-4d21-8558-1784d12c2f22 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:37.963304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0860f35-9ff1-4d21-8558-1784d12c2f22 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:37.963727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0860f35-9ff1-4d21-8558-1784d12c2f22 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:38.066127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b160853d-2866-400f-b23b-3afddbf9432f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:38.075204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b160853d-2866-400f-b23b-3afddbf9432f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:38.076711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b160853d-2866-400f-b23b-3afddbf9432f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:38.077912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b160853d-2866-400f-b23b-3afddbf9432f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156019 Aug 18 22:11:38.078480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1218/2444] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:38.082932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-53e044e9-150b-4cc3-bf33-e6a14426d67a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:38.083540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-53e044e9-150b-4cc3-bf33-e6a14426d67a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:38.089193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53e044e9-150b-4cc3-bf33-e6a14426d67a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:38.089710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53e044e9-150b-4cc3-bf33-e6a14426d67a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:38.090147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53e044e9-150b-4cc3-bf33-e6a14426d67a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:38.090844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53e044e9-150b-4cc3-bf33-e6a14426d67a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:38.091300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53e044e9-150b-4cc3-bf33-e6a14426d67a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:38.091736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53e044e9-150b-4cc3-bf33-e6a14426d67a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:38.094484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:38.096345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b0860f35-9ff1-4d21-8558-1784d12c2f22 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:38.105233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b0860f35-9ff1-4d21-8558-1784d12c2f22 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154718 Aug 18 22:11:38.105936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1227/2445] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:37 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:38.225032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-53e044e9-150b-4cc3-bf33-e6a14426d67a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:38.234551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-53e044e9-150b-4cc3-bf33-e6a14426d67a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154872 Aug 18 22:11:38.235127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1219/2446] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:38 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:38.488790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d3a0ea10-0b89-43fb-bad5-d2f71f20506d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:38.489319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d3a0ea10-0b89-43fb-bad5-d2f71f20506d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:38.495923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3a0ea10-0b89-43fb-bad5-d2f71f20506d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:38.496405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3a0ea10-0b89-43fb-bad5-d2f71f20506d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:38.496843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3a0ea10-0b89-43fb-bad5-d2f71f20506d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:38.497550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3a0ea10-0b89-43fb-bad5-d2f71f20506d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:38.498051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3a0ea10-0b89-43fb-bad5-d2f71f20506d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:38.498477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3a0ea10-0b89-43fb-bad5-d2f71f20506d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:38.628341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d3a0ea10-0b89-43fb-bad5-d2f71f20506d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:38.636562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d3a0ea10-0b89-43fb-bad5-d2f71f20506d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151772 Aug 18 22:11:38.637123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1228/2447] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:38 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:38.826210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-14d8b0d7-2f96-4137-b747-6fe16f03fa73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:38.826831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-14d8b0d7-2f96-4137-b747-6fe16f03fa73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:38.832761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14d8b0d7-2f96-4137-b747-6fe16f03fa73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:38.833240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14d8b0d7-2f96-4137-b747-6fe16f03fa73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:38.833706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14d8b0d7-2f96-4137-b747-6fe16f03fa73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:38.834391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14d8b0d7-2f96-4137-b747-6fe16f03fa73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:38.834844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14d8b0d7-2f96-4137-b747-6fe16f03fa73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:38.835269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14d8b0d7-2f96-4137-b747-6fe16f03fa73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:38.962910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-14d8b0d7-2f96-4137-b747-6fe16f03fa73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:38.971204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-14d8b0d7-2f96-4137-b747-6fe16f03fa73 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148798 Aug 18 22:11:38.971771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1220/2448] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:38 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:39.100354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-83f022ee-2b49-4c7c-8cc1-41809af44c8f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:39.100977 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-83f022ee-2b49-4c7c-8cc1-41809af44c8f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:39.108148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83f022ee-2b49-4c7c-8cc1-41809af44c8f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:39.108631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83f022ee-2b49-4c7c-8cc1-41809af44c8f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:39.109072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83f022ee-2b49-4c7c-8cc1-41809af44c8f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:39.109795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83f022ee-2b49-4c7c-8cc1-41809af44c8f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:39.110256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83f022ee-2b49-4c7c-8cc1-41809af44c8f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:39.110686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83f022ee-2b49-4c7c-8cc1-41809af44c8f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:39.126571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-906c4830-9c6e-4e53-807b-f0297f2c54b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:39.127310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-906c4830-9c6e-4e53-807b-f0297f2c54b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:39.133290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-906c4830-9c6e-4e53-807b-f0297f2c54b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:39.133816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-906c4830-9c6e-4e53-807b-f0297f2c54b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:39.134264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-906c4830-9c6e-4e53-807b-f0297f2c54b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:39.134969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-906c4830-9c6e-4e53-807b-f0297f2c54b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:39.135432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-906c4830-9c6e-4e53-807b-f0297f2c54b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:39.135863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-906c4830-9c6e-4e53-807b-f0297f2c54b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:39.239888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-83f022ee-2b49-4c7c-8cc1-41809af44c8f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:39.248812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-83f022ee-2b49-4c7c-8cc1-41809af44c8f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:39.250390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-83f022ee-2b49-4c7c-8cc1-41809af44c8f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:39.251488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-83f022ee-2b49-4c7c-8cc1-41809af44c8f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155086 Aug 18 22:11:39.252106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1229/2449] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:39.256764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b118202e-6e7e-4d65-9e82-ef920ac6263c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:39.257375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b118202e-6e7e-4d65-9e82-ef920ac6263c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:39.263844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b118202e-6e7e-4d65-9e82-ef920ac6263c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:39.264372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b118202e-6e7e-4d65-9e82-ef920ac6263c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:39.264809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b118202e-6e7e-4d65-9e82-ef920ac6263c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:39.265543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b118202e-6e7e-4d65-9e82-ef920ac6263c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:39.266137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b118202e-6e7e-4d65-9e82-ef920ac6263c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:39.266560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b118202e-6e7e-4d65-9e82-ef920ac6263c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:39.279725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-906c4830-9c6e-4e53-807b-f0297f2c54b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:39.288133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-906c4830-9c6e-4e53-807b-f0297f2c54b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.165310 Aug 18 22:11:39.288729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1221/2450] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:39 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:39.395308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b118202e-6e7e-4d65-9e82-ef920ac6263c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:39.404322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b118202e-6e7e-4d65-9e82-ef920ac6263c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151010 Aug 18 22:11:39.404884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1230/2451] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:39.657656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cf9a3069-737e-4bf1-a8be-e138880caf11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:39.658271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cf9a3069-737e-4bf1-a8be-e138880caf11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:39.664240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf9a3069-737e-4bf1-a8be-e138880caf11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:39.664746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf9a3069-737e-4bf1-a8be-e138880caf11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:39.665190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf9a3069-737e-4bf1-a8be-e138880caf11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:39.665906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf9a3069-737e-4bf1-a8be-e138880caf11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:39.666365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf9a3069-737e-4bf1-a8be-e138880caf11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:39.666794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf9a3069-737e-4bf1-a8be-e138880caf11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:39.794516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cf9a3069-737e-4bf1-a8be-e138880caf11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:39.804406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cf9a3069-737e-4bf1-a8be-e138880caf11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150294 Aug 18 22:11:39.805981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1222/2452] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:39 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:39.993414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-abccdfb2-d496-46b8-9cf5-214b3ecfc646 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:39.993996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-abccdfb2-d496-46b8-9cf5-214b3ecfc646 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:39.999958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abccdfb2-d496-46b8-9cf5-214b3ecfc646 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:40.000446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abccdfb2-d496-46b8-9cf5-214b3ecfc646 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:40.000880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abccdfb2-d496-46b8-9cf5-214b3ecfc646 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:40.001569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abccdfb2-d496-46b8-9cf5-214b3ecfc646 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:40.002517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abccdfb2-d496-46b8-9cf5-214b3ecfc646 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:40.003128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abccdfb2-d496-46b8-9cf5-214b3ecfc646 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:40.132537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-abccdfb2-d496-46b8-9cf5-214b3ecfc646 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:40.140681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-abccdfb2-d496-46b8-9cf5-214b3ecfc646 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151809 Aug 18 22:11:40.141255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1231/2453] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:39 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:40.276049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-65946d5a-d39b-45d8-a1ed-6d0696f4e367 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:40.276667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-65946d5a-d39b-45d8-a1ed-6d0696f4e367 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:40.283138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65946d5a-d39b-45d8-a1ed-6d0696f4e367 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:40.283622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65946d5a-d39b-45d8-a1ed-6d0696f4e367 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:40.284058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65946d5a-d39b-45d8-a1ed-6d0696f4e367 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:40.284746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65946d5a-d39b-45d8-a1ed-6d0696f4e367 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:40.285198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65946d5a-d39b-45d8-a1ed-6d0696f4e367 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:40.285641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65946d5a-d39b-45d8-a1ed-6d0696f4e367 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:40.309483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f1b7c850-baa7-4c88-9768-67e75d44234a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:40.310128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f1b7c850-baa7-4c88-9768-67e75d44234a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:40.315992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b7c850-baa7-4c88-9768-67e75d44234a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:40.316476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b7c850-baa7-4c88-9768-67e75d44234a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:40.316914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b7c850-baa7-4c88-9768-67e75d44234a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:40.317619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b7c850-baa7-4c88-9768-67e75d44234a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:40.318082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b7c850-baa7-4c88-9768-67e75d44234a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:40.318514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b7c850-baa7-4c88-9768-67e75d44234a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:40.417332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-65946d5a-d39b-45d8-a1ed-6d0696f4e367 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:40.426669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-65946d5a-d39b-45d8-a1ed-6d0696f4e367 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:40.428198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-65946d5a-d39b-45d8-a1ed-6d0696f4e367 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:40.429354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-65946d5a-d39b-45d8-a1ed-6d0696f4e367 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157326 Aug 18 22:11:40.429984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1223/2454] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:40.434474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c82fae1e-0bd1-457c-b8ad-30247ea46b22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:40.435084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c82fae1e-0bd1-457c-b8ad-30247ea46b22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:40.440861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c82fae1e-0bd1-457c-b8ad-30247ea46b22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:40.441347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c82fae1e-0bd1-457c-b8ad-30247ea46b22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:40.441872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c82fae1e-0bd1-457c-b8ad-30247ea46b22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:40.442768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c82fae1e-0bd1-457c-b8ad-30247ea46b22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:40.443226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c82fae1e-0bd1-457c-b8ad-30247ea46b22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:40.443646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c82fae1e-0bd1-457c-b8ad-30247ea46b22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:40.450829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f1b7c850-baa7-4c88-9768-67e75d44234a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:40.459188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f1b7c850-baa7-4c88-9768-67e75d44234a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154149 Aug 18 22:11:40.459875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1232/2455] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:40 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:40.572522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c82fae1e-0bd1-457c-b8ad-30247ea46b22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:40.580667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c82fae1e-0bd1-457c-b8ad-30247ea46b22 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149754 Aug 18 22:11:40.581347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1224/2456] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:40 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:40.826877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-77df7bd8-d14c-4b49-8bdd-0e09dee04eee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:40.827418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-77df7bd8-d14c-4b49-8bdd-0e09dee04eee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:40.833410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77df7bd8-d14c-4b49-8bdd-0e09dee04eee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:40.833919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77df7bd8-d14c-4b49-8bdd-0e09dee04eee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:40.834357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77df7bd8-d14c-4b49-8bdd-0e09dee04eee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:40.835038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77df7bd8-d14c-4b49-8bdd-0e09dee04eee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:40.835486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77df7bd8-d14c-4b49-8bdd-0e09dee04eee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:40.836519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-77df7bd8-d14c-4b49-8bdd-0e09dee04eee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:40.968144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-77df7bd8-d14c-4b49-8bdd-0e09dee04eee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:40.976957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-77df7bd8-d14c-4b49-8bdd-0e09dee04eee tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153471 Aug 18 22:11:40.977531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1233/2457] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:41.163484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-29b2ebec-5304-40cc-93dd-5c7ed63693ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:41.164021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-29b2ebec-5304-40cc-93dd-5c7ed63693ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:41.170503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29b2ebec-5304-40cc-93dd-5c7ed63693ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:41.170995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29b2ebec-5304-40cc-93dd-5c7ed63693ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:41.171429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29b2ebec-5304-40cc-93dd-5c7ed63693ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:41.172135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29b2ebec-5304-40cc-93dd-5c7ed63693ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:41.172584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29b2ebec-5304-40cc-93dd-5c7ed63693ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:41.173006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29b2ebec-5304-40cc-93dd-5c7ed63693ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:41.303436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-29b2ebec-5304-40cc-93dd-5c7ed63693ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:41.311976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-29b2ebec-5304-40cc-93dd-5c7ed63693ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153111 Aug 18 22:11:41.312546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1225/2458] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:41 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:41.452656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ac79f16c-bb10-485d-ad2a-006a6b7da47d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:41.453197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ac79f16c-bb10-485d-ad2a-006a6b7da47d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:41.459637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac79f16c-bb10-485d-ad2a-006a6b7da47d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:41.460115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac79f16c-bb10-485d-ad2a-006a6b7da47d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:41.460549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac79f16c-bb10-485d-ad2a-006a6b7da47d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:41.461231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac79f16c-bb10-485d-ad2a-006a6b7da47d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:41.461745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac79f16c-bb10-485d-ad2a-006a6b7da47d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:41.462144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac79f16c-bb10-485d-ad2a-006a6b7da47d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:41.480344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5913dfbb-e409-4459-972a-367268568d70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:41.480972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5913dfbb-e409-4459-972a-367268568d70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:41.486984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5913dfbb-e409-4459-972a-367268568d70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:41.487589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5913dfbb-e409-4459-972a-367268568d70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:41.488035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5913dfbb-e409-4459-972a-367268568d70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:41.488732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5913dfbb-e409-4459-972a-367268568d70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:41.489188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5913dfbb-e409-4459-972a-367268568d70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:41.489638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5913dfbb-e409-4459-972a-367268568d70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:41.592217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ac79f16c-bb10-485d-ad2a-006a6b7da47d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:41.602009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ac79f16c-bb10-485d-ad2a-006a6b7da47d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:41.603512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ac79f16c-bb10-485d-ad2a-006a6b7da47d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:41.604709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ac79f16c-bb10-485d-ad2a-006a6b7da47d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156055 Aug 18 22:11:41.605269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1234/2459] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:41.609728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-60d0a359-af88-4ecc-baae-92be7b692e1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:41.610340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-60d0a359-af88-4ecc-baae-92be7b692e1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:41.616123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60d0a359-af88-4ecc-baae-92be7b692e1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:41.616610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60d0a359-af88-4ecc-baae-92be7b692e1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:41.617098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60d0a359-af88-4ecc-baae-92be7b692e1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:41.618431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60d0a359-af88-4ecc-baae-92be7b692e1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:41.618898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60d0a359-af88-4ecc-baae-92be7b692e1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:41.619329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60d0a359-af88-4ecc-baae-92be7b692e1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:41.621995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5913dfbb-e409-4459-972a-367268568d70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:41.630105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5913dfbb-e409-4459-972a-367268568d70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153731 Aug 18 22:11:41.630679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1226/2460] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:41 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:41.752392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-60d0a359-af88-4ecc-baae-92be7b692e1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:41.760740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-60d0a359-af88-4ecc-baae-92be7b692e1f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154496 Aug 18 22:11:41.761319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1235/2461] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:41 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:41.998139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5b158a03-1925-4d95-a694-7f2b0ce034ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:41.998835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5b158a03-1925-4d95-a694-7f2b0ce034ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:42.006723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b158a03-1925-4d95-a694-7f2b0ce034ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:42.007249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b158a03-1925-4d95-a694-7f2b0ce034ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:42.007694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b158a03-1925-4d95-a694-7f2b0ce034ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:42.008524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b158a03-1925-4d95-a694-7f2b0ce034ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:42.008984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b158a03-1925-4d95-a694-7f2b0ce034ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:42.009447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b158a03-1925-4d95-a694-7f2b0ce034ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:42.137617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5b158a03-1925-4d95-a694-7f2b0ce034ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:42.145684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5b158a03-1925-4d95-a694-7f2b0ce034ab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151295 Aug 18 22:11:42.146260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1227/2462] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:42.333440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3c3b54aa-4226-4efb-8f1b-27c72a5ce7c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:42.334093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3c3b54aa-4226-4efb-8f1b-27c72a5ce7c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:42.341019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c3b54aa-4226-4efb-8f1b-27c72a5ce7c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:42.341503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c3b54aa-4226-4efb-8f1b-27c72a5ce7c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:42.341972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c3b54aa-4226-4efb-8f1b-27c72a5ce7c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:42.342676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c3b54aa-4226-4efb-8f1b-27c72a5ce7c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:42.343129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c3b54aa-4226-4efb-8f1b-27c72a5ce7c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:42.343556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c3b54aa-4226-4efb-8f1b-27c72a5ce7c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:42.469144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3c3b54aa-4226-4efb-8f1b-27c72a5ce7c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:42.477345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3c3b54aa-4226-4efb-8f1b-27c72a5ce7c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147822 Aug 18 22:11:42.477947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1236/2463] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:42 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:42.628225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e05bba61-f283-4150-a7b9-0dd8b8b1d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:42.628772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e05bba61-f283-4150-a7b9-0dd8b8b1d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:42.635907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e05bba61-f283-4150-a7b9-0dd8b8b1d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:42.636399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e05bba61-f283-4150-a7b9-0dd8b8b1d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:42.636833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e05bba61-f283-4150-a7b9-0dd8b8b1d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:42.637524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e05bba61-f283-4150-a7b9-0dd8b8b1d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:42.638009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e05bba61-f283-4150-a7b9-0dd8b8b1d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:42.638434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e05bba61-f283-4150-a7b9-0dd8b8b1d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:42.650628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-933de270-16a5-481b-a03c-8cdea71ef419 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:42.651250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-933de270-16a5-481b-a03c-8cdea71ef419 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:42.657268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-933de270-16a5-481b-a03c-8cdea71ef419 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:42.657816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-933de270-16a5-481b-a03c-8cdea71ef419 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:42.658512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-933de270-16a5-481b-a03c-8cdea71ef419 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:42.659046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-933de270-16a5-481b-a03c-8cdea71ef419 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:42.659502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-933de270-16a5-481b-a03c-8cdea71ef419 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:42.659940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-933de270-16a5-481b-a03c-8cdea71ef419 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:42.663986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:42.775790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e05bba61-f283-4150-a7b9-0dd8b8b1d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:42.784478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e05bba61-f283-4150-a7b9-0dd8b8b1d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:42.786136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e05bba61-f283-4150-a7b9-0dd8b8b1d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:42.787398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e05bba61-f283-4150-a7b9-0dd8b8b1d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.163234 Aug 18 22:11:42.788043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1228/2464] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:42.792501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4b8b2e17-1774-466d-a1e2-b97c1553cfc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:42.792682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-933de270-16a5-481b-a03c-8cdea71ef419 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:42.793115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4b8b2e17-1774-466d-a1e2-b97c1553cfc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:42.799137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b8b2e17-1774-466d-a1e2-b97c1553cfc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:42.799629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b8b2e17-1774-466d-a1e2-b97c1553cfc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:42.800315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b8b2e17-1774-466d-a1e2-b97c1553cfc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:42.801023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b8b2e17-1774-466d-a1e2-b97c1553cfc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:42.801285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-933de270-16a5-481b-a03c-8cdea71ef419 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154418 Aug 18 22:11:42.801477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b8b2e17-1774-466d-a1e2-b97c1553cfc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:42.802043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1237/2465] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:42 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:42.802200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b8b2e17-1774-466d-a1e2-b97c1553cfc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:43.155690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4b8b2e17-1774-466d-a1e2-b97c1553cfc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:43.164436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4b8b2e17-1774-466d-a1e2-b97c1553cfc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.374887 Aug 18 22:11:43.165007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1229/2466] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:43.168512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-41ea57f8-6d05-46bc-92b4-2ab951ab5a66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:43.169135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-41ea57f8-6d05-46bc-92b4-2ab951ab5a66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:43.175277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41ea57f8-6d05-46bc-92b4-2ab951ab5a66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:43.175764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41ea57f8-6d05-46bc-92b4-2ab951ab5a66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:43.176205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41ea57f8-6d05-46bc-92b4-2ab951ab5a66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:43.176898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41ea57f8-6d05-46bc-92b4-2ab951ab5a66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:43.177359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41ea57f8-6d05-46bc-92b4-2ab951ab5a66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:43.177820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41ea57f8-6d05-46bc-92b4-2ab951ab5a66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:43.452456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-41ea57f8-6d05-46bc-92b4-2ab951ab5a66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:43.461102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-41ea57f8-6d05-46bc-92b4-2ab951ab5a66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.296961 Aug 18 22:11:43.461686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1238/2467] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:43 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:43.497680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b4db3b14-10b7-467c-9256-e4547a4b8be5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:43.498294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b4db3b14-10b7-467c-9256-e4547a4b8be5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:43.504148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4db3b14-10b7-467c-9256-e4547a4b8be5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:43.504625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4db3b14-10b7-467c-9256-e4547a4b8be5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:43.505052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4db3b14-10b7-467c-9256-e4547a4b8be5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:43.505758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4db3b14-10b7-467c-9256-e4547a4b8be5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:43.506206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4db3b14-10b7-467c-9256-e4547a4b8be5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:43.506625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4db3b14-10b7-467c-9256-e4547a4b8be5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:43.640170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b4db3b14-10b7-467c-9256-e4547a4b8be5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:43.648261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b4db3b14-10b7-467c-9256-e4547a4b8be5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154345 Aug 18 22:11:43.648838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1230/2468] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:43 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:43.812015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-07a6108d-3de2-4081-aab8-7584188bccd9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:43.812616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-07a6108d-3de2-4081-aab8-7584188bccd9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:43.818934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07a6108d-3de2-4081-aab8-7584188bccd9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:43.819415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07a6108d-3de2-4081-aab8-7584188bccd9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:43.819851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07a6108d-3de2-4081-aab8-7584188bccd9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:43.820563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07a6108d-3de2-4081-aab8-7584188bccd9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:43.821012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07a6108d-3de2-4081-aab8-7584188bccd9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:43.821430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07a6108d-3de2-4081-aab8-7584188bccd9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:43.822600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ec503133-3d00-4313-8592-35b581e7c926 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:43.823218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ec503133-3d00-4313-8592-35b581e7c926 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:43.829005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec503133-3d00-4313-8592-35b581e7c926 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:43.829480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec503133-3d00-4313-8592-35b581e7c926 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:43.829962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec503133-3d00-4313-8592-35b581e7c926 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:43.830627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec503133-3d00-4313-8592-35b581e7c926 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:43.831077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec503133-3d00-4313-8592-35b581e7c926 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:43.831498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec503133-3d00-4313-8592-35b581e7c926 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:43.950321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-07a6108d-3de2-4081-aab8-7584188bccd9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:43.959089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-07a6108d-3de2-4081-aab8-7584188bccd9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:43.960621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-07a6108d-3de2-4081-aab8-7584188bccd9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:43.961856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-07a6108d-3de2-4081-aab8-7584188bccd9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153972 Aug 18 22:11:43.962424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1239/2469] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:43.966686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ec503133-3d00-4313-8592-35b581e7c926 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:43.974912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ec503133-3d00-4313-8592-35b581e7c926 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155883 Aug 18 22:11:43.975425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1231/2470] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:43 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:44.185781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-670472e7-c00b-4e01-8ac1-9ee7335dbff5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:44.186403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-670472e7-c00b-4e01-8ac1-9ee7335dbff5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:44.192278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-670472e7-c00b-4e01-8ac1-9ee7335dbff5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:44.192762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-670472e7-c00b-4e01-8ac1-9ee7335dbff5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:44.193204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-670472e7-c00b-4e01-8ac1-9ee7335dbff5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:44.193930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-670472e7-c00b-4e01-8ac1-9ee7335dbff5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:44.194390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-670472e7-c00b-4e01-8ac1-9ee7335dbff5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:44.194817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-670472e7-c00b-4e01-8ac1-9ee7335dbff5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:44.322273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-670472e7-c00b-4e01-8ac1-9ee7335dbff5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:44.330511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-670472e7-c00b-4e01-8ac1-9ee7335dbff5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148590 Aug 18 22:11:44.331075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1240/2471] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:44 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:44.482792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-97b75d95-ebeb-4374-a355-6419791c7156 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:44.483416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-97b75d95-ebeb-4374-a355-6419791c7156 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:44.489509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97b75d95-ebeb-4374-a355-6419791c7156 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:44.490021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97b75d95-ebeb-4374-a355-6419791c7156 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:44.490461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97b75d95-ebeb-4374-a355-6419791c7156 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:44.491151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97b75d95-ebeb-4374-a355-6419791c7156 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:44.491611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97b75d95-ebeb-4374-a355-6419791c7156 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:44.492074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97b75d95-ebeb-4374-a355-6419791c7156 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:44.617555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97b75d95-ebeb-4374-a355-6419791c7156 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:44.625784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-97b75d95-ebeb-4374-a355-6419791c7156 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.146839 Aug 18 22:11:44.626355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1232/2472] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:44 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:44.668645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-96d591e8-db9b-43a5-83bc-be87d5fb8fc4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:44.669271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-96d591e8-db9b-43a5-83bc-be87d5fb8fc4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:44.676036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96d591e8-db9b-43a5-83bc-be87d5fb8fc4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:44.676514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96d591e8-db9b-43a5-83bc-be87d5fb8fc4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:44.676950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96d591e8-db9b-43a5-83bc-be87d5fb8fc4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:44.677657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96d591e8-db9b-43a5-83bc-be87d5fb8fc4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:44.678113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96d591e8-db9b-43a5-83bc-be87d5fb8fc4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:44.678538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96d591e8-db9b-43a5-83bc-be87d5fb8fc4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:44.803641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-96d591e8-db9b-43a5-83bc-be87d5fb8fc4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:44.811761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-96d591e8-db9b-43a5-83bc-be87d5fb8fc4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147026 Aug 18 22:11:44.812525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1241/2473] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:44.985023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-466d2e3d-19b4-46f1-b1eb-17068f734b96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:44.985838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-466d2e3d-19b4-46f1-b1eb-17068f734b96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:44.993001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-466d2e3d-19b4-46f1-b1eb-17068f734b96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:44.993495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-466d2e3d-19b4-46f1-b1eb-17068f734b96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:44.993967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-466d2e3d-19b4-46f1-b1eb-17068f734b96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:44.994685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-466d2e3d-19b4-46f1-b1eb-17068f734b96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:44.995148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-466d2e3d-19b4-46f1-b1eb-17068f734b96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:44.995579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-466d2e3d-19b4-46f1-b1eb-17068f734b96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:44.996460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-84998e86-333b-4cca-8215-809f71f71333 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:44.997089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-84998e86-333b-4cca-8215-809f71f71333 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:45.003230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84998e86-333b-4cca-8215-809f71f71333 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:45.003704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84998e86-333b-4cca-8215-809f71f71333 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:45.004144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84998e86-333b-4cca-8215-809f71f71333 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:45.004848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84998e86-333b-4cca-8215-809f71f71333 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:45.005305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84998e86-333b-4cca-8215-809f71f71333 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:45.005764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84998e86-333b-4cca-8215-809f71f71333 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:45.134390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-466d2e3d-19b4-46f1-b1eb-17068f734b96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:45.136455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-84998e86-333b-4cca-8215-809f71f71333 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:45.143710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-466d2e3d-19b4-46f1-b1eb-17068f734b96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:45.145231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-466d2e3d-19b4-46f1-b1eb-17068f734b96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:45.145767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-84998e86-333b-4cca-8215-809f71f71333 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153522 Aug 18 22:11:45.146490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-466d2e3d-19b4-46f1-b1eb-17068f734b96 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.165416 Aug 18 22:11:45.147214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1233/2474] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:45.158040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1242/2475] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:44 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:45.352712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-45752486-1bf0-4d9d-a1f8-6c9c458f9ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:45.353327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-45752486-1bf0-4d9d-a1f8-6c9c458f9ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:45.359269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45752486-1bf0-4d9d-a1f8-6c9c458f9ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:45.359746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45752486-1bf0-4d9d-a1f8-6c9c458f9ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:45.360183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45752486-1bf0-4d9d-a1f8-6c9c458f9ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:45.360865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45752486-1bf0-4d9d-a1f8-6c9c458f9ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:45.361326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45752486-1bf0-4d9d-a1f8-6c9c458f9ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:45.361786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45752486-1bf0-4d9d-a1f8-6c9c458f9ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:45.485357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-45752486-1bf0-4d9d-a1f8-6c9c458f9ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:45.494217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-45752486-1bf0-4d9d-a1f8-6c9c458f9ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.145836 Aug 18 22:11:45.494793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1234/2476] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:45 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:45.647490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ea1cd895-903e-45c4-82c4-b54bb411101a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:45.648108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ea1cd895-903e-45c4-82c4-b54bb411101a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:45.654901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea1cd895-903e-45c4-82c4-b54bb411101a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:45.655390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea1cd895-903e-45c4-82c4-b54bb411101a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:45.655825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea1cd895-903e-45c4-82c4-b54bb411101a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:45.656510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea1cd895-903e-45c4-82c4-b54bb411101a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:45.656961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea1cd895-903e-45c4-82c4-b54bb411101a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:45.657386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea1cd895-903e-45c4-82c4-b54bb411101a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:45.787808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ea1cd895-903e-45c4-82c4-b54bb411101a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:45.796638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea1cd895-903e-45c4-82c4-b54bb411101a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152970 Aug 18 22:11:45.797209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1243/2477] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:45 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:45.832975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c4116b7f-5a96-4555-b55e-3809115cee2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:45.833583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c4116b7f-5a96-4555-b55e-3809115cee2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:45.839640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4116b7f-5a96-4555-b55e-3809115cee2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:45.840118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4116b7f-5a96-4555-b55e-3809115cee2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:45.840550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4116b7f-5a96-4555-b55e-3809115cee2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:45.841226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4116b7f-5a96-4555-b55e-3809115cee2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:45.841712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4116b7f-5a96-4555-b55e-3809115cee2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:45.842138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c4116b7f-5a96-4555-b55e-3809115cee2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:45.969812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c4116b7f-5a96-4555-b55e-3809115cee2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:45.971936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:45.979479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c4116b7f-5a96-4555-b55e-3809115cee2e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150267 Aug 18 22:11:45.980097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1235/2478] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:45 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:46.168467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-396f5378-c82e-44b7-ade0-b3de727863d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:46.169087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-396f5378-c82e-44b7-ade0-b3de727863d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:46.169393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9ae4001a-bca1-44be-83d5-4652e2bb2991 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:46.170053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9ae4001a-bca1-44be-83d5-4652e2bb2991 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:46.175947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-396f5378-c82e-44b7-ade0-b3de727863d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:46.176427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-396f5378-c82e-44b7-ade0-b3de727863d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:46.176863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-396f5378-c82e-44b7-ade0-b3de727863d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:46.177078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ae4001a-bca1-44be-83d5-4652e2bb2991 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:46.177524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ae4001a-bca1-44be-83d5-4652e2bb2991 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:46.177728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-396f5378-c82e-44b7-ade0-b3de727863d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:46.177984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ae4001a-bca1-44be-83d5-4652e2bb2991 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:46.178118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-396f5378-c82e-44b7-ade0-b3de727863d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:46.178442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-396f5378-c82e-44b7-ade0-b3de727863d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:46.178666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ae4001a-bca1-44be-83d5-4652e2bb2991 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:46.179116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ae4001a-bca1-44be-83d5-4652e2bb2991 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:46.180206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ae4001a-bca1-44be-83d5-4652e2bb2991 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:46.312301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-396f5378-c82e-44b7-ade0-b3de727863d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:46.319094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9ae4001a-bca1-44be-83d5-4652e2bb2991 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:46.320903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-396f5378-c82e-44b7-ade0-b3de727863d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156895 Aug 18 22:11:46.321580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1244/2479] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:46 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:46.327878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9ae4001a-bca1-44be-83d5-4652e2bb2991 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:46.329375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9ae4001a-bca1-44be-83d5-4652e2bb2991 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:46.330555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9ae4001a-bca1-44be-83d5-4652e2bb2991 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.164904 Aug 18 22:11:46.331107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1236/2480] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:46 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:46.516015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e7439e72-befd-4b6c-9fd5-e3c5a741480b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:46.516557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e7439e72-befd-4b6c-9fd5-e3c5a741480b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:46.523020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7439e72-befd-4b6c-9fd5-e3c5a741480b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:46.523990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7439e72-befd-4b6c-9fd5-e3c5a741480b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:46.524428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7439e72-befd-4b6c-9fd5-e3c5a741480b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:46.525118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7439e72-befd-4b6c-9fd5-e3c5a741480b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:46.525570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7439e72-befd-4b6c-9fd5-e3c5a741480b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:46.526022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7439e72-befd-4b6c-9fd5-e3c5a741480b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:46.655222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e7439e72-befd-4b6c-9fd5-e3c5a741480b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:46.663399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e7439e72-befd-4b6c-9fd5-e3c5a741480b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151350 Aug 18 22:11:46.663984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1245/2481] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:46 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:46.818668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-38eb2b94-aa1f-4356-b933-260ee14b6c58 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:46.819284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-38eb2b94-aa1f-4356-b933-260ee14b6c58 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:46.825214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38eb2b94-aa1f-4356-b933-260ee14b6c58 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:46.825723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38eb2b94-aa1f-4356-b933-260ee14b6c58 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:46.826157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38eb2b94-aa1f-4356-b933-260ee14b6c58 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:46.826834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38eb2b94-aa1f-4356-b933-260ee14b6c58 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:46.827280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38eb2b94-aa1f-4356-b933-260ee14b6c58 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:46.827702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38eb2b94-aa1f-4356-b933-260ee14b6c58 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:46.953641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-38eb2b94-aa1f-4356-b933-260ee14b6c58 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:46.961864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-38eb2b94-aa1f-4356-b933-260ee14b6c58 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.147091 Aug 18 22:11:46.962446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1237/2482] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:47.000111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e57281c0-822e-4f1f-8f98-fce50c91f7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:47.000726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e57281c0-822e-4f1f-8f98-fce50c91f7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:47.006862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e57281c0-822e-4f1f-8f98-fce50c91f7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:47.007343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e57281c0-822e-4f1f-8f98-fce50c91f7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:47.007775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e57281c0-822e-4f1f-8f98-fce50c91f7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:47.008457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e57281c0-822e-4f1f-8f98-fce50c91f7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:47.008907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e57281c0-822e-4f1f-8f98-fce50c91f7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:47.009357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e57281c0-822e-4f1f-8f98-fce50c91f7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:47.136489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e57281c0-822e-4f1f-8f98-fce50c91f7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:47.144570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e57281c0-822e-4f1f-8f98-fce50c91f7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148245 Aug 18 22:11:47.145138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1246/2483] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:46 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:47.342331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ed8ba8d3-947e-489b-931f-1f5a0cf5e42c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:47.342867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ed8ba8d3-947e-489b-931f-1f5a0cf5e42c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:47.349964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed8ba8d3-947e-489b-931f-1f5a0cf5e42c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:47.350449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed8ba8d3-947e-489b-931f-1f5a0cf5e42c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:47.350879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed8ba8d3-947e-489b-931f-1f5a0cf5e42c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:47.352175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed8ba8d3-947e-489b-931f-1f5a0cf5e42c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:47.352626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed8ba8d3-947e-489b-931f-1f5a0cf5e42c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:47.353048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ed8ba8d3-947e-489b-931f-1f5a0cf5e42c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:47.353890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6068e59c-511b-4e81-aaa2-c9da46df178b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:47.354605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6068e59c-511b-4e81-aaa2-c9da46df178b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:47.360944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6068e59c-511b-4e81-aaa2-c9da46df178b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:47.361431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6068e59c-511b-4e81-aaa2-c9da46df178b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:47.361954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6068e59c-511b-4e81-aaa2-c9da46df178b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:47.362655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6068e59c-511b-4e81-aaa2-c9da46df178b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:47.363115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6068e59c-511b-4e81-aaa2-c9da46df178b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:47.363544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6068e59c-511b-4e81-aaa2-c9da46df178b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:47.486690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ed8ba8d3-947e-489b-931f-1f5a0cf5e42c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:47.494822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ed8ba8d3-947e-489b-931f-1f5a0cf5e42c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156333 Aug 18 22:11:47.495433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1238/2484] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:47 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:47.501690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6068e59c-511b-4e81-aaa2-c9da46df178b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:47.510682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6068e59c-511b-4e81-aaa2-c9da46df178b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:47.512185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6068e59c-511b-4e81-aaa2-c9da46df178b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:47.513346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6068e59c-511b-4e81-aaa2-c9da46df178b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.164265 Aug 18 22:11:47.513944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1247/2485] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:47 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:47.684399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-80a016b0-0c9c-4b4d-9c8c-94eb2c316690 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:47.684916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-80a016b0-0c9c-4b4d-9c8c-94eb2c316690 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:47.691436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80a016b0-0c9c-4b4d-9c8c-94eb2c316690 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:47.691932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80a016b0-0c9c-4b4d-9c8c-94eb2c316690 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:47.692375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80a016b0-0c9c-4b4d-9c8c-94eb2c316690 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:47.693116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80a016b0-0c9c-4b4d-9c8c-94eb2c316690 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:47.693618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80a016b0-0c9c-4b4d-9c8c-94eb2c316690 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:47.694065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80a016b0-0c9c-4b4d-9c8c-94eb2c316690 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:47.826518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-80a016b0-0c9c-4b4d-9c8c-94eb2c316690 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:47.834634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-80a016b0-0c9c-4b4d-9c8c-94eb2c316690 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154130 Aug 18 22:11:47.835207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1239/2486] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:47 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:47.983033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-73224c45-d451-4b66-ab05-305691322884 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:47.983561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-73224c45-d451-4b66-ab05-305691322884 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:47.989627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73224c45-d451-4b66-ab05-305691322884 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:47.990109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73224c45-d451-4b66-ab05-305691322884 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:47.990546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73224c45-d451-4b66-ab05-305691322884 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:47.991233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73224c45-d451-4b66-ab05-305691322884 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:47.991689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73224c45-d451-4b66-ab05-305691322884 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:47.992135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73224c45-d451-4b66-ab05-305691322884 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:48.118748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-73224c45-d451-4b66-ab05-305691322884 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:48.126904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-73224c45-d451-4b66-ab05-305691322884 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.147908 Aug 18 22:11:48.127476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1248/2487] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:48.165587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7ff92cc4-e9f8-40f5-a33d-bba583c5015e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:48.166216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7ff92cc4-e9f8-40f5-a33d-bba583c5015e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:48.172091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ff92cc4-e9f8-40f5-a33d-bba583c5015e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:48.172570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ff92cc4-e9f8-40f5-a33d-bba583c5015e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:48.173010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ff92cc4-e9f8-40f5-a33d-bba583c5015e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:48.173728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ff92cc4-e9f8-40f5-a33d-bba583c5015e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:48.174182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ff92cc4-e9f8-40f5-a33d-bba583c5015e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:48.174604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ff92cc4-e9f8-40f5-a33d-bba583c5015e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:48.303282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7ff92cc4-e9f8-40f5-a33d-bba583c5015e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:48.311971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7ff92cc4-e9f8-40f5-a33d-bba583c5015e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150146 Aug 18 22:11:48.312548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1240/2488] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:48 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:48.515928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-73c2dfe7-9110-478e-a0fa-f81051c3913a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:48.516456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-73c2dfe7-9110-478e-a0fa-f81051c3913a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:48.522921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73c2dfe7-9110-478e-a0fa-f81051c3913a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:48.523434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73c2dfe7-9110-478e-a0fa-f81051c3913a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:48.523908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73c2dfe7-9110-478e-a0fa-f81051c3913a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:48.524602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73c2dfe7-9110-478e-a0fa-f81051c3913a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:48.525061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73c2dfe7-9110-478e-a0fa-f81051c3913a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:48.525492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73c2dfe7-9110-478e-a0fa-f81051c3913a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:48.536260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-71d74252-a68e-4af6-ad77-6e2ce09e0377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:48.537004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-71d74252-a68e-4af6-ad77-6e2ce09e0377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:48.543338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71d74252-a68e-4af6-ad77-6e2ce09e0377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:48.543818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71d74252-a68e-4af6-ad77-6e2ce09e0377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:48.544250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71d74252-a68e-4af6-ad77-6e2ce09e0377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:48.544929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71d74252-a68e-4af6-ad77-6e2ce09e0377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:48.545379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71d74252-a68e-4af6-ad77-6e2ce09e0377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:48.545827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71d74252-a68e-4af6-ad77-6e2ce09e0377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:48.653150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-73c2dfe7-9110-478e-a0fa-f81051c3913a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:48.661649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-73c2dfe7-9110-478e-a0fa-f81051c3913a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149669 Aug 18 22:11:48.662236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1249/2489] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:48 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:48.675207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-71d74252-a68e-4af6-ad77-6e2ce09e0377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:48.684454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-71d74252-a68e-4af6-ad77-6e2ce09e0377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:48.685992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-71d74252-a68e-4af6-ad77-6e2ce09e0377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:48.687142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-71d74252-a68e-4af6-ad77-6e2ce09e0377 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154749 Aug 18 22:11:48.687726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1241/2490] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:48.856081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-292f1e15-47bd-4845-9c72-a0e006307257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:48.856819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-292f1e15-47bd-4845-9c72-a0e006307257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:48.862838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-292f1e15-47bd-4845-9c72-a0e006307257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:48.863321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-292f1e15-47bd-4845-9c72-a0e006307257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:48.863764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-292f1e15-47bd-4845-9c72-a0e006307257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:48.864455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-292f1e15-47bd-4845-9c72-a0e006307257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:48.864910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-292f1e15-47bd-4845-9c72-a0e006307257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:48.865338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-292f1e15-47bd-4845-9c72-a0e006307257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:48.995762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-292f1e15-47bd-4845-9c72-a0e006307257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:49.003866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-292f1e15-47bd-4845-9c72-a0e006307257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151684 Aug 18 22:11:49.004440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1250/2491] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:48 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:49.148730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ff61430a-c842-4855-a03c-0e389a28b9c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:49.149301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ff61430a-c842-4855-a03c-0e389a28b9c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:49.155283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff61430a-c842-4855-a03c-0e389a28b9c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:49.155767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff61430a-c842-4855-a03c-0e389a28b9c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:49.156200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff61430a-c842-4855-a03c-0e389a28b9c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:49.156886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff61430a-c842-4855-a03c-0e389a28b9c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:49.157694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff61430a-c842-4855-a03c-0e389a28b9c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:49.158125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff61430a-c842-4855-a03c-0e389a28b9c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:49.287696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ff61430a-c842-4855-a03c-0e389a28b9c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:49.296683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ff61430a-c842-4855-a03c-0e389a28b9c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152355 Aug 18 22:11:49.297256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1242/2492] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:49 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:49.333550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-18a115b6-187a-440c-bf2f-eada8aea4f0a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:49.334185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-18a115b6-187a-440c-bf2f-eada8aea4f0a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:49.340791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18a115b6-187a-440c-bf2f-eada8aea4f0a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:49.341266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18a115b6-187a-440c-bf2f-eada8aea4f0a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:49.341728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18a115b6-187a-440c-bf2f-eada8aea4f0a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:49.342406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18a115b6-187a-440c-bf2f-eada8aea4f0a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:49.342854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18a115b6-187a-440c-bf2f-eada8aea4f0a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:49.343273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18a115b6-187a-440c-bf2f-eada8aea4f0a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:49.471058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-18a115b6-187a-440c-bf2f-eada8aea4f0a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:49.479229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-18a115b6-187a-440c-bf2f-eada8aea4f0a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149589 Aug 18 22:11:49.479805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1251/2493] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:49 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:49.685120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c171e484-746f-489d-96c8-437a588cba59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:49.685984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c171e484-746f-489d-96c8-437a588cba59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:49.692594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c171e484-746f-489d-96c8-437a588cba59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:49.693090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c171e484-746f-489d-96c8-437a588cba59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:49.693534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c171e484-746f-489d-96c8-437a588cba59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:49.694266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c171e484-746f-489d-96c8-437a588cba59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:49.694727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c171e484-746f-489d-96c8-437a588cba59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:49.695714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c171e484-746f-489d-96c8-437a588cba59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:49.709569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fd415d54-9805-47f2-8932-89937d690622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:49.710267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fd415d54-9805-47f2-8932-89937d690622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:49.718314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd415d54-9805-47f2-8932-89937d690622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:49.719286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd415d54-9805-47f2-8932-89937d690622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:49.719286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd415d54-9805-47f2-8932-89937d690622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:49.720039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd415d54-9805-47f2-8932-89937d690622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:49.720493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd415d54-9805-47f2-8932-89937d690622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:49.720920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd415d54-9805-47f2-8932-89937d690622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:49.831421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c171e484-746f-489d-96c8-437a588cba59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:49.839823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c171e484-746f-489d-96c8-437a588cba59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.160684 Aug 18 22:11:49.840410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1243/2494] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:49 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:49.855560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fd415d54-9805-47f2-8932-89937d690622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:49.864346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fd415d54-9805-47f2-8932-89937d690622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:49.865893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fd415d54-9805-47f2-8932-89937d690622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:49.867598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fd415d54-9805-47f2-8932-89937d690622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.161944 Aug 18 22:11:49.868164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1252/2495] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:50.024244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c6413267-aa9a-4db8-8230-3a59dde21d0c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:50.024855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c6413267-aa9a-4db8-8230-3a59dde21d0c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:50.030785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6413267-aa9a-4db8-8230-3a59dde21d0c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:50.031264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6413267-aa9a-4db8-8230-3a59dde21d0c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:50.031719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6413267-aa9a-4db8-8230-3a59dde21d0c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:50.032396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6413267-aa9a-4db8-8230-3a59dde21d0c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:50.032847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6413267-aa9a-4db8-8230-3a59dde21d0c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:50.033272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6413267-aa9a-4db8-8230-3a59dde21d0c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:50.160258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c6413267-aa9a-4db8-8230-3a59dde21d0c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:50.169563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c6413267-aa9a-4db8-8230-3a59dde21d0c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149117 Aug 18 22:11:50.170211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1244/2496] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:50 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:50.318348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab8eb93f-2deb-4607-8d4c-bbb6cd859d87 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:50.318918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab8eb93f-2deb-4607-8d4c-bbb6cd859d87 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:50.324989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8eb93f-2deb-4607-8d4c-bbb6cd859d87 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:50.325476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8eb93f-2deb-4607-8d4c-bbb6cd859d87 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:50.325955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8eb93f-2deb-4607-8d4c-bbb6cd859d87 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:50.326649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8eb93f-2deb-4607-8d4c-bbb6cd859d87 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:50.327107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8eb93f-2deb-4607-8d4c-bbb6cd859d87 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:50.327535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab8eb93f-2deb-4607-8d4c-bbb6cd859d87 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:50.457865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ab8eb93f-2deb-4607-8d4c-bbb6cd859d87 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:50.460296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:50.467553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab8eb93f-2deb-4607-8d4c-bbb6cd859d87 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153105 Aug 18 22:11:50.468121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1253/2497] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:50 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:50.500020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5993f81d-14c1-4db2-80db-631cadddc37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:50.500626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5993f81d-14c1-4db2-80db-631cadddc37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:50.506557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5993f81d-14c1-4db2-80db-631cadddc37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:50.507034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5993f81d-14c1-4db2-80db-631cadddc37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:50.507482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5993f81d-14c1-4db2-80db-631cadddc37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:50.508164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5993f81d-14c1-4db2-80db-631cadddc37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:50.508620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5993f81d-14c1-4db2-80db-631cadddc37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:50.509043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5993f81d-14c1-4db2-80db-631cadddc37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:50.638051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5993f81d-14c1-4db2-80db-631cadddc37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:50.646197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5993f81d-14c1-4db2-80db-631cadddc37b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149925 Aug 18 22:11:50.646776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1245/2498] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:50.861024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0f542b01-3c36-4559-93da-1dfe68576c55 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:50.861552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0f542b01-3c36-4559-93da-1dfe68576c55 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:50.867777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f542b01-3c36-4559-93da-1dfe68576c55 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:50.868251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f542b01-3c36-4559-93da-1dfe68576c55 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:50.868685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f542b01-3c36-4559-93da-1dfe68576c55 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:50.869365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f542b01-3c36-4559-93da-1dfe68576c55 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:50.869839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f542b01-3c36-4559-93da-1dfe68576c55 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:50.870264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f542b01-3c36-4559-93da-1dfe68576c55 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:50.891224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-483e49c1-65ee-4ad0-941f-3989991ecd13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:50.891879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-483e49c1-65ee-4ad0-941f-3989991ecd13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:50.899242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-483e49c1-65ee-4ad0-941f-3989991ecd13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:50.899729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-483e49c1-65ee-4ad0-941f-3989991ecd13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:50.900168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-483e49c1-65ee-4ad0-941f-3989991ecd13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:50.900868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-483e49c1-65ee-4ad0-941f-3989991ecd13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:50.901379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-483e49c1-65ee-4ad0-941f-3989991ecd13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:50.901849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-483e49c1-65ee-4ad0-941f-3989991ecd13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:51.016492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0f542b01-3c36-4559-93da-1dfe68576c55 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:51.025229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0f542b01-3c36-4559-93da-1dfe68576c55 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.168398 Aug 18 22:11:51.026067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1254/2499] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:50 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:51.051211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-483e49c1-65ee-4ad0-941f-3989991ecd13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:51.059902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-483e49c1-65ee-4ad0-941f-3989991ecd13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:51.061409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-483e49c1-65ee-4ad0-941f-3989991ecd13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:51.062602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-483e49c1-65ee-4ad0-941f-3989991ecd13 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.175244 Aug 18 22:11:51.063171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1246/2500] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:51.191958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-175f1d0f-a392-40e0-9866-dd7400e0c2af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:51.192497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-175f1d0f-a392-40e0-9866-dd7400e0c2af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:51.199011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-175f1d0f-a392-40e0-9866-dd7400e0c2af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:51.199496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-175f1d0f-a392-40e0-9866-dd7400e0c2af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:51.199930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-175f1d0f-a392-40e0-9866-dd7400e0c2af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:51.200617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-175f1d0f-a392-40e0-9866-dd7400e0c2af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:51.201077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-175f1d0f-a392-40e0-9866-dd7400e0c2af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:51.201511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-175f1d0f-a392-40e0-9866-dd7400e0c2af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:51.332628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-175f1d0f-a392-40e0-9866-dd7400e0c2af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:51.341037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-175f1d0f-a392-40e0-9866-dd7400e0c2af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153094 Aug 18 22:11:51.341630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1255/2501] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:51 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:51.488190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5f2a4d1f-0b82-4b57-8422-6720c5e0bb98 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:51.488808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5f2a4d1f-0b82-4b57-8422-6720c5e0bb98 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:51.490692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:51.496796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f2a4d1f-0b82-4b57-8422-6720c5e0bb98 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:51.497286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f2a4d1f-0b82-4b57-8422-6720c5e0bb98 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:51.497752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f2a4d1f-0b82-4b57-8422-6720c5e0bb98 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:51.498452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f2a4d1f-0b82-4b57-8422-6720c5e0bb98 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:51.498915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f2a4d1f-0b82-4b57-8422-6720c5e0bb98 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:51.499340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f2a4d1f-0b82-4b57-8422-6720c5e0bb98 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:51.629239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5f2a4d1f-0b82-4b57-8422-6720c5e0bb98 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:51.638010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5f2a4d1f-0b82-4b57-8422-6720c5e0bb98 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153609 Aug 18 22:11:51.639586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1247/2502] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:51 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:51.667403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e80fac26-c56c-4a1d-bc89-cfdeaf51f4ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:51.668021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e80fac26-c56c-4a1d-bc89-cfdeaf51f4ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:51.673950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e80fac26-c56c-4a1d-bc89-cfdeaf51f4ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:51.674420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e80fac26-c56c-4a1d-bc89-cfdeaf51f4ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:51.674852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e80fac26-c56c-4a1d-bc89-cfdeaf51f4ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:51.675778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e80fac26-c56c-4a1d-bc89-cfdeaf51f4ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:51.676227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e80fac26-c56c-4a1d-bc89-cfdeaf51f4ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:51.676649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e80fac26-c56c-4a1d-bc89-cfdeaf51f4ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:51.802657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e80fac26-c56c-4a1d-bc89-cfdeaf51f4ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:51.811447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e80fac26-c56c-4a1d-bc89-cfdeaf51f4ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148395 Aug 18 22:11:51.812023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1256/2503] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:52.046007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cecdc009-1a59-4683-877d-1c1d8a78387b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:52.046621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cecdc009-1a59-4683-877d-1c1d8a78387b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:52.053265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cecdc009-1a59-4683-877d-1c1d8a78387b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:52.053780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cecdc009-1a59-4683-877d-1c1d8a78387b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:52.054214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cecdc009-1a59-4683-877d-1c1d8a78387b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:52.054897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cecdc009-1a59-4683-877d-1c1d8a78387b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:52.055346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cecdc009-1a59-4683-877d-1c1d8a78387b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:52.055769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cecdc009-1a59-4683-877d-1c1d8a78387b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:52.087083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-926ee812-0e65-41a7-8f13-339a6b9337a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:52.087651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-926ee812-0e65-41a7-8f13-339a6b9337a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:52.094156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-926ee812-0e65-41a7-8f13-339a6b9337a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:52.094652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-926ee812-0e65-41a7-8f13-339a6b9337a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:52.095091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-926ee812-0e65-41a7-8f13-339a6b9337a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:52.095797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-926ee812-0e65-41a7-8f13-339a6b9337a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:52.096258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-926ee812-0e65-41a7-8f13-339a6b9337a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:52.096693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-926ee812-0e65-41a7-8f13-339a6b9337a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:52.185046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cecdc009-1a59-4683-877d-1c1d8a78387b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:52.193457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cecdc009-1a59-4683-877d-1c1d8a78387b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151275 Aug 18 22:11:52.194088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1248/2504] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:52 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:52.231832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-926ee812-0e65-41a7-8f13-339a6b9337a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:52.240484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-926ee812-0e65-41a7-8f13-339a6b9337a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:52.242063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-926ee812-0e65-41a7-8f13-339a6b9337a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:52.243230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-926ee812-0e65-41a7-8f13-339a6b9337a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.161130 Aug 18 22:11:52.243787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1257/2505] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:52 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:52.362383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f8e2907a-6b37-4391-830a-2e8f57d597a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:52.362917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f8e2907a-6b37-4391-830a-2e8f57d597a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:52.368836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8e2907a-6b37-4391-830a-2e8f57d597a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:52.369309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8e2907a-6b37-4391-830a-2e8f57d597a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:52.369773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8e2907a-6b37-4391-830a-2e8f57d597a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:52.370451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8e2907a-6b37-4391-830a-2e8f57d597a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:52.370907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8e2907a-6b37-4391-830a-2e8f57d597a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:52.371325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8e2907a-6b37-4391-830a-2e8f57d597a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:52.499442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8e2907a-6b37-4391-830a-2e8f57d597a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:52.508057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f8e2907a-6b37-4391-830a-2e8f57d597a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149133 Aug 18 22:11:52.508628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1249/2506] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:52 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:52.659511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6c2e3a49-b66f-4b7f-a05e-8aa3f2a68ce4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:52.660169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6c2e3a49-b66f-4b7f-a05e-8aa3f2a68ce4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:52.666344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c2e3a49-b66f-4b7f-a05e-8aa3f2a68ce4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:52.666828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c2e3a49-b66f-4b7f-a05e-8aa3f2a68ce4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:52.667268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c2e3a49-b66f-4b7f-a05e-8aa3f2a68ce4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:52.667956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c2e3a49-b66f-4b7f-a05e-8aa3f2a68ce4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:52.668441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c2e3a49-b66f-4b7f-a05e-8aa3f2a68ce4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:52.668867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6c2e3a49-b66f-4b7f-a05e-8aa3f2a68ce4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:52.795296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6c2e3a49-b66f-4b7f-a05e-8aa3f2a68ce4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:52.803635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6c2e3a49-b66f-4b7f-a05e-8aa3f2a68ce4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148000 Aug 18 22:11:52.804229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1258/2507] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:52.832142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-940bd6b8-e2d3-41a3-b67d-913aeef756ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:52.832754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-940bd6b8-e2d3-41a3-b67d-913aeef756ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:52.838677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-940bd6b8-e2d3-41a3-b67d-913aeef756ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:52.839157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-940bd6b8-e2d3-41a3-b67d-913aeef756ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:52.839589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-940bd6b8-e2d3-41a3-b67d-913aeef756ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:52.840266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-940bd6b8-e2d3-41a3-b67d-913aeef756ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:52.840714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-940bd6b8-e2d3-41a3-b67d-913aeef756ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:52.841135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-940bd6b8-e2d3-41a3-b67d-913aeef756ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:52.969880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-940bd6b8-e2d3-41a3-b67d-913aeef756ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:52.978071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-940bd6b8-e2d3-41a3-b67d-913aeef756ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149718 Aug 18 22:11:52.978648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1250/2508] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:53.213561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-04a2060e-0c40-43f2-b46a-247d176953e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:53.214141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-04a2060e-0c40-43f2-b46a-247d176953e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:53.220557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04a2060e-0c40-43f2-b46a-247d176953e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:53.221044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04a2060e-0c40-43f2-b46a-247d176953e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:53.221485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04a2060e-0c40-43f2-b46a-247d176953e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:53.222208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04a2060e-0c40-43f2-b46a-247d176953e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:53.222668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04a2060e-0c40-43f2-b46a-247d176953e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:53.223102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04a2060e-0c40-43f2-b46a-247d176953e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:53.265550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e3840473-aa1c-4310-a640-7f7de221c579 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:53.266206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e3840473-aa1c-4310-a640-7f7de221c579 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:53.272610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3840473-aa1c-4310-a640-7f7de221c579 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:53.273110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3840473-aa1c-4310-a640-7f7de221c579 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:53.273612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3840473-aa1c-4310-a640-7f7de221c579 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:53.274325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3840473-aa1c-4310-a640-7f7de221c579 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:53.274786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3840473-aa1c-4310-a640-7f7de221c579 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:53.275218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3840473-aa1c-4310-a640-7f7de221c579 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:53.353568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-04a2060e-0c40-43f2-b46a-247d176953e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:53.361967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-04a2060e-0c40-43f2-b46a-247d176953e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152260 Aug 18 22:11:53.362938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1259/2509] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:53 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:53.403740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e3840473-aa1c-4310-a640-7f7de221c579 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:53.412500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e3840473-aa1c-4310-a640-7f7de221c579 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:53.414539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e3840473-aa1c-4310-a640-7f7de221c579 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:53.415717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e3840473-aa1c-4310-a640-7f7de221c579 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153991 Aug 18 22:11:53.416279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1251/2510] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:53 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:53.529620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ef8f311a-aa59-4435-ba4d-b7a5cfc84cc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:53.530239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ef8f311a-aa59-4435-ba4d-b7a5cfc84cc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:53.536156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef8f311a-aa59-4435-ba4d-b7a5cfc84cc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:53.536628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef8f311a-aa59-4435-ba4d-b7a5cfc84cc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:53.537057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef8f311a-aa59-4435-ba4d-b7a5cfc84cc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:53.537771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef8f311a-aa59-4435-ba4d-b7a5cfc84cc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:53.538218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef8f311a-aa59-4435-ba4d-b7a5cfc84cc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:53.538727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef8f311a-aa59-4435-ba4d-b7a5cfc84cc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:53.666357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ef8f311a-aa59-4435-ba4d-b7a5cfc84cc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:53.674494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ef8f311a-aa59-4435-ba4d-b7a5cfc84cc5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148690 Aug 18 22:11:53.675319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1260/2511] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:53 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:53.825474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8ce24497-b939-4d87-9942-5c921294e068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:53.826054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8ce24497-b939-4d87-9942-5c921294e068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:53.832098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ce24497-b939-4d87-9942-5c921294e068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:53.832590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ce24497-b939-4d87-9942-5c921294e068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:53.833033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ce24497-b939-4d87-9942-5c921294e068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:53.833754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ce24497-b939-4d87-9942-5c921294e068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:53.834214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ce24497-b939-4d87-9942-5c921294e068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:53.834647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ce24497-b939-4d87-9942-5c921294e068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:53.849514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:53.966239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8ce24497-b939-4d87-9942-5c921294e068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:53.974407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8ce24497-b939-4d87-9942-5c921294e068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152813 Aug 18 22:11:53.974954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1252/2512] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:53.998579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4e0f13f0-5db1-45aa-86a2-c16129974cb2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:53.999227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4e0f13f0-5db1-45aa-86a2-c16129974cb2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:54.005092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e0f13f0-5db1-45aa-86a2-c16129974cb2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:54.005572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e0f13f0-5db1-45aa-86a2-c16129974cb2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:54.006038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e0f13f0-5db1-45aa-86a2-c16129974cb2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:54.006754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e0f13f0-5db1-45aa-86a2-c16129974cb2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:54.007206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e0f13f0-5db1-45aa-86a2-c16129974cb2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:54.008132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e0f13f0-5db1-45aa-86a2-c16129974cb2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:54.132118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4e0f13f0-5db1-45aa-86a2-c16129974cb2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:54.140673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4e0f13f0-5db1-45aa-86a2-c16129974cb2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.145912 Aug 18 22:11:54.141247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1261/2513] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:53 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:54.384748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cb6fd01e-3bf8-442c-b6ec-187e459e52e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:54.385294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cb6fd01e-3bf8-442c-b6ec-187e459e52e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:54.391778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb6fd01e-3bf8-442c-b6ec-187e459e52e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:54.392264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb6fd01e-3bf8-442c-b6ec-187e459e52e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:54.392705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb6fd01e-3bf8-442c-b6ec-187e459e52e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:54.393397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb6fd01e-3bf8-442c-b6ec-187e459e52e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:54.393879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb6fd01e-3bf8-442c-b6ec-187e459e52e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:54.394315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb6fd01e-3bf8-442c-b6ec-187e459e52e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:54.439014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b5d9be68-907f-4309-adbe-ecabbde24c36 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:54.439836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b5d9be68-907f-4309-adbe-ecabbde24c36 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:54.446944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5d9be68-907f-4309-adbe-ecabbde24c36 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:54.447432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5d9be68-907f-4309-adbe-ecabbde24c36 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:54.447873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5d9be68-907f-4309-adbe-ecabbde24c36 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:54.448581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5d9be68-907f-4309-adbe-ecabbde24c36 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:54.449042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5d9be68-907f-4309-adbe-ecabbde24c36 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:54.449470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5d9be68-907f-4309-adbe-ecabbde24c36 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:54.524487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cb6fd01e-3bf8-442c-b6ec-187e459e52e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:54.532470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cb6fd01e-3bf8-442c-b6ec-187e459e52e5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152288 Aug 18 22:11:54.533260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1253/2514] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:54 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:54.581973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b5d9be68-907f-4309-adbe-ecabbde24c36 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:54.591201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b5d9be68-907f-4309-adbe-ecabbde24c36 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:54.592706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b5d9be68-907f-4309-adbe-ecabbde24c36 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:54.593904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b5d9be68-907f-4309-adbe-ecabbde24c36 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.158824 Aug 18 22:11:54.594470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1262/2515] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:54 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:54.697425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2c230248-b76b-4909-8172-9c8ff7183380 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:54.698072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2c230248-b76b-4909-8172-9c8ff7183380 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:54.704023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c230248-b76b-4909-8172-9c8ff7183380 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:54.704505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c230248-b76b-4909-8172-9c8ff7183380 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:54.704943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c230248-b76b-4909-8172-9c8ff7183380 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:54.705664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c230248-b76b-4909-8172-9c8ff7183380 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:54.706123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c230248-b76b-4909-8172-9c8ff7183380 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:54.706553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c230248-b76b-4909-8172-9c8ff7183380 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:54.836755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2c230248-b76b-4909-8172-9c8ff7183380 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:54.844959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2c230248-b76b-4909-8172-9c8ff7183380 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151875 Aug 18 22:11:54.845523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1254/2516] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:54 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:54.995536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-67fc9858-5da6-45e8-b665-ec6a825f64a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:54.996157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-67fc9858-5da6-45e8-b665-ec6a825f64a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:55.002416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67fc9858-5da6-45e8-b665-ec6a825f64a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:55.002950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67fc9858-5da6-45e8-b665-ec6a825f64a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:55.003359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67fc9858-5da6-45e8-b665-ec6a825f64a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:55.004161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67fc9858-5da6-45e8-b665-ec6a825f64a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:55.004626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67fc9858-5da6-45e8-b665-ec6a825f64a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:55.005057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67fc9858-5da6-45e8-b665-ec6a825f64a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:55.133118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-67fc9858-5da6-45e8-b665-ec6a825f64a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:55.141258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-67fc9858-5da6-45e8-b665-ec6a825f64a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149669 Aug 18 22:11:55.141883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1263/2517] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:55.161901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8d219454-0ef7-4da6-a167-867cc1fa3ce0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:55.162522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8d219454-0ef7-4da6-a167-867cc1fa3ce0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:55.168730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d219454-0ef7-4da6-a167-867cc1fa3ce0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:55.169218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d219454-0ef7-4da6-a167-867cc1fa3ce0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:55.169693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d219454-0ef7-4da6-a167-867cc1fa3ce0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:55.170390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d219454-0ef7-4da6-a167-867cc1fa3ce0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:55.170847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d219454-0ef7-4da6-a167-867cc1fa3ce0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:55.171280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d219454-0ef7-4da6-a167-867cc1fa3ce0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:55.303132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8d219454-0ef7-4da6-a167-867cc1fa3ce0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:55.312711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8d219454-0ef7-4da6-a167-867cc1fa3ce0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154570 Aug 18 22:11:55.313291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1255/2518] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:55 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:55.553386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d7a61e30-df00-4ced-bb70-ac5929c4a047 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:55.554056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d7a61e30-df00-4ced-bb70-ac5929c4a047 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:55.556904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:55.562076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7a61e30-df00-4ced-bb70-ac5929c4a047 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:55.562559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7a61e30-df00-4ced-bb70-ac5929c4a047 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:55.562990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7a61e30-df00-4ced-bb70-ac5929c4a047 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:55.563673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7a61e30-df00-4ced-bb70-ac5929c4a047 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:55.564123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7a61e30-df00-4ced-bb70-ac5929c4a047 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:55.564544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7a61e30-df00-4ced-bb70-ac5929c4a047 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:55.617904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b57df65c-fecd-4408-a990-d295baae7d21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:55.618624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b57df65c-fecd-4408-a990-d295baae7d21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:55.625492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b57df65c-fecd-4408-a990-d295baae7d21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:55.626094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b57df65c-fecd-4408-a990-d295baae7d21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:55.626609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b57df65c-fecd-4408-a990-d295baae7d21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:55.627314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b57df65c-fecd-4408-a990-d295baae7d21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:55.627773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b57df65c-fecd-4408-a990-d295baae7d21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:55.628204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b57df65c-fecd-4408-a990-d295baae7d21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:55.698740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d7a61e30-df00-4ced-bb70-ac5929c4a047 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:55.708274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d7a61e30-df00-4ced-bb70-ac5929c4a047 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.158794 Aug 18 22:11:55.708868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1264/2519] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:55 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:55.770271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b57df65c-fecd-4408-a990-d295baae7d21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:55.779393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b57df65c-fecd-4408-a990-d295baae7d21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:55.780890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b57df65c-fecd-4408-a990-d295baae7d21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:55.782082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b57df65c-fecd-4408-a990-d295baae7d21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.168773 Aug 18 22:11:55.782684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1256/2520] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:55.866475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9e274888-ffc8-4fc1-bc3c-ec281aabbe12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:55.867034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9e274888-ffc8-4fc1-bc3c-ec281aabbe12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:55.872848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e274888-ffc8-4fc1-bc3c-ec281aabbe12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:55.873323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e274888-ffc8-4fc1-bc3c-ec281aabbe12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:55.873796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e274888-ffc8-4fc1-bc3c-ec281aabbe12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:55.874472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e274888-ffc8-4fc1-bc3c-ec281aabbe12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:55.874920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e274888-ffc8-4fc1-bc3c-ec281aabbe12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:55.875340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e274888-ffc8-4fc1-bc3c-ec281aabbe12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:56.000843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e274888-ffc8-4fc1-bc3c-ec281aabbe12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:56.009146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9e274888-ffc8-4fc1-bc3c-ec281aabbe12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.146542 Aug 18 22:11:56.009743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1265/2521] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:55 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:56.163357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bc5c8441-a915-4c85-9615-425c40bea6f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:56.163898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bc5c8441-a915-4c85-9615-425c40bea6f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:56.169935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc5c8441-a915-4c85-9615-425c40bea6f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:56.170417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc5c8441-a915-4c85-9615-425c40bea6f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:56.170851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc5c8441-a915-4c85-9615-425c40bea6f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:56.171539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc5c8441-a915-4c85-9615-425c40bea6f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:56.172018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc5c8441-a915-4c85-9615-425c40bea6f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:56.172451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc5c8441-a915-4c85-9615-425c40bea6f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:56.303772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bc5c8441-a915-4c85-9615-425c40bea6f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:56.311893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bc5c8441-a915-4c85-9615-425c40bea6f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152467 Aug 18 22:11:56.312472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1257/2522] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:56 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:11:56.334176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-118f6c21-cb46-436d-9c46-69168a77dcc6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:56.334824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-118f6c21-cb46-436d-9c46-69168a77dcc6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:56.341398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-118f6c21-cb46-436d-9c46-69168a77dcc6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:56.341919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-118f6c21-cb46-436d-9c46-69168a77dcc6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:56.342368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-118f6c21-cb46-436d-9c46-69168a77dcc6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:56.343062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-118f6c21-cb46-436d-9c46-69168a77dcc6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:56.343521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-118f6c21-cb46-436d-9c46-69168a77dcc6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:56.343958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-118f6c21-cb46-436d-9c46-69168a77dcc6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:56.468575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-118f6c21-cb46-436d-9c46-69168a77dcc6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:56.476698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-118f6c21-cb46-436d-9c46-69168a77dcc6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.146382 Aug 18 22:11:56.477270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1266/2523] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:56 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:56.728212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-27777df4-62df-4174-86b2-e0796d4dc49b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:56.728862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-27777df4-62df-4174-86b2-e0796d4dc49b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:56.735402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27777df4-62df-4174-86b2-e0796d4dc49b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:56.735882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27777df4-62df-4174-86b2-e0796d4dc49b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:56.736316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27777df4-62df-4174-86b2-e0796d4dc49b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:56.737031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27777df4-62df-4174-86b2-e0796d4dc49b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:56.737483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27777df4-62df-4174-86b2-e0796d4dc49b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:56.737931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27777df4-62df-4174-86b2-e0796d4dc49b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:56.805124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-84472273-9d9f-4ef9-b662-8575fee60445 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:56.805816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-84472273-9d9f-4ef9-b662-8575fee60445 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:56.812159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84472273-9d9f-4ef9-b662-8575fee60445 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:56.812646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84472273-9d9f-4ef9-b662-8575fee60445 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:56.813084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84472273-9d9f-4ef9-b662-8575fee60445 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:56.813806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84472273-9d9f-4ef9-b662-8575fee60445 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:56.814264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84472273-9d9f-4ef9-b662-8575fee60445 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:56.814691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84472273-9d9f-4ef9-b662-8575fee60445 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:56.869942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-27777df4-62df-4174-86b2-e0796d4dc49b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:56.878200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-27777df4-62df-4174-86b2-e0796d4dc49b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153833 Aug 18 22:11:56.878772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1258/2524] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:56 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:56.946966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-84472273-9d9f-4ef9-b662-8575fee60445 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:56.955761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-84472273-9d9f-4ef9-b662-8575fee60445 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:56.957293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-84472273-9d9f-4ef9-b662-8575fee60445 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:56.958531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-84472273-9d9f-4ef9-b662-8575fee60445 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157810 Aug 18 22:11:56.959098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1267/2525] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:57.030300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4ccebd47-23d7-47ea-bb8f-8124f51255f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:57.030918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4ccebd47-23d7-47ea-bb8f-8124f51255f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:57.036818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccebd47-23d7-47ea-bb8f-8124f51255f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:57.037301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccebd47-23d7-47ea-bb8f-8124f51255f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:57.037773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccebd47-23d7-47ea-bb8f-8124f51255f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:57.038489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccebd47-23d7-47ea-bb8f-8124f51255f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:57.039512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccebd47-23d7-47ea-bb8f-8124f51255f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:57.039941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4ccebd47-23d7-47ea-bb8f-8124f51255f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:57.171200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4ccebd47-23d7-47ea-bb8f-8124f51255f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:57.180270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4ccebd47-23d7-47ea-bb8f-8124f51255f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153764 Aug 18 22:11:57.180846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1259/2526] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:57 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:57.333571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a97a25ac-dc46-409e-b3f6-0dde9b035d6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:57.334145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a97a25ac-dc46-409e-b3f6-0dde9b035d6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:57.340544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a97a25ac-dc46-409e-b3f6-0dde9b035d6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:57.341028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a97a25ac-dc46-409e-b3f6-0dde9b035d6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:57.341469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a97a25ac-dc46-409e-b3f6-0dde9b035d6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:57.342188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a97a25ac-dc46-409e-b3f6-0dde9b035d6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:57.342648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a97a25ac-dc46-409e-b3f6-0dde9b035d6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:57.343076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a97a25ac-dc46-409e-b3f6-0dde9b035d6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:57.468861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a97a25ac-dc46-409e-b3f6-0dde9b035d6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:57.477670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a97a25ac-dc46-409e-b3f6-0dde9b035d6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.147967 Aug 18 22:11:57.478257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1268/2527] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:57 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:57.497367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0c416478-9e44-463e-91b5-1efd3fdfdf4e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:57.498010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0c416478-9e44-463e-91b5-1efd3fdfdf4e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:57.503913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c416478-9e44-463e-91b5-1efd3fdfdf4e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:57.504388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c416478-9e44-463e-91b5-1efd3fdfdf4e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:57.504819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c416478-9e44-463e-91b5-1efd3fdfdf4e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:57.505493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c416478-9e44-463e-91b5-1efd3fdfdf4e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:57.505970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c416478-9e44-463e-91b5-1efd3fdfdf4e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:57.506396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0c416478-9e44-463e-91b5-1efd3fdfdf4e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:57.633443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0c416478-9e44-463e-91b5-1efd3fdfdf4e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:57.642856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0c416478-9e44-463e-91b5-1efd3fdfdf4e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149227 Aug 18 22:11:57.643449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1260/2528] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:57.900551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-33624f55-9952-417e-abde-aa808dcfdb42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:57.901110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-33624f55-9952-417e-abde-aa808dcfdb42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:57.907517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33624f55-9952-417e-abde-aa808dcfdb42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:57.907990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33624f55-9952-417e-abde-aa808dcfdb42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:57.908421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33624f55-9952-417e-abde-aa808dcfdb42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:57.909103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33624f55-9952-417e-abde-aa808dcfdb42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:57.909552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33624f55-9952-417e-abde-aa808dcfdb42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:57.909995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-33624f55-9952-417e-abde-aa808dcfdb42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:57.982194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-791805df-3c81-4de0-9291-64187d06c232 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:57.983494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-791805df-3c81-4de0-9291-64187d06c232 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:57.989718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-791805df-3c81-4de0-9291-64187d06c232 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:57.990127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-791805df-3c81-4de0-9291-64187d06c232 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:57.990561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-791805df-3c81-4de0-9291-64187d06c232 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:57.991261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-791805df-3c81-4de0-9291-64187d06c232 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:57.991717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-791805df-3c81-4de0-9291-64187d06c232 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:57.992174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-791805df-3c81-4de0-9291-64187d06c232 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:58.043369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-33624f55-9952-417e-abde-aa808dcfdb42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:58.051936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-33624f55-9952-417e-abde-aa808dcfdb42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155908 Aug 18 22:11:58.052532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1269/2529] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:57 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:58.126761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-791805df-3c81-4de0-9291-64187d06c232 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:58.136199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-791805df-3c81-4de0-9291-64187d06c232 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:58.137710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-791805df-3c81-4de0-9291-64187d06c232 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:58.138868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-791805df-3c81-4de0-9291-64187d06c232 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.161844 Aug 18 22:11:58.139427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1261/2530] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:11:58.202028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-08d0d600-f323-4ae5-bcca-f640e020633f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:58.202584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-08d0d600-f323-4ae5-bcca-f640e020633f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:58.208513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-08d0d600-f323-4ae5-bcca-f640e020633f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:58.208998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-08d0d600-f323-4ae5-bcca-f640e020633f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:58.209438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-08d0d600-f323-4ae5-bcca-f640e020633f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:58.210157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-08d0d600-f323-4ae5-bcca-f640e020633f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:58.210667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-08d0d600-f323-4ae5-bcca-f640e020633f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:58.211106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-08d0d600-f323-4ae5-bcca-f640e020633f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:58.225470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:11:58.339068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-08d0d600-f323-4ae5-bcca-f640e020633f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:58.348274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-08d0d600-f323-4ae5-bcca-f640e020633f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150168 Aug 18 22:11:58.348849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1270/2531] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:58 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:58.499011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-deca2710-974e-4d14-b6f3-6f46c6111657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:58.499562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-deca2710-974e-4d14-b6f3-6f46c6111657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:58.505471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deca2710-974e-4d14-b6f3-6f46c6111657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:58.505976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deca2710-974e-4d14-b6f3-6f46c6111657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:58.506436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deca2710-974e-4d14-b6f3-6f46c6111657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:58.507109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deca2710-974e-4d14-b6f3-6f46c6111657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:58.507558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deca2710-974e-4d14-b6f3-6f46c6111657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:58.507979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deca2710-974e-4d14-b6f3-6f46c6111657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:58.638945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-deca2710-974e-4d14-b6f3-6f46c6111657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:58.647163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-deca2710-974e-4d14-b6f3-6f46c6111657 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152110 Aug 18 22:11:58.647740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1262/2532] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:58.668005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-324f1936-a23c-4a45-b099-0fd9a7416317 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:58.668948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-324f1936-a23c-4a45-b099-0fd9a7416317 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:58.678057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-324f1936-a23c-4a45-b099-0fd9a7416317 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:58.678788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-324f1936-a23c-4a45-b099-0fd9a7416317 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:58.680121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-324f1936-a23c-4a45-b099-0fd9a7416317 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:58.681169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-324f1936-a23c-4a45-b099-0fd9a7416317 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:58.681915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-324f1936-a23c-4a45-b099-0fd9a7416317 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:58.682567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-324f1936-a23c-4a45-b099-0fd9a7416317 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:58.816181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-324f1936-a23c-4a45-b099-0fd9a7416317 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:58.824366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-324f1936-a23c-4a45-b099-0fd9a7416317 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.163077 Aug 18 22:11:58.824934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1271/2533] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:58 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:59.072801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dd9ecd13-b6aa-49c8-b8f7-d1c4d6b7b406 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:59.073403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dd9ecd13-b6aa-49c8-b8f7-d1c4d6b7b406 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:59.080102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd9ecd13-b6aa-49c8-b8f7-d1c4d6b7b406 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:59.080597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd9ecd13-b6aa-49c8-b8f7-d1c4d6b7b406 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:59.081040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd9ecd13-b6aa-49c8-b8f7-d1c4d6b7b406 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:59.081777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd9ecd13-b6aa-49c8-b8f7-d1c4d6b7b406 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:59.082237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd9ecd13-b6aa-49c8-b8f7-d1c4d6b7b406 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:59.082668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dd9ecd13-b6aa-49c8-b8f7-d1c4d6b7b406 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:59.161931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-249791ee-6dad-4960-a674-e794be0cfc49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:59.162547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-249791ee-6dad-4960-a674-e794be0cfc49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:59.168972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249791ee-6dad-4960-a674-e794be0cfc49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:59.169458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249791ee-6dad-4960-a674-e794be0cfc49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:59.169926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249791ee-6dad-4960-a674-e794be0cfc49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:59.170618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249791ee-6dad-4960-a674-e794be0cfc49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:59.171074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249791ee-6dad-4960-a674-e794be0cfc49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:59.171500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-249791ee-6dad-4960-a674-e794be0cfc49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:59.212427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dd9ecd13-b6aa-49c8-b8f7-d1c4d6b7b406 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:59.220827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dd9ecd13-b6aa-49c8-b8f7-d1c4d6b7b406 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151790 Aug 18 22:11:59.221413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1263/2534] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:59 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:59.300498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-249791ee-6dad-4960-a674-e794be0cfc49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:59.311632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-249791ee-6dad-4960-a674-e794be0cfc49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:59.313135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-249791ee-6dad-4960-a674-e794be0cfc49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:59.314500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-249791ee-6dad-4960-a674-e794be0cfc49 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156870 Aug 18 22:11:59.315072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1272/2535] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:11:59 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:11:59.371902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2d0ba1f3-962a-4aa5-83f9-a511df3cfd87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:59.372482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2d0ba1f3-962a-4aa5-83f9-a511df3cfd87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:59.378655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d0ba1f3-962a-4aa5-83f9-a511df3cfd87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:59.379145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d0ba1f3-962a-4aa5-83f9-a511df3cfd87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:59.379588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d0ba1f3-962a-4aa5-83f9-a511df3cfd87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:59.380283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d0ba1f3-962a-4aa5-83f9-a511df3cfd87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:59.380742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d0ba1f3-962a-4aa5-83f9-a511df3cfd87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:59.381184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d0ba1f3-962a-4aa5-83f9-a511df3cfd87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:59.510124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2d0ba1f3-962a-4aa5-83f9-a511df3cfd87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:59.518305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2d0ba1f3-962a-4aa5-83f9-a511df3cfd87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150325 Aug 18 22:11:59.518878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1264/2536] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:59 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:59.667981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e216e8f0-3fce-489b-aa29-4ab41ec92022 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:59.668528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e216e8f0-3fce-489b-aa29-4ab41ec92022 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:59.674651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e216e8f0-3fce-489b-aa29-4ab41ec92022 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:59.675375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e216e8f0-3fce-489b-aa29-4ab41ec92022 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:59.675816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e216e8f0-3fce-489b-aa29-4ab41ec92022 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:59.676509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e216e8f0-3fce-489b-aa29-4ab41ec92022 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:59.676971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e216e8f0-3fce-489b-aa29-4ab41ec92022 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:59.677403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e216e8f0-3fce-489b-aa29-4ab41ec92022 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:59.804959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e216e8f0-3fce-489b-aa29-4ab41ec92022 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:59.813138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e216e8f0-3fce-489b-aa29-4ab41ec92022 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149069 Aug 18 22:11:59.813737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1273/2537] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:59 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:11:59.844362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-119c5779-9fac-4b3f-8fee-c2aa850efa17 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:11:59.845027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-119c5779-9fac-4b3f-8fee-c2aa850efa17 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:11:59.851175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-119c5779-9fac-4b3f-8fee-c2aa850efa17 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:59.851659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-119c5779-9fac-4b3f-8fee-c2aa850efa17 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:59.852098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-119c5779-9fac-4b3f-8fee-c2aa850efa17 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:59.852794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-119c5779-9fac-4b3f-8fee-c2aa850efa17 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:11:59.853251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-119c5779-9fac-4b3f-8fee-c2aa850efa17 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:11:59.853709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-119c5779-9fac-4b3f-8fee-c2aa850efa17 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:11:59.981829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-119c5779-9fac-4b3f-8fee-c2aa850efa17 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:11:59.989975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-119c5779-9fac-4b3f-8fee-c2aa850efa17 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149574 Aug 18 22:11:59.990548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1265/2538] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:11:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:00.243052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9409124a-a496-4fea-9e3f-0cdaf0c841e0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:00.243605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9409124a-a496-4fea-9e3f-0cdaf0c841e0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:00.250163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9409124a-a496-4fea-9e3f-0cdaf0c841e0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:00.250680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9409124a-a496-4fea-9e3f-0cdaf0c841e0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:00.251125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9409124a-a496-4fea-9e3f-0cdaf0c841e0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:00.251887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9409124a-a496-4fea-9e3f-0cdaf0c841e0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:00.252286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9409124a-a496-4fea-9e3f-0cdaf0c841e0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:00.252721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9409124a-a496-4fea-9e3f-0cdaf0c841e0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:00.337486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-467cd478-4e58-4607-88fa-5093711549e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:00.338148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-467cd478-4e58-4607-88fa-5093711549e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:00.344684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-467cd478-4e58-4607-88fa-5093711549e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:00.345172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-467cd478-4e58-4607-88fa-5093711549e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:00.345626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-467cd478-4e58-4607-88fa-5093711549e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:00.346336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-467cd478-4e58-4607-88fa-5093711549e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:00.346797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-467cd478-4e58-4607-88fa-5093711549e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:00.347226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-467cd478-4e58-4607-88fa-5093711549e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:00.383745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9409124a-a496-4fea-9e3f-0cdaf0c841e0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:00.392186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9409124a-a496-4fea-9e3f-0cdaf0c841e0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153585 Aug 18 22:12:00.392781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1274/2539] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:00 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:00.477958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-467cd478-4e58-4607-88fa-5093711549e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:00.486619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-467cd478-4e58-4607-88fa-5093711549e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:00.488121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-467cd478-4e58-4607-88fa-5093711549e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:00.489286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-467cd478-4e58-4607-88fa-5093711549e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155721 Aug 18 22:12:00.489892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1266/2540] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:00 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:00.540713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bb1644a5-1105-408a-8822-54028be89c3b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:00.541333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bb1644a5-1105-408a-8822-54028be89c3b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:00.547302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb1644a5-1105-408a-8822-54028be89c3b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:00.547783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb1644a5-1105-408a-8822-54028be89c3b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:00.548219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb1644a5-1105-408a-8822-54028be89c3b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:00.548907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb1644a5-1105-408a-8822-54028be89c3b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:00.549371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb1644a5-1105-408a-8822-54028be89c3b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:00.549834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb1644a5-1105-408a-8822-54028be89c3b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:00.674698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bb1644a5-1105-408a-8822-54028be89c3b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:00.683063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bb1644a5-1105-408a-8822-54028be89c3b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.146953 Aug 18 22:12:00.683633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1275/2541] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:00 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:00.839567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f68e7547-c839-4471-a7a4-a3a2af3a5f0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:00.840484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f68e7547-c839-4471-a7a4-a3a2af3a5f0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:00.848327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f68e7547-c839-4471-a7a4-a3a2af3a5f0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:00.848825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f68e7547-c839-4471-a7a4-a3a2af3a5f0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:00.849262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f68e7547-c839-4471-a7a4-a3a2af3a5f0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:00.849986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f68e7547-c839-4471-a7a4-a3a2af3a5f0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:00.850444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f68e7547-c839-4471-a7a4-a3a2af3a5f0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:00.850876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f68e7547-c839-4471-a7a4-a3a2af3a5f0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:00.984366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f68e7547-c839-4471-a7a4-a3a2af3a5f0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:00.992709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f68e7547-c839-4471-a7a4-a3a2af3a5f0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.161592 Aug 18 22:12:00.993285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1267/2542] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:00 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:01.011420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2c1c57ca-fd3f-477d-907e-1afa92cf9ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:01.012041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2c1c57ca-fd3f-477d-907e-1afa92cf9ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:01.017874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c1c57ca-fd3f-477d-907e-1afa92cf9ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:01.018356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c1c57ca-fd3f-477d-907e-1afa92cf9ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:01.018802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c1c57ca-fd3f-477d-907e-1afa92cf9ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:01.019543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c1c57ca-fd3f-477d-907e-1afa92cf9ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:01.019997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c1c57ca-fd3f-477d-907e-1afa92cf9ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:01.020431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c1c57ca-fd3f-477d-907e-1afa92cf9ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:01.153971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2c1c57ca-fd3f-477d-907e-1afa92cf9ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:01.162219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2c1c57ca-fd3f-477d-907e-1afa92cf9ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154515 Aug 18 22:12:01.162793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1276/2543] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:01 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:01.413833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-899fb890-361d-4806-93bb-d6395916b158 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:01.414393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-899fb890-361d-4806-93bb-d6395916b158 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:01.420583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-899fb890-361d-4806-93bb-d6395916b158 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:01.421069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-899fb890-361d-4806-93bb-d6395916b158 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:01.421509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-899fb890-361d-4806-93bb-d6395916b158 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:01.422233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-899fb890-361d-4806-93bb-d6395916b158 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:01.422692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-899fb890-361d-4806-93bb-d6395916b158 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:01.423123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-899fb890-361d-4806-93bb-d6395916b158 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:01.512863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ce7145a7-b8b0-4210-8b1f-e3a320b9c8db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:01.513647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ce7145a7-b8b0-4210-8b1f-e3a320b9c8db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:01.520393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce7145a7-b8b0-4210-8b1f-e3a320b9c8db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:01.520985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce7145a7-b8b0-4210-8b1f-e3a320b9c8db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:01.521495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce7145a7-b8b0-4210-8b1f-e3a320b9c8db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:01.522292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce7145a7-b8b0-4210-8b1f-e3a320b9c8db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:01.522850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce7145a7-b8b0-4210-8b1f-e3a320b9c8db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:01.523351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce7145a7-b8b0-4210-8b1f-e3a320b9c8db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:01.552074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-899fb890-361d-4806-93bb-d6395916b158 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:01.561030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-899fb890-361d-4806-93bb-d6395916b158 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151705 Aug 18 22:12:01.561616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1268/2544] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:01 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:01.653332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ce7145a7-b8b0-4210-8b1f-e3a320b9c8db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:01.662464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ce7145a7-b8b0-4210-8b1f-e3a320b9c8db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:01.664063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ce7145a7-b8b0-4210-8b1f-e3a320b9c8db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:01.665178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ce7145a7-b8b0-4210-8b1f-e3a320b9c8db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156202 Aug 18 22:12:01.665803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1277/2545] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:01.704165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f6891efe-d9b7-4236-b9fb-9460119aaf12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:01.704827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f6891efe-d9b7-4236-b9fb-9460119aaf12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:01.710870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6891efe-d9b7-4236-b9fb-9460119aaf12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:01.711356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6891efe-d9b7-4236-b9fb-9460119aaf12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:01.711794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6891efe-d9b7-4236-b9fb-9460119aaf12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:01.712482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6891efe-d9b7-4236-b9fb-9460119aaf12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:01.712939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6891efe-d9b7-4236-b9fb-9460119aaf12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:01.713380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6891efe-d9b7-4236-b9fb-9460119aaf12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:01.717463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:01.847482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f6891efe-d9b7-4236-b9fb-9460119aaf12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:01.856230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f6891efe-d9b7-4236-b9fb-9460119aaf12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155916 Aug 18 22:12:01.856803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1269/2546] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:01 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:02.014172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fad6c798-955e-4aa3-85ed-195e0d52a87b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:02.014821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fad6c798-955e-4aa3-85ed-195e0d52a87b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:02.020950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fad6c798-955e-4aa3-85ed-195e0d52a87b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:02.021461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fad6c798-955e-4aa3-85ed-195e0d52a87b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:02.021940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fad6c798-955e-4aa3-85ed-195e0d52a87b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:02.022627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fad6c798-955e-4aa3-85ed-195e0d52a87b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:02.023102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fad6c798-955e-4aa3-85ed-195e0d52a87b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:02.023524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fad6c798-955e-4aa3-85ed-195e0d52a87b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:02.152214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fad6c798-955e-4aa3-85ed-195e0d52a87b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:02.160407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fad6c798-955e-4aa3-85ed-195e0d52a87b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150064 Aug 18 22:12:02.160984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1278/2547] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:02 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:02.183286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-187bd9a0-cea5-4993-9401-58e574dd7d94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:02.183951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-187bd9a0-cea5-4993-9401-58e574dd7d94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:02.191016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-187bd9a0-cea5-4993-9401-58e574dd7d94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:02.191523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-187bd9a0-cea5-4993-9401-58e574dd7d94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:02.191965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-187bd9a0-cea5-4993-9401-58e574dd7d94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:02.192681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-187bd9a0-cea5-4993-9401-58e574dd7d94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:02.193159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-187bd9a0-cea5-4993-9401-58e574dd7d94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:02.193615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-187bd9a0-cea5-4993-9401-58e574dd7d94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:02.320110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-187bd9a0-cea5-4993-9401-58e574dd7d94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:02.328326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-187bd9a0-cea5-4993-9401-58e574dd7d94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148875 Aug 18 22:12:02.328898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1270/2548] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:02 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:02.582539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c6eae6ec-c5fd-407a-8662-c61ff823ce96 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:02.583159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c6eae6ec-c5fd-407a-8662-c61ff823ce96 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:02.590171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6eae6ec-c5fd-407a-8662-c61ff823ce96 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:02.590656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6eae6ec-c5fd-407a-8662-c61ff823ce96 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:02.591095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6eae6ec-c5fd-407a-8662-c61ff823ce96 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:02.591785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6eae6ec-c5fd-407a-8662-c61ff823ce96 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:02.592241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6eae6ec-c5fd-407a-8662-c61ff823ce96 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:02.592666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6eae6ec-c5fd-407a-8662-c61ff823ce96 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:02.688321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-740c5ce7-a118-41e8-8020-2de9d42aa0e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:02.689015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-740c5ce7-a118-41e8-8020-2de9d42aa0e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:02.696646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-740c5ce7-a118-41e8-8020-2de9d42aa0e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:02.697436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-740c5ce7-a118-41e8-8020-2de9d42aa0e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:02.697918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-740c5ce7-a118-41e8-8020-2de9d42aa0e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:02.698707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-740c5ce7-a118-41e8-8020-2de9d42aa0e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:02.699108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-740c5ce7-a118-41e8-8020-2de9d42aa0e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:02.699511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-740c5ce7-a118-41e8-8020-2de9d42aa0e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:02.729998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c6eae6ec-c5fd-407a-8662-c61ff823ce96 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:02.738564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c6eae6ec-c5fd-407a-8662-c61ff823ce96 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.159898 Aug 18 22:12:02.739272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1279/2549] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:02 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:02.833983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-740c5ce7-a118-41e8-8020-2de9d42aa0e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:02.843007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-740c5ce7-a118-41e8-8020-2de9d42aa0e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:02.844506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-740c5ce7-a118-41e8-8020-2de9d42aa0e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:02.845655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-740c5ce7-a118-41e8-8020-2de9d42aa0e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.161326 Aug 18 22:12:02.846213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1271/2550] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:02.878051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-677b490c-309c-4b7b-8337-19a8a70bfe77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:02.878669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-677b490c-309c-4b7b-8337-19a8a70bfe77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:02.885008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-677b490c-309c-4b7b-8337-19a8a70bfe77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:02.885488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-677b490c-309c-4b7b-8337-19a8a70bfe77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:02.885950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-677b490c-309c-4b7b-8337-19a8a70bfe77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:02.886637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-677b490c-309c-4b7b-8337-19a8a70bfe77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:02.887087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-677b490c-309c-4b7b-8337-19a8a70bfe77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:02.887513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-677b490c-309c-4b7b-8337-19a8a70bfe77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:03.014523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-677b490c-309c-4b7b-8337-19a8a70bfe77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:03.023120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-677b490c-309c-4b7b-8337-19a8a70bfe77 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148723 Aug 18 22:12:03.023724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1280/2551] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:02 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:03.182670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2dad9cd-0d09-42a6-bd2f-32ced8c1f726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:03.183296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e2dad9cd-0d09-42a6-bd2f-32ced8c1f726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:03.189203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2dad9cd-0d09-42a6-bd2f-32ced8c1f726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:03.189721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2dad9cd-0d09-42a6-bd2f-32ced8c1f726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:03.190165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2dad9cd-0d09-42a6-bd2f-32ced8c1f726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:03.190860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2dad9cd-0d09-42a6-bd2f-32ced8c1f726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:03.191319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2dad9cd-0d09-42a6-bd2f-32ced8c1f726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:03.191754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2dad9cd-0d09-42a6-bd2f-32ced8c1f726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:03.319259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e2dad9cd-0d09-42a6-bd2f-32ced8c1f726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:03.327467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e2dad9cd-0d09-42a6-bd2f-32ced8c1f726 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149165 Aug 18 22:12:03.328039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1272/2552] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:03 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:03.348716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-039c7ffc-5ade-487c-8a32-dedfced7b5db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:03.349392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-039c7ffc-5ade-487c-8a32-dedfced7b5db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:03.359149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-039c7ffc-5ade-487c-8a32-dedfced7b5db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:03.359812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-039c7ffc-5ade-487c-8a32-dedfced7b5db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:03.360257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-039c7ffc-5ade-487c-8a32-dedfced7b5db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:03.361019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-039c7ffc-5ade-487c-8a32-dedfced7b5db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:03.361477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-039c7ffc-5ade-487c-8a32-dedfced7b5db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:03.361939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-039c7ffc-5ade-487c-8a32-dedfced7b5db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:03.490528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-039c7ffc-5ade-487c-8a32-dedfced7b5db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:03.499303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-039c7ffc-5ade-487c-8a32-dedfced7b5db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154496 Aug 18 22:12:03.499878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1281/2553] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:03 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:03.759414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bb49e06f-9693-4508-9c17-8f91b05afeff tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:03.760072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bb49e06f-9693-4508-9c17-8f91b05afeff tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:03.767230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb49e06f-9693-4508-9c17-8f91b05afeff tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:03.767723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb49e06f-9693-4508-9c17-8f91b05afeff tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:03.768165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb49e06f-9693-4508-9c17-8f91b05afeff tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:03.768857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb49e06f-9693-4508-9c17-8f91b05afeff tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:03.769316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb49e06f-9693-4508-9c17-8f91b05afeff tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:03.769780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb49e06f-9693-4508-9c17-8f91b05afeff tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:03.868237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2d02a299-c68d-417a-af4f-19f47d1ea357 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:03.868895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2d02a299-c68d-417a-af4f-19f47d1ea357 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:03.875364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d02a299-c68d-417a-af4f-19f47d1ea357 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:03.875849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d02a299-c68d-417a-af4f-19f47d1ea357 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:03.876293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d02a299-c68d-417a-af4f-19f47d1ea357 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:03.876991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d02a299-c68d-417a-af4f-19f47d1ea357 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:03.877450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d02a299-c68d-417a-af4f-19f47d1ea357 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:03.877915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d02a299-c68d-417a-af4f-19f47d1ea357 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:03.898405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bb49e06f-9693-4508-9c17-8f91b05afeff tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:03.906710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bb49e06f-9693-4508-9c17-8f91b05afeff tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151157 Aug 18 22:12:03.907396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1273/2554] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:03 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:04.005448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2d02a299-c68d-417a-af4f-19f47d1ea357 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:04.014073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2d02a299-c68d-417a-af4f-19f47d1ea357 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:04.015568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2d02a299-c68d-417a-af4f-19f47d1ea357 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:04.016720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2d02a299-c68d-417a-af4f-19f47d1ea357 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152369 Aug 18 22:12:04.017353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1282/2555] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:04.044754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-02196c6d-2593-4ad1-936d-0d23926f92bd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:04.045363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-02196c6d-2593-4ad1-936d-0d23926f92bd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:04.051578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02196c6d-2593-4ad1-936d-0d23926f92bd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:04.052056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02196c6d-2593-4ad1-936d-0d23926f92bd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:04.052488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02196c6d-2593-4ad1-936d-0d23926f92bd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:04.053166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02196c6d-2593-4ad1-936d-0d23926f92bd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:04.053640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02196c6d-2593-4ad1-936d-0d23926f92bd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:04.054068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02196c6d-2593-4ad1-936d-0d23926f92bd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:04.187038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-02196c6d-2593-4ad1-936d-0d23926f92bd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:04.195814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-02196c6d-2593-4ad1-936d-0d23926f92bd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154855 Aug 18 22:12:04.196409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1274/2556] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:04 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:04.348516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8c9243a0-f950-4749-a235-5be0157f35ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:04.349162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8c9243a0-f950-4749-a235-5be0157f35ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:04.355214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c9243a0-f950-4749-a235-5be0157f35ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:04.355694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c9243a0-f950-4749-a235-5be0157f35ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:04.356129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c9243a0-f950-4749-a235-5be0157f35ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:04.356812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c9243a0-f950-4749-a235-5be0157f35ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:04.357265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c9243a0-f950-4749-a235-5be0157f35ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:04.357717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c9243a0-f950-4749-a235-5be0157f35ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:04.484963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8c9243a0-f950-4749-a235-5be0157f35ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:04.493830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8c9243a0-f950-4749-a235-5be0157f35ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149134 Aug 18 22:12:04.494405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1283/2557] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:04 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:04.519852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-249ecd6d-40cb-4be6-8b34-c5750492a3ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:04.520470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-249ecd6d-40cb-4be6-8b34-c5750492a3ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:04.526537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-249ecd6d-40cb-4be6-8b34-c5750492a3ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:04.527026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-249ecd6d-40cb-4be6-8b34-c5750492a3ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:04.527462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-249ecd6d-40cb-4be6-8b34-c5750492a3ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:04.528151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-249ecd6d-40cb-4be6-8b34-c5750492a3ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:04.528625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-249ecd6d-40cb-4be6-8b34-c5750492a3ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:04.529029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-249ecd6d-40cb-4be6-8b34-c5750492a3ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:04.654483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-249ecd6d-40cb-4be6-8b34-c5750492a3ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:04.662581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-249ecd6d-40cb-4be6-8b34-c5750492a3ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.146600 Aug 18 22:12:04.663335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1275/2558] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:04.931262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-80b6a9fc-e828-47bc-b056-4b2149960c7c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:04.931810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-80b6a9fc-e828-47bc-b056-4b2149960c7c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:04.938206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80b6a9fc-e828-47bc-b056-4b2149960c7c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:04.938695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80b6a9fc-e828-47bc-b056-4b2149960c7c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:04.939132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80b6a9fc-e828-47bc-b056-4b2149960c7c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:04.939826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80b6a9fc-e828-47bc-b056-4b2149960c7c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:04.940279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80b6a9fc-e828-47bc-b056-4b2149960c7c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:04.940706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80b6a9fc-e828-47bc-b056-4b2149960c7c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:05.040844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3175a893-da69-4f9c-a84f-a61192dea864 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:05.041567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3175a893-da69-4f9c-a84f-a61192dea864 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:05.048105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3175a893-da69-4f9c-a84f-a61192dea864 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:05.048678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3175a893-da69-4f9c-a84f-a61192dea864 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:05.049124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3175a893-da69-4f9c-a84f-a61192dea864 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:05.049879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3175a893-da69-4f9c-a84f-a61192dea864 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:05.050586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3175a893-da69-4f9c-a84f-a61192dea864 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:05.051010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3175a893-da69-4f9c-a84f-a61192dea864 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:05.072415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-80b6a9fc-e828-47bc-b056-4b2149960c7c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:05.080805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-80b6a9fc-e828-47bc-b056-4b2149960c7c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154092 Aug 18 22:12:05.081482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1284/2559] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:04 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:05.182745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3175a893-da69-4f9c-a84f-a61192dea864 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:05.191314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3175a893-da69-4f9c-a84f-a61192dea864 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:05.192829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3175a893-da69-4f9c-a84f-a61192dea864 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:05.194017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3175a893-da69-4f9c-a84f-a61192dea864 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157652 Aug 18 22:12:05.194610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1276/2560] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:05.217116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-019cc106-cd02-4e1b-852a-6c6780bed92f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:05.217789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-019cc106-cd02-4e1b-852a-6c6780bed92f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:05.224100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-019cc106-cd02-4e1b-852a-6c6780bed92f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:05.224622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-019cc106-cd02-4e1b-852a-6c6780bed92f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:05.225066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-019cc106-cd02-4e1b-852a-6c6780bed92f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:05.225812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-019cc106-cd02-4e1b-852a-6c6780bed92f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:05.226843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-019cc106-cd02-4e1b-852a-6c6780bed92f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:05.227299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-019cc106-cd02-4e1b-852a-6c6780bed92f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:05.354823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-019cc106-cd02-4e1b-852a-6c6780bed92f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:05.363143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-019cc106-cd02-4e1b-852a-6c6780bed92f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149772 Aug 18 22:12:05.363728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1285/2561] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:05 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:05.515439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0e9173cc-423f-4352-963f-476cf7d7a0fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:05.516002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0e9173cc-423f-4352-963f-476cf7d7a0fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:05.522079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e9173cc-423f-4352-963f-476cf7d7a0fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:05.522565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e9173cc-423f-4352-963f-476cf7d7a0fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:05.523544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e9173cc-423f-4352-963f-476cf7d7a0fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:05.524259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e9173cc-423f-4352-963f-476cf7d7a0fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:05.524717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e9173cc-423f-4352-963f-476cf7d7a0fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:05.525145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e9173cc-423f-4352-963f-476cf7d7a0fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:05.653550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0e9173cc-423f-4352-963f-476cf7d7a0fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:05.661929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0e9173cc-423f-4352-963f-476cf7d7a0fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150365 Aug 18 22:12:05.662499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1277/2562] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:05 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:05.684288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-806ea5fd-4b3a-4d51-a74a-6ffbfdc05aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:05.684942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-806ea5fd-4b3a-4d51-a74a-6ffbfdc05aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:05.691771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-806ea5fd-4b3a-4d51-a74a-6ffbfdc05aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:05.692285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-806ea5fd-4b3a-4d51-a74a-6ffbfdc05aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:05.692737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-806ea5fd-4b3a-4d51-a74a-6ffbfdc05aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:05.693454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-806ea5fd-4b3a-4d51-a74a-6ffbfdc05aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:05.693956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-806ea5fd-4b3a-4d51-a74a-6ffbfdc05aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:05.694387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-806ea5fd-4b3a-4d51-a74a-6ffbfdc05aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:06.049492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-806ea5fd-4b3a-4d51-a74a-6ffbfdc05aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:06.058340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-806ea5fd-4b3a-4d51-a74a-6ffbfdc05aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.378379 Aug 18 22:12:06.058914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1286/2563] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:05 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:06.101181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e97268af-2f87-460c-98f9-3c7908597c89 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:06.101842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e97268af-2f87-460c-98f9-3c7908597c89 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:06.108287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e97268af-2f87-460c-98f9-3c7908597c89 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:06.108794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e97268af-2f87-460c-98f9-3c7908597c89 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:06.109221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e97268af-2f87-460c-98f9-3c7908597c89 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:06.109944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e97268af-2f87-460c-98f9-3c7908597c89 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:06.110406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e97268af-2f87-460c-98f9-3c7908597c89 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:06.110845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e97268af-2f87-460c-98f9-3c7908597c89 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:06.216346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9313a7fd-fd73-4683-ae89-05c38d24dd94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:06.216970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9313a7fd-fd73-4683-ae89-05c38d24dd94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:06.223067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9313a7fd-fd73-4683-ae89-05c38d24dd94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:06.223535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9313a7fd-fd73-4683-ae89-05c38d24dd94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:06.223987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9313a7fd-fd73-4683-ae89-05c38d24dd94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:06.224664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9313a7fd-fd73-4683-ae89-05c38d24dd94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:06.225120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9313a7fd-fd73-4683-ae89-05c38d24dd94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:06.225546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9313a7fd-fd73-4683-ae89-05c38d24dd94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:06.229614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:06.238771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e97268af-2f87-460c-98f9-3c7908597c89 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:06.247652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e97268af-2f87-460c-98f9-3c7908597c89 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150365 Aug 18 22:12:06.248241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1278/2564] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:06 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:06.355699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9313a7fd-fd73-4683-ae89-05c38d24dd94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:06.364351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9313a7fd-fd73-4683-ae89-05c38d24dd94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:06.365890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9313a7fd-fd73-4683-ae89-05c38d24dd94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:06.367107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9313a7fd-fd73-4683-ae89-05c38d24dd94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154760 Aug 18 22:12:06.367673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1287/2565] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:06 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:06.384682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ac2b54aa-5804-404e-bb78-524c57d08724 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:06.385298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ac2b54aa-5804-404e-bb78-524c57d08724 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:06.391216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac2b54aa-5804-404e-bb78-524c57d08724 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:06.391733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac2b54aa-5804-404e-bb78-524c57d08724 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:06.392328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac2b54aa-5804-404e-bb78-524c57d08724 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:06.392801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac2b54aa-5804-404e-bb78-524c57d08724 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:06.393253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac2b54aa-5804-404e-bb78-524c57d08724 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:06.393702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac2b54aa-5804-404e-bb78-524c57d08724 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:06.524293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ac2b54aa-5804-404e-bb78-524c57d08724 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:06.532289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ac2b54aa-5804-404e-bb78-524c57d08724 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152018 Aug 18 22:12:06.534188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1279/2566] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:06 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:06.684838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a861ad64-1ce1-4862-ae98-22b3418d747c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:06.685454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a861ad64-1ce1-4862-ae98-22b3418d747c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:06.691490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a861ad64-1ce1-4862-ae98-22b3418d747c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:06.691979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a861ad64-1ce1-4862-ae98-22b3418d747c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:06.692419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a861ad64-1ce1-4862-ae98-22b3418d747c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:06.693113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a861ad64-1ce1-4862-ae98-22b3418d747c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:06.693569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a861ad64-1ce1-4862-ae98-22b3418d747c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:06.694018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a861ad64-1ce1-4862-ae98-22b3418d747c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:06.824585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a861ad64-1ce1-4862-ae98-22b3418d747c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:06.832757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a861ad64-1ce1-4862-ae98-22b3418d747c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151754 Aug 18 22:12:06.833333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1288/2567] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:06 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:07.079056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d66ad36c-4ebb-435d-ac5c-b0eb46153ac8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:07.079721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d66ad36c-4ebb-435d-ac5c-b0eb46153ac8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:07.085951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d66ad36c-4ebb-435d-ac5c-b0eb46153ac8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:07.086432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d66ad36c-4ebb-435d-ac5c-b0eb46153ac8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:07.086870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d66ad36c-4ebb-435d-ac5c-b0eb46153ac8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:07.087558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d66ad36c-4ebb-435d-ac5c-b0eb46153ac8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:07.088035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d66ad36c-4ebb-435d-ac5c-b0eb46153ac8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:07.088457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d66ad36c-4ebb-435d-ac5c-b0eb46153ac8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:07.214284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d66ad36c-4ebb-435d-ac5c-b0eb46153ac8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:07.222317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d66ad36c-4ebb-435d-ac5c-b0eb46153ac8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147126 Aug 18 22:12:07.222891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1280/2568] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:07.269746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8dab1e8f-0b0c-465c-887c-b9a3350ea250 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:07.270361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8dab1e8f-0b0c-465c-887c-b9a3350ea250 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:07.276723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dab1e8f-0b0c-465c-887c-b9a3350ea250 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:07.277199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dab1e8f-0b0c-465c-887c-b9a3350ea250 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:07.277657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dab1e8f-0b0c-465c-887c-b9a3350ea250 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:07.278343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dab1e8f-0b0c-465c-887c-b9a3350ea250 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:07.278795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dab1e8f-0b0c-465c-887c-b9a3350ea250 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:07.279220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8dab1e8f-0b0c-465c-887c-b9a3350ea250 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:07.389414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-76cc5889-440a-4a15-9f26-d0c61e8a36ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:07.390115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-76cc5889-440a-4a15-9f26-d0c61e8a36ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:07.396006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76cc5889-440a-4a15-9f26-d0c61e8a36ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:07.396504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76cc5889-440a-4a15-9f26-d0c61e8a36ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:07.396943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76cc5889-440a-4a15-9f26-d0c61e8a36ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:07.398180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76cc5889-440a-4a15-9f26-d0c61e8a36ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:07.398645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76cc5889-440a-4a15-9f26-d0c61e8a36ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:07.399077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76cc5889-440a-4a15-9f26-d0c61e8a36ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:07.407432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8dab1e8f-0b0c-465c-887c-b9a3350ea250 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:07.416920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8dab1e8f-0b0c-465c-887c-b9a3350ea250 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151020 Aug 18 22:12:07.417590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1289/2569] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:07 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:07.530044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-76cc5889-440a-4a15-9f26-d0c61e8a36ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:07.539267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-76cc5889-440a-4a15-9f26-d0c61e8a36ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:07.540773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-76cc5889-440a-4a15-9f26-d0c61e8a36ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:07.541959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-76cc5889-440a-4a15-9f26-d0c61e8a36ef tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156373 Aug 18 22:12:07.542530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1281/2570] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:07.553667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7babcdf0-1b48-4144-8476-0b41b8b20d6c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:07.554327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7babcdf0-1b48-4144-8476-0b41b8b20d6c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:07.560241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7babcdf0-1b48-4144-8476-0b41b8b20d6c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:07.560706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7babcdf0-1b48-4144-8476-0b41b8b20d6c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:07.561140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7babcdf0-1b48-4144-8476-0b41b8b20d6c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:07.561861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7babcdf0-1b48-4144-8476-0b41b8b20d6c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:07.562338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7babcdf0-1b48-4144-8476-0b41b8b20d6c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:07.562750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7babcdf0-1b48-4144-8476-0b41b8b20d6c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:07.690674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7babcdf0-1b48-4144-8476-0b41b8b20d6c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:07.698753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7babcdf0-1b48-4144-8476-0b41b8b20d6c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149252 Aug 18 22:12:07.699317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1290/2571] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:07 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:07.854156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6ef0b0a3-b3c1-497f-9ad6-ecab50f7807b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:07.854767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6ef0b0a3-b3c1-497f-9ad6-ecab50f7807b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:07.860676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ef0b0a3-b3c1-497f-9ad6-ecab50f7807b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:07.861157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ef0b0a3-b3c1-497f-9ad6-ecab50f7807b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:07.861592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ef0b0a3-b3c1-497f-9ad6-ecab50f7807b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:07.862294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ef0b0a3-b3c1-497f-9ad6-ecab50f7807b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:07.862741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ef0b0a3-b3c1-497f-9ad6-ecab50f7807b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:07.863165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ef0b0a3-b3c1-497f-9ad6-ecab50f7807b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:07.990705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6ef0b0a3-b3c1-497f-9ad6-ecab50f7807b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:07.998783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6ef0b0a3-b3c1-497f-9ad6-ecab50f7807b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148504 Aug 18 22:12:07.999382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1282/2572] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:07 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:08.243485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c9e71c6d-b04b-4d23-9496-4889f529ad25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:08.244023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c9e71c6d-b04b-4d23-9496-4889f529ad25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:08.250142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9e71c6d-b04b-4d23-9496-4889f529ad25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:08.250623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9e71c6d-b04b-4d23-9496-4889f529ad25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:08.251432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9e71c6d-b04b-4d23-9496-4889f529ad25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:08.251852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9e71c6d-b04b-4d23-9496-4889f529ad25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:08.252304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9e71c6d-b04b-4d23-9496-4889f529ad25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:08.252729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9e71c6d-b04b-4d23-9496-4889f529ad25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:08.380148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c9e71c6d-b04b-4d23-9496-4889f529ad25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:08.388938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c9e71c6d-b04b-4d23-9496-4889f529ad25 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149930 Aug 18 22:12:08.389522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1291/2573] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:08 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:08.438011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7cf4d1a1-71f5-4cea-8859-94605abe6252 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:08.438724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7cf4d1a1-71f5-4cea-8859-94605abe6252 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:08.445674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cf4d1a1-71f5-4cea-8859-94605abe6252 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:08.446164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cf4d1a1-71f5-4cea-8859-94605abe6252 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:08.446607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cf4d1a1-71f5-4cea-8859-94605abe6252 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:08.447300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cf4d1a1-71f5-4cea-8859-94605abe6252 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:08.447761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cf4d1a1-71f5-4cea-8859-94605abe6252 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:08.448192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7cf4d1a1-71f5-4cea-8859-94605abe6252 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:08.564730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e733ac7c-d941-4929-9798-4e188e6cb7f6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:08.565358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e733ac7c-d941-4929-9798-4e188e6cb7f6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:08.571913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e733ac7c-d941-4929-9798-4e188e6cb7f6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:08.572410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e733ac7c-d941-4929-9798-4e188e6cb7f6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:08.572848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e733ac7c-d941-4929-9798-4e188e6cb7f6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:08.573557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e733ac7c-d941-4929-9798-4e188e6cb7f6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:08.574039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e733ac7c-d941-4929-9798-4e188e6cb7f6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:08.574465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e733ac7c-d941-4929-9798-4e188e6cb7f6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:08.705172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e733ac7c-d941-4929-9798-4e188e6cb7f6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:08.714055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e733ac7c-d941-4929-9798-4e188e6cb7f6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:08.715978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e733ac7c-d941-4929-9798-4e188e6cb7f6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:08.717188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e733ac7c-d941-4929-9798-4e188e6cb7f6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156549 Aug 18 22:12:08.717784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1292/2574] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:08.722201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-63ad3eb9-2246-48c7-8f23-241661a6c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:08.722820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-63ad3eb9-2246-48c7-8f23-241661a6c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:08.729246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63ad3eb9-2246-48c7-8f23-241661a6c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:08.732344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7cf4d1a1-71f5-4cea-8859-94605abe6252 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:08.734084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63ad3eb9-2246-48c7-8f23-241661a6c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:08.734549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63ad3eb9-2246-48c7-8f23-241661a6c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:08.735307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63ad3eb9-2246-48c7-8f23-241661a6c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:08.736093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63ad3eb9-2246-48c7-8f23-241661a6c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:08.736530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63ad3eb9-2246-48c7-8f23-241661a6c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:08.740652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7cf4d1a1-71f5-4cea-8859-94605abe6252 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.306478 Aug 18 22:12:08.741226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1283/2575] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:08 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:08.864922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-63ad3eb9-2246-48c7-8f23-241661a6c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:08.873793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-63ad3eb9-2246-48c7-8f23-241661a6c23c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155005 Aug 18 22:12:08.874363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1293/2576] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:08 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:09.020176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-51264f51-508f-4d93-bceb-d5f6eb9a7590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:09.020827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-51264f51-508f-4d93-bceb-d5f6eb9a7590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:09.027270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51264f51-508f-4d93-bceb-d5f6eb9a7590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:09.027763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51264f51-508f-4d93-bceb-d5f6eb9a7590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:09.028207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51264f51-508f-4d93-bceb-d5f6eb9a7590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:09.028894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51264f51-508f-4d93-bceb-d5f6eb9a7590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:09.029350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51264f51-508f-4d93-bceb-d5f6eb9a7590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:09.029836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51264f51-508f-4d93-bceb-d5f6eb9a7590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:09.156594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-51264f51-508f-4d93-bceb-d5f6eb9a7590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:09.165621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-51264f51-508f-4d93-bceb-d5f6eb9a7590 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149187 Aug 18 22:12:09.166195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1284/2577] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:09 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:09.410924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c74bcf80-77f4-4e35-8f58-8cfa6adb6b50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:09.411463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c74bcf80-77f4-4e35-8f58-8cfa6adb6b50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:09.417885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c74bcf80-77f4-4e35-8f58-8cfa6adb6b50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:09.418366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c74bcf80-77f4-4e35-8f58-8cfa6adb6b50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:09.418799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c74bcf80-77f4-4e35-8f58-8cfa6adb6b50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:09.419479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c74bcf80-77f4-4e35-8f58-8cfa6adb6b50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:09.419928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c74bcf80-77f4-4e35-8f58-8cfa6adb6b50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:09.420348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c74bcf80-77f4-4e35-8f58-8cfa6adb6b50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:09.547862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c74bcf80-77f4-4e35-8f58-8cfa6adb6b50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:09.556405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c74bcf80-77f4-4e35-8f58-8cfa6adb6b50 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149485 Aug 18 22:12:09.556964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1294/2578] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:09 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:09.740623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c49a403b-b7e7-433c-9b9f-0ac83e2e7fbc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:09.741243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c49a403b-b7e7-433c-9b9f-0ac83e2e7fbc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:09.748187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c49a403b-b7e7-433c-9b9f-0ac83e2e7fbc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:09.748675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c49a403b-b7e7-433c-9b9f-0ac83e2e7fbc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:09.749113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c49a403b-b7e7-433c-9b9f-0ac83e2e7fbc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:09.749867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c49a403b-b7e7-433c-9b9f-0ac83e2e7fbc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:09.750330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c49a403b-b7e7-433c-9b9f-0ac83e2e7fbc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:09.750753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c49a403b-b7e7-433c-9b9f-0ac83e2e7fbc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:09.762813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-167f2bb7-6ceb-421f-a7db-e37e26d388a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:09.763468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-167f2bb7-6ceb-421f-a7db-e37e26d388a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:09.769472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-167f2bb7-6ceb-421f-a7db-e37e26d388a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:09.769987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-167f2bb7-6ceb-421f-a7db-e37e26d388a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:09.770432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-167f2bb7-6ceb-421f-a7db-e37e26d388a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:09.771242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-167f2bb7-6ceb-421f-a7db-e37e26d388a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:09.771703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-167f2bb7-6ceb-421f-a7db-e37e26d388a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:09.772133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-167f2bb7-6ceb-421f-a7db-e37e26d388a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:09.887610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c49a403b-b7e7-433c-9b9f-0ac83e2e7fbc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:09.889875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:09.898554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c49a403b-b7e7-433c-9b9f-0ac83e2e7fbc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:09.900068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c49a403b-b7e7-433c-9b9f-0ac83e2e7fbc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:09.901249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c49a403b-b7e7-433c-9b9f-0ac83e2e7fbc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.164488 Aug 18 22:12:09.901839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1285/2579] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:09.906238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-341af950-a5a9-43c5-a8f0-ad637abd397b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:09.906853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-341af950-a5a9-43c5-a8f0-ad637abd397b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:09.912944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-341af950-a5a9-43c5-a8f0-ad637abd397b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:09.913163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-167f2bb7-6ceb-421f-a7db-e37e26d388a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:09.913479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-341af950-a5a9-43c5-a8f0-ad637abd397b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:09.914129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-341af950-a5a9-43c5-a8f0-ad637abd397b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:09.914831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-341af950-a5a9-43c5-a8f0-ad637abd397b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:09.915484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-341af950-a5a9-43c5-a8f0-ad637abd397b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:09.915921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-341af950-a5a9-43c5-a8f0-ad637abd397b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:09.923498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-167f2bb7-6ceb-421f-a7db-e37e26d388a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.164423 Aug 18 22:12:09.924273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1295/2580] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:09 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:10.054813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-341af950-a5a9-43c5-a8f0-ad637abd397b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:10.063147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-341af950-a5a9-43c5-a8f0-ad637abd397b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.160319 Aug 18 22:12:10.063722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1286/2581] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:09 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:10.187127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9370aee8-b816-4cb0-b3e3-7d84e8e02510 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:10.187733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9370aee8-b816-4cb0-b3e3-7d84e8e02510 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:10.193708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9370aee8-b816-4cb0-b3e3-7d84e8e02510 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:10.194186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9370aee8-b816-4cb0-b3e3-7d84e8e02510 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:10.195314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9370aee8-b816-4cb0-b3e3-7d84e8e02510 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:10.195959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9370aee8-b816-4cb0-b3e3-7d84e8e02510 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:10.196407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9370aee8-b816-4cb0-b3e3-7d84e8e02510 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:10.196832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9370aee8-b816-4cb0-b3e3-7d84e8e02510 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:10.324348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9370aee8-b816-4cb0-b3e3-7d84e8e02510 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:10.332559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9370aee8-b816-4cb0-b3e3-7d84e8e02510 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149341 Aug 18 22:12:10.333134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1296/2582] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:10 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:10.578704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-32519b93-d239-4535-84fa-5751f44c358b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:10.579500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-32519b93-d239-4535-84fa-5751f44c358b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:10.585478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32519b93-d239-4535-84fa-5751f44c358b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:10.585998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32519b93-d239-4535-84fa-5751f44c358b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:10.586440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32519b93-d239-4535-84fa-5751f44c358b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:10.587137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32519b93-d239-4535-84fa-5751f44c358b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:10.587592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32519b93-d239-4535-84fa-5751f44c358b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:10.588018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32519b93-d239-4535-84fa-5751f44c358b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:10.714595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-32519b93-d239-4535-84fa-5751f44c358b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:10.722859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-32519b93-d239-4535-84fa-5751f44c358b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147990 Aug 18 22:12:10.723435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1287/2583] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:10 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:10.924012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf9ca623-6b0a-465d-9a4e-195ffaa8f375 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:10.924650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf9ca623-6b0a-465d-9a4e-195ffaa8f375 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:10.931403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf9ca623-6b0a-465d-9a4e-195ffaa8f375 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:10.931883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf9ca623-6b0a-465d-9a4e-195ffaa8f375 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:10.932320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf9ca623-6b0a-465d-9a4e-195ffaa8f375 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:10.933005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf9ca623-6b0a-465d-9a4e-195ffaa8f375 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:10.933459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf9ca623-6b0a-465d-9a4e-195ffaa8f375 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:10.933912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf9ca623-6b0a-465d-9a4e-195ffaa8f375 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:10.944093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a0fe3b89-2d94-40a2-9368-a350d34a71ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:10.944716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a0fe3b89-2d94-40a2-9368-a350d34a71ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:10.951089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0fe3b89-2d94-40a2-9368-a350d34a71ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:10.951575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0fe3b89-2d94-40a2-9368-a350d34a71ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:10.952019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0fe3b89-2d94-40a2-9368-a350d34a71ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:10.952713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0fe3b89-2d94-40a2-9368-a350d34a71ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:10.953166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0fe3b89-2d94-40a2-9368-a350d34a71ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:10.953590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0fe3b89-2d94-40a2-9368-a350d34a71ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:11.063966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bf9ca623-6b0a-465d-9a4e-195ffaa8f375 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:11.073425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bf9ca623-6b0a-465d-9a4e-195ffaa8f375 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:11.075422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bf9ca623-6b0a-465d-9a4e-195ffaa8f375 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:11.076132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf9ca623-6b0a-465d-9a4e-195ffaa8f375 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156096 Aug 18 22:12:11.076880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1297/2584] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:11.086799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a0fe3b89-2d94-40a2-9368-a350d34a71ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:11.089711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4208800e-e6f7-4a53-a3c2-ffd7ffb919e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:11.090424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4208800e-e6f7-4a53-a3c2-ffd7ffb919e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:11.096998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4208800e-e6f7-4a53-a3c2-ffd7ffb919e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:11.097482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4208800e-e6f7-4a53-a3c2-ffd7ffb919e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:11.097950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4208800e-e6f7-4a53-a3c2-ffd7ffb919e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:11.098112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a0fe3b89-2d94-40a2-9368-a350d34a71ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157588 Aug 18 22:12:11.098649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4208800e-e6f7-4a53-a3c2-ffd7ffb919e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:11.103107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1288/2585] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:10 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:11.103276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4208800e-e6f7-4a53-a3c2-ffd7ffb919e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:11.103276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4208800e-e6f7-4a53-a3c2-ffd7ffb919e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:11.230351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4208800e-e6f7-4a53-a3c2-ffd7ffb919e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:11.238577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4208800e-e6f7-4a53-a3c2-ffd7ffb919e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156583 Aug 18 22:12:11.239150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1298/2586] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:11 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:11.353966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c9f0dfa6-c78f-4d7f-a33d-006d27fc1979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:11.354503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c9f0dfa6-c78f-4d7f-a33d-006d27fc1979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:11.360469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9f0dfa6-c78f-4d7f-a33d-006d27fc1979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:11.360469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9f0dfa6-c78f-4d7f-a33d-006d27fc1979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:11.361281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9f0dfa6-c78f-4d7f-a33d-006d27fc1979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:11.361991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9f0dfa6-c78f-4d7f-a33d-006d27fc1979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:11.362449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9f0dfa6-c78f-4d7f-a33d-006d27fc1979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:11.362875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c9f0dfa6-c78f-4d7f-a33d-006d27fc1979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:11.489253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c9f0dfa6-c78f-4d7f-a33d-006d27fc1979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:11.497791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c9f0dfa6-c78f-4d7f-a33d-006d27fc1979 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.147656 Aug 18 22:12:11.498371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1289/2587] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:11.746831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-17eeed8c-2c8a-4755-a3b5-20e0621d386e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:11.747458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-17eeed8c-2c8a-4755-a3b5-20e0621d386e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:11.753378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-17eeed8c-2c8a-4755-a3b5-20e0621d386e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:11.753896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-17eeed8c-2c8a-4755-a3b5-20e0621d386e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:11.754411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-17eeed8c-2c8a-4755-a3b5-20e0621d386e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:11.755048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-17eeed8c-2c8a-4755-a3b5-20e0621d386e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:11.755507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-17eeed8c-2c8a-4755-a3b5-20e0621d386e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:11.755939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-17eeed8c-2c8a-4755-a3b5-20e0621d386e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:11.884089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-17eeed8c-2c8a-4755-a3b5-20e0621d386e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:11.892206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-17eeed8c-2c8a-4755-a3b5-20e0621d386e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149237 Aug 18 22:12:11.892782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1299/2588] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:12.099383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0539a3fa-0065-4314-a142-118be07c819a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:12.100011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0539a3fa-0065-4314-a142-118be07c819a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:12.106498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0539a3fa-0065-4314-a142-118be07c819a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:12.106989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0539a3fa-0065-4314-a142-118be07c819a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:12.107431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0539a3fa-0065-4314-a142-118be07c819a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:12.108133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0539a3fa-0065-4314-a142-118be07c819a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:12.108593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0539a3fa-0065-4314-a142-118be07c819a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:12.109030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0539a3fa-0065-4314-a142-118be07c819a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:12.120257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5ca8502e-e4f1-4c10-83cb-361e00fd0d6c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:12.120880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5ca8502e-e4f1-4c10-83cb-361e00fd0d6c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:12.127254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ca8502e-e4f1-4c10-83cb-361e00fd0d6c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:12.127769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ca8502e-e4f1-4c10-83cb-361e00fd0d6c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:12.128283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ca8502e-e4f1-4c10-83cb-361e00fd0d6c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:12.129009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ca8502e-e4f1-4c10-83cb-361e00fd0d6c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:12.129471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ca8502e-e4f1-4c10-83cb-361e00fd0d6c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:12.129928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ca8502e-e4f1-4c10-83cb-361e00fd0d6c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:12.237692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0539a3fa-0065-4314-a142-118be07c819a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:12.246506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0539a3fa-0065-4314-a142-118be07c819a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:12.248009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0539a3fa-0065-4314-a142-118be07c819a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:12.249178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0539a3fa-0065-4314-a142-118be07c819a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153784 Aug 18 22:12:12.249765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1290/2589] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:12 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:12.260208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fd1b637d-e241-44e1-b6ee-bdd27fec1cea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:12.261087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fd1b637d-e241-44e1-b6ee-bdd27fec1cea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:12.266829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5ca8502e-e4f1-4c10-83cb-361e00fd0d6c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:12.267510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd1b637d-e241-44e1-b6ee-bdd27fec1cea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:12.267995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd1b637d-e241-44e1-b6ee-bdd27fec1cea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:12.268436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd1b637d-e241-44e1-b6ee-bdd27fec1cea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:12.269130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd1b637d-e241-44e1-b6ee-bdd27fec1cea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:12.269580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd1b637d-e241-44e1-b6ee-bdd27fec1cea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:12.270033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd1b637d-e241-44e1-b6ee-bdd27fec1cea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:12.275723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5ca8502e-e4f1-4c10-83cb-361e00fd0d6c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.159369 Aug 18 22:12:12.276310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1300/2590] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:12 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:12.401456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fd1b637d-e241-44e1-b6ee-bdd27fec1cea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:12.409746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fd1b637d-e241-44e1-b6ee-bdd27fec1cea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153829 Aug 18 22:12:12.410321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1291/2591] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:12 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:12.520191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-abbedda4-0f8d-4dac-97c2-5a6596003c0f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:12.520812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-abbedda4-0f8d-4dac-97c2-5a6596003c0f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:12.526681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abbedda4-0f8d-4dac-97c2-5a6596003c0f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:12.527194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abbedda4-0f8d-4dac-97c2-5a6596003c0f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:12.527636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abbedda4-0f8d-4dac-97c2-5a6596003c0f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:12.528329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abbedda4-0f8d-4dac-97c2-5a6596003c0f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:12.528787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abbedda4-0f8d-4dac-97c2-5a6596003c0f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:12.529210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abbedda4-0f8d-4dac-97c2-5a6596003c0f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:12.654996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-abbedda4-0f8d-4dac-97c2-5a6596003c0f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:12.664051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-abbedda4-0f8d-4dac-97c2-5a6596003c0f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.147935 Aug 18 22:12:12.664618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1301/2592] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:12 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:12.913704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eff7591f-b9ff-4b6f-9756-3413f5cbfd43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:12.914262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eff7591f-b9ff-4b6f-9756-3413f5cbfd43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:12.920189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff7591f-b9ff-4b6f-9756-3413f5cbfd43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:12.920665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff7591f-b9ff-4b6f-9756-3413f5cbfd43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:12.921105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff7591f-b9ff-4b6f-9756-3413f5cbfd43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:12.921812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff7591f-b9ff-4b6f-9756-3413f5cbfd43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:12.922267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff7591f-b9ff-4b6f-9756-3413f5cbfd43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:12.922834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eff7591f-b9ff-4b6f-9756-3413f5cbfd43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:13.048427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-eff7591f-b9ff-4b6f-9756-3413f5cbfd43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:13.057417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eff7591f-b9ff-4b6f-9756-3413f5cbfd43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148150 Aug 18 22:12:13.058016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1292/2593] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:12 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:13.273401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8ff03c33-87a4-444f-82e2-096ce5639915 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:13.274089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8ff03c33-87a4-444f-82e2-096ce5639915 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:13.280545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ff03c33-87a4-444f-82e2-096ce5639915 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:13.281033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ff03c33-87a4-444f-82e2-096ce5639915 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:13.281477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ff03c33-87a4-444f-82e2-096ce5639915 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:13.282241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ff03c33-87a4-444f-82e2-096ce5639915 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:13.282701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ff03c33-87a4-444f-82e2-096ce5639915 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:13.283129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ff03c33-87a4-444f-82e2-096ce5639915 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:13.296715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dc7521e5-1ae1-44e0-916e-7937b3fe67f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:13.297450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dc7521e5-1ae1-44e0-916e-7937b3fe67f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:13.304590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc7521e5-1ae1-44e0-916e-7937b3fe67f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:13.305078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc7521e5-1ae1-44e0-916e-7937b3fe67f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:13.305545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc7521e5-1ae1-44e0-916e-7937b3fe67f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:13.306251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc7521e5-1ae1-44e0-916e-7937b3fe67f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:13.306711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc7521e5-1ae1-44e0-916e-7937b3fe67f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:13.307144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc7521e5-1ae1-44e0-916e-7937b3fe67f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:13.422075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8ff03c33-87a4-444f-82e2-096ce5639915 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:13.432349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8ff03c33-87a4-444f-82e2-096ce5639915 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:13.433872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8ff03c33-87a4-444f-82e2-096ce5639915 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:13.435054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8ff03c33-87a4-444f-82e2-096ce5639915 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.166094 Aug 18 22:12:13.435629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1302/2594] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:13 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:13.440225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-00852bdb-b935-4f60-9923-d2e291528907 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:13.440831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-00852bdb-b935-4f60-9923-d2e291528907 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:13.446480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dc7521e5-1ae1-44e0-916e-7937b3fe67f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:13.446829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00852bdb-b935-4f60-9923-d2e291528907 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:13.447310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00852bdb-b935-4f60-9923-d2e291528907 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:13.447741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00852bdb-b935-4f60-9923-d2e291528907 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:13.448435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00852bdb-b935-4f60-9923-d2e291528907 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:13.448995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00852bdb-b935-4f60-9923-d2e291528907 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:13.449296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-00852bdb-b935-4f60-9923-d2e291528907 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:13.455570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dc7521e5-1ae1-44e0-916e-7937b3fe67f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.162714 Aug 18 22:12:13.456144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1293/2595] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:13 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:13.577027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-00852bdb-b935-4f60-9923-d2e291528907 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:13.579253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:13.586595 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-00852bdb-b935-4f60-9923-d2e291528907 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149882 Aug 18 22:12:13.587174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1303/2596] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:13 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:13.685844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-51f95ce1-9bf8-480f-9948-4fad36ebf6e3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:13.686496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-51f95ce1-9bf8-480f-9948-4fad36ebf6e3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:13.692604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51f95ce1-9bf8-480f-9948-4fad36ebf6e3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:13.693109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51f95ce1-9bf8-480f-9948-4fad36ebf6e3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:13.693520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51f95ce1-9bf8-480f-9948-4fad36ebf6e3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:13.694247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51f95ce1-9bf8-480f-9948-4fad36ebf6e3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:13.694707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51f95ce1-9bf8-480f-9948-4fad36ebf6e3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:13.695134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51f95ce1-9bf8-480f-9948-4fad36ebf6e3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:13.825324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-51f95ce1-9bf8-480f-9948-4fad36ebf6e3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:13.833463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-51f95ce1-9bf8-480f-9948-4fad36ebf6e3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151566 Aug 18 22:12:13.834061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1294/2597] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:14.080359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eb50ef81-749b-490f-9287-8773887dcbdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:14.080927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eb50ef81-749b-490f-9287-8773887dcbdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:14.087468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb50ef81-749b-490f-9287-8773887dcbdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:14.088085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb50ef81-749b-490f-9287-8773887dcbdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:14.088525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb50ef81-749b-490f-9287-8773887dcbdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:14.089252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb50ef81-749b-490f-9287-8773887dcbdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:14.089733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb50ef81-749b-490f-9287-8773887dcbdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:14.090190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb50ef81-749b-490f-9287-8773887dcbdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:14.217314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eb50ef81-749b-490f-9287-8773887dcbdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:14.225355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eb50ef81-749b-490f-9287-8773887dcbdb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148949 Aug 18 22:12:14.225964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1304/2598] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:14.458752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0acb1103-2052-4e49-bc51-3b0413fb8179 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:14.459462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0acb1103-2052-4e49-bc51-3b0413fb8179 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:14.466217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0acb1103-2052-4e49-bc51-3b0413fb8179 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:14.466707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0acb1103-2052-4e49-bc51-3b0413fb8179 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:14.467151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0acb1103-2052-4e49-bc51-3b0413fb8179 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:14.467862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0acb1103-2052-4e49-bc51-3b0413fb8179 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:14.468304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0acb1103-2052-4e49-bc51-3b0413fb8179 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:14.468735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0acb1103-2052-4e49-bc51-3b0413fb8179 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:14.476157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-05ed5d62-063c-40d2-8c4b-942b2184d7d7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:14.476765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-05ed5d62-063c-40d2-8c4b-942b2184d7d7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:14.483104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05ed5d62-063c-40d2-8c4b-942b2184d7d7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:14.483587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05ed5d62-063c-40d2-8c4b-942b2184d7d7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:14.484016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05ed5d62-063c-40d2-8c4b-942b2184d7d7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:14.484704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05ed5d62-063c-40d2-8c4b-942b2184d7d7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:14.485151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05ed5d62-063c-40d2-8c4b-942b2184d7d7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:14.485570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05ed5d62-063c-40d2-8c4b-942b2184d7d7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:14.602871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0acb1103-2052-4e49-bc51-3b0413fb8179 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:14.611544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0acb1103-2052-4e49-bc51-3b0413fb8179 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:14.613090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0acb1103-2052-4e49-bc51-3b0413fb8179 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:14.614282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0acb1103-2052-4e49-bc51-3b0413fb8179 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.160101 Aug 18 22:12:14.614843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1295/2599] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:14.619965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-404d181c-251f-40eb-80e0-f33bb9cc1fab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:14.620579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-404d181c-251f-40eb-80e0-f33bb9cc1fab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:14.621475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05ed5d62-063c-40d2-8c4b-942b2184d7d7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:14.626588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-404d181c-251f-40eb-80e0-f33bb9cc1fab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:14.627064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-404d181c-251f-40eb-80e0-f33bb9cc1fab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:14.627499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-404d181c-251f-40eb-80e0-f33bb9cc1fab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:14.628190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-404d181c-251f-40eb-80e0-f33bb9cc1fab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:14.628646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-404d181c-251f-40eb-80e0-f33bb9cc1fab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:14.629072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-404d181c-251f-40eb-80e0-f33bb9cc1fab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:14.630395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-05ed5d62-063c-40d2-8c4b-942b2184d7d7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.158158 Aug 18 22:12:14.631046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1305/2600] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:14 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:14.764411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-404d181c-251f-40eb-80e0-f33bb9cc1fab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:14.772683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-404d181c-251f-40eb-80e0-f33bb9cc1fab tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156852 Aug 18 22:12:14.773479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1296/2601] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:14 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:14.855178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6e47d0ea-a49f-4673-a899-071b70feb670 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:14.855825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6e47d0ea-a49f-4673-a899-071b70feb670 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:14.861895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e47d0ea-a49f-4673-a899-071b70feb670 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:14.862407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e47d0ea-a49f-4673-a899-071b70feb670 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:14.862875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e47d0ea-a49f-4673-a899-071b70feb670 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:14.863567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e47d0ea-a49f-4673-a899-071b70feb670 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:14.864018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e47d0ea-a49f-4673-a899-071b70feb670 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:14.864444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e47d0ea-a49f-4673-a899-071b70feb670 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:14.992956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6e47d0ea-a49f-4673-a899-071b70feb670 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:15.001091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6e47d0ea-a49f-4673-a899-071b70feb670 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149752 Aug 18 22:12:15.001684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1306/2602] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:15.247331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-29fd8d61-29d4-4202-95ae-3790e5bec605 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:15.247871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-29fd8d61-29d4-4202-95ae-3790e5bec605 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:15.249748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:15.255553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29fd8d61-29d4-4202-95ae-3790e5bec605 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:15.256041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29fd8d61-29d4-4202-95ae-3790e5bec605 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:15.256475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29fd8d61-29d4-4202-95ae-3790e5bec605 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:15.257193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29fd8d61-29d4-4202-95ae-3790e5bec605 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:15.257670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29fd8d61-29d4-4202-95ae-3790e5bec605 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:15.258100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29fd8d61-29d4-4202-95ae-3790e5bec605 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:15.384445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-29fd8d61-29d4-4202-95ae-3790e5bec605 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:15.392634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-29fd8d61-29d4-4202-95ae-3790e5bec605 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149445 Aug 18 22:12:15.393205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1297/2603] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:15 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:15.639143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a808525f-1ed9-4f31-a013-f6e152819dbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:15.639765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a808525f-1ed9-4f31-a013-f6e152819dbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:15.645974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a808525f-1ed9-4f31-a013-f6e152819dbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:15.646538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a808525f-1ed9-4f31-a013-f6e152819dbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:15.646995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a808525f-1ed9-4f31-a013-f6e152819dbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:15.647727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a808525f-1ed9-4f31-a013-f6e152819dbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:15.648191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a808525f-1ed9-4f31-a013-f6e152819dbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:15.648619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a808525f-1ed9-4f31-a013-f6e152819dbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:15.651751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b3d0879a-4892-4005-9939-fb37342c0517 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:15.652381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b3d0879a-4892-4005-9939-fb37342c0517 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:15.658904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3d0879a-4892-4005-9939-fb37342c0517 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:15.659390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3d0879a-4892-4005-9939-fb37342c0517 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:15.659835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3d0879a-4892-4005-9939-fb37342c0517 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:15.660543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3d0879a-4892-4005-9939-fb37342c0517 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:15.661006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3d0879a-4892-4005-9939-fb37342c0517 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:15.661436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3d0879a-4892-4005-9939-fb37342c0517 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:15.784260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a808525f-1ed9-4f31-a013-f6e152819dbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:15.793686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a808525f-1ed9-4f31-a013-f6e152819dbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:15.795186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a808525f-1ed9-4f31-a013-f6e152819dbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:15.796358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a808525f-1ed9-4f31-a013-f6e152819dbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.161126 Aug 18 22:12:15.796917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1307/2604] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:15.797053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b3d0879a-4892-4005-9939-fb37342c0517 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:15.801809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f912e5e4-4e52-457e-9604-88e682740af4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:15.802273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f912e5e4-4e52-457e-9604-88e682740af4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:15.809137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f912e5e4-4e52-457e-9604-88e682740af4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:15.809747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f912e5e4-4e52-457e-9604-88e682740af4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:15.810184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f912e5e4-4e52-457e-9604-88e682740af4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:15.810584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b3d0879a-4892-4005-9939-fb37342c0517 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.162467 Aug 18 22:12:15.810882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f912e5e4-4e52-457e-9604-88e682740af4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:15.811410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f912e5e4-4e52-457e-9604-88e682740af4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:15.811602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1298/2605] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:15 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:15.811848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f912e5e4-4e52-457e-9604-88e682740af4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:15.948602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f912e5e4-4e52-457e-9604-88e682740af4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:15.957096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f912e5e4-4e52-457e-9604-88e682740af4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.159191 Aug 18 22:12:15.957717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1308/2606] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:15 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:16.022710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3cc7ac1b-0796-4326-bc31-53499e842789 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:16.023329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3cc7ac1b-0796-4326-bc31-53499e842789 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:16.029335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cc7ac1b-0796-4326-bc31-53499e842789 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:16.029858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cc7ac1b-0796-4326-bc31-53499e842789 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:16.030293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cc7ac1b-0796-4326-bc31-53499e842789 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:16.030986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cc7ac1b-0796-4326-bc31-53499e842789 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:16.031438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cc7ac1b-0796-4326-bc31-53499e842789 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:16.031870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3cc7ac1b-0796-4326-bc31-53499e842789 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:16.164354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3cc7ac1b-0796-4326-bc31-53499e842789 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:16.172892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3cc7ac1b-0796-4326-bc31-53499e842789 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154150 Aug 18 22:12:16.173477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1299/2607] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:16 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:16.415164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-60b6993d-649c-467e-90f2-5ba696aa96d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:16.415695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-60b6993d-649c-467e-90f2-5ba696aa96d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:16.421760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60b6993d-649c-467e-90f2-5ba696aa96d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:16.422236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60b6993d-649c-467e-90f2-5ba696aa96d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:16.422667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60b6993d-649c-467e-90f2-5ba696aa96d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:16.423343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60b6993d-649c-467e-90f2-5ba696aa96d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:16.423791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60b6993d-649c-467e-90f2-5ba696aa96d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:16.424231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60b6993d-649c-467e-90f2-5ba696aa96d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:16.550455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-60b6993d-649c-467e-90f2-5ba696aa96d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:16.559113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-60b6993d-649c-467e-90f2-5ba696aa96d3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148545 Aug 18 22:12:16.559683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1309/2608] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:16.822230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ad29a8f1-1891-4603-901c-a6b1786eee70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:16.822853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ad29a8f1-1891-4603-901c-a6b1786eee70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:16.829589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad29a8f1-1891-4603-901c-a6b1786eee70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:16.830110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad29a8f1-1891-4603-901c-a6b1786eee70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:16.830557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad29a8f1-1891-4603-901c-a6b1786eee70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:16.831268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad29a8f1-1891-4603-901c-a6b1786eee70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:16.831378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-55bed500-bdf0-4e0b-9bea-43187f68700b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:16.831795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad29a8f1-1891-4603-901c-a6b1786eee70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:16.831900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-55bed500-bdf0-4e0b-9bea-43187f68700b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:16.832150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad29a8f1-1891-4603-901c-a6b1786eee70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:16.838869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55bed500-bdf0-4e0b-9bea-43187f68700b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:16.839349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55bed500-bdf0-4e0b-9bea-43187f68700b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:16.839786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55bed500-bdf0-4e0b-9bea-43187f68700b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:16.840481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55bed500-bdf0-4e0b-9bea-43187f68700b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:16.840947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55bed500-bdf0-4e0b-9bea-43187f68700b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:16.841366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55bed500-bdf0-4e0b-9bea-43187f68700b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:16.966798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ad29a8f1-1891-4603-901c-a6b1786eee70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:16.976853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ad29a8f1-1891-4603-901c-a6b1786eee70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:16.978325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ad29a8f1-1891-4603-901c-a6b1786eee70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:16.979497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ad29a8f1-1891-4603-901c-a6b1786eee70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.161270 Aug 18 22:12:16.980259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1300/2609] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:16.984414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7ddaf675-c380-45fc-a582-38890ce35687 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:16.985023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7ddaf675-c380-45fc-a582-38890ce35687 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:16.988063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-55bed500-bdf0-4e0b-9bea-43187f68700b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:16.991828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ddaf675-c380-45fc-a582-38890ce35687 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:16.992325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ddaf675-c380-45fc-a582-38890ce35687 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:16.992763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ddaf675-c380-45fc-a582-38890ce35687 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:16.993462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ddaf675-c380-45fc-a582-38890ce35687 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:16.993975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ddaf675-c380-45fc-a582-38890ce35687 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:16.994378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ddaf675-c380-45fc-a582-38890ce35687 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:16.996623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-55bed500-bdf0-4e0b-9bea-43187f68700b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.169382 Aug 18 22:12:16.997208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1310/2610] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:16 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:17.120505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7ddaf675-c380-45fc-a582-38890ce35687 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:17.129003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7ddaf675-c380-45fc-a582-38890ce35687 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.147954 Aug 18 22:12:17.129585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1301/2611] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:16 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:17.194921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1a5c18c3-c220-4303-a660-2156a77a2a34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:17.195533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1a5c18c3-c220-4303-a660-2156a77a2a34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:17.201320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a5c18c3-c220-4303-a660-2156a77a2a34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:17.201839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a5c18c3-c220-4303-a660-2156a77a2a34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:17.202266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a5c18c3-c220-4303-a660-2156a77a2a34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:17.202951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a5c18c3-c220-4303-a660-2156a77a2a34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:17.203397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a5c18c3-c220-4303-a660-2156a77a2a34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:17.203817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a5c18c3-c220-4303-a660-2156a77a2a34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:17.329757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1a5c18c3-c220-4303-a660-2156a77a2a34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:17.338509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1a5c18c3-c220-4303-a660-2156a77a2a34 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.147911 Aug 18 22:12:17.339083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1311/2612] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:17 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:17.580245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-966e1626-aaec-4142-ba5a-127ac8424567 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:17.580839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-966e1626-aaec-4142-ba5a-127ac8424567 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:17.586973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-966e1626-aaec-4142-ba5a-127ac8424567 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:17.587454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-966e1626-aaec-4142-ba5a-127ac8424567 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:17.587892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-966e1626-aaec-4142-ba5a-127ac8424567 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:17.588577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-966e1626-aaec-4142-ba5a-127ac8424567 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:17.589033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-966e1626-aaec-4142-ba5a-127ac8424567 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:17.589460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-966e1626-aaec-4142-ba5a-127ac8424567 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:17.604050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:17.717537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-966e1626-aaec-4142-ba5a-127ac8424567 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:17.726336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-966e1626-aaec-4142-ba5a-127ac8424567 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149968 Aug 18 22:12:17.726961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1302/2613] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:18.001731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-171e6739-7d5d-404e-b750-8f582fa67304 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:18.002720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-171e6739-7d5d-404e-b750-8f582fa67304 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:18.008664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-171e6739-7d5d-404e-b750-8f582fa67304 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:18.009146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-171e6739-7d5d-404e-b750-8f582fa67304 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:18.009587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-171e6739-7d5d-404e-b750-8f582fa67304 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:18.010296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-171e6739-7d5d-404e-b750-8f582fa67304 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:18.010750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-171e6739-7d5d-404e-b750-8f582fa67304 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:18.011177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-171e6739-7d5d-404e-b750-8f582fa67304 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:18.017718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2891a6be-dd90-4e43-88ba-c19ddb6bbbf3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:18.018561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2891a6be-dd90-4e43-88ba-c19ddb6bbbf3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:18.024854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2891a6be-dd90-4e43-88ba-c19ddb6bbbf3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:18.025345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2891a6be-dd90-4e43-88ba-c19ddb6bbbf3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:18.025821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2891a6be-dd90-4e43-88ba-c19ddb6bbbf3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:18.026524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2891a6be-dd90-4e43-88ba-c19ddb6bbbf3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:18.026989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2891a6be-dd90-4e43-88ba-c19ddb6bbbf3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:18.027422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2891a6be-dd90-4e43-88ba-c19ddb6bbbf3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:18.148469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-171e6739-7d5d-404e-b750-8f582fa67304 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:18.157432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-171e6739-7d5d-404e-b750-8f582fa67304 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:18.159070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-171e6739-7d5d-404e-b750-8f582fa67304 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:18.160270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-171e6739-7d5d-404e-b750-8f582fa67304 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.162461 Aug 18 22:12:18.160840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1312/2614] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:18.164847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2891a6be-dd90-4e43-88ba-c19ddb6bbbf3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:18.165834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-87c1b1ae-af5b-4100-9b50-ba0890d72c73 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:18.166953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-87c1b1ae-af5b-4100-9b50-ba0890d72c73 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:18.172802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87c1b1ae-af5b-4100-9b50-ba0890d72c73 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:18.173371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87c1b1ae-af5b-4100-9b50-ba0890d72c73 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:18.173527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2891a6be-dd90-4e43-88ba-c19ddb6bbbf3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.159387 Aug 18 22:12:18.174147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87c1b1ae-af5b-4100-9b50-ba0890d72c73 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:18.174295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1303/2615] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:18 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:18.175470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87c1b1ae-af5b-4100-9b50-ba0890d72c73 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:18.175942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87c1b1ae-af5b-4100-9b50-ba0890d72c73 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:18.176374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87c1b1ae-af5b-4100-9b50-ba0890d72c73 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:18.301937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-87c1b1ae-af5b-4100-9b50-ba0890d72c73 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:18.310663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-87c1b1ae-af5b-4100-9b50-ba0890d72c73 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148886 Aug 18 22:12:18.311237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1313/2616] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:18 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:18.359436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4968105c-64ac-4477-9792-78b1e0442b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:18.360050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4968105c-64ac-4477-9792-78b1e0442b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:18.365892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4968105c-64ac-4477-9792-78b1e0442b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:18.366418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4968105c-64ac-4477-9792-78b1e0442b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:18.366853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4968105c-64ac-4477-9792-78b1e0442b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:18.367536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4968105c-64ac-4477-9792-78b1e0442b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:18.367987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4968105c-64ac-4477-9792-78b1e0442b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:18.368416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4968105c-64ac-4477-9792-78b1e0442b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:18.502955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4968105c-64ac-4477-9792-78b1e0442b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:18.511160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4968105c-64ac-4477-9792-78b1e0442b25 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155592 Aug 18 22:12:18.511742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1304/2617] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:18 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:18.747502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a523c079-7e73-4671-80b3-2f2e30b26931 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:18.748143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a523c079-7e73-4671-80b3-2f2e30b26931 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:18.749996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:18.755677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a523c079-7e73-4671-80b3-2f2e30b26931 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:18.756162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a523c079-7e73-4671-80b3-2f2e30b26931 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:18.756597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a523c079-7e73-4671-80b3-2f2e30b26931 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:18.757854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a523c079-7e73-4671-80b3-2f2e30b26931 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:18.758310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a523c079-7e73-4671-80b3-2f2e30b26931 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:18.758734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a523c079-7e73-4671-80b3-2f2e30b26931 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:18.896063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a523c079-7e73-4671-80b3-2f2e30b26931 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:18.905013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a523c079-7e73-4671-80b3-2f2e30b26931 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.161437 Aug 18 22:12:18.905588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1314/2618] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:19.185712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f0a795a9-6216-41e8-a684-a25df2277c30 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:19.186345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f0a795a9-6216-41e8-a684-a25df2277c30 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:19.194107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0a795a9-6216-41e8-a684-a25df2277c30 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:19.194604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0a795a9-6216-41e8-a684-a25df2277c30 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:19.195052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0a795a9-6216-41e8-a684-a25df2277c30 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:19.195773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0a795a9-6216-41e8-a684-a25df2277c30 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:19.196240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0a795a9-6216-41e8-a684-a25df2277c30 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:19.196430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-966aa6e6-8d08-48d7-b37f-d7780225c2f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:19.197176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0a795a9-6216-41e8-a684-a25df2277c30 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:19.197418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-966aa6e6-8d08-48d7-b37f-d7780225c2f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:19.204569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-966aa6e6-8d08-48d7-b37f-d7780225c2f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:19.205063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-966aa6e6-8d08-48d7-b37f-d7780225c2f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:19.205507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-966aa6e6-8d08-48d7-b37f-d7780225c2f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:19.206263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-966aa6e6-8d08-48d7-b37f-d7780225c2f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:19.206725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-966aa6e6-8d08-48d7-b37f-d7780225c2f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:19.207156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-966aa6e6-8d08-48d7-b37f-d7780225c2f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:19.339806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f0a795a9-6216-41e8-a684-a25df2277c30 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:19.348598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f0a795a9-6216-41e8-a684-a25df2277c30 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:19.350263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f0a795a9-6216-41e8-a684-a25df2277c30 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:19.352043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f0a795a9-6216-41e8-a684-a25df2277c30 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.170415 Aug 18 22:12:19.352610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1305/2619] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:19.357066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6591375b-81d2-478d-bc90-1bad191849aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:19.357715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6591375b-81d2-478d-bc90-1bad191849aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:19.364175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6591375b-81d2-478d-bc90-1bad191849aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:19.364704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6591375b-81d2-478d-bc90-1bad191849aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:19.365126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6591375b-81d2-478d-bc90-1bad191849aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:19.365866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6591375b-81d2-478d-bc90-1bad191849aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:19.365990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-966aa6e6-8d08-48d7-b37f-d7780225c2f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:19.366317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6591375b-81d2-478d-bc90-1bad191849aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:19.366742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6591375b-81d2-478d-bc90-1bad191849aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:19.374834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-966aa6e6-8d08-48d7-b37f-d7780225c2f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.183298 Aug 18 22:12:19.375424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1315/2620] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:19 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:19.498242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6591375b-81d2-478d-bc90-1bad191849aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:19.506672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6591375b-81d2-478d-bc90-1bad191849aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153082 Aug 18 22:12:19.507744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1306/2621] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:19 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:19.532642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-850de89d-c803-4edb-a961-7c1bf11db334 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:19.533328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-850de89d-c803-4edb-a961-7c1bf11db334 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:19.542186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-850de89d-c803-4edb-a961-7c1bf11db334 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:19.542674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-850de89d-c803-4edb-a961-7c1bf11db334 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:19.543117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-850de89d-c803-4edb-a961-7c1bf11db334 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:19.543817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-850de89d-c803-4edb-a961-7c1bf11db334 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:19.544280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-850de89d-c803-4edb-a961-7c1bf11db334 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:19.544712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-850de89d-c803-4edb-a961-7c1bf11db334 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:19.684530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-850de89d-c803-4edb-a961-7c1bf11db334 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:19.693993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-850de89d-c803-4edb-a961-7c1bf11db334 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.165265 Aug 18 22:12:19.695076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1316/2622] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:19 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:19.926295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cb59c616-8fbf-42db-a94e-8149ec6c604b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:19.926825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cb59c616-8fbf-42db-a94e-8149ec6c604b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:19.933243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb59c616-8fbf-42db-a94e-8149ec6c604b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:19.933764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb59c616-8fbf-42db-a94e-8149ec6c604b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:19.934201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb59c616-8fbf-42db-a94e-8149ec6c604b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:19.934916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb59c616-8fbf-42db-a94e-8149ec6c604b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:19.935355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb59c616-8fbf-42db-a94e-8149ec6c604b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:19.935797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb59c616-8fbf-42db-a94e-8149ec6c604b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:20.064714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cb59c616-8fbf-42db-a94e-8149ec6c604b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:20.073323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cb59c616-8fbf-42db-a94e-8149ec6c604b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151211 Aug 18 22:12:20.073929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1307/2623] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:19 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:20.375679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f1584b28-0ddc-4b9d-be83-7c352b28ef52 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:20.376495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f1584b28-0ddc-4b9d-be83-7c352b28ef52 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:20.382705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1584b28-0ddc-4b9d-be83-7c352b28ef52 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:20.383180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1584b28-0ddc-4b9d-be83-7c352b28ef52 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:20.383614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1584b28-0ddc-4b9d-be83-7c352b28ef52 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:20.384293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1584b28-0ddc-4b9d-be83-7c352b28ef52 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:20.384741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1584b28-0ddc-4b9d-be83-7c352b28ef52 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:20.385164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1584b28-0ddc-4b9d-be83-7c352b28ef52 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:20.397267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6bb17b12-448c-4ce0-b051-f09fd6609789 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:20.397933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6bb17b12-448c-4ce0-b051-f09fd6609789 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:20.404317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bb17b12-448c-4ce0-b051-f09fd6609789 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:20.404800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bb17b12-448c-4ce0-b051-f09fd6609789 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:20.405239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bb17b12-448c-4ce0-b051-f09fd6609789 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:20.405997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bb17b12-448c-4ce0-b051-f09fd6609789 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:20.406456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bb17b12-448c-4ce0-b051-f09fd6609789 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:20.406886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bb17b12-448c-4ce0-b051-f09fd6609789 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:20.522573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f1584b28-0ddc-4b9d-be83-7c352b28ef52 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:20.531533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f1584b28-0ddc-4b9d-be83-7c352b28ef52 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:20.533301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f1584b28-0ddc-4b9d-be83-7c352b28ef52 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:20.534640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f1584b28-0ddc-4b9d-be83-7c352b28ef52 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.162931 Aug 18 22:12:20.535213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1317/2624] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:20 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:20.547620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-80c21cb2-34c4-4f42-9a7d-3a4fea7f58b2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:20.547620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-80c21cb2-34c4-4f42-9a7d-3a4fea7f58b2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:20.547996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6bb17b12-448c-4ce0-b051-f09fd6609789 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:20.548138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80c21cb2-34c4-4f42-9a7d-3a4fea7f58b2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:20.548138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80c21cb2-34c4-4f42-9a7d-3a4fea7f58b2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:20.548138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80c21cb2-34c4-4f42-9a7d-3a4fea7f58b2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:20.548421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80c21cb2-34c4-4f42-9a7d-3a4fea7f58b2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:20.548708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80c21cb2-34c4-4f42-9a7d-3a4fea7f58b2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:20.549142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80c21cb2-34c4-4f42-9a7d-3a4fea7f58b2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:20.557014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6bb17b12-448c-4ce0-b051-f09fd6609789 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.164262 Aug 18 22:12:20.561638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1308/2625] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:20 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:20.676535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-80c21cb2-34c4-4f42-9a7d-3a4fea7f58b2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:20.684564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-80c21cb2-34c4-4f42-9a7d-3a4fea7f58b2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148426 Aug 18 22:12:20.685130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1318/2626] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:20 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:20.716708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-131f6912-024b-44be-8a79-892f6b750163 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:20.717321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-131f6912-024b-44be-8a79-892f6b750163 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:20.723443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-131f6912-024b-44be-8a79-892f6b750163 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:20.723938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-131f6912-024b-44be-8a79-892f6b750163 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:20.724382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-131f6912-024b-44be-8a79-892f6b750163 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:20.725087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-131f6912-024b-44be-8a79-892f6b750163 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:20.726182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-131f6912-024b-44be-8a79-892f6b750163 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:20.726620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-131f6912-024b-44be-8a79-892f6b750163 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:20.867589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-131f6912-024b-44be-8a79-892f6b750163 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:20.875860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-131f6912-024b-44be-8a79-892f6b750163 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.162995 Aug 18 22:12:20.876461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1309/2627] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:21.094624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f4a302c1-5852-4ebe-a452-1ad56ff20a24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:21.095385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f4a302c1-5852-4ebe-a452-1ad56ff20a24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:21.101978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4a302c1-5852-4ebe-a452-1ad56ff20a24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:21.102474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4a302c1-5852-4ebe-a452-1ad56ff20a24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:21.102916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4a302c1-5852-4ebe-a452-1ad56ff20a24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:21.103623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4a302c1-5852-4ebe-a452-1ad56ff20a24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:21.104080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4a302c1-5852-4ebe-a452-1ad56ff20a24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:21.104510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4a302c1-5852-4ebe-a452-1ad56ff20a24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:21.237230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f4a302c1-5852-4ebe-a452-1ad56ff20a24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:21.245360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f4a302c1-5852-4ebe-a452-1ad56ff20a24 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154657 Aug 18 22:12:21.245969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1319/2628] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:21 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:21.559012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d083c7d6-6176-480c-b12b-b6210438b5a2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:21.559668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d083c7d6-6176-480c-b12b-b6210438b5a2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:21.566389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d083c7d6-6176-480c-b12b-b6210438b5a2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:21.566878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d083c7d6-6176-480c-b12b-b6210438b5a2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:21.567324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d083c7d6-6176-480c-b12b-b6210438b5a2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:21.568026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d083c7d6-6176-480c-b12b-b6210438b5a2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:21.568485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d083c7d6-6176-480c-b12b-b6210438b5a2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:21.568917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d083c7d6-6176-480c-b12b-b6210438b5a2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:21.578112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1aa68573-9279-4465-9a16-baeb557b3d8d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:21.578736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1aa68573-9279-4465-9a16-baeb557b3d8d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:21.585062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aa68573-9279-4465-9a16-baeb557b3d8d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:21.585544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aa68573-9279-4465-9a16-baeb557b3d8d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:21.586013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aa68573-9279-4465-9a16-baeb557b3d8d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:21.586709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aa68573-9279-4465-9a16-baeb557b3d8d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:21.587169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aa68573-9279-4465-9a16-baeb557b3d8d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:21.587596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1aa68573-9279-4465-9a16-baeb557b3d8d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:21.602323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:21.701887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d083c7d6-6176-480c-b12b-b6210438b5a2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:21.710640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d083c7d6-6176-480c-b12b-b6210438b5a2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:21.712138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d083c7d6-6176-480c-b12b-b6210438b5a2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:21.713328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d083c7d6-6176-480c-b12b-b6210438b5a2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.158283 Aug 18 22:12:21.716991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1310/2629] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:21.719123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-09bc0189-073b-445a-b3cd-fae5dc2b6328 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:21.720586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-09bc0189-073b-445a-b3cd-fae5dc2b6328 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:21.724315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1aa68573-9279-4465-9a16-baeb557b3d8d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:21.727949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09bc0189-073b-445a-b3cd-fae5dc2b6328 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:21.728438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09bc0189-073b-445a-b3cd-fae5dc2b6328 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:21.728883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09bc0189-073b-445a-b3cd-fae5dc2b6328 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:21.729590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09bc0189-073b-445a-b3cd-fae5dc2b6328 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:21.730159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09bc0189-073b-445a-b3cd-fae5dc2b6328 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:21.730590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09bc0189-073b-445a-b3cd-fae5dc2b6328 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:21.733730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1aa68573-9279-4465-9a16-baeb557b3d8d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.159427 Aug 18 22:12:21.734304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1320/2630] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:21 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:21.867598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-09bc0189-073b-445a-b3cd-fae5dc2b6328 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:21.875891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-09bc0189-073b-445a-b3cd-fae5dc2b6328 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.160573 Aug 18 22:12:21.876468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1311/2631] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:21 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:21.896144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1cb604e1-226b-4535-8cf5-0027c3a44bcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:21.896762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1cb604e1-226b-4535-8cf5-0027c3a44bcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:21.902751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1cb604e1-226b-4535-8cf5-0027c3a44bcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:21.903350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1cb604e1-226b-4535-8cf5-0027c3a44bcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:21.903798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1cb604e1-226b-4535-8cf5-0027c3a44bcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:21.904496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1cb604e1-226b-4535-8cf5-0027c3a44bcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:21.904958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1cb604e1-226b-4535-8cf5-0027c3a44bcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:21.905389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1cb604e1-226b-4535-8cf5-0027c3a44bcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:22.031973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1cb604e1-226b-4535-8cf5-0027c3a44bcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:22.040581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1cb604e1-226b-4535-8cf5-0027c3a44bcb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148260 Aug 18 22:12:22.041149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1321/2632] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:22.266970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e9899729-5d94-4a2e-905a-efae44f58177 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:22.267621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e9899729-5d94-4a2e-905a-efae44f58177 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:22.275109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9899729-5d94-4a2e-905a-efae44f58177 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:22.275602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9899729-5d94-4a2e-905a-efae44f58177 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:22.276045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9899729-5d94-4a2e-905a-efae44f58177 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:22.276744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9899729-5d94-4a2e-905a-efae44f58177 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:22.277206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9899729-5d94-4a2e-905a-efae44f58177 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:22.277666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9899729-5d94-4a2e-905a-efae44f58177 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:22.405364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e9899729-5d94-4a2e-905a-efae44f58177 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:22.414755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e9899729-5d94-4a2e-905a-efae44f58177 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151763 Aug 18 22:12:22.415333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1312/2633] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:22 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:22.736278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-07fedbe3-08c7-4798-bd45-9c3153f01c41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:22.736896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-07fedbe3-08c7-4798-bd45-9c3153f01c41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:22.743420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07fedbe3-08c7-4798-bd45-9c3153f01c41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:22.743900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07fedbe3-08c7-4798-bd45-9c3153f01c41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:22.744340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07fedbe3-08c7-4798-bd45-9c3153f01c41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:22.745030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07fedbe3-08c7-4798-bd45-9c3153f01c41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:22.745485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07fedbe3-08c7-4798-bd45-9c3153f01c41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:22.745936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07fedbe3-08c7-4798-bd45-9c3153f01c41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:22.755237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4282ba78-8462-4d62-8cbe-d3eca4af6bd2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:22.755952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4282ba78-8462-4d62-8cbe-d3eca4af6bd2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:22.762978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4282ba78-8462-4d62-8cbe-d3eca4af6bd2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:22.763470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4282ba78-8462-4d62-8cbe-d3eca4af6bd2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:22.763914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4282ba78-8462-4d62-8cbe-d3eca4af6bd2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:22.764617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4282ba78-8462-4d62-8cbe-d3eca4af6bd2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:22.765077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4282ba78-8462-4d62-8cbe-d3eca4af6bd2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:22.765511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4282ba78-8462-4d62-8cbe-d3eca4af6bd2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:22.879375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-07fedbe3-08c7-4798-bd45-9c3153f01c41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:22.888529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-07fedbe3-08c7-4798-bd45-9c3153f01c41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:22.890053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-07fedbe3-08c7-4798-bd45-9c3153f01c41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:22.891218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-07fedbe3-08c7-4798-bd45-9c3153f01c41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.158835 Aug 18 22:12:22.893208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1322/2634] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:22.894862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4282ba78-8462-4d62-8cbe-d3eca4af6bd2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:22.898193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d0738d4-1fd0-4c0b-858f-a370f7dd29b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:22.898898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1d0738d4-1fd0-4c0b-858f-a370f7dd29b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:22.903382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4282ba78-8462-4d62-8cbe-d3eca4af6bd2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151921 Aug 18 22:12:22.904136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1313/2635] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:22 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:22.904723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d0738d4-1fd0-4c0b-858f-a370f7dd29b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:22.905269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d0738d4-1fd0-4c0b-858f-a370f7dd29b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:22.905752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d0738d4-1fd0-4c0b-858f-a370f7dd29b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:22.906452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d0738d4-1fd0-4c0b-858f-a370f7dd29b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:22.906937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d0738d4-1fd0-4c0b-858f-a370f7dd29b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:22.907426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d0738d4-1fd0-4c0b-858f-a370f7dd29b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:23.033923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1d0738d4-1fd0-4c0b-858f-a370f7dd29b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:23.042144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1d0738d4-1fd0-4c0b-858f-a370f7dd29b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.147897 Aug 18 22:12:23.042723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1323/2636] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:23.061358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fcba5f6a-ff6b-48b9-b9dd-ffb275bc9327 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:23.062007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fcba5f6a-ff6b-48b9-b9dd-ffb275bc9327 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:23.067955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcba5f6a-ff6b-48b9-b9dd-ffb275bc9327 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:23.068447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcba5f6a-ff6b-48b9-b9dd-ffb275bc9327 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:23.068891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcba5f6a-ff6b-48b9-b9dd-ffb275bc9327 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:23.070203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcba5f6a-ff6b-48b9-b9dd-ffb275bc9327 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:23.070666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcba5f6a-ff6b-48b9-b9dd-ffb275bc9327 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:23.071105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcba5f6a-ff6b-48b9-b9dd-ffb275bc9327 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:23.195666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fcba5f6a-ff6b-48b9-b9dd-ffb275bc9327 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:23.203888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fcba5f6a-ff6b-48b9-b9dd-ffb275bc9327 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.146356 Aug 18 22:12:23.204473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1314/2637] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:23 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:23.435857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0d8938b7-27f3-427f-96cd-d902e7e7a579 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:23.436474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0d8938b7-27f3-427f-96cd-d902e7e7a579 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:23.442543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d8938b7-27f3-427f-96cd-d902e7e7a579 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:23.443024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d8938b7-27f3-427f-96cd-d902e7e7a579 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:23.443464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d8938b7-27f3-427f-96cd-d902e7e7a579 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:23.444220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d8938b7-27f3-427f-96cd-d902e7e7a579 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:23.444723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d8938b7-27f3-427f-96cd-d902e7e7a579 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:23.445161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0d8938b7-27f3-427f-96cd-d902e7e7a579 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:23.574645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0d8938b7-27f3-427f-96cd-d902e7e7a579 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:23.582751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0d8938b7-27f3-427f-96cd-d902e7e7a579 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150729 Aug 18 22:12:23.583320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1324/2638] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:23 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:23.915813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b615b3f6-a9e7-45ac-878e-c4aad1090806 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:23.916377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b615b3f6-a9e7-45ac-878e-c4aad1090806 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:23.922837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b615b3f6-a9e7-45ac-878e-c4aad1090806 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:23.923316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b615b3f6-a9e7-45ac-878e-c4aad1090806 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:23.923748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b615b3f6-a9e7-45ac-878e-c4aad1090806 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:23.924209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9ec026fb-0e3d-4c48-97b9-7a507b2d29cf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:23.924645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b615b3f6-a9e7-45ac-878e-c4aad1090806 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:23.924855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9ec026fb-0e3d-4c48-97b9-7a507b2d29cf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:23.924972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b615b3f6-a9e7-45ac-878e-c4aad1090806 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:23.925538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b615b3f6-a9e7-45ac-878e-c4aad1090806 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:23.931526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ec026fb-0e3d-4c48-97b9-7a507b2d29cf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:23.931999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ec026fb-0e3d-4c48-97b9-7a507b2d29cf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:23.932428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ec026fb-0e3d-4c48-97b9-7a507b2d29cf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:23.933108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ec026fb-0e3d-4c48-97b9-7a507b2d29cf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:23.933555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ec026fb-0e3d-4c48-97b9-7a507b2d29cf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:23.934000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9ec026fb-0e3d-4c48-97b9-7a507b2d29cf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:24.057813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b615b3f6-a9e7-45ac-878e-c4aad1090806 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:24.064364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9ec026fb-0e3d-4c48-97b9-7a507b2d29cf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:24.067504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b615b3f6-a9e7-45ac-878e-c4aad1090806 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:24.069007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b615b3f6-a9e7-45ac-878e-c4aad1090806 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:24.070736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b615b3f6-a9e7-45ac-878e-c4aad1090806 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159514 Aug 18 22:12:24.071301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1315/2639] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:24.073321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9ec026fb-0e3d-4c48-97b9-7a507b2d29cf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152819 Aug 18 22:12:24.074084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1325/2640] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:23 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:24.075880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cb193cd3-6493-4c02-95bd-47832b4d1476 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:24.076495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cb193cd3-6493-4c02-95bd-47832b4d1476 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:24.082432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb193cd3-6493-4c02-95bd-47832b4d1476 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:24.082924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb193cd3-6493-4c02-95bd-47832b4d1476 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:24.083363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb193cd3-6493-4c02-95bd-47832b4d1476 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:24.084052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb193cd3-6493-4c02-95bd-47832b4d1476 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:24.084510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb193cd3-6493-4c02-95bd-47832b4d1476 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:24.085512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb193cd3-6493-4c02-95bd-47832b4d1476 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:24.211463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cb193cd3-6493-4c02-95bd-47832b4d1476 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:24.219659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cb193cd3-6493-4c02-95bd-47832b4d1476 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.147325 Aug 18 22:12:24.220228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1316/2641] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:24 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:24.224553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6ec701ce-d7b7-4d93-9ccb-7f11152a98cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:24.225175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6ec701ce-d7b7-4d93-9ccb-7f11152a98cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:24.231340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ec701ce-d7b7-4d93-9ccb-7f11152a98cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:24.231853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ec701ce-d7b7-4d93-9ccb-7f11152a98cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:24.232296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ec701ce-d7b7-4d93-9ccb-7f11152a98cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:24.232991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ec701ce-d7b7-4d93-9ccb-7f11152a98cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:24.233453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ec701ce-d7b7-4d93-9ccb-7f11152a98cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:24.233914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6ec701ce-d7b7-4d93-9ccb-7f11152a98cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:24.364385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6ec701ce-d7b7-4d93-9ccb-7f11152a98cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:24.373055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6ec701ce-d7b7-4d93-9ccb-7f11152a98cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152307 Aug 18 22:12:24.373641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1326/2642] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:24 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:24.604673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7db69c1f-45d4-4241-ba05-bdf2db5391ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:24.605283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7db69c1f-45d4-4241-ba05-bdf2db5391ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:24.611412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7db69c1f-45d4-4241-ba05-bdf2db5391ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:24.611896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7db69c1f-45d4-4241-ba05-bdf2db5391ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:24.612326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7db69c1f-45d4-4241-ba05-bdf2db5391ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:24.613007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7db69c1f-45d4-4241-ba05-bdf2db5391ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:24.613452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7db69c1f-45d4-4241-ba05-bdf2db5391ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:24.613899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7db69c1f-45d4-4241-ba05-bdf2db5391ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:24.745103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7db69c1f-45d4-4241-ba05-bdf2db5391ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:24.753455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7db69c1f-45d4-4241-ba05-bdf2db5391ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152630 Aug 18 22:12:24.754070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1317/2643] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:25.094563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1815cffc-8253-4d1e-8e04-436d26a9a267 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:25.095189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2e1f8fd5-c444-4b83-8c15-b019cec10042 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:25.095581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1815cffc-8253-4d1e-8e04-436d26a9a267 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:25.095693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2e1f8fd5-c444-4b83-8c15-b019cec10042 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:25.102412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e1f8fd5-c444-4b83-8c15-b019cec10042 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:25.102611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1815cffc-8253-4d1e-8e04-436d26a9a267 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:25.102903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e1f8fd5-c444-4b83-8c15-b019cec10042 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:25.103049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1815cffc-8253-4d1e-8e04-436d26a9a267 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:25.103341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e1f8fd5-c444-4b83-8c15-b019cec10042 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:25.103465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1815cffc-8253-4d1e-8e04-436d26a9a267 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:25.104042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e1f8fd5-c444-4b83-8c15-b019cec10042 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:25.104153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1815cffc-8253-4d1e-8e04-436d26a9a267 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:25.104499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e1f8fd5-c444-4b83-8c15-b019cec10042 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:25.104607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1815cffc-8253-4d1e-8e04-436d26a9a267 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:25.104929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2e1f8fd5-c444-4b83-8c15-b019cec10042 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:25.105038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1815cffc-8253-4d1e-8e04-436d26a9a267 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:25.235852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1815cffc-8253-4d1e-8e04-436d26a9a267 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:25.236129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2e1f8fd5-c444-4b83-8c15-b019cec10042 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:25.244314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1815cffc-8253-4d1e-8e04-436d26a9a267 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153579 Aug 18 22:12:25.244766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2e1f8fd5-c444-4b83-8c15-b019cec10042 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:25.245243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1318/2644] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:25 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:25.246430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2e1f8fd5-c444-4b83-8c15-b019cec10042 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:25.247584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2e1f8fd5-c444-4b83-8c15-b019cec10042 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156988 Aug 18 22:12:25.248279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1327/2645] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:25 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:25.249674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a468dc76-d409-4b2c-afcc-3580288831e0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:25.250291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a468dc76-d409-4b2c-afcc-3580288831e0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:25.256470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a468dc76-d409-4b2c-afcc-3580288831e0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:25.257015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a468dc76-d409-4b2c-afcc-3580288831e0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:25.257460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a468dc76-d409-4b2c-afcc-3580288831e0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:25.258198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a468dc76-d409-4b2c-afcc-3580288831e0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:25.258666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a468dc76-d409-4b2c-afcc-3580288831e0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:25.259102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a468dc76-d409-4b2c-afcc-3580288831e0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:25.261666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:25.389202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a468dc76-d409-4b2c-afcc-3580288831e0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:25.395040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-686d9335-b54f-44f4-9a06-28904c10e857 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:25.395656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-686d9335-b54f-44f4-9a06-28904c10e857 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:25.398244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a468dc76-d409-4b2c-afcc-3580288831e0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151958 Aug 18 22:12:25.399144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1319/2646] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:25.402283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-686d9335-b54f-44f4-9a06-28904c10e857 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:25.402762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-686d9335-b54f-44f4-9a06-28904c10e857 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:25.403196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-686d9335-b54f-44f4-9a06-28904c10e857 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:25.403880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-686d9335-b54f-44f4-9a06-28904c10e857 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:25.404328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-686d9335-b54f-44f4-9a06-28904c10e857 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:25.404748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-686d9335-b54f-44f4-9a06-28904c10e857 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:25.530795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-686d9335-b54f-44f4-9a06-28904c10e857 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:25.539089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-686d9335-b54f-44f4-9a06-28904c10e857 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.147792 Aug 18 22:12:25.539662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1328/2647] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:25 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:25.775164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-02125ae8-3fa6-4ea1-a96e-ad23ddfa8767 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:25.775879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-02125ae8-3fa6-4ea1-a96e-ad23ddfa8767 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:25.782540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02125ae8-3fa6-4ea1-a96e-ad23ddfa8767 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:25.783036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02125ae8-3fa6-4ea1-a96e-ad23ddfa8767 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:25.783479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02125ae8-3fa6-4ea1-a96e-ad23ddfa8767 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:25.784176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02125ae8-3fa6-4ea1-a96e-ad23ddfa8767 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:25.784635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02125ae8-3fa6-4ea1-a96e-ad23ddfa8767 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:25.785067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02125ae8-3fa6-4ea1-a96e-ad23ddfa8767 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:25.912262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-02125ae8-3fa6-4ea1-a96e-ad23ddfa8767 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:25.920379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-02125ae8-3fa6-4ea1-a96e-ad23ddfa8767 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149989 Aug 18 22:12:25.920960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1320/2648] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:25 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:26.265841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-306a097f-4805-40c6-9a76-f0e0d80b2c4e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:26.266470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-306a097f-4805-40c6-9a76-f0e0d80b2c4e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:26.270825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cad2d9d0-0fc7-4944-b17d-d67d94e93169 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:26.271443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cad2d9d0-0fc7-4944-b17d-d67d94e93169 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:26.272984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-306a097f-4805-40c6-9a76-f0e0d80b2c4e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:26.273499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-306a097f-4805-40c6-9a76-f0e0d80b2c4e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:26.273964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-306a097f-4805-40c6-9a76-f0e0d80b2c4e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:26.274665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-306a097f-4805-40c6-9a76-f0e0d80b2c4e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:26.275117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-306a097f-4805-40c6-9a76-f0e0d80b2c4e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:26.275543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-306a097f-4805-40c6-9a76-f0e0d80b2c4e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:26.277336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cad2d9d0-0fc7-4944-b17d-d67d94e93169 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:26.277874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cad2d9d0-0fc7-4944-b17d-d67d94e93169 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:26.278315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cad2d9d0-0fc7-4944-b17d-d67d94e93169 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:26.279009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cad2d9d0-0fc7-4944-b17d-d67d94e93169 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:26.279474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cad2d9d0-0fc7-4944-b17d-d67d94e93169 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:26.279903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cad2d9d0-0fc7-4944-b17d-d67d94e93169 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:26.410031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cad2d9d0-0fc7-4944-b17d-d67d94e93169 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:26.410447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-306a097f-4805-40c6-9a76-f0e0d80b2c4e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:26.419760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-306a097f-4805-40c6-9a76-f0e0d80b2c4e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157944 Aug 18 22:12:26.433836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1329/2649] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:26 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:26.434294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cad2d9d0-0fc7-4944-b17d-d67d94e93169 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:26.434294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cad2d9d0-0fc7-4944-b17d-d67d94e93169 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:26.434294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cad2d9d0-0fc7-4944-b17d-d67d94e93169 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157820 Aug 18 22:12:26.434638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1321/2650] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:26 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:26.434758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-20b0fbcd-de4d-4c20-9a81-eef46aa5d535 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:26.434758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-20b0fbcd-de4d-4c20-9a81-eef46aa5d535 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:26.434758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20b0fbcd-de4d-4c20-9a81-eef46aa5d535 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:26.434758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20b0fbcd-de4d-4c20-9a81-eef46aa5d535 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:26.435148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20b0fbcd-de4d-4c20-9a81-eef46aa5d535 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:26.435148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20b0fbcd-de4d-4c20-9a81-eef46aa5d535 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:26.435148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20b0fbcd-de4d-4c20-9a81-eef46aa5d535 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:26.435148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20b0fbcd-de4d-4c20-9a81-eef46aa5d535 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:26.560713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9fc55fee-edc1-4414-a6b4-e025681625d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:26.561328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9fc55fee-edc1-4414-a6b4-e025681625d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:26.562018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-20b0fbcd-de4d-4c20-9a81-eef46aa5d535 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:26.567273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fc55fee-edc1-4414-a6b4-e025681625d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:26.567765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fc55fee-edc1-4414-a6b4-e025681625d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:26.568205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fc55fee-edc1-4414-a6b4-e025681625d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:26.568901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fc55fee-edc1-4414-a6b4-e025681625d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:26.569360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fc55fee-edc1-4414-a6b4-e025681625d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:26.569823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fc55fee-edc1-4414-a6b4-e025681625d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:26.570226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-20b0fbcd-de4d-4c20-9a81-eef46aa5d535 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148954 Aug 18 22:12:26.570893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1330/2651] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:26 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:26.700062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9fc55fee-edc1-4414-a6b4-e025681625d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:26.708248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9fc55fee-edc1-4414-a6b4-e025681625d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151383 Aug 18 22:12:26.708825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1322/2652] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:26 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:26.941782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ba939d6-d3d4-4752-bdf0-07f4552027ac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:26.942342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ba939d6-d3d4-4752-bdf0-07f4552027ac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:26.948684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ba939d6-d3d4-4752-bdf0-07f4552027ac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:26.949155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ba939d6-d3d4-4752-bdf0-07f4552027ac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:26.949587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ba939d6-d3d4-4752-bdf0-07f4552027ac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:26.950288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ba939d6-d3d4-4752-bdf0-07f4552027ac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:26.950738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ba939d6-d3d4-4752-bdf0-07f4552027ac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:26.951158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ba939d6-d3d4-4752-bdf0-07f4552027ac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:27.081082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3ba939d6-d3d4-4752-bdf0-07f4552027ac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:27.089871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ba939d6-d3d4-4752-bdf0-07f4552027ac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152006 Aug 18 22:12:27.090443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1331/2653] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:26 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:27.448209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bf11bcfc-0d43-4915-b8ff-b577ade83fb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:27.448813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bf11bcfc-0d43-4915-b8ff-b577ade83fb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:27.451348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1fcbdaa6-8877-4bcc-9009-332b42912396 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:27.451978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1fcbdaa6-8877-4bcc-9009-332b42912396 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:27.455443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf11bcfc-0d43-4915-b8ff-b577ade83fb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:27.455928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf11bcfc-0d43-4915-b8ff-b577ade83fb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:27.456367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf11bcfc-0d43-4915-b8ff-b577ade83fb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:27.457086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf11bcfc-0d43-4915-b8ff-b577ade83fb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:27.457531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf11bcfc-0d43-4915-b8ff-b577ade83fb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:27.457963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf11bcfc-0d43-4915-b8ff-b577ade83fb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:27.458717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fcbdaa6-8877-4bcc-9009-332b42912396 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:27.459206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fcbdaa6-8877-4bcc-9009-332b42912396 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:27.459650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fcbdaa6-8877-4bcc-9009-332b42912396 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:27.460450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fcbdaa6-8877-4bcc-9009-332b42912396 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:27.461796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fcbdaa6-8877-4bcc-9009-332b42912396 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:27.462250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fcbdaa6-8877-4bcc-9009-332b42912396 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:27.595031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bf11bcfc-0d43-4915-b8ff-b577ade83fb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:27.599567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1fcbdaa6-8877-4bcc-9009-332b42912396 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:27.604410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bf11bcfc-0d43-4915-b8ff-b577ade83fb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:27.606026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bf11bcfc-0d43-4915-b8ff-b577ade83fb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:27.607272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bf11bcfc-0d43-4915-b8ff-b577ade83fb6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.163624 Aug 18 22:12:27.607839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1323/2654] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:27 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:27.608027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1fcbdaa6-8877-4bcc-9009-332b42912396 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.160366 Aug 18 22:12:27.614492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1332/2655] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:27 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:27.614668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-330ec63a-229c-4421-8b38-5293fa2b891e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:27.614668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-330ec63a-229c-4421-8b38-5293fa2b891e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:27.619376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-330ec63a-229c-4421-8b38-5293fa2b891e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:27.619874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-330ec63a-229c-4421-8b38-5293fa2b891e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:27.620305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-330ec63a-229c-4421-8b38-5293fa2b891e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:27.621001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-330ec63a-229c-4421-8b38-5293fa2b891e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:27.621461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-330ec63a-229c-4421-8b38-5293fa2b891e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:27.621918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-330ec63a-229c-4421-8b38-5293fa2b891e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:27.729285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f417a3ad-a70e-4b15-8a67-d9aac3ea487a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:27.729925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f417a3ad-a70e-4b15-8a67-d9aac3ea487a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:27.736206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f417a3ad-a70e-4b15-8a67-d9aac3ea487a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:27.736695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f417a3ad-a70e-4b15-8a67-d9aac3ea487a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:27.737139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f417a3ad-a70e-4b15-8a67-d9aac3ea487a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:27.737963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f417a3ad-a70e-4b15-8a67-d9aac3ea487a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:27.738419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f417a3ad-a70e-4b15-8a67-d9aac3ea487a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:27.738847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f417a3ad-a70e-4b15-8a67-d9aac3ea487a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:27.758247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-330ec63a-229c-4421-8b38-5293fa2b891e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:27.766760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-330ec63a-229c-4421-8b38-5293fa2b891e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.157948 Aug 18 22:12:27.767342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1324/2656] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:27.865465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f417a3ad-a70e-4b15-8a67-d9aac3ea487a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:27.874473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f417a3ad-a70e-4b15-8a67-d9aac3ea487a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149564 Aug 18 22:12:27.875049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1333/2657] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:27 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:28.110925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3aef7eb2-4881-415d-8b02-3a092bf7a11c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:28.111537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3aef7eb2-4881-415d-8b02-3a092bf7a11c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:28.117918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3aef7eb2-4881-415d-8b02-3a092bf7a11c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:28.118410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3aef7eb2-4881-415d-8b02-3a092bf7a11c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:28.118851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3aef7eb2-4881-415d-8b02-3a092bf7a11c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:28.119545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3aef7eb2-4881-415d-8b02-3a092bf7a11c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:28.120000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3aef7eb2-4881-415d-8b02-3a092bf7a11c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:28.120432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3aef7eb2-4881-415d-8b02-3a092bf7a11c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:28.246344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3aef7eb2-4881-415d-8b02-3a092bf7a11c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:28.254556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3aef7eb2-4881-415d-8b02-3a092bf7a11c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147484 Aug 18 22:12:28.255133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1325/2658] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:28 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:28.639719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e759abdd-511f-4a53-b38a-e82d785f2e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:28.640455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e759abdd-511f-4a53-b38a-e82d785f2e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:28.641960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-28c73e3a-2d18-43bf-9c0d-f49d37efb16e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:28.642720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-28c73e3a-2d18-43bf-9c0d-f49d37efb16e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:28.647258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e759abdd-511f-4a53-b38a-e82d785f2e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:28.647786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e759abdd-511f-4a53-b38a-e82d785f2e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:28.648870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e759abdd-511f-4a53-b38a-e82d785f2e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:28.649617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e759abdd-511f-4a53-b38a-e82d785f2e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:28.649734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28c73e3a-2d18-43bf-9c0d-f49d37efb16e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:28.650077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e759abdd-511f-4a53-b38a-e82d785f2e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:28.650198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28c73e3a-2d18-43bf-9c0d-f49d37efb16e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:28.650506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e759abdd-511f-4a53-b38a-e82d785f2e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:28.650622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28c73e3a-2d18-43bf-9c0d-f49d37efb16e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:28.651271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28c73e3a-2d18-43bf-9c0d-f49d37efb16e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:28.651720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28c73e3a-2d18-43bf-9c0d-f49d37efb16e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:28.652144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28c73e3a-2d18-43bf-9c0d-f49d37efb16e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:28.784595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-28c73e3a-2d18-43bf-9c0d-f49d37efb16e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:28.784839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e759abdd-511f-4a53-b38a-e82d785f2e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:28.793055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e759abdd-511f-4a53-b38a-e82d785f2e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157205 Aug 18 22:12:28.793582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-28c73e3a-2d18-43bf-9c0d-f49d37efb16e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:28.793758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1334/2659] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:28 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:28.795143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-28c73e3a-2d18-43bf-9c0d-f49d37efb16e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:28.796330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-28c73e3a-2d18-43bf-9c0d-f49d37efb16e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.158575 Aug 18 22:12:28.797251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1326/2660] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:28.798186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9a9a089e-f33d-42ba-9efb-7663683775cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:28.798961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9a9a089e-f33d-42ba-9efb-7663683775cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:28.806217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a9a089e-f33d-42ba-9efb-7663683775cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:28.806703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a9a089e-f33d-42ba-9efb-7663683775cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:28.807144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a9a089e-f33d-42ba-9efb-7663683775cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:28.807841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a9a089e-f33d-42ba-9efb-7663683775cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:28.808299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a9a089e-f33d-42ba-9efb-7663683775cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:28.808728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a9a089e-f33d-42ba-9efb-7663683775cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:28.895682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8d1c3bd9-c2d5-49e2-9965-4a343a6566ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:28.896296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8d1c3bd9-c2d5-49e2-9965-4a343a6566ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:28.903008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d1c3bd9-c2d5-49e2-9965-4a343a6566ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:28.903492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d1c3bd9-c2d5-49e2-9965-4a343a6566ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:28.903926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d1c3bd9-c2d5-49e2-9965-4a343a6566ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:28.904621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d1c3bd9-c2d5-49e2-9965-4a343a6566ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:28.905073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d1c3bd9-c2d5-49e2-9965-4a343a6566ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:28.905495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d1c3bd9-c2d5-49e2-9965-4a343a6566ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:28.945077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9a9a089e-f33d-42ba-9efb-7663683775cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:28.953245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9a9a089e-f33d-42ba-9efb-7663683775cd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.158585 Aug 18 22:12:28.953861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1335/2661] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:29.036886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8d1c3bd9-c2d5-49e2-9965-4a343a6566ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:29.045727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8d1c3bd9-c2d5-49e2-9965-4a343a6566ce tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153814 Aug 18 22:12:29.046303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1327/2662] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:28 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:29.276986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f1a6c88-f0a1-45a8-8978-a22b16262aad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:29.277727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f1a6c88-f0a1-45a8-8978-a22b16262aad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:29.283731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1a6c88-f0a1-45a8-8978-a22b16262aad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:29.284215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1a6c88-f0a1-45a8-8978-a22b16262aad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:29.284698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1a6c88-f0a1-45a8-8978-a22b16262aad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:29.285337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1a6c88-f0a1-45a8-8978-a22b16262aad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:29.285823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1a6c88-f0a1-45a8-8978-a22b16262aad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:29.286249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1a6c88-f0a1-45a8-8978-a22b16262aad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:29.415246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4f1a6c88-f0a1-45a8-8978-a22b16262aad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:29.423522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f1a6c88-f0a1-45a8-8978-a22b16262aad tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151347 Aug 18 22:12:29.424101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1336/2663] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:29 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:29.815095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1d1805f3-7822-4293-bcda-c5416b6d9629 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:29.815819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1d1805f3-7822-4293-bcda-c5416b6d9629 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:29.821204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a6ac6890-23c7-452b-9321-28f3e2c7447d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:29.822119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a6ac6890-23c7-452b-9321-28f3e2c7447d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:29.822986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d1805f3-7822-4293-bcda-c5416b6d9629 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:29.823471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d1805f3-7822-4293-bcda-c5416b6d9629 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:29.823903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d1805f3-7822-4293-bcda-c5416b6d9629 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:29.824788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d1805f3-7822-4293-bcda-c5416b6d9629 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:29.825243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d1805f3-7822-4293-bcda-c5416b6d9629 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:29.825719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d1805f3-7822-4293-bcda-c5416b6d9629 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:29.829634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6ac6890-23c7-452b-9321-28f3e2c7447d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:29.830120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6ac6890-23c7-452b-9321-28f3e2c7447d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:29.830559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6ac6890-23c7-452b-9321-28f3e2c7447d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:29.831259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6ac6890-23c7-452b-9321-28f3e2c7447d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:29.831713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6ac6890-23c7-452b-9321-28f3e2c7447d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:29.832139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6ac6890-23c7-452b-9321-28f3e2c7447d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:29.836198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:29.958754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1d1805f3-7822-4293-bcda-c5416b6d9629 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:29.966162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a6ac6890-23c7-452b-9321-28f3e2c7447d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:29.967006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1d1805f3-7822-4293-bcda-c5416b6d9629 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155728 Aug 18 22:12:29.967589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1328/2664] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:29 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:29.974980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-119193b4-cddb-4229-a055-5285eac00298 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:29.975278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a6ac6890-23c7-452b-9321-28f3e2c7447d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:29.976320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-119193b4-cddb-4229-a055-5285eac00298 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:29.977279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a6ac6890-23c7-452b-9321-28f3e2c7447d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:29.978517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a6ac6890-23c7-452b-9321-28f3e2c7447d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.162032 Aug 18 22:12:29.979222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1337/2665] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:29.982887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-119193b4-cddb-4229-a055-5285eac00298 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:29.983445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-119193b4-cddb-4229-a055-5285eac00298 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:29.983966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-119193b4-cddb-4229-a055-5285eac00298 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:29.984730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-119193b4-cddb-4229-a055-5285eac00298 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:29.985265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-119193b4-cddb-4229-a055-5285eac00298 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:29.985793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-119193b4-cddb-4229-a055-5285eac00298 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:30.069105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d17bd43-7511-488a-aecc-a21f1a43b1b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:30.069789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7d17bd43-7511-488a-aecc-a21f1a43b1b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:30.075966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d17bd43-7511-488a-aecc-a21f1a43b1b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:30.076459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d17bd43-7511-488a-aecc-a21f1a43b1b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:30.076901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d17bd43-7511-488a-aecc-a21f1a43b1b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:30.077628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d17bd43-7511-488a-aecc-a21f1a43b1b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:30.078091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d17bd43-7511-488a-aecc-a21f1a43b1b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:30.078547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d17bd43-7511-488a-aecc-a21f1a43b1b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:30.116453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-119193b4-cddb-4229-a055-5285eac00298 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:30.125434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-119193b4-cddb-4229-a055-5285eac00298 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154036 Aug 18 22:12:30.126031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1329/2666] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:29 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:30.209953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7d17bd43-7511-488a-aecc-a21f1a43b1b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:30.218199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d17bd43-7511-488a-aecc-a21f1a43b1b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152907 Aug 18 22:12:30.218778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1338/2667] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:30 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:30.444843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4cae92f0-8743-4672-ab89-e068e1e7318f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:30.445381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4cae92f0-8743-4672-ab89-e068e1e7318f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:30.451301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4cae92f0-8743-4672-ab89-e068e1e7318f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:30.451787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4cae92f0-8743-4672-ab89-e068e1e7318f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:30.452220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4cae92f0-8743-4672-ab89-e068e1e7318f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:30.452901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4cae92f0-8743-4672-ab89-e068e1e7318f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:30.453350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4cae92f0-8743-4672-ab89-e068e1e7318f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:30.453881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4cae92f0-8743-4672-ab89-e068e1e7318f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:30.579733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4cae92f0-8743-4672-ab89-e068e1e7318f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:30.588861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4cae92f0-8743-4672-ab89-e068e1e7318f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147981 Aug 18 22:12:30.589440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1330/2668] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:30.988472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-06eb02c4-79ed-4576-b98b-fcb7317b05de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:30.989049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-06eb02c4-79ed-4576-b98b-fcb7317b05de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:30.995490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06eb02c4-79ed-4576-b98b-fcb7317b05de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:30.995973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06eb02c4-79ed-4576-b98b-fcb7317b05de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:30.996410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06eb02c4-79ed-4576-b98b-fcb7317b05de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:30.997100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06eb02c4-79ed-4576-b98b-fcb7317b05de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:30.997555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06eb02c4-79ed-4576-b98b-fcb7317b05de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:30.998008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06eb02c4-79ed-4576-b98b-fcb7317b05de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:31.001984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aea64dff-57d0-47b3-be93-a31c6392006a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:31.002604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-aea64dff-57d0-47b3-be93-a31c6392006a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:31.009524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aea64dff-57d0-47b3-be93-a31c6392006a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:31.010063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aea64dff-57d0-47b3-be93-a31c6392006a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:31.010506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aea64dff-57d0-47b3-be93-a31c6392006a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:31.011208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aea64dff-57d0-47b3-be93-a31c6392006a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:31.011668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aea64dff-57d0-47b3-be93-a31c6392006a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:31.012130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aea64dff-57d0-47b3-be93-a31c6392006a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:31.127923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-06eb02c4-79ed-4576-b98b-fcb7317b05de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:31.136853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-06eb02c4-79ed-4576-b98b-fcb7317b05de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152316 Aug 18 22:12:31.137436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1339/2669] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:30 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:31.146383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a65b913f-5ddb-429d-9c71-5b7bab27e566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:31.146571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aea64dff-57d0-47b3-be93-a31c6392006a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:31.147105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a65b913f-5ddb-429d-9c71-5b7bab27e566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:31.153719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a65b913f-5ddb-429d-9c71-5b7bab27e566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:31.154202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a65b913f-5ddb-429d-9c71-5b7bab27e566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:31.154628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a65b913f-5ddb-429d-9c71-5b7bab27e566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:31.155312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a65b913f-5ddb-429d-9c71-5b7bab27e566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:31.155758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a65b913f-5ddb-429d-9c71-5b7bab27e566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:31.156181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a65b913f-5ddb-429d-9c71-5b7bab27e566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:31.156803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aea64dff-57d0-47b3-be93-a31c6392006a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:31.158363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aea64dff-57d0-47b3-be93-a31c6392006a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:31.159616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aea64dff-57d0-47b3-be93-a31c6392006a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.161674 Aug 18 22:12:31.160474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1331/2670] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:31.240141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-16f00c44-7ef6-4827-85ed-0e631e065f86 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:31.240699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-16f00c44-7ef6-4827-85ed-0e631e065f86 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:31.246720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16f00c44-7ef6-4827-85ed-0e631e065f86 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:31.247206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16f00c44-7ef6-4827-85ed-0e631e065f86 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:31.247646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16f00c44-7ef6-4827-85ed-0e631e065f86 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:31.248338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16f00c44-7ef6-4827-85ed-0e631e065f86 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:31.248796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16f00c44-7ef6-4827-85ed-0e631e065f86 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:31.249220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16f00c44-7ef6-4827-85ed-0e631e065f86 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:31.284564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a65b913f-5ddb-429d-9c71-5b7bab27e566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:31.293539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a65b913f-5ddb-429d-9c71-5b7bab27e566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150835 Aug 18 22:12:31.294147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1340/2671] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:31 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:31.376133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-16f00c44-7ef6-4827-85ed-0e631e065f86 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:31.384234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-16f00c44-7ef6-4827-85ed-0e631e065f86 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148034 Aug 18 22:12:31.384804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1332/2672] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:31.610283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-89512e40-3b16-41da-a140-60b604ff2b20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:31.610894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-89512e40-3b16-41da-a140-60b604ff2b20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:31.617024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89512e40-3b16-41da-a140-60b604ff2b20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:31.617511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89512e40-3b16-41da-a140-60b604ff2b20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:31.617987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89512e40-3b16-41da-a140-60b604ff2b20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:31.618676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89512e40-3b16-41da-a140-60b604ff2b20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:31.619135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89512e40-3b16-41da-a140-60b604ff2b20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:31.619563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89512e40-3b16-41da-a140-60b604ff2b20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:31.753551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-89512e40-3b16-41da-a140-60b604ff2b20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:31.762521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-89512e40-3b16-41da-a140-60b604ff2b20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.156194 Aug 18 22:12:31.763085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1341/2673] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:31 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:32.158862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9337837b-4c43-4e71-b4ff-64d54d783592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:32.159510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9337837b-4c43-4e71-b4ff-64d54d783592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:32.166492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9337837b-4c43-4e71-b4ff-64d54d783592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:32.166980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9337837b-4c43-4e71-b4ff-64d54d783592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:32.167419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9337837b-4c43-4e71-b4ff-64d54d783592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:32.168110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9337837b-4c43-4e71-b4ff-64d54d783592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:32.168565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9337837b-4c43-4e71-b4ff-64d54d783592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:32.168989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9337837b-4c43-4e71-b4ff-64d54d783592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:32.183252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6fb9741c-1a77-4cca-8c96-c161747b815f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:32.183878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6fb9741c-1a77-4cca-8c96-c161747b815f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:32.190458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fb9741c-1a77-4cca-8c96-c161747b815f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:32.190949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fb9741c-1a77-4cca-8c96-c161747b815f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:32.191389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fb9741c-1a77-4cca-8c96-c161747b815f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:32.192091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fb9741c-1a77-4cca-8c96-c161747b815f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:32.192551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fb9741c-1a77-4cca-8c96-c161747b815f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:32.192979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fb9741c-1a77-4cca-8c96-c161747b815f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:32.299315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9337837b-4c43-4e71-b4ff-64d54d783592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:32.308400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9337837b-4c43-4e71-b4ff-64d54d783592 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153371 Aug 18 22:12:32.309070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1333/2674] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:32 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:32.313831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8a85fc5b-8f2a-4777-b7c6-ae641897b9fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:32.314441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8a85fc5b-8f2a-4777-b7c6-ae641897b9fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:32.320901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a85fc5b-8f2a-4777-b7c6-ae641897b9fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:32.321384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a85fc5b-8f2a-4777-b7c6-ae641897b9fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:32.321858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a85fc5b-8f2a-4777-b7c6-ae641897b9fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:32.322584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a85fc5b-8f2a-4777-b7c6-ae641897b9fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:32.323038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a85fc5b-8f2a-4777-b7c6-ae641897b9fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:32.323468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a85fc5b-8f2a-4777-b7c6-ae641897b9fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:32.325863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6fb9741c-1a77-4cca-8c96-c161747b815f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:32.335270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6fb9741c-1a77-4cca-8c96-c161747b815f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:32.336885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6fb9741c-1a77-4cca-8c96-c161747b815f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:32.338186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6fb9741c-1a77-4cca-8c96-c161747b815f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159410 Aug 18 22:12:32.339037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1342/2675] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:32.405282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1216bf61-d34a-4838-81c2-2034f9f84432 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:32.405932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1216bf61-d34a-4838-81c2-2034f9f84432 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:32.411968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1216bf61-d34a-4838-81c2-2034f9f84432 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:32.412401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1216bf61-d34a-4838-81c2-2034f9f84432 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:32.412843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1216bf61-d34a-4838-81c2-2034f9f84432 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:32.413658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1216bf61-d34a-4838-81c2-2034f9f84432 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:32.414138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1216bf61-d34a-4838-81c2-2034f9f84432 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:32.414567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1216bf61-d34a-4838-81c2-2034f9f84432 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:32.456650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8a85fc5b-8f2a-4777-b7c6-ae641897b9fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:32.465714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8a85fc5b-8f2a-4777-b7c6-ae641897b9fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155326 Aug 18 22:12:32.466298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1334/2676] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:32 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:32.547275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1216bf61-d34a-4838-81c2-2034f9f84432 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:32.556197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1216bf61-d34a-4838-81c2-2034f9f84432 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154746 Aug 18 22:12:32.556766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1343/2677] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:32 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:32.783744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ac9b325b-a84f-463e-9e61-768f9010e58e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:32.784371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ac9b325b-a84f-463e-9e61-768f9010e58e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:32.790302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac9b325b-a84f-463e-9e61-768f9010e58e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:32.790797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac9b325b-a84f-463e-9e61-768f9010e58e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:32.791242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac9b325b-a84f-463e-9e61-768f9010e58e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:32.791945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac9b325b-a84f-463e-9e61-768f9010e58e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:32.792407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac9b325b-a84f-463e-9e61-768f9010e58e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:32.792841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ac9b325b-a84f-463e-9e61-768f9010e58e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:32.919512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ac9b325b-a84f-463e-9e61-768f9010e58e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:32.921810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:32.929964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ac9b325b-a84f-463e-9e61-768f9010e58e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149358 Aug 18 22:12:32.930552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1335/2678] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:33.329565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2387ae3b-f7f6-4a07-b9be-913774eaba97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:33.330206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2387ae3b-f7f6-4a07-b9be-913774eaba97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:33.337428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2387ae3b-f7f6-4a07-b9be-913774eaba97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:33.337908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2387ae3b-f7f6-4a07-b9be-913774eaba97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:33.338356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2387ae3b-f7f6-4a07-b9be-913774eaba97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:33.339056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2387ae3b-f7f6-4a07-b9be-913774eaba97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:33.339516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2387ae3b-f7f6-4a07-b9be-913774eaba97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:33.339952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2387ae3b-f7f6-4a07-b9be-913774eaba97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:33.361773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-178a917c-2d41-4744-9cce-d37897fcc7c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:33.362391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-178a917c-2d41-4744-9cce-d37897fcc7c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:33.368710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-178a917c-2d41-4744-9cce-d37897fcc7c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:33.369190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-178a917c-2d41-4744-9cce-d37897fcc7c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:33.369654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-178a917c-2d41-4744-9cce-d37897fcc7c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:33.370351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-178a917c-2d41-4744-9cce-d37897fcc7c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:33.370800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-178a917c-2d41-4744-9cce-d37897fcc7c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:33.371222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-178a917c-2d41-4744-9cce-d37897fcc7c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:33.468861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2387ae3b-f7f6-4a07-b9be-913774eaba97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:33.478680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2387ae3b-f7f6-4a07-b9be-913774eaba97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153039 Aug 18 22:12:33.479277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1344/2679] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:33 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:33.488753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-25433936-a68a-470d-bd52-90d5c58f7bb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:33.489661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-25433936-a68a-470d-bd52-90d5c58f7bb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:33.496373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25433936-a68a-470d-bd52-90d5c58f7bb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:33.496855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25433936-a68a-470d-bd52-90d5c58f7bb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:33.497288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25433936-a68a-470d-bd52-90d5c58f7bb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:33.498012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25433936-a68a-470d-bd52-90d5c58f7bb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:33.498571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25433936-a68a-470d-bd52-90d5c58f7bb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:33.498968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25433936-a68a-470d-bd52-90d5c58f7bb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:33.504839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-178a917c-2d41-4744-9cce-d37897fcc7c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:33.514536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-178a917c-2d41-4744-9cce-d37897fcc7c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:33.516285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-178a917c-2d41-4744-9cce-d37897fcc7c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:33.517470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-178a917c-2d41-4744-9cce-d37897fcc7c0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159690 Aug 18 22:12:33.518075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1336/2680] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:33 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:33.578082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a22c56e0-a167-45a8-b17a-b7bf3275339d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:33.578631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a22c56e0-a167-45a8-b17a-b7bf3275339d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:33.584622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a22c56e0-a167-45a8-b17a-b7bf3275339d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:33.585157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a22c56e0-a167-45a8-b17a-b7bf3275339d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:33.585672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a22c56e0-a167-45a8-b17a-b7bf3275339d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:33.586333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a22c56e0-a167-45a8-b17a-b7bf3275339d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:33.586791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a22c56e0-a167-45a8-b17a-b7bf3275339d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:33.587218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a22c56e0-a167-45a8-b17a-b7bf3275339d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:33.627379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-25433936-a68a-470d-bd52-90d5c58f7bb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:33.636327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-25433936-a68a-470d-bd52-90d5c58f7bb5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151222 Aug 18 22:12:33.637002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1345/2681] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:33 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:33.720180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a22c56e0-a167-45a8-b17a-b7bf3275339d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:33.728392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a22c56e0-a167-45a8-b17a-b7bf3275339d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154295 Aug 18 22:12:33.728960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1337/2682] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:33.951041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-18c5a121-df7e-4a8d-9b0f-ad087411fc6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:33.951598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-18c5a121-df7e-4a8d-9b0f-ad087411fc6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:33.957810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18c5a121-df7e-4a8d-9b0f-ad087411fc6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:33.958285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18c5a121-df7e-4a8d-9b0f-ad087411fc6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:33.958715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18c5a121-df7e-4a8d-9b0f-ad087411fc6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:33.959393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18c5a121-df7e-4a8d-9b0f-ad087411fc6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:33.959839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18c5a121-df7e-4a8d-9b0f-ad087411fc6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:33.960902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18c5a121-df7e-4a8d-9b0f-ad087411fc6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:34.088857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-18c5a121-df7e-4a8d-9b0f-ad087411fc6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:34.097036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-18c5a121-df7e-4a8d-9b0f-ad087411fc6c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149888 Aug 18 22:12:34.097631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1346/2683] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:33 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:34.500223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bf337c71-69d4-4424-8eac-643ccfdaa17e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:34.500831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bf337c71-69d4-4424-8eac-643ccfdaa17e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:34.507544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf337c71-69d4-4424-8eac-643ccfdaa17e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:34.508031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf337c71-69d4-4424-8eac-643ccfdaa17e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:34.508475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf337c71-69d4-4424-8eac-643ccfdaa17e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:34.509183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf337c71-69d4-4424-8eac-643ccfdaa17e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:34.509659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf337c71-69d4-4424-8eac-643ccfdaa17e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:34.510095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf337c71-69d4-4424-8eac-643ccfdaa17e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:34.541139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f2e064b1-77c1-4e00-ac51-b835a2617170 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:34.542004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f2e064b1-77c1-4e00-ac51-b835a2617170 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:34.548726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2e064b1-77c1-4e00-ac51-b835a2617170 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:34.549295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2e064b1-77c1-4e00-ac51-b835a2617170 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:34.549832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2e064b1-77c1-4e00-ac51-b835a2617170 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:34.550855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2e064b1-77c1-4e00-ac51-b835a2617170 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:34.551537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2e064b1-77c1-4e00-ac51-b835a2617170 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:34.551998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2e064b1-77c1-4e00-ac51-b835a2617170 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:34.639642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bf337c71-69d4-4424-8eac-643ccfdaa17e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:34.648064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bf337c71-69d4-4424-8eac-643ccfdaa17e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151700 Aug 18 22:12:34.648642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1338/2684] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:34 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:34.662582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b3510108-198a-491c-aee8-181858a5e67f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:34.663744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b3510108-198a-491c-aee8-181858a5e67f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:34.669554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3510108-198a-491c-aee8-181858a5e67f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:34.670065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3510108-198a-491c-aee8-181858a5e67f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:34.670507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3510108-198a-491c-aee8-181858a5e67f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:34.671203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3510108-198a-491c-aee8-181858a5e67f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:34.671668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3510108-198a-491c-aee8-181858a5e67f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:34.672095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b3510108-198a-491c-aee8-181858a5e67f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:34.682086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f2e064b1-77c1-4e00-ac51-b835a2617170 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:34.690905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f2e064b1-77c1-4e00-ac51-b835a2617170 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:34.692412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f2e064b1-77c1-4e00-ac51-b835a2617170 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:34.693584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f2e064b1-77c1-4e00-ac51-b835a2617170 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156840 Aug 18 22:12:34.694177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1347/2685] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:34.748782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3b6ba846-8dfd-4f39-8511-0341ac1eba2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:34.749496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3b6ba846-8dfd-4f39-8511-0341ac1eba2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:34.755435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b6ba846-8dfd-4f39-8511-0341ac1eba2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:34.755918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b6ba846-8dfd-4f39-8511-0341ac1eba2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:34.756354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b6ba846-8dfd-4f39-8511-0341ac1eba2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:34.757099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b6ba846-8dfd-4f39-8511-0341ac1eba2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:34.757559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b6ba846-8dfd-4f39-8511-0341ac1eba2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:34.758012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b6ba846-8dfd-4f39-8511-0341ac1eba2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:34.806788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b3510108-198a-491c-aee8-181858a5e67f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:34.815708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b3510108-198a-491c-aee8-181858a5e67f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.162059 Aug 18 22:12:34.816290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1339/2686] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:34 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:34.888960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3b6ba846-8dfd-4f39-8511-0341ac1eba2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:34.898759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3b6ba846-8dfd-4f39-8511-0341ac1eba2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153672 Aug 18 22:12:34.899578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1348/2687] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:35.117901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-816f95bf-1052-409a-b108-ccf22e48ab26 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:35.118523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-816f95bf-1052-409a-b108-ccf22e48ab26 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:35.124463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-816f95bf-1052-409a-b108-ccf22e48ab26 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:35.124974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-816f95bf-1052-409a-b108-ccf22e48ab26 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:35.125422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-816f95bf-1052-409a-b108-ccf22e48ab26 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:35.126206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-816f95bf-1052-409a-b108-ccf22e48ab26 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:35.126673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-816f95bf-1052-409a-b108-ccf22e48ab26 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:35.127105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-816f95bf-1052-409a-b108-ccf22e48ab26 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:35.253852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-816f95bf-1052-409a-b108-ccf22e48ab26 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:35.262469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-816f95bf-1052-409a-b108-ccf22e48ab26 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148494 Aug 18 22:12:35.263044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1340/2688] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:35 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:35.668404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-acfe3519-4e43-4e84-a27c-6aa964040c60 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:35.669047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-acfe3519-4e43-4e84-a27c-6aa964040c60 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:35.676373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acfe3519-4e43-4e84-a27c-6aa964040c60 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:35.676853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acfe3519-4e43-4e84-a27c-6aa964040c60 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:35.677287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acfe3519-4e43-4e84-a27c-6aa964040c60 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:35.678010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acfe3519-4e43-4e84-a27c-6aa964040c60 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:35.678455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acfe3519-4e43-4e84-a27c-6aa964040c60 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:35.679379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acfe3519-4e43-4e84-a27c-6aa964040c60 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:35.716627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d3ce9ab8-25c9-4b2b-b531-a21e926128e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:35.717464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d3ce9ab8-25c9-4b2b-b531-a21e926128e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:35.724195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3ce9ab8-25c9-4b2b-b531-a21e926128e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:35.724692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3ce9ab8-25c9-4b2b-b531-a21e926128e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:35.725136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3ce9ab8-25c9-4b2b-b531-a21e926128e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:35.725915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3ce9ab8-25c9-4b2b-b531-a21e926128e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:35.726418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3ce9ab8-25c9-4b2b-b531-a21e926128e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:35.726852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3ce9ab8-25c9-4b2b-b531-a21e926128e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:35.809877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-acfe3519-4e43-4e84-a27c-6aa964040c60 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:35.818196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-acfe3519-4e43-4e84-a27c-6aa964040c60 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153639 Aug 18 22:12:35.818774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1349/2689] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:35 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:35.838730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b55493a8-ea11-4de5-bf8f-2455d9868a8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:35.839475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b55493a8-ea11-4de5-bf8f-2455d9868a8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:35.845799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b55493a8-ea11-4de5-bf8f-2455d9868a8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:35.846411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b55493a8-ea11-4de5-bf8f-2455d9868a8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:35.846906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b55493a8-ea11-4de5-bf8f-2455d9868a8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:35.847689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b55493a8-ea11-4de5-bf8f-2455d9868a8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:35.848153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b55493a8-ea11-4de5-bf8f-2455d9868a8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:35.848613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b55493a8-ea11-4de5-bf8f-2455d9868a8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:36.000556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b55493a8-ea11-4de5-bf8f-2455d9868a8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:36.010183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b55493a8-ea11-4de5-bf8f-2455d9868a8f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.175828 Aug 18 22:12:36.010775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1350/2690] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:36.015819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a1c3c73-5d8b-45cb-8360-6b8f0fbcaec6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:36.016488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0a1c3c73-5d8b-45cb-8360-6b8f0fbcaec6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:36.023812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a1c3c73-5d8b-45cb-8360-6b8f0fbcaec6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:36.024301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a1c3c73-5d8b-45cb-8360-6b8f0fbcaec6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:36.024741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a1c3c73-5d8b-45cb-8360-6b8f0fbcaec6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:36.025449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a1c3c73-5d8b-45cb-8360-6b8f0fbcaec6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:36.025931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a1c3c73-5d8b-45cb-8360-6b8f0fbcaec6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:36.026355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a1c3c73-5d8b-45cb-8360-6b8f0fbcaec6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:36.103704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d3ce9ab8-25c9-4b2b-b531-a21e926128e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:36.112561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d3ce9ab8-25c9-4b2b-b531-a21e926128e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:36.114096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d3ce9ab8-25c9-4b2b-b531-a21e926128e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:36.115269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d3ce9ab8-25c9-4b2b-b531-a21e926128e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.402632 Aug 18 22:12:36.115841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1341/2691] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:36.157389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0a1c3c73-5d8b-45cb-8360-6b8f0fbcaec6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:36.165712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a1c3c73-5d8b-45cb-8360-6b8f0fbcaec6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153898 Aug 18 22:12:36.166288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1351/2692] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:36 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:36.284446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7ae9722d-513b-4f28-bc84-66f12dac1d2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:36.285063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7ae9722d-513b-4f28-bc84-66f12dac1d2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:36.291025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ae9722d-513b-4f28-bc84-66f12dac1d2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:36.291505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ae9722d-513b-4f28-bc84-66f12dac1d2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:36.291946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ae9722d-513b-4f28-bc84-66f12dac1d2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:36.292632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ae9722d-513b-4f28-bc84-66f12dac1d2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:36.293081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ae9722d-513b-4f28-bc84-66f12dac1d2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:36.293509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ae9722d-513b-4f28-bc84-66f12dac1d2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:36.415933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7ae9722d-513b-4f28-bc84-66f12dac1d2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:36.424117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7ae9722d-513b-4f28-bc84-66f12dac1d2f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.143777 Aug 18 22:12:36.424700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1342/2693] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:36 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:36.839879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e0ff2c5e-e198-4af6-80b8-9740be3fc69d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:36.840488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e0ff2c5e-e198-4af6-80b8-9740be3fc69d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:36.846969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0ff2c5e-e198-4af6-80b8-9740be3fc69d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:36.847448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0ff2c5e-e198-4af6-80b8-9740be3fc69d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:36.847879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0ff2c5e-e198-4af6-80b8-9740be3fc69d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:36.848559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0ff2c5e-e198-4af6-80b8-9740be3fc69d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:36.849007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0ff2c5e-e198-4af6-80b8-9740be3fc69d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:36.849429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0ff2c5e-e198-4af6-80b8-9740be3fc69d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:36.976816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e0ff2c5e-e198-4af6-80b8-9740be3fc69d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:36.985053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e0ff2c5e-e198-4af6-80b8-9740be3fc69d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148914 Aug 18 22:12:36.985410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1352/2694] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:36 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:37.032205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-caffc623-00c8-451b-88e1-f6d70b46dbdd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:37.032704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-caffc623-00c8-451b-88e1-f6d70b46dbdd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:37.039850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caffc623-00c8-451b-88e1-f6d70b46dbdd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:37.040411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caffc623-00c8-451b-88e1-f6d70b46dbdd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:37.040937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caffc623-00c8-451b-88e1-f6d70b46dbdd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:37.041730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caffc623-00c8-451b-88e1-f6d70b46dbdd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:37.042188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caffc623-00c8-451b-88e1-f6d70b46dbdd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:37.042616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caffc623-00c8-451b-88e1-f6d70b46dbdd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:37.138113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-89b0c955-40aa-487a-a992-48027bbcdb17 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:37.138722 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-89b0c955-40aa-487a-a992-48027bbcdb17 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:37.144850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89b0c955-40aa-487a-a992-48027bbcdb17 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:37.145346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89b0c955-40aa-487a-a992-48027bbcdb17 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:37.145816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89b0c955-40aa-487a-a992-48027bbcdb17 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:37.146515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89b0c955-40aa-487a-a992-48027bbcdb17 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:37.146971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89b0c955-40aa-487a-a992-48027bbcdb17 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:37.148530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89b0c955-40aa-487a-a992-48027bbcdb17 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:37.174029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-caffc623-00c8-451b-88e1-f6d70b46dbdd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:37.182883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-caffc623-00c8-451b-88e1-f6d70b46dbdd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154697 Aug 18 22:12:37.183465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1343/2695] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:37 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:37.187858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c77f6978-7602-4ec9-bd4d-97a7725c893f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:37.188458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c77f6978-7602-4ec9-bd4d-97a7725c893f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:37.194391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c77f6978-7602-4ec9-bd4d-97a7725c893f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:37.195159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c77f6978-7602-4ec9-bd4d-97a7725c893f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:37.195713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c77f6978-7602-4ec9-bd4d-97a7725c893f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:37.196670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c77f6978-7602-4ec9-bd4d-97a7725c893f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:37.197137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c77f6978-7602-4ec9-bd4d-97a7725c893f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:37.197570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c77f6978-7602-4ec9-bd4d-97a7725c893f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:37.280149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-89b0c955-40aa-487a-a992-48027bbcdb17 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:37.282367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:37.291094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-89b0c955-40aa-487a-a992-48027bbcdb17 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:37.292672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-89b0c955-40aa-487a-a992-48027bbcdb17 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:37.293898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-89b0c955-40aa-487a-a992-48027bbcdb17 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159615 Aug 18 22:12:37.294680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1353/2696] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:37.324401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c77f6978-7602-4ec9-bd4d-97a7725c893f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:37.332417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c77f6978-7602-4ec9-bd4d-97a7725c893f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148030 Aug 18 22:12:37.332984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1344/2697] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:37 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:37.446642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1a93cfd0-9d92-4bff-ac96-2b02098c7869 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:37.447260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1a93cfd0-9d92-4bff-ac96-2b02098c7869 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:37.453164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a93cfd0-9d92-4bff-ac96-2b02098c7869 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:37.453671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a93cfd0-9d92-4bff-ac96-2b02098c7869 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:37.454121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a93cfd0-9d92-4bff-ac96-2b02098c7869 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:37.454807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a93cfd0-9d92-4bff-ac96-2b02098c7869 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:37.455261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a93cfd0-9d92-4bff-ac96-2b02098c7869 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:37.455685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a93cfd0-9d92-4bff-ac96-2b02098c7869 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:37.582654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1a93cfd0-9d92-4bff-ac96-2b02098c7869 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:37.591447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1a93cfd0-9d92-4bff-ac96-2b02098c7869 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149099 Aug 18 22:12:37.592012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1354/2698] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:37 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:38.008479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5069600e-a218-4ed8-9da5-76fb86990a4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:38.009007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5069600e-a218-4ed8-9da5-76fb86990a4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:38.015080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5069600e-a218-4ed8-9da5-76fb86990a4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:38.015567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5069600e-a218-4ed8-9da5-76fb86990a4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:38.016009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5069600e-a218-4ed8-9da5-76fb86990a4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:38.016700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5069600e-a218-4ed8-9da5-76fb86990a4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:38.017157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5069600e-a218-4ed8-9da5-76fb86990a4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:38.017591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5069600e-a218-4ed8-9da5-76fb86990a4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:38.146109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5069600e-a218-4ed8-9da5-76fb86990a4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:38.154259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5069600e-a218-4ed8-9da5-76fb86990a4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151450 Aug 18 22:12:38.154825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1345/2699] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:38 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:38.203975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fd89fe64-e9b5-4488-bc98-e47780d93252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:38.204606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fd89fe64-e9b5-4488-bc98-e47780d93252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:38.211026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd89fe64-e9b5-4488-bc98-e47780d93252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:38.211506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd89fe64-e9b5-4488-bc98-e47780d93252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:38.211953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd89fe64-e9b5-4488-bc98-e47780d93252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:38.212620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd89fe64-e9b5-4488-bc98-e47780d93252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:38.213068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd89fe64-e9b5-4488-bc98-e47780d93252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:38.213486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd89fe64-e9b5-4488-bc98-e47780d93252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:38.316418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c5f73097-03b5-4d29-ae94-81a94e3eb9d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:38.317040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c5f73097-03b5-4d29-ae94-81a94e3eb9d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:38.323824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5f73097-03b5-4d29-ae94-81a94e3eb9d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:38.324316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5f73097-03b5-4d29-ae94-81a94e3eb9d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:38.324783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5f73097-03b5-4d29-ae94-81a94e3eb9d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:38.325487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5f73097-03b5-4d29-ae94-81a94e3eb9d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:38.325970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5f73097-03b5-4d29-ae94-81a94e3eb9d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:38.326400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5f73097-03b5-4d29-ae94-81a94e3eb9d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:38.345880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fd89fe64-e9b5-4488-bc98-e47780d93252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:38.354140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fd89fe64-e9b5-4488-bc98-e47780d93252 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153961 Aug 18 22:12:38.354720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1355/2700] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:38 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:38.360695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-41833bf9-0b36-49ab-8a0d-aff0b299f481 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:38.361303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-41833bf9-0b36-49ab-8a0d-aff0b299f481 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:38.367356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41833bf9-0b36-49ab-8a0d-aff0b299f481 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:38.367845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41833bf9-0b36-49ab-8a0d-aff0b299f481 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:38.368290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41833bf9-0b36-49ab-8a0d-aff0b299f481 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:38.368999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41833bf9-0b36-49ab-8a0d-aff0b299f481 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:38.369458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41833bf9-0b36-49ab-8a0d-aff0b299f481 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:38.369914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-41833bf9-0b36-49ab-8a0d-aff0b299f481 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:38.457836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c5f73097-03b5-4d29-ae94-81a94e3eb9d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:38.467315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c5f73097-03b5-4d29-ae94-81a94e3eb9d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:38.468857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c5f73097-03b5-4d29-ae94-81a94e3eb9d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:38.470100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c5f73097-03b5-4d29-ae94-81a94e3eb9d6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157649 Aug 18 22:12:38.470669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1346/2701] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:38 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:38.499764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-41833bf9-0b36-49ab-8a0d-aff0b299f481 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:38.507910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-41833bf9-0b36-49ab-8a0d-aff0b299f481 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152253 Aug 18 22:12:38.508498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1356/2702] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:38 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:38.612218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9d74a722-a942-48f0-a298-59ab1b90eb12 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:38.612763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9d74a722-a942-48f0-a298-59ab1b90eb12 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:38.614607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:38.620088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d74a722-a942-48f0-a298-59ab1b90eb12 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:38.620573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d74a722-a942-48f0-a298-59ab1b90eb12 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:38.621014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d74a722-a942-48f0-a298-59ab1b90eb12 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:38.621740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d74a722-a942-48f0-a298-59ab1b90eb12 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:38.622197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d74a722-a942-48f0-a298-59ab1b90eb12 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:38.622623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d74a722-a942-48f0-a298-59ab1b90eb12 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:38.748732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9d74a722-a942-48f0-a298-59ab1b90eb12 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:38.757626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9d74a722-a942-48f0-a298-59ab1b90eb12 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148712 Aug 18 22:12:38.758194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1347/2703] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:38 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:39.176657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-196ad003-d798-47d1-960a-5612410d6e25 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:39.177266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-196ad003-d798-47d1-960a-5612410d6e25 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:39.183794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-196ad003-d798-47d1-960a-5612410d6e25 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:39.184270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-196ad003-d798-47d1-960a-5612410d6e25 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:39.184699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-196ad003-d798-47d1-960a-5612410d6e25 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:39.185377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-196ad003-d798-47d1-960a-5612410d6e25 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:39.185861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-196ad003-d798-47d1-960a-5612410d6e25 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:39.186398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-196ad003-d798-47d1-960a-5612410d6e25 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:39.314295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-196ad003-d798-47d1-960a-5612410d6e25 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:39.322640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-196ad003-d798-47d1-960a-5612410d6e25 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150632 Aug 18 22:12:39.323243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1357/2704] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:39 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:39.376302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5ecc0335-575b-4753-8f63-07ca26fb7376 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:39.376848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5ecc0335-575b-4753-8f63-07ca26fb7376 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:39.383478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ecc0335-575b-4753-8f63-07ca26fb7376 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:39.383974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ecc0335-575b-4753-8f63-07ca26fb7376 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:39.384418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ecc0335-575b-4753-8f63-07ca26fb7376 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:39.385148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ecc0335-575b-4753-8f63-07ca26fb7376 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:39.385635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ecc0335-575b-4753-8f63-07ca26fb7376 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:39.386073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ecc0335-575b-4753-8f63-07ca26fb7376 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:39.493260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a7fe4f3a-8f5e-4471-b359-4777311b08c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:39.494085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a7fe4f3a-8f5e-4471-b359-4777311b08c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:39.500032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a7fe4f3a-8f5e-4471-b359-4777311b08c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:39.500581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a7fe4f3a-8f5e-4471-b359-4777311b08c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:39.501078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a7fe4f3a-8f5e-4471-b359-4777311b08c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:39.501862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a7fe4f3a-8f5e-4471-b359-4777311b08c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:39.502402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a7fe4f3a-8f5e-4471-b359-4777311b08c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:39.502828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a7fe4f3a-8f5e-4471-b359-4777311b08c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:39.517145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5ecc0335-575b-4753-8f63-07ca26fb7376 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:39.526120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5ecc0335-575b-4753-8f63-07ca26fb7376 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153659 Aug 18 22:12:39.526805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1348/2705] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:39.531384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9633c134-29ab-41d0-a847-298b7952fc16 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:39.532082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9633c134-29ab-41d0-a847-298b7952fc16 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:39.540621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9633c134-29ab-41d0-a847-298b7952fc16 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:39.541193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9633c134-29ab-41d0-a847-298b7952fc16 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:39.541667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9633c134-29ab-41d0-a847-298b7952fc16 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:39.542374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9633c134-29ab-41d0-a847-298b7952fc16 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:39.542832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9633c134-29ab-41d0-a847-298b7952fc16 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:39.543260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9633c134-29ab-41d0-a847-298b7952fc16 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:39.634970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a7fe4f3a-8f5e-4471-b359-4777311b08c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:39.643723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a7fe4f3a-8f5e-4471-b359-4777311b08c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:39.645215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a7fe4f3a-8f5e-4471-b359-4777311b08c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:39.646403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a7fe4f3a-8f5e-4471-b359-4777311b08c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157040 Aug 18 22:12:39.646963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1358/2706] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:39.672147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9633c134-29ab-41d0-a847-298b7952fc16 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:39.680554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9633c134-29ab-41d0-a847-298b7952fc16 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152722 Aug 18 22:12:39.681121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1349/2707] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:39 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:39.778958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fa483fd0-eff0-4f52-8fe0-9fc69940e776 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:39.779570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fa483fd0-eff0-4f52-8fe0-9fc69940e776 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:39.785396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa483fd0-eff0-4f52-8fe0-9fc69940e776 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:39.785902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa483fd0-eff0-4f52-8fe0-9fc69940e776 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:39.786334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa483fd0-eff0-4f52-8fe0-9fc69940e776 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:39.787010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa483fd0-eff0-4f52-8fe0-9fc69940e776 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:39.787457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa483fd0-eff0-4f52-8fe0-9fc69940e776 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:39.787882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa483fd0-eff0-4f52-8fe0-9fc69940e776 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:39.914323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fa483fd0-eff0-4f52-8fe0-9fc69940e776 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:39.922587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fa483fd0-eff0-4f52-8fe0-9fc69940e776 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147422 Aug 18 22:12:39.923156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1359/2708] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:39 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:40.344362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d0c2dcc3-ee8e-47b5-9e1e-a5245d2d7c78 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:40.344995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d0c2dcc3-ee8e-47b5-9e1e-a5245d2d7c78 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:40.351251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0c2dcc3-ee8e-47b5-9e1e-a5245d2d7c78 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:40.351745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0c2dcc3-ee8e-47b5-9e1e-a5245d2d7c78 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:40.352190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0c2dcc3-ee8e-47b5-9e1e-a5245d2d7c78 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:40.352891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0c2dcc3-ee8e-47b5-9e1e-a5245d2d7c78 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:40.353354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0c2dcc3-ee8e-47b5-9e1e-a5245d2d7c78 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:40.353819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0c2dcc3-ee8e-47b5-9e1e-a5245d2d7c78 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:40.484553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d0c2dcc3-ee8e-47b5-9e1e-a5245d2d7c78 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:40.493349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d0c2dcc3-ee8e-47b5-9e1e-a5245d2d7c78 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153069 Aug 18 22:12:40.493952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1350/2709] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:40 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:40.547657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-939d1fa5-81c0-4b67-aca0-2b73ab24b329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:40.548265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-939d1fa5-81c0-4b67-aca0-2b73ab24b329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:40.555504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-939d1fa5-81c0-4b67-aca0-2b73ab24b329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:40.555980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-939d1fa5-81c0-4b67-aca0-2b73ab24b329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:40.556420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-939d1fa5-81c0-4b67-aca0-2b73ab24b329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:40.557103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-939d1fa5-81c0-4b67-aca0-2b73ab24b329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:40.557551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-939d1fa5-81c0-4b67-aca0-2b73ab24b329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:40.557996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-939d1fa5-81c0-4b67-aca0-2b73ab24b329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:40.670197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f8692125-d33b-4d9e-b382-43e8d0541f91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:40.670972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f8692125-d33b-4d9e-b382-43e8d0541f91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:40.677125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8692125-d33b-4d9e-b382-43e8d0541f91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:40.677633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8692125-d33b-4d9e-b382-43e8d0541f91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:40.678079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8692125-d33b-4d9e-b382-43e8d0541f91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:40.679419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8692125-d33b-4d9e-b382-43e8d0541f91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:40.679881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8692125-d33b-4d9e-b382-43e8d0541f91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:40.680310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8692125-d33b-4d9e-b382-43e8d0541f91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:40.689821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-939d1fa5-81c0-4b67-aca0-2b73ab24b329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:40.698392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-939d1fa5-81c0-4b67-aca0-2b73ab24b329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154454 Aug 18 22:12:40.698979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1360/2710] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:40 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:40.704301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ea75f965-f63f-4d58-be71-d8f8bbee5f06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:40.704926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ea75f965-f63f-4d58-be71-d8f8bbee5f06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:40.710985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea75f965-f63f-4d58-be71-d8f8bbee5f06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:40.711473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea75f965-f63f-4d58-be71-d8f8bbee5f06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:40.711914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea75f965-f63f-4d58-be71-d8f8bbee5f06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:40.712614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea75f965-f63f-4d58-be71-d8f8bbee5f06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:40.713076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea75f965-f63f-4d58-be71-d8f8bbee5f06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:40.713507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea75f965-f63f-4d58-be71-d8f8bbee5f06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:40.815590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8692125-d33b-4d9e-b382-43e8d0541f91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:40.824638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8692125-d33b-4d9e-b382-43e8d0541f91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:40.826178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8692125-d33b-4d9e-b382-43e8d0541f91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:40.827340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f8692125-d33b-4d9e-b382-43e8d0541f91 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.161046 Aug 18 22:12:40.827941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1351/2711] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:40.845116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ea75f965-f63f-4d58-be71-d8f8bbee5f06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:40.854355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea75f965-f63f-4d58-be71-d8f8bbee5f06 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153773 Aug 18 22:12:40.854935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1361/2712] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:40.944046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c331c7d5-9097-4a9e-93fc-f7b90f5a19da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:40.945335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c331c7d5-9097-4a9e-93fc-f7b90f5a19da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:40.951431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c331c7d5-9097-4a9e-93fc-f7b90f5a19da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:40.951917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c331c7d5-9097-4a9e-93fc-f7b90f5a19da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:40.952365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c331c7d5-9097-4a9e-93fc-f7b90f5a19da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:40.953046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c331c7d5-9097-4a9e-93fc-f7b90f5a19da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:40.953510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c331c7d5-9097-4a9e-93fc-f7b90f5a19da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:40.953962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c331c7d5-9097-4a9e-93fc-f7b90f5a19da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:40.968586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:41.079845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c331c7d5-9097-4a9e-93fc-f7b90f5a19da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:41.088001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c331c7d5-9097-4a9e-93fc-f7b90f5a19da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148015 Aug 18 22:12:41.089148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1352/2713] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:40 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:41.514282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-11692063-4c89-4020-a8b0-d3dfda0f1be9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:41.514847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-11692063-4c89-4020-a8b0-d3dfda0f1be9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:41.523651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11692063-4c89-4020-a8b0-d3dfda0f1be9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:41.524287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11692063-4c89-4020-a8b0-d3dfda0f1be9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:41.524712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11692063-4c89-4020-a8b0-d3dfda0f1be9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:41.525402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11692063-4c89-4020-a8b0-d3dfda0f1be9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:41.525890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11692063-4c89-4020-a8b0-d3dfda0f1be9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:41.526314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11692063-4c89-4020-a8b0-d3dfda0f1be9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:41.655026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-11692063-4c89-4020-a8b0-d3dfda0f1be9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:41.663929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-11692063-4c89-4020-a8b0-d3dfda0f1be9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152869 Aug 18 22:12:41.664500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1362/2714] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:41 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:41.720440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c15e6bb4-5752-4a4d-8bd0-c98acc4af278 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:41.721081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c15e6bb4-5752-4a4d-8bd0-c98acc4af278 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:41.728205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c15e6bb4-5752-4a4d-8bd0-c98acc4af278 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:41.728682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c15e6bb4-5752-4a4d-8bd0-c98acc4af278 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:41.729113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c15e6bb4-5752-4a4d-8bd0-c98acc4af278 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:41.729843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c15e6bb4-5752-4a4d-8bd0-c98acc4af278 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:41.730293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c15e6bb4-5752-4a4d-8bd0-c98acc4af278 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:41.730721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c15e6bb4-5752-4a4d-8bd0-c98acc4af278 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:41.852881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-451a0edf-e972-4c32-9a6a-3b3af4ad420a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:41.853481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-451a0edf-e972-4c32-9a6a-3b3af4ad420a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:41.859389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-451a0edf-e972-4c32-9a6a-3b3af4ad420a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:41.861439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-451a0edf-e972-4c32-9a6a-3b3af4ad420a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:41.861439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-451a0edf-e972-4c32-9a6a-3b3af4ad420a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:41.861733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c15e6bb4-5752-4a4d-8bd0-c98acc4af278 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:41.861878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-451a0edf-e972-4c32-9a6a-3b3af4ad420a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:41.861878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-451a0edf-e972-4c32-9a6a-3b3af4ad420a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:41.862088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-451a0edf-e972-4c32-9a6a-3b3af4ad420a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:41.869702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c15e6bb4-5752-4a4d-8bd0-c98acc4af278 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153167 Aug 18 22:12:41.870535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1353/2715] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:41 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:41.877783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c412e576-ad64-48b6-bc14-487521e204f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:41.878057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c412e576-ad64-48b6-bc14-487521e204f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:41.884036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c412e576-ad64-48b6-bc14-487521e204f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:41.884526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c412e576-ad64-48b6-bc14-487521e204f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:41.884965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c412e576-ad64-48b6-bc14-487521e204f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:41.885681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c412e576-ad64-48b6-bc14-487521e204f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:41.886141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c412e576-ad64-48b6-bc14-487521e204f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:41.886570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c412e576-ad64-48b6-bc14-487521e204f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:41.993505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-451a0edf-e972-4c32-9a6a-3b3af4ad420a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:42.002335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-451a0edf-e972-4c32-9a6a-3b3af4ad420a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:42.003839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-451a0edf-e972-4c32-9a6a-3b3af4ad420a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:42.005038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-451a0edf-e972-4c32-9a6a-3b3af4ad420a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156663 Aug 18 22:12:42.005641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1363/2716] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:42.015129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c412e576-ad64-48b6-bc14-487521e204f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:42.023990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c412e576-ad64-48b6-bc14-487521e204f9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150462 Aug 18 22:12:42.024549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1354/2717] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:42.108929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-971c8e75-51fe-4daa-8de4-241bdaa38366 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:42.109500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-971c8e75-51fe-4daa-8de4-241bdaa38366 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:42.111410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:42.116801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-971c8e75-51fe-4daa-8de4-241bdaa38366 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:42.117286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-971c8e75-51fe-4daa-8de4-241bdaa38366 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:42.117785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-971c8e75-51fe-4daa-8de4-241bdaa38366 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:42.118479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-971c8e75-51fe-4daa-8de4-241bdaa38366 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:42.118937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-971c8e75-51fe-4daa-8de4-241bdaa38366 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:42.119397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-971c8e75-51fe-4daa-8de4-241bdaa38366 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:42.244846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-971c8e75-51fe-4daa-8de4-241bdaa38366 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:42.252980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-971c8e75-51fe-4daa-8de4-241bdaa38366 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148044 Aug 18 22:12:42.253545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1364/2718] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:42 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:42.684923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-200d19aa-8498-42ae-8b91-0386281b3687 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:42.685535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-200d19aa-8498-42ae-8b91-0386281b3687 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:42.691678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-200d19aa-8498-42ae-8b91-0386281b3687 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:42.692157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-200d19aa-8498-42ae-8b91-0386281b3687 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:42.692588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-200d19aa-8498-42ae-8b91-0386281b3687 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:42.693276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-200d19aa-8498-42ae-8b91-0386281b3687 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:42.693749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-200d19aa-8498-42ae-8b91-0386281b3687 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:42.694178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-200d19aa-8498-42ae-8b91-0386281b3687 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:42.823790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-200d19aa-8498-42ae-8b91-0386281b3687 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:42.831994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-200d19aa-8498-42ae-8b91-0386281b3687 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150916 Aug 18 22:12:42.832565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1355/2719] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:42 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:42.890598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ce1dea35-9a55-4580-ae6c-e7e4bf168c99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:42.891236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ce1dea35-9a55-4580-ae6c-e7e4bf168c99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:42.897648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce1dea35-9a55-4580-ae6c-e7e4bf168c99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:42.898129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce1dea35-9a55-4580-ae6c-e7e4bf168c99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:42.898559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce1dea35-9a55-4580-ae6c-e7e4bf168c99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:42.899237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce1dea35-9a55-4580-ae6c-e7e4bf168c99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:42.899684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce1dea35-9a55-4580-ae6c-e7e4bf168c99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:42.900102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce1dea35-9a55-4580-ae6c-e7e4bf168c99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:43.029022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e8472e13-7780-4c55-8fc5-22132b94eadc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:43.029617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ce1dea35-9a55-4580-ae6c-e7e4bf168c99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:43.029760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e8472e13-7780-4c55-8fc5-22132b94eadc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:43.035792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8472e13-7780-4c55-8fc5-22132b94eadc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:43.036285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8472e13-7780-4c55-8fc5-22132b94eadc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:43.036728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8472e13-7780-4c55-8fc5-22132b94eadc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:43.037569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8472e13-7780-4c55-8fc5-22132b94eadc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:43.037702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ce1dea35-9a55-4580-ae6c-e7e4bf168c99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150826 Aug 18 22:12:43.038110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8472e13-7780-4c55-8fc5-22132b94eadc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:43.039095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1365/2720] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:43.039779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e8472e13-7780-4c55-8fc5-22132b94eadc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:43.046361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c4b8d751-538c-4fe1-b5b3-dc1d5b81fa09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:43.046995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c4b8d751-538c-4fe1-b5b3-dc1d5b81fa09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:43.053291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4b8d751-538c-4fe1-b5b3-dc1d5b81fa09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:43.053831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4b8d751-538c-4fe1-b5b3-dc1d5b81fa09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:43.054276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4b8d751-538c-4fe1-b5b3-dc1d5b81fa09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:43.054974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4b8d751-538c-4fe1-b5b3-dc1d5b81fa09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:43.055428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4b8d751-538c-4fe1-b5b3-dc1d5b81fa09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:43.055889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4b8d751-538c-4fe1-b5b3-dc1d5b81fa09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:43.169664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e8472e13-7780-4c55-8fc5-22132b94eadc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:43.178567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e8472e13-7780-4c55-8fc5-22132b94eadc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:43.180109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e8472e13-7780-4c55-8fc5-22132b94eadc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:43.181283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e8472e13-7780-4c55-8fc5-22132b94eadc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156381 Aug 18 22:12:43.181877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1356/2721] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:43.185252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c4b8d751-538c-4fe1-b5b3-dc1d5b81fa09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:43.193452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c4b8d751-538c-4fe1-b5b3-dc1d5b81fa09 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150753 Aug 18 22:12:43.194056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1366/2722] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:43 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:43.274873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6306636f-ae2c-4542-806d-d368c7a8636c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:43.275490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6306636f-ae2c-4542-806d-d368c7a8636c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:43.281330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6306636f-ae2c-4542-806d-d368c7a8636c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:43.281840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6306636f-ae2c-4542-806d-d368c7a8636c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:43.282273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6306636f-ae2c-4542-806d-d368c7a8636c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:43.282952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6306636f-ae2c-4542-806d-d368c7a8636c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:43.283401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6306636f-ae2c-4542-806d-d368c7a8636c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:43.283822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6306636f-ae2c-4542-806d-d368c7a8636c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:43.411515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6306636f-ae2c-4542-806d-d368c7a8636c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:43.420293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6306636f-ae2c-4542-806d-d368c7a8636c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149771 Aug 18 22:12:43.420872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1357/2723] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:43 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:43.852935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-151a1a92-edf8-4768-b21a-2533105fb425 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:43.853562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-151a1a92-edf8-4768-b21a-2533105fb425 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:43.859651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-151a1a92-edf8-4768-b21a-2533105fb425 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:43.860172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-151a1a92-edf8-4768-b21a-2533105fb425 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:43.860603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-151a1a92-edf8-4768-b21a-2533105fb425 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:43.861296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-151a1a92-edf8-4768-b21a-2533105fb425 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:43.861789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-151a1a92-edf8-4768-b21a-2533105fb425 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:43.862221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-151a1a92-edf8-4768-b21a-2533105fb425 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:43.994324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-151a1a92-edf8-4768-b21a-2533105fb425 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:44.002726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-151a1a92-edf8-4768-b21a-2533105fb425 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153762 Aug 18 22:12:44.003310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1367/2724] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:43 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:44.061134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-55a7dee7-f956-444b-ab13-72e9beddb24b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:44.061792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-55a7dee7-f956-444b-ab13-72e9beddb24b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:44.068503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55a7dee7-f956-444b-ab13-72e9beddb24b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:44.068991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55a7dee7-f956-444b-ab13-72e9beddb24b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:44.070086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55a7dee7-f956-444b-ab13-72e9beddb24b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:44.070779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55a7dee7-f956-444b-ab13-72e9beddb24b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:44.071236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55a7dee7-f956-444b-ab13-72e9beddb24b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:44.071663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55a7dee7-f956-444b-ab13-72e9beddb24b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:44.202017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-55a7dee7-f956-444b-ab13-72e9beddb24b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:44.204018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e6798aa4-b9ef-4e86-b737-4adbd8f24288 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:44.204708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e6798aa4-b9ef-4e86-b737-4adbd8f24288 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:44.210652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-55a7dee7-f956-444b-ab13-72e9beddb24b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153368 Aug 18 22:12:44.210843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6798aa4-b9ef-4e86-b737-4adbd8f24288 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:44.211238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6798aa4-b9ef-4e86-b737-4adbd8f24288 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:44.211387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1358/2725] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:44 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:44.211681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6798aa4-b9ef-4e86-b737-4adbd8f24288 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:44.212387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6798aa4-b9ef-4e86-b737-4adbd8f24288 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:44.212847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6798aa4-b9ef-4e86-b737-4adbd8f24288 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:44.213279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6798aa4-b9ef-4e86-b737-4adbd8f24288 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:44.215737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b70d1ef0-2d30-45c9-8919-217891258f3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:44.216351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b70d1ef0-2d30-45c9-8919-217891258f3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:44.222080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b70d1ef0-2d30-45c9-8919-217891258f3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:44.222705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b70d1ef0-2d30-45c9-8919-217891258f3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:44.223155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b70d1ef0-2d30-45c9-8919-217891258f3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:44.223855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b70d1ef0-2d30-45c9-8919-217891258f3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:44.224317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b70d1ef0-2d30-45c9-8919-217891258f3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:44.224751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b70d1ef0-2d30-45c9-8919-217891258f3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:44.355505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e6798aa4-b9ef-4e86-b737-4adbd8f24288 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:44.362076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b70d1ef0-2d30-45c9-8919-217891258f3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:44.368003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e6798aa4-b9ef-4e86-b737-4adbd8f24288 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:44.369698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e6798aa4-b9ef-4e86-b737-4adbd8f24288 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:44.370503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b70d1ef0-2d30-45c9-8919-217891258f3e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.158314 Aug 18 22:12:44.371088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1359/2726] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:44 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:44.371237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e6798aa4-b9ef-4e86-b737-4adbd8f24288 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.171006 Aug 18 22:12:44.372031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1368/2727] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:44.441611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-47625664-025e-48d6-a039-edaf4c40e113 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:44.442248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-47625664-025e-48d6-a039-edaf4c40e113 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:44.448579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47625664-025e-48d6-a039-edaf4c40e113 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:44.449071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47625664-025e-48d6-a039-edaf4c40e113 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:44.449557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47625664-025e-48d6-a039-edaf4c40e113 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:44.450228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47625664-025e-48d6-a039-edaf4c40e113 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:44.450690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47625664-025e-48d6-a039-edaf4c40e113 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:44.451117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47625664-025e-48d6-a039-edaf4c40e113 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:44.578886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-47625664-025e-48d6-a039-edaf4c40e113 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:44.587078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-47625664-025e-48d6-a039-edaf4c40e113 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149556 Aug 18 22:12:44.587645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1360/2728] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:45.024082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-647dc102-0259-4cec-89b2-d604f435d046 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:45.024699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-647dc102-0259-4cec-89b2-d604f435d046 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:45.031410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-647dc102-0259-4cec-89b2-d604f435d046 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:45.032064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-647dc102-0259-4cec-89b2-d604f435d046 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:45.032511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-647dc102-0259-4cec-89b2-d604f435d046 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:45.033216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-647dc102-0259-4cec-89b2-d604f435d046 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:45.033725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-647dc102-0259-4cec-89b2-d604f435d046 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:45.034164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-647dc102-0259-4cec-89b2-d604f435d046 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:45.160257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-647dc102-0259-4cec-89b2-d604f435d046 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:45.168938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-647dc102-0259-4cec-89b2-d604f435d046 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148796 Aug 18 22:12:45.169512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1369/2729] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:45 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:45.232197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-433e10ce-5c41-40e7-9ab6-c831f632ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:45.232820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-433e10ce-5c41-40e7-9ab6-c831f632ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:45.239287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-433e10ce-5c41-40e7-9ab6-c831f632ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:45.239777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-433e10ce-5c41-40e7-9ab6-c831f632ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:45.240222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-433e10ce-5c41-40e7-9ab6-c831f632ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:45.240920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-433e10ce-5c41-40e7-9ab6-c831f632ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:45.242033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-433e10ce-5c41-40e7-9ab6-c831f632ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:45.242466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-433e10ce-5c41-40e7-9ab6-c831f632ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:45.370857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-433e10ce-5c41-40e7-9ab6-c831f632ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:45.378990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-433e10ce-5c41-40e7-9ab6-c831f632ec25 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150594 Aug 18 22:12:45.379566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1361/2730] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:45 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:45.393548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e7887e9f-0c24-40f5-97b5-51eb3d1371e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:45.394193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e7887e9f-0c24-40f5-97b5-51eb3d1371e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:45.394474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e0b46b14-835c-4d0a-9823-741789eb9f79 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:45.395167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e0b46b14-835c-4d0a-9823-741789eb9f79 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:45.400601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7887e9f-0c24-40f5-97b5-51eb3d1371e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:45.401087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7887e9f-0c24-40f5-97b5-51eb3d1371e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:45.401527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7887e9f-0c24-40f5-97b5-51eb3d1371e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:45.401793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0b46b14-835c-4d0a-9823-741789eb9f79 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:45.402249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7887e9f-0c24-40f5-97b5-51eb3d1371e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:45.402377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0b46b14-835c-4d0a-9823-741789eb9f79 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:45.402707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7887e9f-0c24-40f5-97b5-51eb3d1371e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:45.402842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0b46b14-835c-4d0a-9823-741789eb9f79 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:45.403133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e7887e9f-0c24-40f5-97b5-51eb3d1371e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:45.403466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0b46b14-835c-4d0a-9823-741789eb9f79 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:45.403929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0b46b14-835c-4d0a-9823-741789eb9f79 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:45.404361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0b46b14-835c-4d0a-9823-741789eb9f79 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:45.419682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:45.540626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e7887e9f-0c24-40f5-97b5-51eb3d1371e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:45.545996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e0b46b14-835c-4d0a-9823-741789eb9f79 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:45.549138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e7887e9f-0c24-40f5-97b5-51eb3d1371e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.160804 Aug 18 22:12:45.549743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1370/2731] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:45 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:45.555635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e0b46b14-835c-4d0a-9823-741789eb9f79 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:45.557144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e0b46b14-835c-4d0a-9823-741789eb9f79 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:45.558326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e0b46b14-835c-4d0a-9823-741789eb9f79 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.167751 Aug 18 22:12:45.558876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1362/2732] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:45 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:45.607983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-184992f1-aa3c-41d9-8d56-acd393dd1c95 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:45.608527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-184992f1-aa3c-41d9-8d56-acd393dd1c95 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:45.614521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-184992f1-aa3c-41d9-8d56-acd393dd1c95 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:45.615005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-184992f1-aa3c-41d9-8d56-acd393dd1c95 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:45.615455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-184992f1-aa3c-41d9-8d56-acd393dd1c95 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:45.616185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-184992f1-aa3c-41d9-8d56-acd393dd1c95 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:45.616642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-184992f1-aa3c-41d9-8d56-acd393dd1c95 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:45.617073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-184992f1-aa3c-41d9-8d56-acd393dd1c95 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:45.743785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-184992f1-aa3c-41d9-8d56-acd393dd1c95 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:45.751874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-184992f1-aa3c-41d9-8d56-acd393dd1c95 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147799 Aug 18 22:12:45.752451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1371/2733] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:45 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:46.190816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2572e56f-9cc7-495b-bcf9-0cd91a0121a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:46.191432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2572e56f-9cc7-495b-bcf9-0cd91a0121a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:46.198138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2572e56f-9cc7-495b-bcf9-0cd91a0121a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:46.198621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2572e56f-9cc7-495b-bcf9-0cd91a0121a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:46.199059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2572e56f-9cc7-495b-bcf9-0cd91a0121a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:46.199764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2572e56f-9cc7-495b-bcf9-0cd91a0121a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:46.200202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2572e56f-9cc7-495b-bcf9-0cd91a0121a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:46.200625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2572e56f-9cc7-495b-bcf9-0cd91a0121a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:46.327090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2572e56f-9cc7-495b-bcf9-0cd91a0121a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:46.335371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2572e56f-9cc7-495b-bcf9-0cd91a0121a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148372 Aug 18 22:12:46.336096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1363/2734] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:46 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:46.400409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6b0a23ac-d897-4f05-8694-91143e51b2ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:46.401029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6b0a23ac-d897-4f05-8694-91143e51b2ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:46.407625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b0a23ac-d897-4f05-8694-91143e51b2ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:46.408088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b0a23ac-d897-4f05-8694-91143e51b2ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:46.408529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b0a23ac-d897-4f05-8694-91143e51b2ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:46.409220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b0a23ac-d897-4f05-8694-91143e51b2ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:46.409708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b0a23ac-d897-4f05-8694-91143e51b2ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:46.410140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b0a23ac-d897-4f05-8694-91143e51b2ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:46.542236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6b0a23ac-d897-4f05-8694-91143e51b2ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:46.550661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6b0a23ac-d897-4f05-8694-91143e51b2ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153900 Aug 18 22:12:46.551242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1372/2735] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:46 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:46.570970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0070624e-54ca-4e94-979f-a9cf05668fb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:46.571599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0070624e-54ca-4e94-979f-a9cf05668fb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:46.577784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0070624e-54ca-4e94-979f-a9cf05668fb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:46.578440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0070624e-54ca-4e94-979f-a9cf05668fb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:46.578888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0070624e-54ca-4e94-979f-a9cf05668fb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:46.579594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0070624e-54ca-4e94-979f-a9cf05668fb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:46.580056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0070624e-54ca-4e94-979f-a9cf05668fb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:46.580486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0070624e-54ca-4e94-979f-a9cf05668fb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:46.581963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c17a8415-454b-4967-a254-80c29e7559a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:46.582590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c17a8415-454b-4967-a254-80c29e7559a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:46.588662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c17a8415-454b-4967-a254-80c29e7559a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:46.589147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c17a8415-454b-4967-a254-80c29e7559a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:46.589586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c17a8415-454b-4967-a254-80c29e7559a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:46.590304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c17a8415-454b-4967-a254-80c29e7559a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:46.590788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c17a8415-454b-4967-a254-80c29e7559a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:46.591219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c17a8415-454b-4967-a254-80c29e7559a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:46.709976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0070624e-54ca-4e94-979f-a9cf05668fb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:46.718591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0070624e-54ca-4e94-979f-a9cf05668fb0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151399 Aug 18 22:12:46.719390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1364/2736] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:46.722819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c17a8415-454b-4967-a254-80c29e7559a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:46.732108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c17a8415-454b-4967-a254-80c29e7559a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:46.733631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c17a8415-454b-4967-a254-80c29e7559a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:46.734782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c17a8415-454b-4967-a254-80c29e7559a3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157482 Aug 18 22:12:46.735328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1373/2737] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:46 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:46.773981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3502544f-06bc-4362-86e8-c4472acd6893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:46.774690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3502544f-06bc-4362-86e8-c4472acd6893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:46.780609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3502544f-06bc-4362-86e8-c4472acd6893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:46.781097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3502544f-06bc-4362-86e8-c4472acd6893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:46.781657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3502544f-06bc-4362-86e8-c4472acd6893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:46.782463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3502544f-06bc-4362-86e8-c4472acd6893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:46.782924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3502544f-06bc-4362-86e8-c4472acd6893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:46.783354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3502544f-06bc-4362-86e8-c4472acd6893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:46.911668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3502544f-06bc-4362-86e8-c4472acd6893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:46.920395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3502544f-06bc-4362-86e8-c4472acd6893 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150827 Aug 18 22:12:46.920961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1365/2738] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:46 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:47.356263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4856202e-e5d9-4e1c-8f7a-334816c857c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:47.356816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4856202e-e5d9-4e1c-8f7a-334816c857c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:47.363110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4856202e-e5d9-4e1c-8f7a-334816c857c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:47.363596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4856202e-e5d9-4e1c-8f7a-334816c857c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:47.364038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4856202e-e5d9-4e1c-8f7a-334816c857c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:47.364731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4856202e-e5d9-4e1c-8f7a-334816c857c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:47.365191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4856202e-e5d9-4e1c-8f7a-334816c857c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:47.365640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4856202e-e5d9-4e1c-8f7a-334816c857c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:47.493201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4856202e-e5d9-4e1c-8f7a-334816c857c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:47.501500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4856202e-e5d9-4e1c-8f7a-334816c857c8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149175 Aug 18 22:12:47.502118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1374/2739] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:47 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:47.573320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fe80c0f9-006b-4afb-89ee-50b7e08cc0b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:47.573964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fe80c0f9-006b-4afb-89ee-50b7e08cc0b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:47.580485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe80c0f9-006b-4afb-89ee-50b7e08cc0b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:47.580966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe80c0f9-006b-4afb-89ee-50b7e08cc0b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:47.581438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe80c0f9-006b-4afb-89ee-50b7e08cc0b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:47.582157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe80c0f9-006b-4afb-89ee-50b7e08cc0b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:47.582614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe80c0f9-006b-4afb-89ee-50b7e08cc0b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:47.583043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe80c0f9-006b-4afb-89ee-50b7e08cc0b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:47.713635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fe80c0f9-006b-4afb-89ee-50b7e08cc0b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:47.723487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fe80c0f9-006b-4afb-89ee-50b7e08cc0b3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153855 Aug 18 22:12:47.723487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1366/2740] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:47 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:47.743958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-867366d3-599c-4af2-8a96-8b6e188f38cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:47.744575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-867366d3-599c-4af2-8a96-8b6e188f38cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:47.750694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867366d3-599c-4af2-8a96-8b6e188f38cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:47.751416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867366d3-599c-4af2-8a96-8b6e188f38cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:47.751606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867366d3-599c-4af2-8a96-8b6e188f38cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:47.752386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867366d3-599c-4af2-8a96-8b6e188f38cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:47.752855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867366d3-599c-4af2-8a96-8b6e188f38cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:47.753287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867366d3-599c-4af2-8a96-8b6e188f38cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:47.758250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-391a3059-35b0-4570-aa59-e34ddf8257eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:47.758866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-391a3059-35b0-4570-aa59-e34ddf8257eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:47.766279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-391a3059-35b0-4570-aa59-e34ddf8257eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:47.767131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-391a3059-35b0-4570-aa59-e34ddf8257eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:47.767926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-391a3059-35b0-4570-aa59-e34ddf8257eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:47.769045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-391a3059-35b0-4570-aa59-e34ddf8257eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:47.769567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-391a3059-35b0-4570-aa59-e34ddf8257eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:47.770057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-391a3059-35b0-4570-aa59-e34ddf8257eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:47.883836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-867366d3-599c-4af2-8a96-8b6e188f38cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:47.892403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-867366d3-599c-4af2-8a96-8b6e188f38cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152977 Aug 18 22:12:47.893256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1375/2741] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:47.903299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-391a3059-35b0-4570-aa59-e34ddf8257eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:47.912044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-391a3059-35b0-4570-aa59-e34ddf8257eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:47.914065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-391a3059-35b0-4570-aa59-e34ddf8257eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:47.915206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-391a3059-35b0-4570-aa59-e34ddf8257eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.161673 Aug 18 22:12:47.915762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1367/2742] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:47 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:12:47.941133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7fdb2995-b76b-447f-8743-094e88b54929 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:47.941782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7fdb2995-b76b-447f-8743-094e88b54929 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:47.947734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fdb2995-b76b-447f-8743-094e88b54929 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:47.948210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fdb2995-b76b-447f-8743-094e88b54929 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:47.948642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fdb2995-b76b-447f-8743-094e88b54929 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:47.949323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fdb2995-b76b-447f-8743-094e88b54929 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:47.949811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fdb2995-b76b-447f-8743-094e88b54929 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:47.950236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fdb2995-b76b-447f-8743-094e88b54929 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:48.075448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7fdb2995-b76b-447f-8743-094e88b54929 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:48.083662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7fdb2995-b76b-447f-8743-094e88b54929 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.146282 Aug 18 22:12:48.084232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1376/2743] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:47 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:48.523471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eb60cc39-f32d-41ad-8e2a-c53ce3b4976e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:48.524094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eb60cc39-f32d-41ad-8e2a-c53ce3b4976e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:48.530122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb60cc39-f32d-41ad-8e2a-c53ce3b4976e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:48.530611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb60cc39-f32d-41ad-8e2a-c53ce3b4976e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:48.531055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb60cc39-f32d-41ad-8e2a-c53ce3b4976e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:48.531791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb60cc39-f32d-41ad-8e2a-c53ce3b4976e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:48.532251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb60cc39-f32d-41ad-8e2a-c53ce3b4976e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:48.532686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb60cc39-f32d-41ad-8e2a-c53ce3b4976e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:48.659510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-eb60cc39-f32d-41ad-8e2a-c53ce3b4976e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:48.668352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eb60cc39-f32d-41ad-8e2a-c53ce3b4976e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149321 Aug 18 22:12:48.668930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1368/2744] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:48 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:48.745892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e5c624d6-68cc-4d95-b98c-079a4c439e83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:48.746514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e5c624d6-68cc-4d95-b98c-079a4c439e83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:48.752939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5c624d6-68cc-4d95-b98c-079a4c439e83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:48.753421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5c624d6-68cc-4d95-b98c-079a4c439e83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:48.753892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5c624d6-68cc-4d95-b98c-079a4c439e83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:48.754581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5c624d6-68cc-4d95-b98c-079a4c439e83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:48.755036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5c624d6-68cc-4d95-b98c-079a4c439e83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:48.755468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5c624d6-68cc-4d95-b98c-079a4c439e83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:48.886061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e5c624d6-68cc-4d95-b98c-079a4c439e83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:48.894206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e5c624d6-68cc-4d95-b98c-079a4c439e83 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152228 Aug 18 22:12:48.894787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1377/2745] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:48 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:48.914154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-74868220-7747-4b58-8b26-206a678ec3a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:48.914808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-74868220-7747-4b58-8b26-206a678ec3a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:48.920721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74868220-7747-4b58-8b26-206a678ec3a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:48.921211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74868220-7747-4b58-8b26-206a678ec3a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:48.921686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74868220-7747-4b58-8b26-206a678ec3a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:48.922392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74868220-7747-4b58-8b26-206a678ec3a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:48.922852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74868220-7747-4b58-8b26-206a678ec3a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:48.923284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74868220-7747-4b58-8b26-206a678ec3a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:48.927442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:48.938622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-369227eb-363c-48f5-80f1-ec1d55ec0720 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:48.939250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-369227eb-363c-48f5-80f1-ec1d55ec0720 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:48.945975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-369227eb-363c-48f5-80f1-ec1d55ec0720 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:48.946450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-369227eb-363c-48f5-80f1-ec1d55ec0720 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:48.946891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-369227eb-363c-48f5-80f1-ec1d55ec0720 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:48.947589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-369227eb-363c-48f5-80f1-ec1d55ec0720 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:48.948050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-369227eb-363c-48f5-80f1-ec1d55ec0720 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:48.948476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-369227eb-363c-48f5-80f1-ec1d55ec0720 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:49.056810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-74868220-7747-4b58-8b26-206a678ec3a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:49.065077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-74868220-7747-4b58-8b26-206a678ec3a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154818 Aug 18 22:12:49.065685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1369/2746] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:48 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:49.082493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-369227eb-363c-48f5-80f1-ec1d55ec0720 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:49.091600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-369227eb-363c-48f5-80f1-ec1d55ec0720 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:49.093026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-369227eb-363c-48f5-80f1-ec1d55ec0720 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:49.094562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-369227eb-363c-48f5-80f1-ec1d55ec0720 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159514 Aug 18 22:12:49.094896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1378/2747] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:49.105965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d545bbb4-25e8-447f-b594-cccfa7a4f82d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:49.106635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d545bbb4-25e8-447f-b594-cccfa7a4f82d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:49.112762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d545bbb4-25e8-447f-b594-cccfa7a4f82d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:49.113240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d545bbb4-25e8-447f-b594-cccfa7a4f82d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:49.113713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d545bbb4-25e8-447f-b594-cccfa7a4f82d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:49.114401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d545bbb4-25e8-447f-b594-cccfa7a4f82d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:49.114852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d545bbb4-25e8-447f-b594-cccfa7a4f82d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:49.115275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d545bbb4-25e8-447f-b594-cccfa7a4f82d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:49.244593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d545bbb4-25e8-447f-b594-cccfa7a4f82d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:49.252789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d545bbb4-25e8-447f-b594-cccfa7a4f82d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150613 Aug 18 22:12:49.253360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1370/2748] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:49 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:49.691864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ac499c86-745a-4c6a-88f1-c80d16bea690 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:49.692498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ac499c86-745a-4c6a-88f1-c80d16bea690 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:49.699115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac499c86-745a-4c6a-88f1-c80d16bea690 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:49.699599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac499c86-745a-4c6a-88f1-c80d16bea690 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:49.700037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac499c86-745a-4c6a-88f1-c80d16bea690 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:49.700757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac499c86-745a-4c6a-88f1-c80d16bea690 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:49.701194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac499c86-745a-4c6a-88f1-c80d16bea690 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:49.701643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac499c86-745a-4c6a-88f1-c80d16bea690 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:49.833270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ac499c86-745a-4c6a-88f1-c80d16bea690 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:49.841559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ac499c86-745a-4c6a-88f1-c80d16bea690 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155270 Aug 18 22:12:49.842163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1379/2749] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:49 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:49.916224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-45c90f77-f7bf-42aa-a7d0-feeca338d206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:49.916847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-45c90f77-f7bf-42aa-a7d0-feeca338d206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:49.923332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c90f77-f7bf-42aa-a7d0-feeca338d206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:49.923847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c90f77-f7bf-42aa-a7d0-feeca338d206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:49.924295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c90f77-f7bf-42aa-a7d0-feeca338d206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:49.924988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c90f77-f7bf-42aa-a7d0-feeca338d206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:49.925739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c90f77-f7bf-42aa-a7d0-feeca338d206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:49.926175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c90f77-f7bf-42aa-a7d0-feeca338d206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:50.051792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-45c90f77-f7bf-42aa-a7d0-feeca338d206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:50.060334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-45c90f77-f7bf-42aa-a7d0-feeca338d206 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.147997 Aug 18 22:12:50.060902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1371/2750] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:49 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:50.086508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64a82c46-f3f2-4137-8879-647677c1ea6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:50.087084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64a82c46-f3f2-4137-8879-647677c1ea6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:50.093008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a82c46-f3f2-4137-8879-647677c1ea6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:50.093497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a82c46-f3f2-4137-8879-647677c1ea6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:50.093971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a82c46-f3f2-4137-8879-647677c1ea6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:50.094666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a82c46-f3f2-4137-8879-647677c1ea6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:50.095123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a82c46-f3f2-4137-8879-647677c1ea6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:50.095553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a82c46-f3f2-4137-8879-647677c1ea6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:50.117741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9b4bb74e-1350-4125-b72f-c8261b645766 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:50.118524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9b4bb74e-1350-4125-b72f-c8261b645766 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:50.124444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b4bb74e-1350-4125-b72f-c8261b645766 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:50.125011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b4bb74e-1350-4125-b72f-c8261b645766 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:50.125530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b4bb74e-1350-4125-b72f-c8261b645766 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:50.126235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b4bb74e-1350-4125-b72f-c8261b645766 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:50.128350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b4bb74e-1350-4125-b72f-c8261b645766 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:50.128779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b4bb74e-1350-4125-b72f-c8261b645766 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:50.225164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-64a82c46-f3f2-4137-8879-647677c1ea6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:50.235386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64a82c46-f3f2-4137-8879-647677c1ea6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152545 Aug 18 22:12:50.236294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1380/2751] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:50 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:50.264273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9b4bb74e-1350-4125-b72f-c8261b645766 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:50.273927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9b4bb74e-1350-4125-b72f-c8261b645766 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:50.274190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6bb58cb8-3825-4904-b5b9-6021b4c62545 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:50.274815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6bb58cb8-3825-4904-b5b9-6021b4c62545 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:50.275505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9b4bb74e-1350-4125-b72f-c8261b645766 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:50.276714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9b4bb74e-1350-4125-b72f-c8261b645766 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.163286 Aug 18 22:12:50.277275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1372/2752] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:50.280983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bb58cb8-3825-4904-b5b9-6021b4c62545 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:50.281470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bb58cb8-3825-4904-b5b9-6021b4c62545 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:50.281936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bb58cb8-3825-4904-b5b9-6021b4c62545 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:50.282641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bb58cb8-3825-4904-b5b9-6021b4c62545 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:50.283104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bb58cb8-3825-4904-b5b9-6021b4c62545 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:50.283535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bb58cb8-3825-4904-b5b9-6021b4c62545 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:50.408749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6bb58cb8-3825-4904-b5b9-6021b4c62545 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:50.417609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6bb58cb8-3825-4904-b5b9-6021b4c62545 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147285 Aug 18 22:12:50.418192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1381/2753] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:50.861542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-56c912ef-bf18-478a-ba46-04f8840c6a01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:50.862182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-56c912ef-bf18-478a-ba46-04f8840c6a01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:50.868210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56c912ef-bf18-478a-ba46-04f8840c6a01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:50.868690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56c912ef-bf18-478a-ba46-04f8840c6a01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:50.869122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56c912ef-bf18-478a-ba46-04f8840c6a01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:50.869842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56c912ef-bf18-478a-ba46-04f8840c6a01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:50.870294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56c912ef-bf18-478a-ba46-04f8840c6a01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:50.870716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56c912ef-bf18-478a-ba46-04f8840c6a01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:50.996863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-56c912ef-bf18-478a-ba46-04f8840c6a01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:51.005380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-56c912ef-bf18-478a-ba46-04f8840c6a01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.147706 Aug 18 22:12:51.005992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1373/2754] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:50 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:51.081956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-91ce5020-5195-44f8-bcbe-9a62a54c706d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:51.082574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-91ce5020-5195-44f8-bcbe-9a62a54c706d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:51.089702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91ce5020-5195-44f8-bcbe-9a62a54c706d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:51.090184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91ce5020-5195-44f8-bcbe-9a62a54c706d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:51.090624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91ce5020-5195-44f8-bcbe-9a62a54c706d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:51.091312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91ce5020-5195-44f8-bcbe-9a62a54c706d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:51.091766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91ce5020-5195-44f8-bcbe-9a62a54c706d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:51.092190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91ce5020-5195-44f8-bcbe-9a62a54c706d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:51.221191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-91ce5020-5195-44f8-bcbe-9a62a54c706d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:51.229516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-91ce5020-5195-44f8-bcbe-9a62a54c706d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151391 Aug 18 22:12:51.230133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1382/2755] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:51 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:51.257957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5ac0229a-e91a-4e7e-af94-d72793788368 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:51.258524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5ac0229a-e91a-4e7e-af94-d72793788368 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:51.264656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ac0229a-e91a-4e7e-af94-d72793788368 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:51.265144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ac0229a-e91a-4e7e-af94-d72793788368 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:51.265641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ac0229a-e91a-4e7e-af94-d72793788368 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:51.266379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ac0229a-e91a-4e7e-af94-d72793788368 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:51.266835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ac0229a-e91a-4e7e-af94-d72793788368 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:51.267264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ac0229a-e91a-4e7e-af94-d72793788368 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:51.302163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a96c19b5-eb95-42a2-9511-93f2e012b5d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:51.303257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a96c19b5-eb95-42a2-9511-93f2e012b5d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:51.311740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a96c19b5-eb95-42a2-9511-93f2e012b5d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:51.312232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a96c19b5-eb95-42a2-9511-93f2e012b5d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:51.312676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a96c19b5-eb95-42a2-9511-93f2e012b5d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:51.313386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a96c19b5-eb95-42a2-9511-93f2e012b5d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:51.313867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a96c19b5-eb95-42a2-9511-93f2e012b5d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:51.314306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a96c19b5-eb95-42a2-9511-93f2e012b5d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:51.409907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5ac0229a-e91a-4e7e-af94-d72793788368 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:51.418125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5ac0229a-e91a-4e7e-af94-d72793788368 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.164694 Aug 18 22:12:51.418716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1374/2756] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:51 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:51.439383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6e8db5a4-60c6-4ebe-b929-524f608f46d0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:51.440009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6e8db5a4-60c6-4ebe-b929-524f608f46d0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:51.446514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e8db5a4-60c6-4ebe-b929-524f608f46d0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:51.447008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e8db5a4-60c6-4ebe-b929-524f608f46d0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:51.447452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e8db5a4-60c6-4ebe-b929-524f608f46d0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:51.448157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e8db5a4-60c6-4ebe-b929-524f608f46d0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:51.448566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a96c19b5-eb95-42a2-9511-93f2e012b5d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:51.448719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e8db5a4-60c6-4ebe-b929-524f608f46d0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:51.449040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e8db5a4-60c6-4ebe-b929-524f608f46d0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:51.457939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a96c19b5-eb95-42a2-9511-93f2e012b5d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:51.459538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a96c19b5-eb95-42a2-9511-93f2e012b5d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:51.460741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a96c19b5-eb95-42a2-9511-93f2e012b5d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.165532 Aug 18 22:12:51.461307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1383/2757] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:51 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:51.574884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6e8db5a4-60c6-4ebe-b929-524f608f46d0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:51.583065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6e8db5a4-60c6-4ebe-b929-524f608f46d0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147439 Aug 18 22:12:51.583641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1375/2758] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:52.027146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab00f248-4c4a-497a-9777-1995c46b6b5f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:52.027761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab00f248-4c4a-497a-9777-1995c46b6b5f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:52.033812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab00f248-4c4a-497a-9777-1995c46b6b5f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:52.034297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab00f248-4c4a-497a-9777-1995c46b6b5f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:52.034736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab00f248-4c4a-497a-9777-1995c46b6b5f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:52.035421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab00f248-4c4a-497a-9777-1995c46b6b5f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:52.035875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab00f248-4c4a-497a-9777-1995c46b6b5f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:52.036300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab00f248-4c4a-497a-9777-1995c46b6b5f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:52.166317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ab00f248-4c4a-497a-9777-1995c46b6b5f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:52.174497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab00f248-4c4a-497a-9777-1995c46b6b5f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151226 Aug 18 22:12:52.175075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1384/2759] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:52 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:52.250928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-491b5bf1-3f31-4956-a2a6-4aac24c55085 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:52.251548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-491b5bf1-3f31-4956-a2a6-4aac24c55085 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:52.258147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-491b5bf1-3f31-4956-a2a6-4aac24c55085 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:52.258634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-491b5bf1-3f31-4956-a2a6-4aac24c55085 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:52.259074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-491b5bf1-3f31-4956-a2a6-4aac24c55085 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:52.259768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-491b5bf1-3f31-4956-a2a6-4aac24c55085 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:52.260229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-491b5bf1-3f31-4956-a2a6-4aac24c55085 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:52.260659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-491b5bf1-3f31-4956-a2a6-4aac24c55085 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:52.386623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-491b5bf1-3f31-4956-a2a6-4aac24c55085 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:52.394893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-491b5bf1-3f31-4956-a2a6-4aac24c55085 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.147864 Aug 18 22:12:52.395470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1376/2760] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:52 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:52.440066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f54474b-d753-416c-9528-258cbbd61f6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:52.440700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f54474b-d753-416c-9528-258cbbd61f6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:52.447085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f54474b-d753-416c-9528-258cbbd61f6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:52.447563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f54474b-d753-416c-9528-258cbbd61f6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:52.447997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f54474b-d753-416c-9528-258cbbd61f6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:52.448716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f54474b-d753-416c-9528-258cbbd61f6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:52.449162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f54474b-d753-416c-9528-258cbbd61f6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:52.449624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f54474b-d753-416c-9528-258cbbd61f6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:52.483477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d197ec33-23ec-423c-a07c-8a6f5ddc141e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:52.484098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d197ec33-23ec-423c-a07c-8a6f5ddc141e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:52.490141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d197ec33-23ec-423c-a07c-8a6f5ddc141e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:52.490628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d197ec33-23ec-423c-a07c-8a6f5ddc141e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:52.491071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d197ec33-23ec-423c-a07c-8a6f5ddc141e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:52.491768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d197ec33-23ec-423c-a07c-8a6f5ddc141e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:52.492220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d197ec33-23ec-423c-a07c-8a6f5ddc141e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:52.492649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d197ec33-23ec-423c-a07c-8a6f5ddc141e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:52.586824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4f54474b-d753-416c-9528-258cbbd61f6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:52.595207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f54474b-d753-416c-9528-258cbbd61f6a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159005 Aug 18 22:12:52.595784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1385/2761] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:52.604511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-394a3b22-c3eb-49b8-a04d-0f8a0eb9baa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:52.605395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-394a3b22-c3eb-49b8-a04d-0f8a0eb9baa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:52.611343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-394a3b22-c3eb-49b8-a04d-0f8a0eb9baa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:52.611905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-394a3b22-c3eb-49b8-a04d-0f8a0eb9baa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:52.612413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-394a3b22-c3eb-49b8-a04d-0f8a0eb9baa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:52.613112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-394a3b22-c3eb-49b8-a04d-0f8a0eb9baa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:52.613566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-394a3b22-c3eb-49b8-a04d-0f8a0eb9baa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:52.614021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-394a3b22-c3eb-49b8-a04d-0f8a0eb9baa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:52.638697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d197ec33-23ec-423c-a07c-8a6f5ddc141e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:52.648647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d197ec33-23ec-423c-a07c-8a6f5ddc141e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:52.650267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d197ec33-23ec-423c-a07c-8a6f5ddc141e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:52.651444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d197ec33-23ec-423c-a07c-8a6f5ddc141e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.171827 Aug 18 22:12:52.652016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1377/2762] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:52 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:52.746997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-394a3b22-c3eb-49b8-a04d-0f8a0eb9baa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:52.755189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-394a3b22-c3eb-49b8-a04d-0f8a0eb9baa8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154660 Aug 18 22:12:52.755764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1386/2763] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:53.195633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-46fd76b7-2b80-4293-805f-2f0140b48713 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:53.196286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46fd76b7-2b80-4293-805f-2f0140b48713 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:53.202418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46fd76b7-2b80-4293-805f-2f0140b48713 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:53.202909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46fd76b7-2b80-4293-805f-2f0140b48713 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:53.203449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46fd76b7-2b80-4293-805f-2f0140b48713 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:53.204148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46fd76b7-2b80-4293-805f-2f0140b48713 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:53.204602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46fd76b7-2b80-4293-805f-2f0140b48713 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:53.205035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46fd76b7-2b80-4293-805f-2f0140b48713 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:53.332360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-46fd76b7-2b80-4293-805f-2f0140b48713 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:53.340576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-46fd76b7-2b80-4293-805f-2f0140b48713 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148859 Aug 18 22:12:53.341148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1378/2764] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:53 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:53.417222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fd015633-508f-4e9d-925d-6f6844fd5ce3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:53.417816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fd015633-508f-4e9d-925d-6f6844fd5ce3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:53.424361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd015633-508f-4e9d-925d-6f6844fd5ce3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:53.424848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd015633-508f-4e9d-925d-6f6844fd5ce3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:53.425541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd015633-508f-4e9d-925d-6f6844fd5ce3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:53.426273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd015633-508f-4e9d-925d-6f6844fd5ce3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:53.426727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd015633-508f-4e9d-925d-6f6844fd5ce3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:53.427157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fd015633-508f-4e9d-925d-6f6844fd5ce3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:53.430388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:53.553276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fd015633-508f-4e9d-925d-6f6844fd5ce3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:53.561457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fd015633-508f-4e9d-925d-6f6844fd5ce3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148808 Aug 18 22:12:53.562071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1387/2765] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:53 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:53.617288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f75a51d7-8ef5-4d69-a6d0-bed95dc1f15a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:53.617931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f75a51d7-8ef5-4d69-a6d0-bed95dc1f15a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:53.623862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f75a51d7-8ef5-4d69-a6d0-bed95dc1f15a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:53.624348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f75a51d7-8ef5-4d69-a6d0-bed95dc1f15a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:53.624787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f75a51d7-8ef5-4d69-a6d0-bed95dc1f15a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:53.625483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f75a51d7-8ef5-4d69-a6d0-bed95dc1f15a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:53.625984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f75a51d7-8ef5-4d69-a6d0-bed95dc1f15a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:53.626410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f75a51d7-8ef5-4d69-a6d0-bed95dc1f15a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:53.674998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3dcadc66-bdf9-4a93-874e-a49d7fbde449 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:53.675777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3dcadc66-bdf9-4a93-874e-a49d7fbde449 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:53.681616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dcadc66-bdf9-4a93-874e-a49d7fbde449 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:53.682100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dcadc66-bdf9-4a93-874e-a49d7fbde449 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:53.682532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dcadc66-bdf9-4a93-874e-a49d7fbde449 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:53.683214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dcadc66-bdf9-4a93-874e-a49d7fbde449 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:53.683693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dcadc66-bdf9-4a93-874e-a49d7fbde449 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:53.684115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dcadc66-bdf9-4a93-874e-a49d7fbde449 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:53.760003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f75a51d7-8ef5-4d69-a6d0-bed95dc1f15a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:53.769941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f75a51d7-8ef5-4d69-a6d0-bed95dc1f15a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156488 Aug 18 22:12:53.770720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1379/2766] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:53.777236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cdb556f3-9cd0-4d5c-aed3-17e75e0e8cc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:53.778217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cdb556f3-9cd0-4d5c-aed3-17e75e0e8cc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:53.784661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cdb556f3-9cd0-4d5c-aed3-17e75e0e8cc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:53.785152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cdb556f3-9cd0-4d5c-aed3-17e75e0e8cc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:53.785611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cdb556f3-9cd0-4d5c-aed3-17e75e0e8cc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:53.786441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cdb556f3-9cd0-4d5c-aed3-17e75e0e8cc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:53.786902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cdb556f3-9cd0-4d5c-aed3-17e75e0e8cc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:53.787334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cdb556f3-9cd0-4d5c-aed3-17e75e0e8cc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:53.814943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3dcadc66-bdf9-4a93-874e-a49d7fbde449 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:53.823789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3dcadc66-bdf9-4a93-874e-a49d7fbde449 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:53.825284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3dcadc66-bdf9-4a93-874e-a49d7fbde449 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:53.826468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3dcadc66-bdf9-4a93-874e-a49d7fbde449 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155437 Aug 18 22:12:53.827037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1388/2767] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:53 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:53.914818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cdb556f3-9cd0-4d5c-aed3-17e75e0e8cc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:53.923069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cdb556f3-9cd0-4d5c-aed3-17e75e0e8cc7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150698 Aug 18 22:12:53.923655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1380/2768] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:53 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:54.362080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3a15fec8-907d-448f-bbbe-62ea1d7cf620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:54.362709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3a15fec8-907d-448f-bbbe-62ea1d7cf620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:54.369393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a15fec8-907d-448f-bbbe-62ea1d7cf620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:54.369901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a15fec8-907d-448f-bbbe-62ea1d7cf620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:54.370363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a15fec8-907d-448f-bbbe-62ea1d7cf620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:54.371050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a15fec8-907d-448f-bbbe-62ea1d7cf620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:54.371502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a15fec8-907d-448f-bbbe-62ea1d7cf620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:54.371925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a15fec8-907d-448f-bbbe-62ea1d7cf620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:54.499512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3a15fec8-907d-448f-bbbe-62ea1d7cf620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:54.508395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3a15fec8-907d-448f-bbbe-62ea1d7cf620 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150218 Aug 18 22:12:54.508966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1389/2769] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:54 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:54.582820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c2908c8b-71da-47cb-bb78-15f1bf489933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:54.583438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c2908c8b-71da-47cb-bb78-15f1bf489933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:54.589948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2908c8b-71da-47cb-bb78-15f1bf489933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:54.590433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2908c8b-71da-47cb-bb78-15f1bf489933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:54.590874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2908c8b-71da-47cb-bb78-15f1bf489933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:54.591559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2908c8b-71da-47cb-bb78-15f1bf489933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:54.592014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2908c8b-71da-47cb-bb78-15f1bf489933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:54.592441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2908c8b-71da-47cb-bb78-15f1bf489933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:54.719616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c2908c8b-71da-47cb-bb78-15f1bf489933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:54.728465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c2908c8b-71da-47cb-bb78-15f1bf489933 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149599 Aug 18 22:12:54.729081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1381/2770] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:54 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:54.792068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9d4708c3-20a2-4a14-b62a-5f1d1cda56d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:54.792674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9d4708c3-20a2-4a14-b62a-5f1d1cda56d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:54.798803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d4708c3-20a2-4a14-b62a-5f1d1cda56d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:54.799287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d4708c3-20a2-4a14-b62a-5f1d1cda56d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:54.799720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d4708c3-20a2-4a14-b62a-5f1d1cda56d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:54.800655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d4708c3-20a2-4a14-b62a-5f1d1cda56d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:54.801107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d4708c3-20a2-4a14-b62a-5f1d1cda56d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:54.801528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d4708c3-20a2-4a14-b62a-5f1d1cda56d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:54.851074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-97e8cfd1-185c-45e8-8d4f-787fa507aeb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:54.851744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-97e8cfd1-185c-45e8-8d4f-787fa507aeb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:54.857962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97e8cfd1-185c-45e8-8d4f-787fa507aeb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:54.858451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97e8cfd1-185c-45e8-8d4f-787fa507aeb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:54.858896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97e8cfd1-185c-45e8-8d4f-787fa507aeb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:54.859597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97e8cfd1-185c-45e8-8d4f-787fa507aeb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:54.860068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97e8cfd1-185c-45e8-8d4f-787fa507aeb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:54.860502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97e8cfd1-185c-45e8-8d4f-787fa507aeb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:54.937296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9d4708c3-20a2-4a14-b62a-5f1d1cda56d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:54.948704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9d4708c3-20a2-4a14-b62a-5f1d1cda56d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.160734 Aug 18 22:12:54.949299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1390/2771] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:54.954170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0af7c3e8-a215-411a-befe-99c1da459ec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:54.954783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0af7c3e8-a215-411a-befe-99c1da459ec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:54.960866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0af7c3e8-a215-411a-befe-99c1da459ec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:54.961421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0af7c3e8-a215-411a-befe-99c1da459ec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:54.961956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0af7c3e8-a215-411a-befe-99c1da459ec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:54.962719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0af7c3e8-a215-411a-befe-99c1da459ec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:54.963269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0af7c3e8-a215-411a-befe-99c1da459ec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:54.963740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0af7c3e8-a215-411a-befe-99c1da459ec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:55.008320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97e8cfd1-185c-45e8-8d4f-787fa507aeb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:55.019635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97e8cfd1-185c-45e8-8d4f-787fa507aeb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:55.021279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97e8cfd1-185c-45e8-8d4f-787fa507aeb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:55.023089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-97e8cfd1-185c-45e8-8d4f-787fa507aeb3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.175818 Aug 18 22:12:55.025630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1382/2772] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:54 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:55.103945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0af7c3e8-a215-411a-befe-99c1da459ec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:55.112133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0af7c3e8-a215-411a-befe-99c1da459ec6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.161864 Aug 18 22:12:55.112701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1391/2773] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:54 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:55.529059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c33c23fd-5690-441d-8304-066e481ab3f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:55.529701 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c33c23fd-5690-441d-8304-066e481ab3f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:55.535664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c33c23fd-5690-441d-8304-066e481ab3f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:55.536142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c33c23fd-5690-441d-8304-066e481ab3f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:55.536573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c33c23fd-5690-441d-8304-066e481ab3f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:55.537249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c33c23fd-5690-441d-8304-066e481ab3f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:55.538294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c33c23fd-5690-441d-8304-066e481ab3f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:55.538807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c33c23fd-5690-441d-8304-066e481ab3f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:55.664980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c33c23fd-5690-441d-8304-066e481ab3f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:55.673338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c33c23fd-5690-441d-8304-066e481ab3f6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148087 Aug 18 22:12:55.673970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1383/2774] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:55 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:55.750762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-369272ad-77e3-4b82-9274-42ebd4ff2526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:55.751379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-369272ad-77e3-4b82-9274-42ebd4ff2526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:55.757880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-369272ad-77e3-4b82-9274-42ebd4ff2526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:55.758362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-369272ad-77e3-4b82-9274-42ebd4ff2526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:55.758804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-369272ad-77e3-4b82-9274-42ebd4ff2526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:55.759498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-369272ad-77e3-4b82-9274-42ebd4ff2526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:55.759951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-369272ad-77e3-4b82-9274-42ebd4ff2526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:55.760376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-369272ad-77e3-4b82-9274-42ebd4ff2526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:55.889242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-369272ad-77e3-4b82-9274-42ebd4ff2526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:55.898035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-369272ad-77e3-4b82-9274-42ebd4ff2526 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151127 Aug 18 22:12:55.898628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1392/2775] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:55 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:55.969650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2fbb81fc-78dd-4e7a-98d6-53ab222e9c62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:55.970286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2fbb81fc-78dd-4e7a-98d6-53ab222e9c62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:55.976748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fbb81fc-78dd-4e7a-98d6-53ab222e9c62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:55.977224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fbb81fc-78dd-4e7a-98d6-53ab222e9c62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:55.977684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fbb81fc-78dd-4e7a-98d6-53ab222e9c62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:55.978394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fbb81fc-78dd-4e7a-98d6-53ab222e9c62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:55.978845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fbb81fc-78dd-4e7a-98d6-53ab222e9c62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:55.979266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fbb81fc-78dd-4e7a-98d6-53ab222e9c62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:56.047926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b653827c-04ef-481e-aa79-37293100bb78 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:56.048642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b653827c-04ef-481e-aa79-37293100bb78 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:56.054680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b653827c-04ef-481e-aa79-37293100bb78 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:56.055194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b653827c-04ef-481e-aa79-37293100bb78 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:56.055628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b653827c-04ef-481e-aa79-37293100bb78 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:56.056507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b653827c-04ef-481e-aa79-37293100bb78 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:56.056958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b653827c-04ef-481e-aa79-37293100bb78 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:56.057375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b653827c-04ef-481e-aa79-37293100bb78 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:56.115261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2fbb81fc-78dd-4e7a-98d6-53ab222e9c62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:56.123914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2fbb81fc-78dd-4e7a-98d6-53ab222e9c62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.158144 Aug 18 22:12:56.124582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1384/2776] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:55 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:56.133423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cfe549de-afb9-4a99-a6da-65ae747c87bc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:56.134200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cfe549de-afb9-4a99-a6da-65ae747c87bc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:56.140115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfe549de-afb9-4a99-a6da-65ae747c87bc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:56.141240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfe549de-afb9-4a99-a6da-65ae747c87bc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:56.141240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfe549de-afb9-4a99-a6da-65ae747c87bc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:56.141911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfe549de-afb9-4a99-a6da-65ae747c87bc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:56.142420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfe549de-afb9-4a99-a6da-65ae747c87bc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:56.142838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cfe549de-afb9-4a99-a6da-65ae747c87bc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:56.191460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b653827c-04ef-481e-aa79-37293100bb78 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:56.200623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b653827c-04ef-481e-aa79-37293100bb78 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:56.202160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b653827c-04ef-481e-aa79-37293100bb78 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:56.203330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b653827c-04ef-481e-aa79-37293100bb78 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.160100 Aug 18 22:12:56.203905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1393/2777] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:56.271170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cfe549de-afb9-4a99-a6da-65ae747c87bc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:56.273973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:12:56.281198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cfe549de-afb9-4a99-a6da-65ae747c87bc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151692 Aug 18 22:12:56.281832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1385/2778] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:56 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:56.695965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0870eb7d-a6d6-4b6f-bcc1-f7a60b53612b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:56.696584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0870eb7d-a6d6-4b6f-bcc1-f7a60b53612b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:56.702627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0870eb7d-a6d6-4b6f-bcc1-f7a60b53612b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:56.703114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0870eb7d-a6d6-4b6f-bcc1-f7a60b53612b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:56.703553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0870eb7d-a6d6-4b6f-bcc1-f7a60b53612b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:56.704246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0870eb7d-a6d6-4b6f-bcc1-f7a60b53612b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:56.704709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0870eb7d-a6d6-4b6f-bcc1-f7a60b53612b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:56.705129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0870eb7d-a6d6-4b6f-bcc1-f7a60b53612b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:56.832703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0870eb7d-a6d6-4b6f-bcc1-f7a60b53612b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:56.841076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0870eb7d-a6d6-4b6f-bcc1-f7a60b53612b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149666 Aug 18 22:12:56.841672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1394/2779] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:56 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:56.919927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e9a08545-7d69-42c6-a69b-88fbd254cf63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:56.920561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e9a08545-7d69-42c6-a69b-88fbd254cf63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:56.927263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9a08545-7d69-42c6-a69b-88fbd254cf63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:56.927744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9a08545-7d69-42c6-a69b-88fbd254cf63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:56.928179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9a08545-7d69-42c6-a69b-88fbd254cf63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:56.929480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9a08545-7d69-42c6-a69b-88fbd254cf63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:56.929950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9a08545-7d69-42c6-a69b-88fbd254cf63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:56.930373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e9a08545-7d69-42c6-a69b-88fbd254cf63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:57.059880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e9a08545-7d69-42c6-a69b-88fbd254cf63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:57.068034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e9a08545-7d69-42c6-a69b-88fbd254cf63 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152113 Aug 18 22:12:57.068606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1386/2780] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:56 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:57.145169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6a2bfbc5-0ff7-4a4b-bcd5-e8b931cf91b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:57.145817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6a2bfbc5-0ff7-4a4b-bcd5-e8b931cf91b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:57.152233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a2bfbc5-0ff7-4a4b-bcd5-e8b931cf91b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:57.152714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a2bfbc5-0ff7-4a4b-bcd5-e8b931cf91b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:57.153142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a2bfbc5-0ff7-4a4b-bcd5-e8b931cf91b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:57.153850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a2bfbc5-0ff7-4a4b-bcd5-e8b931cf91b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:57.154301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a2bfbc5-0ff7-4a4b-bcd5-e8b931cf91b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:57.154746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a2bfbc5-0ff7-4a4b-bcd5-e8b931cf91b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:57.227234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bd8137a6-7e51-4926-a2f0-f3da796bb2db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:57.227848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bd8137a6-7e51-4926-a2f0-f3da796bb2db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:57.233841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd8137a6-7e51-4926-a2f0-f3da796bb2db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:57.234553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd8137a6-7e51-4926-a2f0-f3da796bb2db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:57.234916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd8137a6-7e51-4926-a2f0-f3da796bb2db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:57.235679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd8137a6-7e51-4926-a2f0-f3da796bb2db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:57.236203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd8137a6-7e51-4926-a2f0-f3da796bb2db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:57.236697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd8137a6-7e51-4926-a2f0-f3da796bb2db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:57.281884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6a2bfbc5-0ff7-4a4b-bcd5-e8b931cf91b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:57.292462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6a2bfbc5-0ff7-4a4b-bcd5-e8b931cf91b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151090 Aug 18 22:12:57.293133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1395/2781] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:57 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:57.302206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7b5f5643-7656-4035-8e26-168e1cd81e8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:57.302825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7b5f5643-7656-4035-8e26-168e1cd81e8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:57.309420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b5f5643-7656-4035-8e26-168e1cd81e8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:57.309948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b5f5643-7656-4035-8e26-168e1cd81e8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:57.310383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b5f5643-7656-4035-8e26-168e1cd81e8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:57.311068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b5f5643-7656-4035-8e26-168e1cd81e8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:57.311515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b5f5643-7656-4035-8e26-168e1cd81e8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:57.311936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b5f5643-7656-4035-8e26-168e1cd81e8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:57.367192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bd8137a6-7e51-4926-a2f0-f3da796bb2db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:57.377198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bd8137a6-7e51-4926-a2f0-f3da796bb2db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:57.378747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bd8137a6-7e51-4926-a2f0-f3da796bb2db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:57.380034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bd8137a6-7e51-4926-a2f0-f3da796bb2db tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157152 Aug 18 22:12:57.380604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1387/2782] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:57.442706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7b5f5643-7656-4035-8e26-168e1cd81e8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:57.450896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7b5f5643-7656-4035-8e26-168e1cd81e8a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152746 Aug 18 22:12:57.451468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1396/2783] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:12:57.861904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-831e7d59-12dc-4f80-8a53-782a7cba070f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:57.862749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-831e7d59-12dc-4f80-8a53-782a7cba070f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:57.868749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-831e7d59-12dc-4f80-8a53-782a7cba070f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:57.869226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-831e7d59-12dc-4f80-8a53-782a7cba070f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:57.869680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-831e7d59-12dc-4f80-8a53-782a7cba070f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:57.870361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-831e7d59-12dc-4f80-8a53-782a7cba070f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:57.870810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-831e7d59-12dc-4f80-8a53-782a7cba070f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:57.871228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-831e7d59-12dc-4f80-8a53-782a7cba070f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:57.998693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-831e7d59-12dc-4f80-8a53-782a7cba070f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:58.006979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-831e7d59-12dc-4f80-8a53-782a7cba070f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149475 Aug 18 22:12:58.007555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1388/2784] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:57 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:58.089805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ca6ce3e4-f9ff-46ad-a520-fcbd67aaf383 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:58.090424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ca6ce3e4-f9ff-46ad-a520-fcbd67aaf383 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:58.096904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca6ce3e4-f9ff-46ad-a520-fcbd67aaf383 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:58.097396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca6ce3e4-f9ff-46ad-a520-fcbd67aaf383 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:58.097866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca6ce3e4-f9ff-46ad-a520-fcbd67aaf383 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:58.098564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca6ce3e4-f9ff-46ad-a520-fcbd67aaf383 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:58.099022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca6ce3e4-f9ff-46ad-a520-fcbd67aaf383 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:58.099451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca6ce3e4-f9ff-46ad-a520-fcbd67aaf383 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:58.228287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ca6ce3e4-f9ff-46ad-a520-fcbd67aaf383 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:58.236483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ca6ce3e4-f9ff-46ad-a520-fcbd67aaf383 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150556 Aug 18 22:12:58.237060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1397/2785] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:58 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:58.313831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fcb623dd-3a1e-4eb0-b9f4-ba7d3d2c77a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:58.314450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fcb623dd-3a1e-4eb0-b9f4-ba7d3d2c77a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:58.321282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcb623dd-3a1e-4eb0-b9f4-ba7d3d2c77a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:58.321797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcb623dd-3a1e-4eb0-b9f4-ba7d3d2c77a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:58.322281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcb623dd-3a1e-4eb0-b9f4-ba7d3d2c77a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:58.322975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcb623dd-3a1e-4eb0-b9f4-ba7d3d2c77a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:58.323587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcb623dd-3a1e-4eb0-b9f4-ba7d3d2c77a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:58.324243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fcb623dd-3a1e-4eb0-b9f4-ba7d3d2c77a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:58.402928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5f11f290-3372-40e3-aabd-4768c2ca3342 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:58.403587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5f11f290-3372-40e3-aabd-4768c2ca3342 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:58.411323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f11f290-3372-40e3-aabd-4768c2ca3342 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:58.411892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f11f290-3372-40e3-aabd-4768c2ca3342 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:58.412407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f11f290-3372-40e3-aabd-4768c2ca3342 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:58.413217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f11f290-3372-40e3-aabd-4768c2ca3342 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:58.413797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f11f290-3372-40e3-aabd-4768c2ca3342 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:58.414803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f11f290-3372-40e3-aabd-4768c2ca3342 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:58.461809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fcb623dd-3a1e-4eb0-b9f4-ba7d3d2c77a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:58.470281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fcb623dd-3a1e-4eb0-b9f4-ba7d3d2c77a3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.160275 Aug 18 22:12:58.470860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1389/2786] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:58.475237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-89243e2c-89dc-4e8e-a4fd-8c8832d99edb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:58.475843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-89243e2c-89dc-4e8e-a4fd-8c8832d99edb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:58.481873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89243e2c-89dc-4e8e-a4fd-8c8832d99edb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:58.482353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89243e2c-89dc-4e8e-a4fd-8c8832d99edb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:58.482783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89243e2c-89dc-4e8e-a4fd-8c8832d99edb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:58.483465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89243e2c-89dc-4e8e-a4fd-8c8832d99edb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:58.483916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89243e2c-89dc-4e8e-a4fd-8c8832d99edb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:58.484339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89243e2c-89dc-4e8e-a4fd-8c8832d99edb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:58.550839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5f11f290-3372-40e3-aabd-4768c2ca3342 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:58.560108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5f11f290-3372-40e3-aabd-4768c2ca3342 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:58.561619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5f11f290-3372-40e3-aabd-4768c2ca3342 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:58.562961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5f11f290-3372-40e3-aabd-4768c2ca3342 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.163794 Aug 18 22:12:58.563532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1398/2787] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:58.613218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-89243e2c-89dc-4e8e-a4fd-8c8832d99edb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:58.622427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-89243e2c-89dc-4e8e-a4fd-8c8832d99edb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150627 Aug 18 22:12:58.623000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1390/2788] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:58 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:59.028374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-301ce0b4-9863-4c9d-85ed-764dec4e760d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:59.028990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-301ce0b4-9863-4c9d-85ed-764dec4e760d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:59.035344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-301ce0b4-9863-4c9d-85ed-764dec4e760d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:59.035845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-301ce0b4-9863-4c9d-85ed-764dec4e760d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:59.036268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-301ce0b4-9863-4c9d-85ed-764dec4e760d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:59.036962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-301ce0b4-9863-4c9d-85ed-764dec4e760d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:59.037418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-301ce0b4-9863-4c9d-85ed-764dec4e760d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:59.037873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-301ce0b4-9863-4c9d-85ed-764dec4e760d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:59.164229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-301ce0b4-9863-4c9d-85ed-764dec4e760d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:59.172281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-301ce0b4-9863-4c9d-85ed-764dec4e760d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.147851 Aug 18 22:12:59.172860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1399/2789] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:59 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:59.257624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-349139f3-42e0-4779-b960-21bffeaf077d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:59.258800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-349139f3-42e0-4779-b960-21bffeaf077d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:59.265270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-349139f3-42e0-4779-b960-21bffeaf077d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:59.265830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-349139f3-42e0-4779-b960-21bffeaf077d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:59.266279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-349139f3-42e0-4779-b960-21bffeaf077d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:59.266985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-349139f3-42e0-4779-b960-21bffeaf077d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:59.267451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-349139f3-42e0-4779-b960-21bffeaf077d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:59.267883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-349139f3-42e0-4779-b960-21bffeaf077d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:59.399583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-349139f3-42e0-4779-b960-21bffeaf077d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:59.408362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-349139f3-42e0-4779-b960-21bffeaf077d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154537 Aug 18 22:12:59.408939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1391/2790] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:59 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:59.492103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-300d6e8c-68b7-4457-81fa-68bd3d447d6d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:59.493294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-300d6e8c-68b7-4457-81fa-68bd3d447d6d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:59.499284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-300d6e8c-68b7-4457-81fa-68bd3d447d6d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:59.499769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-300d6e8c-68b7-4457-81fa-68bd3d447d6d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:59.500209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-300d6e8c-68b7-4457-81fa-68bd3d447d6d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:59.500901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-300d6e8c-68b7-4457-81fa-68bd3d447d6d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:59.501359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-300d6e8c-68b7-4457-81fa-68bd3d447d6d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:59.501830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-300d6e8c-68b7-4457-81fa-68bd3d447d6d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:59.586263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-218851a3-665f-4506-adb1-43530b50a46c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:59.586876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-218851a3-665f-4506-adb1-43530b50a46c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:59.592972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-218851a3-665f-4506-adb1-43530b50a46c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:59.593476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-218851a3-665f-4506-adb1-43530b50a46c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:59.594001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-218851a3-665f-4506-adb1-43530b50a46c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:59.594763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-218851a3-665f-4506-adb1-43530b50a46c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:59.595160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-218851a3-665f-4506-adb1-43530b50a46c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:59.595593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-218851a3-665f-4506-adb1-43530b50a46c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:59.630334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-300d6e8c-68b7-4457-81fa-68bd3d447d6d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:59.639510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-300d6e8c-68b7-4457-81fa-68bd3d447d6d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151212 Aug 18 22:12:59.640098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1400/2791] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:59 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:12:59.644632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3c8d48dc-f946-4c5d-b964-c3a31bfcbdac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:12:59.645345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3c8d48dc-f946-4c5d-b964-c3a31bfcbdac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:12:59.651225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c8d48dc-f946-4c5d-b964-c3a31bfcbdac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:59.651704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c8d48dc-f946-4c5d-b964-c3a31bfcbdac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:59.652138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c8d48dc-f946-4c5d-b964-c3a31bfcbdac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:59.652825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c8d48dc-f946-4c5d-b964-c3a31bfcbdac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:12:59.653295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c8d48dc-f946-4c5d-b964-c3a31bfcbdac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:12:59.653726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c8d48dc-f946-4c5d-b964-c3a31bfcbdac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:12:59.728492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-218851a3-665f-4506-adb1-43530b50a46c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:59.744527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-218851a3-665f-4506-adb1-43530b50a46c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:59.746515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-218851a3-665f-4506-adb1-43530b50a46c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:59.747764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-218851a3-665f-4506-adb1-43530b50a46c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.165412 Aug 18 22:12:59.753654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1392/2792] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:12:59 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:12:59.793969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3c8d48dc-f946-4c5d-b964-c3a31bfcbdac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:12:59.802761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3c8d48dc-f946-4c5d-b964-c3a31bfcbdac tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.161698 Aug 18 22:12:59.803370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1401/2793] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:12:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:00.193371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c58414bc-4b30-4466-804a-49d4228b84a0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:00.194073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c58414bc-4b30-4466-804a-49d4228b84a0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:00.200050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c58414bc-4b30-4466-804a-49d4228b84a0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:00.200530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c58414bc-4b30-4466-804a-49d4228b84a0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:00.200961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c58414bc-4b30-4466-804a-49d4228b84a0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:00.201672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c58414bc-4b30-4466-804a-49d4228b84a0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:00.202122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c58414bc-4b30-4466-804a-49d4228b84a0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:00.202541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c58414bc-4b30-4466-804a-49d4228b84a0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:00.331786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c58414bc-4b30-4466-804a-49d4228b84a0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:00.342917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c58414bc-4b30-4466-804a-49d4228b84a0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153343 Aug 18 22:13:00.343508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1393/2794] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:00 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:00.429191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c773b276-fa42-4cfd-86e3-dd6fd91c025f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:00.429888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c773b276-fa42-4cfd-86e3-dd6fd91c025f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:00.436339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c773b276-fa42-4cfd-86e3-dd6fd91c025f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:00.436813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c773b276-fa42-4cfd-86e3-dd6fd91c025f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:00.437247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c773b276-fa42-4cfd-86e3-dd6fd91c025f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:00.437959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c773b276-fa42-4cfd-86e3-dd6fd91c025f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:00.438407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c773b276-fa42-4cfd-86e3-dd6fd91c025f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:00.438827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c773b276-fa42-4cfd-86e3-dd6fd91c025f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:00.564587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c773b276-fa42-4cfd-86e3-dd6fd91c025f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:00.572756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c773b276-fa42-4cfd-86e3-dd6fd91c025f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.147674 Aug 18 22:13:00.573319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1402/2795] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:00 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:00.660134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e87aecff-9c5d-40c6-8297-b9560da309d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:00.660750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e87aecff-9c5d-40c6-8297-b9560da309d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:00.666848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87aecff-9c5d-40c6-8297-b9560da309d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:00.667331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87aecff-9c5d-40c6-8297-b9560da309d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:00.667776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87aecff-9c5d-40c6-8297-b9560da309d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:00.668635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87aecff-9c5d-40c6-8297-b9560da309d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:00.669327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87aecff-9c5d-40c6-8297-b9560da309d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:00.670027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87aecff-9c5d-40c6-8297-b9560da309d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:00.772539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c96c9810-efac-4792-8f74-230c6a655021 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:00.773183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c96c9810-efac-4792-8f74-230c6a655021 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:00.779734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c96c9810-efac-4792-8f74-230c6a655021 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:00.780221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c96c9810-efac-4792-8f74-230c6a655021 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:00.780654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c96c9810-efac-4792-8f74-230c6a655021 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:00.781347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c96c9810-efac-4792-8f74-230c6a655021 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:00.781831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c96c9810-efac-4792-8f74-230c6a655021 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:00.782296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c96c9810-efac-4792-8f74-230c6a655021 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:00.817661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e87aecff-9c5d-40c6-8297-b9560da309d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:00.826427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e87aecff-9c5d-40c6-8297-b9560da309d5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.170101 Aug 18 22:13:00.827009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1394/2796] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:00 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:00.832066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1bb75e59-975a-4d7f-8f25-b1f2dcc83064 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:00.832674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1bb75e59-975a-4d7f-8f25-b1f2dcc83064 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:00.839383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bb75e59-975a-4d7f-8f25-b1f2dcc83064 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:00.839865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bb75e59-975a-4d7f-8f25-b1f2dcc83064 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:00.842079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bb75e59-975a-4d7f-8f25-b1f2dcc83064 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:00.842901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bb75e59-975a-4d7f-8f25-b1f2dcc83064 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:00.843638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bb75e59-975a-4d7f-8f25-b1f2dcc83064 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:00.844150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bb75e59-975a-4d7f-8f25-b1f2dcc83064 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:00.984019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1bb75e59-975a-4d7f-8f25-b1f2dcc83064 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:00.993176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1bb75e59-975a-4d7f-8f25-b1f2dcc83064 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.164594 Aug 18 22:13:00.993806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1395/2797] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:00 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:01.152322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c96c9810-efac-4792-8f74-230c6a655021 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:01.154581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:01.162295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c96c9810-efac-4792-8f74-230c6a655021 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:01.163796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c96c9810-efac-4792-8f74-230c6a655021 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:01.164980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c96c9810-efac-4792-8f74-230c6a655021 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.396272 Aug 18 22:13:01.165572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1403/2798] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:00 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:13:01.364181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-facb26a8-9642-43ee-8b9c-9026c67bc41f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:01.365380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-facb26a8-9642-43ee-8b9c-9026c67bc41f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:01.372674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-facb26a8-9642-43ee-8b9c-9026c67bc41f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:01.373158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-facb26a8-9642-43ee-8b9c-9026c67bc41f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:01.373607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-facb26a8-9642-43ee-8b9c-9026c67bc41f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:01.374332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-facb26a8-9642-43ee-8b9c-9026c67bc41f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:01.374822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-facb26a8-9642-43ee-8b9c-9026c67bc41f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:01.375248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-facb26a8-9642-43ee-8b9c-9026c67bc41f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:01.504845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-facb26a8-9642-43ee-8b9c-9026c67bc41f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:01.513522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-facb26a8-9642-43ee-8b9c-9026c67bc41f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153210 Aug 18 22:13:01.514130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1396/2799] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:01 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:01.594931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0ecdb4a1-4b71-44e5-aafe-f8d2b0e72df9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:01.595593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0ecdb4a1-4b71-44e5-aafe-f8d2b0e72df9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:01.601998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ecdb4a1-4b71-44e5-aafe-f8d2b0e72df9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:01.602470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ecdb4a1-4b71-44e5-aafe-f8d2b0e72df9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:01.602900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ecdb4a1-4b71-44e5-aafe-f8d2b0e72df9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:01.603578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ecdb4a1-4b71-44e5-aafe-f8d2b0e72df9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:01.604031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ecdb4a1-4b71-44e5-aafe-f8d2b0e72df9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:01.604446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ecdb4a1-4b71-44e5-aafe-f8d2b0e72df9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:01.729693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0ecdb4a1-4b71-44e5-aafe-f8d2b0e72df9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:01.737888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0ecdb4a1-4b71-44e5-aafe-f8d2b0e72df9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.146919 Aug 18 22:13:01.738469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1404/2800] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:01 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:01.848616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5332128f-6a24-4b9e-80dd-4827a1bd838e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:01.849264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5332128f-6a24-4b9e-80dd-4827a1bd838e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:01.851198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:01.856946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5332128f-6a24-4b9e-80dd-4827a1bd838e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:01.857438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5332128f-6a24-4b9e-80dd-4827a1bd838e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:01.857916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5332128f-6a24-4b9e-80dd-4827a1bd838e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:01.858608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5332128f-6a24-4b9e-80dd-4827a1bd838e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:01.859088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5332128f-6a24-4b9e-80dd-4827a1bd838e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:01.859538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5332128f-6a24-4b9e-80dd-4827a1bd838e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:01.988265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5332128f-6a24-4b9e-80dd-4827a1bd838e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:01.997036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5332128f-6a24-4b9e-80dd-4827a1bd838e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152413 Aug 18 22:13:01.997622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1397/2801] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:01 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:02.014962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-23bf8de3-4360-4078-a91f-0f50689d61bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:02.015624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-23bf8de3-4360-4078-a91f-0f50689d61bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:02.021547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23bf8de3-4360-4078-a91f-0f50689d61bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:02.022072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23bf8de3-4360-4078-a91f-0f50689d61bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:02.022514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23bf8de3-4360-4078-a91f-0f50689d61bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:02.023243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23bf8de3-4360-4078-a91f-0f50689d61bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:02.023754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23bf8de3-4360-4078-a91f-0f50689d61bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:02.024188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23bf8de3-4360-4078-a91f-0f50689d61bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:02.151919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-23bf8de3-4360-4078-a91f-0f50689d61bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:02.160106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-23bf8de3-4360-4078-a91f-0f50689d61bb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148993 Aug 18 22:13:02.160688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1405/2802] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:02 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:02.188516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8a27dfde-bdcd-473d-996f-0cddd591970b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:02.189103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8a27dfde-bdcd-473d-996f-0cddd591970b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:02.195076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a27dfde-bdcd-473d-996f-0cddd591970b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:02.195651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a27dfde-bdcd-473d-996f-0cddd591970b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:02.196126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a27dfde-bdcd-473d-996f-0cddd591970b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:02.196816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a27dfde-bdcd-473d-996f-0cddd591970b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:02.197275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a27dfde-bdcd-473d-996f-0cddd591970b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:02.197760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a27dfde-bdcd-473d-996f-0cddd591970b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:02.329455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8a27dfde-bdcd-473d-996f-0cddd591970b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:02.338704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8a27dfde-bdcd-473d-996f-0cddd591970b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:02.340202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8a27dfde-bdcd-473d-996f-0cddd591970b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:02.341361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8a27dfde-bdcd-473d-996f-0cddd591970b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156880 Aug 18 22:13:02.341957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1398/2803] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:02.535419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0c087749-8fd6-4b79-9525-bafb99fe46ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:02.536048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0c087749-8fd6-4b79-9525-bafb99fe46ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:02.542146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c087749-8fd6-4b79-9525-bafb99fe46ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:02.542631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c087749-8fd6-4b79-9525-bafb99fe46ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:02.543097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c087749-8fd6-4b79-9525-bafb99fe46ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:02.543794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c087749-8fd6-4b79-9525-bafb99fe46ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:02.544252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c087749-8fd6-4b79-9525-bafb99fe46ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:02.544683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c087749-8fd6-4b79-9525-bafb99fe46ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:02.670804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0c087749-8fd6-4b79-9525-bafb99fe46ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:02.679297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0c087749-8fd6-4b79-9525-bafb99fe46ba tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148121 Aug 18 22:13:02.680395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1406/2804] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:02 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:02.760497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-110b38a1-8328-4fcf-9709-21463daedae9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:02.761035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-110b38a1-8328-4fcf-9709-21463daedae9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:02.767941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-110b38a1-8328-4fcf-9709-21463daedae9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:02.768433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-110b38a1-8328-4fcf-9709-21463daedae9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:02.768879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-110b38a1-8328-4fcf-9709-21463daedae9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:02.769576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-110b38a1-8328-4fcf-9709-21463daedae9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:02.770062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-110b38a1-8328-4fcf-9709-21463daedae9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:02.770495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-110b38a1-8328-4fcf-9709-21463daedae9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:02.898916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-110b38a1-8328-4fcf-9709-21463daedae9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:02.907680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-110b38a1-8328-4fcf-9709-21463daedae9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151851 Aug 18 22:13:02.908727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1399/2805] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:02 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:03.018775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-40b68c82-6e20-4638-8b45-c2d4fc523df1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:03.019306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-40b68c82-6e20-4638-8b45-c2d4fc523df1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:03.025233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40b68c82-6e20-4638-8b45-c2d4fc523df1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:03.025748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40b68c82-6e20-4638-8b45-c2d4fc523df1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:03.026183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40b68c82-6e20-4638-8b45-c2d4fc523df1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:03.026863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40b68c82-6e20-4638-8b45-c2d4fc523df1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:03.027313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40b68c82-6e20-4638-8b45-c2d4fc523df1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:03.027740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40b68c82-6e20-4638-8b45-c2d4fc523df1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:03.153175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-40b68c82-6e20-4638-8b45-c2d4fc523df1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:03.161283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-40b68c82-6e20-4638-8b45-c2d4fc523df1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.146431 Aug 18 22:13:03.161883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1407/2806] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:03 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:03.182134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-41eb4b3a-c130-42a0-a2ce-efb46aeda950 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:03.182754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-41eb4b3a-c130-42a0-a2ce-efb46aeda950 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:03.188949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41eb4b3a-c130-42a0-a2ce-efb46aeda950 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:03.189432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41eb4b3a-c130-42a0-a2ce-efb46aeda950 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:03.189927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41eb4b3a-c130-42a0-a2ce-efb46aeda950 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:03.190620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41eb4b3a-c130-42a0-a2ce-efb46aeda950 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:03.191075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41eb4b3a-c130-42a0-a2ce-efb46aeda950 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:03.191503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41eb4b3a-c130-42a0-a2ce-efb46aeda950 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:03.318102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-41eb4b3a-c130-42a0-a2ce-efb46aeda950 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:03.327043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-41eb4b3a-c130-42a0-a2ce-efb46aeda950 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148984 Aug 18 22:13:03.327949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1400/2807] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:03 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:03.363190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4a0138b8-5302-43d9-b656-d8852acb61d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:03.363807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4a0138b8-5302-43d9-b656-d8852acb61d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:03.369828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a0138b8-5302-43d9-b656-d8852acb61d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:03.370313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a0138b8-5302-43d9-b656-d8852acb61d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:03.370752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a0138b8-5302-43d9-b656-d8852acb61d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:03.371445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a0138b8-5302-43d9-b656-d8852acb61d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:03.371901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a0138b8-5302-43d9-b656-d8852acb61d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:03.372328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4a0138b8-5302-43d9-b656-d8852acb61d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:03.503433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4a0138b8-5302-43d9-b656-d8852acb61d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:03.511998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4a0138b8-5302-43d9-b656-d8852acb61d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:03.513501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4a0138b8-5302-43d9-b656-d8852acb61d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:03.514680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4a0138b8-5302-43d9-b656-d8852acb61d5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155369 Aug 18 22:13:03.515238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1408/2808] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:03.700845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4d293941-3ccd-49ef-8d7a-064bbd94d2d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:03.701386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4d293941-3ccd-49ef-8d7a-064bbd94d2d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:03.707373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d293941-3ccd-49ef-8d7a-064bbd94d2d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:03.707858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d293941-3ccd-49ef-8d7a-064bbd94d2d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:03.708293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d293941-3ccd-49ef-8d7a-064bbd94d2d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:03.708976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d293941-3ccd-49ef-8d7a-064bbd94d2d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:03.709430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d293941-3ccd-49ef-8d7a-064bbd94d2d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:03.709882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4d293941-3ccd-49ef-8d7a-064bbd94d2d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:03.843382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4d293941-3ccd-49ef-8d7a-064bbd94d2d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:03.851750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4d293941-3ccd-49ef-8d7a-064bbd94d2d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154808 Aug 18 22:13:03.852321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1401/2809] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:03 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:03.930833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b90c281c-c33d-4297-9aea-44cee6f34491 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:03.931452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b90c281c-c33d-4297-9aea-44cee6f34491 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:03.937927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b90c281c-c33d-4297-9aea-44cee6f34491 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:03.938411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b90c281c-c33d-4297-9aea-44cee6f34491 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:03.938852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b90c281c-c33d-4297-9aea-44cee6f34491 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:03.939542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b90c281c-c33d-4297-9aea-44cee6f34491 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:03.939997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b90c281c-c33d-4297-9aea-44cee6f34491 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:03.940422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b90c281c-c33d-4297-9aea-44cee6f34491 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:04.069476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b90c281c-c33d-4297-9aea-44cee6f34491 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:04.078933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b90c281c-c33d-4297-9aea-44cee6f34491 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152115 Aug 18 22:13:04.079512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1409/2810] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:03 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:04.183331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a35cc377-1536-41e2-80ef-fbe9dd19fa5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:04.183955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a35cc377-1536-41e2-80ef-fbe9dd19fa5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:04.190055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a35cc377-1536-41e2-80ef-fbe9dd19fa5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:04.190570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a35cc377-1536-41e2-80ef-fbe9dd19fa5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:04.191013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a35cc377-1536-41e2-80ef-fbe9dd19fa5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:04.191714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a35cc377-1536-41e2-80ef-fbe9dd19fa5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:04.192176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a35cc377-1536-41e2-80ef-fbe9dd19fa5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:04.192608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a35cc377-1536-41e2-80ef-fbe9dd19fa5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:04.207917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:04.319838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a35cc377-1536-41e2-80ef-fbe9dd19fa5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:04.328638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a35cc377-1536-41e2-80ef-fbe9dd19fa5e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149746 Aug 18 22:13:04.329216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1402/2811] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:04 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:04.348083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2f707412-7aeb-45c7-a419-11055c062e4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:04.348708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2f707412-7aeb-45c7-a419-11055c062e4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:04.355190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f707412-7aeb-45c7-a419-11055c062e4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:04.355682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f707412-7aeb-45c7-a419-11055c062e4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:04.356114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f707412-7aeb-45c7-a419-11055c062e4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:04.356805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f707412-7aeb-45c7-a419-11055c062e4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:04.357260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f707412-7aeb-45c7-a419-11055c062e4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:04.357719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f707412-7aeb-45c7-a419-11055c062e4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:04.487064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2f707412-7aeb-45c7-a419-11055c062e4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:04.495817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2f707412-7aeb-45c7-a419-11055c062e4f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151512 Aug 18 22:13:04.496390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1410/2812] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:04.538372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ce9bdd34-b24d-441a-8c6e-9df36c94cb9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:04.539652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ce9bdd34-b24d-441a-8c6e-9df36c94cb9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:04.545515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce9bdd34-b24d-441a-8c6e-9df36c94cb9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:04.546034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce9bdd34-b24d-441a-8c6e-9df36c94cb9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:04.546497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce9bdd34-b24d-441a-8c6e-9df36c94cb9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:04.547151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce9bdd34-b24d-441a-8c6e-9df36c94cb9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:04.547604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce9bdd34-b24d-441a-8c6e-9df36c94cb9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:04.548035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce9bdd34-b24d-441a-8c6e-9df36c94cb9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:04.681586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ce9bdd34-b24d-441a-8c6e-9df36c94cb9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:04.690797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ce9bdd34-b24d-441a-8c6e-9df36c94cb9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:04.692337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ce9bdd34-b24d-441a-8c6e-9df36c94cb9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:04.693545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ce9bdd34-b24d-441a-8c6e-9df36c94cb9e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159115 Aug 18 22:13:04.694152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1403/2813] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:04.872705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f5554da0-d4f6-451e-be56-121e5e14eb24 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:04.873249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f5554da0-d4f6-451e-be56-121e5e14eb24 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:04.879158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5554da0-d4f6-451e-be56-121e5e14eb24 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:04.879636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5554da0-d4f6-451e-be56-121e5e14eb24 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:04.880071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5554da0-d4f6-451e-be56-121e5e14eb24 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:04.880752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5554da0-d4f6-451e-be56-121e5e14eb24 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:04.881236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5554da0-d4f6-451e-be56-121e5e14eb24 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:04.881709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5554da0-d4f6-451e-be56-121e5e14eb24 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:05.011558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f5554da0-d4f6-451e-be56-121e5e14eb24 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:05.019788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f5554da0-d4f6-451e-be56-121e5e14eb24 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150994 Aug 18 22:13:05.020371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1411/2814] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:04 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:05.100512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a64dcb07-1b91-4752-b778-9b82f38463dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:05.101058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a64dcb07-1b91-4752-b778-9b82f38463dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:05.108313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a64dcb07-1b91-4752-b778-9b82f38463dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:05.108797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a64dcb07-1b91-4752-b778-9b82f38463dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:05.109236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a64dcb07-1b91-4752-b778-9b82f38463dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:05.110032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a64dcb07-1b91-4752-b778-9b82f38463dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:05.110490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a64dcb07-1b91-4752-b778-9b82f38463dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:05.110919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a64dcb07-1b91-4752-b778-9b82f38463dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:05.236829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a64dcb07-1b91-4752-b778-9b82f38463dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:05.244968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a64dcb07-1b91-4752-b778-9b82f38463dc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148434 Aug 18 22:13:05.245552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1404/2815] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:05 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:05.349918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ea74310b-52e8-439a-98fb-564e9666d2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:05.350538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ea74310b-52e8-439a-98fb-564e9666d2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:05.356462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea74310b-52e8-439a-98fb-564e9666d2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:05.356943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea74310b-52e8-439a-98fb-564e9666d2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:05.357384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea74310b-52e8-439a-98fb-564e9666d2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:05.358097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea74310b-52e8-439a-98fb-564e9666d2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:05.358550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea74310b-52e8-439a-98fb-564e9666d2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:05.359268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea74310b-52e8-439a-98fb-564e9666d2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:05.485106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ea74310b-52e8-439a-98fb-564e9666d2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:05.493789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea74310b-52e8-439a-98fb-564e9666d2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.147776 Aug 18 22:13:05.494357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1412/2816] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:05 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:05.516196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f35ac539-73b4-48b2-860e-7a5c29170d13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:05.516806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f35ac539-73b4-48b2-860e-7a5c29170d13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:05.522681 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f35ac539-73b4-48b2-860e-7a5c29170d13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:05.523158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f35ac539-73b4-48b2-860e-7a5c29170d13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:05.523622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f35ac539-73b4-48b2-860e-7a5c29170d13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:05.524299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f35ac539-73b4-48b2-860e-7a5c29170d13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:05.524749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f35ac539-73b4-48b2-860e-7a5c29170d13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:05.525170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f35ac539-73b4-48b2-860e-7a5c29170d13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:05.651244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f35ac539-73b4-48b2-860e-7a5c29170d13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:05.659603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f35ac539-73b4-48b2-860e-7a5c29170d13 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147346 Aug 18 22:13:05.660180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1405/2817] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:05 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:05.716320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2d4a534a-d94d-4e2e-ab67-933f238417d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:05.716937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2d4a534a-d94d-4e2e-ab67-933f238417d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:05.723019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d4a534a-d94d-4e2e-ab67-933f238417d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:05.723500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d4a534a-d94d-4e2e-ab67-933f238417d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:05.723934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d4a534a-d94d-4e2e-ab67-933f238417d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:05.724623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d4a534a-d94d-4e2e-ab67-933f238417d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:05.725073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d4a534a-d94d-4e2e-ab67-933f238417d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:05.725496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d4a534a-d94d-4e2e-ab67-933f238417d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:05.854578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2d4a534a-d94d-4e2e-ab67-933f238417d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:05.863245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2d4a534a-d94d-4e2e-ab67-933f238417d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:05.864765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2d4a534a-d94d-4e2e-ab67-933f238417d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:05.865946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2d4a534a-d94d-4e2e-ab67-933f238417d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153610 Aug 18 22:13:05.866520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1413/2818] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:06.045635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-36a50022-00c4-4271-be2a-7ba8bbeb304f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:06.046256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-36a50022-00c4-4271-be2a-7ba8bbeb304f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:06.052791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36a50022-00c4-4271-be2a-7ba8bbeb304f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:06.053327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36a50022-00c4-4271-be2a-7ba8bbeb304f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:06.053741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36a50022-00c4-4271-be2a-7ba8bbeb304f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:06.054438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36a50022-00c4-4271-be2a-7ba8bbeb304f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:06.055529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36a50022-00c4-4271-be2a-7ba8bbeb304f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:06.055961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36a50022-00c4-4271-be2a-7ba8bbeb304f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:06.184959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-36a50022-00c4-4271-be2a-7ba8bbeb304f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:06.193042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-36a50022-00c4-4271-be2a-7ba8bbeb304f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151355 Aug 18 22:13:06.193635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1406/2819] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:06 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:06.265854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-540962ca-a2c6-4fad-83d1-fab714b11979 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:06.266532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-540962ca-a2c6-4fad-83d1-fab714b11979 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:06.268842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:06.274757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-540962ca-a2c6-4fad-83d1-fab714b11979 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:06.275239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-540962ca-a2c6-4fad-83d1-fab714b11979 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:06.275703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-540962ca-a2c6-4fad-83d1-fab714b11979 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:06.276399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-540962ca-a2c6-4fad-83d1-fab714b11979 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:06.276851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-540962ca-a2c6-4fad-83d1-fab714b11979 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:06.277275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-540962ca-a2c6-4fad-83d1-fab714b11979 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:06.404824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-540962ca-a2c6-4fad-83d1-fab714b11979 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:06.412922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-540962ca-a2c6-4fad-83d1-fab714b11979 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151040 Aug 18 22:13:06.413487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1414/2820] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:06 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:06.514877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a4bd0b6f-0626-4bfc-8986-cece9a2718a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:06.515561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a4bd0b6f-0626-4bfc-8986-cece9a2718a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:06.521440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4bd0b6f-0626-4bfc-8986-cece9a2718a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:06.521960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4bd0b6f-0626-4bfc-8986-cece9a2718a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:06.522398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4bd0b6f-0626-4bfc-8986-cece9a2718a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:06.523082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4bd0b6f-0626-4bfc-8986-cece9a2718a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:06.524028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4bd0b6f-0626-4bfc-8986-cece9a2718a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:06.524455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4bd0b6f-0626-4bfc-8986-cece9a2718a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:06.653421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a4bd0b6f-0626-4bfc-8986-cece9a2718a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:06.661680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a4bd0b6f-0626-4bfc-8986-cece9a2718a1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150655 Aug 18 22:13:06.662523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1407/2821] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:06 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:06.680674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-20000cda-fcbc-41df-8bdc-4217af404fe6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:06.681298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-20000cda-fcbc-41df-8bdc-4217af404fe6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:06.687288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20000cda-fcbc-41df-8bdc-4217af404fe6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:06.687779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20000cda-fcbc-41df-8bdc-4217af404fe6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:06.688226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20000cda-fcbc-41df-8bdc-4217af404fe6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:06.688926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20000cda-fcbc-41df-8bdc-4217af404fe6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:06.689388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20000cda-fcbc-41df-8bdc-4217af404fe6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:06.689843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20000cda-fcbc-41df-8bdc-4217af404fe6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:06.828621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-20000cda-fcbc-41df-8bdc-4217af404fe6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:06.837508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-20000cda-fcbc-41df-8bdc-4217af404fe6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.160781 Aug 18 22:13:06.838122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1415/2822] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:06 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:06.889936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-186413ed-c21e-4ac9-892b-494890c0e048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:06.890761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-186413ed-c21e-4ac9-892b-494890c0e048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:06.896437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-186413ed-c21e-4ac9-892b-494890c0e048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:06.896922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-186413ed-c21e-4ac9-892b-494890c0e048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:06.897364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-186413ed-c21e-4ac9-892b-494890c0e048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:06.898082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-186413ed-c21e-4ac9-892b-494890c0e048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:06.899189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-186413ed-c21e-4ac9-892b-494890c0e048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:06.899657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-186413ed-c21e-4ac9-892b-494890c0e048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:07.034607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-186413ed-c21e-4ac9-892b-494890c0e048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:07.043792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-186413ed-c21e-4ac9-892b-494890c0e048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:07.045289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-186413ed-c21e-4ac9-892b-494890c0e048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:07.046472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-186413ed-c21e-4ac9-892b-494890c0e048 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.160643 Aug 18 22:13:07.047111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1408/2823] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:06 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:07.214252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c7390fe3-df4d-41ff-bd88-68b435251d5e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:07.214800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c7390fe3-df4d-41ff-bd88-68b435251d5e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:07.220709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7390fe3-df4d-41ff-bd88-68b435251d5e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:07.221182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7390fe3-df4d-41ff-bd88-68b435251d5e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:07.221632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7390fe3-df4d-41ff-bd88-68b435251d5e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:07.222378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7390fe3-df4d-41ff-bd88-68b435251d5e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:07.222824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7390fe3-df4d-41ff-bd88-68b435251d5e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:07.223247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7390fe3-df4d-41ff-bd88-68b435251d5e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:07.349265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c7390fe3-df4d-41ff-bd88-68b435251d5e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:07.358723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c7390fe3-df4d-41ff-bd88-68b435251d5e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148844 Aug 18 22:13:07.359321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1416/2824] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:07 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:07.434710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8de603d3-3646-428b-8cb7-70a2ee2bfa8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:07.435322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8de603d3-3646-428b-8cb7-70a2ee2bfa8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:07.441702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8de603d3-3646-428b-8cb7-70a2ee2bfa8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:07.442182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8de603d3-3646-428b-8cb7-70a2ee2bfa8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:07.442613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8de603d3-3646-428b-8cb7-70a2ee2bfa8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:07.443291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8de603d3-3646-428b-8cb7-70a2ee2bfa8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:07.443739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8de603d3-3646-428b-8cb7-70a2ee2bfa8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:07.444160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8de603d3-3646-428b-8cb7-70a2ee2bfa8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:07.572711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8de603d3-3646-428b-8cb7-70a2ee2bfa8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:07.581078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8de603d3-3646-428b-8cb7-70a2ee2bfa8b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150204 Aug 18 22:13:07.581676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1409/2825] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:07 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:07.683244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0c519093-fd36-44be-9468-c2799ec16561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:07.683873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0c519093-fd36-44be-9468-c2799ec16561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:07.690187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c519093-fd36-44be-9468-c2799ec16561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:07.690685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c519093-fd36-44be-9468-c2799ec16561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:07.691131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c519093-fd36-44be-9468-c2799ec16561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:07.691842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c519093-fd36-44be-9468-c2799ec16561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:07.692302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c519093-fd36-44be-9468-c2799ec16561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:07.692730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c519093-fd36-44be-9468-c2799ec16561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:07.827901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0c519093-fd36-44be-9468-c2799ec16561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:07.835961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0c519093-fd36-44be-9468-c2799ec16561 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156665 Aug 18 22:13:07.836532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1417/2826] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:07 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:07.858217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e6c3008d-3963-4c10-92a5-0d16dfd3399f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:07.858843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e6c3008d-3963-4c10-92a5-0d16dfd3399f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:07.864764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e6c3008d-3963-4c10-92a5-0d16dfd3399f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:07.865249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e6c3008d-3963-4c10-92a5-0d16dfd3399f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:07.865718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e6c3008d-3963-4c10-92a5-0d16dfd3399f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:07.866411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e6c3008d-3963-4c10-92a5-0d16dfd3399f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:07.866872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e6c3008d-3963-4c10-92a5-0d16dfd3399f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:07.867839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e6c3008d-3963-4c10-92a5-0d16dfd3399f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:07.998586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e6c3008d-3963-4c10-92a5-0d16dfd3399f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:08.006733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e6c3008d-3963-4c10-92a5-0d16dfd3399f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152346 Aug 18 22:13:08.007303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1410/2827] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:08.068398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-457a25a4-cfb8-412d-8977-442ea894c8c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:08.068919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-457a25a4-cfb8-412d-8977-442ea894c8c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:08.075475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-457a25a4-cfb8-412d-8977-442ea894c8c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:08.075948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-457a25a4-cfb8-412d-8977-442ea894c8c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:08.076382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-457a25a4-cfb8-412d-8977-442ea894c8c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:08.077060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-457a25a4-cfb8-412d-8977-442ea894c8c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:08.077507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-457a25a4-cfb8-412d-8977-442ea894c8c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:08.077951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-457a25a4-cfb8-412d-8977-442ea894c8c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:08.203638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-457a25a4-cfb8-412d-8977-442ea894c8c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:08.212386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-457a25a4-cfb8-412d-8977-442ea894c8c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:08.213927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-457a25a4-cfb8-412d-8977-442ea894c8c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:08.215084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-457a25a4-cfb8-412d-8977-442ea894c8c7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150727 Aug 18 22:13:08.215682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1418/2828] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:08.380138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4678c5d9-34e6-4c41-ac60-ef80cac7e79a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:08.380709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4678c5d9-34e6-4c41-ac60-ef80cac7e79a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:08.386698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4678c5d9-34e6-4c41-ac60-ef80cac7e79a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:08.387180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4678c5d9-34e6-4c41-ac60-ef80cac7e79a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:08.387618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4678c5d9-34e6-4c41-ac60-ef80cac7e79a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:08.388303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4678c5d9-34e6-4c41-ac60-ef80cac7e79a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:08.388757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4678c5d9-34e6-4c41-ac60-ef80cac7e79a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:08.389183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4678c5d9-34e6-4c41-ac60-ef80cac7e79a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:08.516420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4678c5d9-34e6-4c41-ac60-ef80cac7e79a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:08.525278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4678c5d9-34e6-4c41-ac60-ef80cac7e79a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149074 Aug 18 22:13:08.525873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1411/2829] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:08 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:08.603408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0325d071-2993-450b-965e-38fcce4aec4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:08.604022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0325d071-2993-450b-965e-38fcce4aec4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:08.610454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0325d071-2993-450b-965e-38fcce4aec4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:08.610932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0325d071-2993-450b-965e-38fcce4aec4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:08.611375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0325d071-2993-450b-965e-38fcce4aec4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:08.612060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0325d071-2993-450b-965e-38fcce4aec4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:08.612512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0325d071-2993-450b-965e-38fcce4aec4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:08.612937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0325d071-2993-450b-965e-38fcce4aec4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:08.740691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0325d071-2993-450b-965e-38fcce4aec4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:08.748961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0325d071-2993-450b-965e-38fcce4aec4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150071 Aug 18 22:13:08.749541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1419/2830] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:08 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:08.857853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cbfa942f-f933-493d-8b7d-9eb3853ae088 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:08.858470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cbfa942f-f933-493d-8b7d-9eb3853ae088 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:08.864345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbfa942f-f933-493d-8b7d-9eb3853ae088 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:08.864834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbfa942f-f933-493d-8b7d-9eb3853ae088 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:08.865272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbfa942f-f933-493d-8b7d-9eb3853ae088 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:08.865989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbfa942f-f933-493d-8b7d-9eb3853ae088 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:08.866446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbfa942f-f933-493d-8b7d-9eb3853ae088 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:08.866875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbfa942f-f933-493d-8b7d-9eb3853ae088 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:08.993172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cbfa942f-f933-493d-8b7d-9eb3853ae088 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:09.001453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cbfa942f-f933-493d-8b7d-9eb3853ae088 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.147490 Aug 18 22:13:09.002067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1412/2831] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:08 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:09.028791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d47910de-1b74-44cf-afec-7b22f9b9b917 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:09.029436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d47910de-1b74-44cf-afec-7b22f9b9b917 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:09.035392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d47910de-1b74-44cf-afec-7b22f9b9b917 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:09.035872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d47910de-1b74-44cf-afec-7b22f9b9b917 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:09.036308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d47910de-1b74-44cf-afec-7b22f9b9b917 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:09.036993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d47910de-1b74-44cf-afec-7b22f9b9b917 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:09.037445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d47910de-1b74-44cf-afec-7b22f9b9b917 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:09.037900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d47910de-1b74-44cf-afec-7b22f9b9b917 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:09.053445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:09.168568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d47910de-1b74-44cf-afec-7b22f9b9b917 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:09.177067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d47910de-1b74-44cf-afec-7b22f9b9b917 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152801 Aug 18 22:13:09.177665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1420/2832] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:09 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:09.239035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5fc8f790-60bc-4bcd-bb56-ba51cf920e90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:09.239565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5fc8f790-60bc-4bcd-bb56-ba51cf920e90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:09.246104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc8f790-60bc-4bcd-bb56-ba51cf920e90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:09.246594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc8f790-60bc-4bcd-bb56-ba51cf920e90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:09.247036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc8f790-60bc-4bcd-bb56-ba51cf920e90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:09.247731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc8f790-60bc-4bcd-bb56-ba51cf920e90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:09.248196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc8f790-60bc-4bcd-bb56-ba51cf920e90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:09.248625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc8f790-60bc-4bcd-bb56-ba51cf920e90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:09.381169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5fc8f790-60bc-4bcd-bb56-ba51cf920e90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:09.390793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5fc8f790-60bc-4bcd-bb56-ba51cf920e90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:09.392296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5fc8f790-60bc-4bcd-bb56-ba51cf920e90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:09.393467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5fc8f790-60bc-4bcd-bb56-ba51cf920e90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.158431 Aug 18 22:13:09.394076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1413/2833] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:09.546139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f28dbb82-1b68-493c-ad93-597dc6d44a99 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:09.546755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f28dbb82-1b68-493c-ad93-597dc6d44a99 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:09.553002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f28dbb82-1b68-493c-ad93-597dc6d44a99 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:09.553680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f28dbb82-1b68-493c-ad93-597dc6d44a99 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:09.554120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f28dbb82-1b68-493c-ad93-597dc6d44a99 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:09.554804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f28dbb82-1b68-493c-ad93-597dc6d44a99 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:09.555256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f28dbb82-1b68-493c-ad93-597dc6d44a99 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:09.556172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f28dbb82-1b68-493c-ad93-597dc6d44a99 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:09.683252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f28dbb82-1b68-493c-ad93-597dc6d44a99 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:09.691385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f28dbb82-1b68-493c-ad93-597dc6d44a99 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149080 Aug 18 22:13:09.691971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1421/2834] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:09 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:09.770976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-15ce4d27-bfb7-4af1-bb46-784aff65a350 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:09.771598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-15ce4d27-bfb7-4af1-bb46-784aff65a350 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:09.777984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15ce4d27-bfb7-4af1-bb46-784aff65a350 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:09.778459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15ce4d27-bfb7-4af1-bb46-784aff65a350 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:09.778889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15ce4d27-bfb7-4af1-bb46-784aff65a350 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:09.779587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15ce4d27-bfb7-4af1-bb46-784aff65a350 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:09.780018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15ce4d27-bfb7-4af1-bb46-784aff65a350 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:09.780435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15ce4d27-bfb7-4af1-bb46-784aff65a350 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:09.912335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-15ce4d27-bfb7-4af1-bb46-784aff65a350 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:09.921126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-15ce4d27-bfb7-4af1-bb46-784aff65a350 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154388 Aug 18 22:13:09.921772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1414/2835] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:09 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:10.022680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3b3172db-a3d9-4079-a81f-a8aed7537e6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:10.023334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3b3172db-a3d9-4079-a81f-a8aed7537e6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:10.029935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b3172db-a3d9-4079-a81f-a8aed7537e6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:10.030421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b3172db-a3d9-4079-a81f-a8aed7537e6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:10.030955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b3172db-a3d9-4079-a81f-a8aed7537e6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:10.031742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b3172db-a3d9-4079-a81f-a8aed7537e6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:10.032204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b3172db-a3d9-4079-a81f-a8aed7537e6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:10.032637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b3172db-a3d9-4079-a81f-a8aed7537e6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:10.162337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3b3172db-a3d9-4079-a81f-a8aed7537e6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:10.171586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3b3172db-a3d9-4079-a81f-a8aed7537e6c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152637 Aug 18 22:13:10.172294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1422/2836] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:10 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:10.197837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bf805d7c-f816-4bab-9d23-8a7151a311da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:10.198460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bf805d7c-f816-4bab-9d23-8a7151a311da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:10.205138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf805d7c-f816-4bab-9d23-8a7151a311da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:10.205686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf805d7c-f816-4bab-9d23-8a7151a311da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:10.206130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf805d7c-f816-4bab-9d23-8a7151a311da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:10.206828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf805d7c-f816-4bab-9d23-8a7151a311da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:10.207286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf805d7c-f816-4bab-9d23-8a7151a311da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:10.207902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf805d7c-f816-4bab-9d23-8a7151a311da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:10.343011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bf805d7c-f816-4bab-9d23-8a7151a311da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:10.351482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bf805d7c-f816-4bab-9d23-8a7151a311da tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.157535 Aug 18 22:13:10.352051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1415/2837] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:10 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:10.415900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-89add822-2fde-4120-b5fc-b9c563ddd4fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:10.416435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-89add822-2fde-4120-b5fc-b9c563ddd4fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:10.422420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89add822-2fde-4120-b5fc-b9c563ddd4fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:10.422895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89add822-2fde-4120-b5fc-b9c563ddd4fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:10.423326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89add822-2fde-4120-b5fc-b9c563ddd4fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:10.424007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89add822-2fde-4120-b5fc-b9c563ddd4fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:10.424452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89add822-2fde-4120-b5fc-b9c563ddd4fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:10.424870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89add822-2fde-4120-b5fc-b9c563ddd4fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:10.550843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-89add822-2fde-4120-b5fc-b9c563ddd4fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:10.559314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-89add822-2fde-4120-b5fc-b9c563ddd4fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:10.560803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-89add822-2fde-4120-b5fc-b9c563ddd4fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:10.562000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-89add822-2fde-4120-b5fc-b9c563ddd4fd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150131 Aug 18 22:13:10.562558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1423/2838] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:10.713057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7706041d-65f6-4dd2-93ad-18b2bb16f47a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:10.713633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7706041d-65f6-4dd2-93ad-18b2bb16f47a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:10.720304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7706041d-65f6-4dd2-93ad-18b2bb16f47a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:10.720795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7706041d-65f6-4dd2-93ad-18b2bb16f47a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:10.721236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7706041d-65f6-4dd2-93ad-18b2bb16f47a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:10.721988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7706041d-65f6-4dd2-93ad-18b2bb16f47a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:10.722447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7706041d-65f6-4dd2-93ad-18b2bb16f47a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:10.722879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7706041d-65f6-4dd2-93ad-18b2bb16f47a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:10.847613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7706041d-65f6-4dd2-93ad-18b2bb16f47a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:10.858829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7706041d-65f6-4dd2-93ad-18b2bb16f47a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149927 Aug 18 22:13:10.859956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1416/2839] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:10 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:10.943854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-53c2bf5c-099b-4dc9-a01b-14c6fd7b0a06 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:10.944548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-53c2bf5c-099b-4dc9-a01b-14c6fd7b0a06 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:10.950844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53c2bf5c-099b-4dc9-a01b-14c6fd7b0a06 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:10.951327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53c2bf5c-099b-4dc9-a01b-14c6fd7b0a06 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:10.951765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53c2bf5c-099b-4dc9-a01b-14c6fd7b0a06 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:10.952454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53c2bf5c-099b-4dc9-a01b-14c6fd7b0a06 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:10.952909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53c2bf5c-099b-4dc9-a01b-14c6fd7b0a06 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:10.953341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-53c2bf5c-099b-4dc9-a01b-14c6fd7b0a06 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:11.079418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-53c2bf5c-099b-4dc9-a01b-14c6fd7b0a06 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:11.087996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-53c2bf5c-099b-4dc9-a01b-14c6fd7b0a06 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148347 Aug 18 22:13:11.088564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1424/2840] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:10 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:11.193424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-424d35e6-db41-4d77-8375-9470abd972fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:11.194088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-424d35e6-db41-4d77-8375-9470abd972fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:11.200591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-424d35e6-db41-4d77-8375-9470abd972fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:11.201075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-424d35e6-db41-4d77-8375-9470abd972fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:11.201516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-424d35e6-db41-4d77-8375-9470abd972fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:11.202231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-424d35e6-db41-4d77-8375-9470abd972fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:11.202784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-424d35e6-db41-4d77-8375-9470abd972fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:11.203214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-424d35e6-db41-4d77-8375-9470abd972fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:11.327856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-424d35e6-db41-4d77-8375-9470abd972fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:11.336460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-424d35e6-db41-4d77-8375-9470abd972fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.146849 Aug 18 22:13:11.337645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1417/2841] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:11.372878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e63c95aa-ddb4-4db9-a51d-ff7da8c205d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:11.373496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e63c95aa-ddb4-4db9-a51d-ff7da8c205d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:11.379498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e63c95aa-ddb4-4db9-a51d-ff7da8c205d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:11.379984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e63c95aa-ddb4-4db9-a51d-ff7da8c205d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:11.380419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e63c95aa-ddb4-4db9-a51d-ff7da8c205d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:11.381110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e63c95aa-ddb4-4db9-a51d-ff7da8c205d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:11.381566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e63c95aa-ddb4-4db9-a51d-ff7da8c205d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:11.382020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e63c95aa-ddb4-4db9-a51d-ff7da8c205d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:11.510613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e63c95aa-ddb4-4db9-a51d-ff7da8c205d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:11.518725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e63c95aa-ddb4-4db9-a51d-ff7da8c205d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149625 Aug 18 22:13:11.519300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1425/2842] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:11.584658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-73d19ba7-5409-48e8-adbb-4a2bea3ae692 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:11.585209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-73d19ba7-5409-48e8-adbb-4a2bea3ae692 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:11.591253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73d19ba7-5409-48e8-adbb-4a2bea3ae692 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:11.591736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73d19ba7-5409-48e8-adbb-4a2bea3ae692 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:11.592172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73d19ba7-5409-48e8-adbb-4a2bea3ae692 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:11.592858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73d19ba7-5409-48e8-adbb-4a2bea3ae692 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:11.593317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73d19ba7-5409-48e8-adbb-4a2bea3ae692 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:11.593765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-73d19ba7-5409-48e8-adbb-4a2bea3ae692 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:11.724316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-73d19ba7-5409-48e8-adbb-4a2bea3ae692 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:11.732912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-73d19ba7-5409-48e8-adbb-4a2bea3ae692 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:11.734569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-73d19ba7-5409-48e8-adbb-4a2bea3ae692 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:11.735728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-73d19ba7-5409-48e8-adbb-4a2bea3ae692 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155042 Aug 18 22:13:11.736294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1418/2843] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:11.880052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-de3194bf-57c2-4a1e-91e0-4d46385e315e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:11.880597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-de3194bf-57c2-4a1e-91e0-4d46385e315e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:11.886683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de3194bf-57c2-4a1e-91e0-4d46385e315e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:11.887168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de3194bf-57c2-4a1e-91e0-4d46385e315e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:11.887607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de3194bf-57c2-4a1e-91e0-4d46385e315e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:11.888293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de3194bf-57c2-4a1e-91e0-4d46385e315e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:11.888750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de3194bf-57c2-4a1e-91e0-4d46385e315e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:11.889183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de3194bf-57c2-4a1e-91e0-4d46385e315e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:12.019383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-de3194bf-57c2-4a1e-91e0-4d46385e315e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:12.027749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-de3194bf-57c2-4a1e-91e0-4d46385e315e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151682 Aug 18 22:13:12.028325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1426/2844] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:11 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:12.109259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9df96a5c-9c85-41b0-afe0-315612e815f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:12.109931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9df96a5c-9c85-41b0-afe0-315612e815f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:12.116285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9df96a5c-9c85-41b0-afe0-315612e815f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:12.116768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9df96a5c-9c85-41b0-afe0-315612e815f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:12.117208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9df96a5c-9c85-41b0-afe0-315612e815f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:12.118560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9df96a5c-9c85-41b0-afe0-315612e815f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:12.119015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9df96a5c-9c85-41b0-afe0-315612e815f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:12.119442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9df96a5c-9c85-41b0-afe0-315612e815f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:12.121972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:12.247024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9df96a5c-9c85-41b0-afe0-315612e815f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:12.255349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9df96a5c-9c85-41b0-afe0-315612e815f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149954 Aug 18 22:13:12.255917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1419/2845] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:12 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:12.359659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ed7ca765-4983-4353-999b-c13fe8f7a2af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:12.360305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ed7ca765-4983-4353-999b-c13fe8f7a2af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:12.366395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7ca765-4983-4353-999b-c13fe8f7a2af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:12.366883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7ca765-4983-4353-999b-c13fe8f7a2af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:12.367324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7ca765-4983-4353-999b-c13fe8f7a2af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:12.368045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7ca765-4983-4353-999b-c13fe8f7a2af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:12.368523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7ca765-4983-4353-999b-c13fe8f7a2af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:12.368953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed7ca765-4983-4353-999b-c13fe8f7a2af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:12.499295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ed7ca765-4983-4353-999b-c13fe8f7a2af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:12.507538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ed7ca765-4983-4353-999b-c13fe8f7a2af tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151827 Aug 18 22:13:12.508111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1427/2846] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:12 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:12.540568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-df2e8eef-9abb-443f-b176-0556e52010cd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:12.541184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-df2e8eef-9abb-443f-b176-0556e52010cd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:12.547228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df2e8eef-9abb-443f-b176-0556e52010cd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:12.547700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df2e8eef-9abb-443f-b176-0556e52010cd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:12.548133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df2e8eef-9abb-443f-b176-0556e52010cd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:12.548811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df2e8eef-9abb-443f-b176-0556e52010cd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:12.549262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df2e8eef-9abb-443f-b176-0556e52010cd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:12.549704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df2e8eef-9abb-443f-b176-0556e52010cd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:12.678278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-df2e8eef-9abb-443f-b176-0556e52010cd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:12.686390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-df2e8eef-9abb-443f-b176-0556e52010cd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150288 Aug 18 22:13:12.686964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1420/2847] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:12 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:12.759839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6aa74040-96bd-4b8b-ba50-9fdb8fc3fce1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:12.760507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6aa74040-96bd-4b8b-ba50-9fdb8fc3fce1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:12.766596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6aa74040-96bd-4b8b-ba50-9fdb8fc3fce1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:12.767078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6aa74040-96bd-4b8b-ba50-9fdb8fc3fce1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:12.767515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6aa74040-96bd-4b8b-ba50-9fdb8fc3fce1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:12.768203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6aa74040-96bd-4b8b-ba50-9fdb8fc3fce1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:12.768660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6aa74040-96bd-4b8b-ba50-9fdb8fc3fce1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:12.769086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6aa74040-96bd-4b8b-ba50-9fdb8fc3fce1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:12.895684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6aa74040-96bd-4b8b-ba50-9fdb8fc3fce1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:12.904795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6aa74040-96bd-4b8b-ba50-9fdb8fc3fce1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:12.906319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6aa74040-96bd-4b8b-ba50-9fdb8fc3fce1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:12.907454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6aa74040-96bd-4b8b-ba50-9fdb8fc3fce1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152100 Aug 18 22:13:12.908017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1428/2848] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:12 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:13.048093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-09e2b0df-5ba1-4fa0-9fa2-ae9323f890fb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:13.048703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-09e2b0df-5ba1-4fa0-9fa2-ae9323f890fb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:13.054999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09e2b0df-5ba1-4fa0-9fa2-ae9323f890fb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:13.055985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09e2b0df-5ba1-4fa0-9fa2-ae9323f890fb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:13.056420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09e2b0df-5ba1-4fa0-9fa2-ae9323f890fb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:13.057105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09e2b0df-5ba1-4fa0-9fa2-ae9323f890fb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:13.057560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09e2b0df-5ba1-4fa0-9fa2-ae9323f890fb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:13.058013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09e2b0df-5ba1-4fa0-9fa2-ae9323f890fb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:13.183977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-09e2b0df-5ba1-4fa0-9fa2-ae9323f890fb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:13.192169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-09e2b0df-5ba1-4fa0-9fa2-ae9323f890fb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.147872 Aug 18 22:13:13.192744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1421/2849] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:13 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:13.276873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fde029dc-ad4f-4e7c-9a42-14163208878b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:13.277495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fde029dc-ad4f-4e7c-9a42-14163208878b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:13.283998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fde029dc-ad4f-4e7c-9a42-14163208878b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:13.284482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fde029dc-ad4f-4e7c-9a42-14163208878b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:13.284923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fde029dc-ad4f-4e7c-9a42-14163208878b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:13.285634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fde029dc-ad4f-4e7c-9a42-14163208878b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:13.286102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fde029dc-ad4f-4e7c-9a42-14163208878b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:13.286532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fde029dc-ad4f-4e7c-9a42-14163208878b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:13.417473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fde029dc-ad4f-4e7c-9a42-14163208878b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:13.426050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fde029dc-ad4f-4e7c-9a42-14163208878b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153132 Aug 18 22:13:13.426633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1429/2850] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:13 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:13.529205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0fa90f3f-e517-4ec4-ada5-6f99bc0a0f22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:13.529793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0fa90f3f-e517-4ec4-ada5-6f99bc0a0f22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:13.535835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fa90f3f-e517-4ec4-ada5-6f99bc0a0f22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:13.536324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fa90f3f-e517-4ec4-ada5-6f99bc0a0f22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:13.536772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fa90f3f-e517-4ec4-ada5-6f99bc0a0f22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:13.537468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fa90f3f-e517-4ec4-ada5-6f99bc0a0f22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:13.537961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fa90f3f-e517-4ec4-ada5-6f99bc0a0f22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:13.538396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fa90f3f-e517-4ec4-ada5-6f99bc0a0f22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:13.668760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0fa90f3f-e517-4ec4-ada5-6f99bc0a0f22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:13.677483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0fa90f3f-e517-4ec4-ada5-6f99bc0a0f22 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152152 Aug 18 22:13:13.678111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1422/2851] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:13.707901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69781bd1-ed9e-4adf-9e90-67f9e5fcbf45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:13.708518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-69781bd1-ed9e-4adf-9e90-67f9e5fcbf45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:13.714991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69781bd1-ed9e-4adf-9e90-67f9e5fcbf45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:13.715475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69781bd1-ed9e-4adf-9e90-67f9e5fcbf45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:13.715911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69781bd1-ed9e-4adf-9e90-67f9e5fcbf45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:13.716604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69781bd1-ed9e-4adf-9e90-67f9e5fcbf45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:13.717058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69781bd1-ed9e-4adf-9e90-67f9e5fcbf45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:13.717481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69781bd1-ed9e-4adf-9e90-67f9e5fcbf45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:13.849024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69781bd1-ed9e-4adf-9e90-67f9e5fcbf45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:13.857174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-69781bd1-ed9e-4adf-9e90-67f9e5fcbf45 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153108 Aug 18 22:13:13.857761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1430/2852] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:13 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:13.930238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f9b10d74-224e-4f92-9723-fc291e66136e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:13.930857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f9b10d74-224e-4f92-9723-fc291e66136e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:13.937298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9b10d74-224e-4f92-9723-fc291e66136e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:13.937822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9b10d74-224e-4f92-9723-fc291e66136e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:13.938270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9b10d74-224e-4f92-9723-fc291e66136e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:13.938966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9b10d74-224e-4f92-9723-fc291e66136e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:13.939424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9b10d74-224e-4f92-9723-fc291e66136e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:13.939854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9b10d74-224e-4f92-9723-fc291e66136e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:14.067784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f9b10d74-224e-4f92-9723-fc291e66136e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:14.077079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f9b10d74-224e-4f92-9723-fc291e66136e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:14.078738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f9b10d74-224e-4f92-9723-fc291e66136e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:14.079907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f9b10d74-224e-4f92-9723-fc291e66136e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153618 Aug 18 22:13:14.080470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1423/2853] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:13 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:14.213683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-530003bd-ba90-4682-b976-cd68378b5955 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:14.214302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-530003bd-ba90-4682-b976-cd68378b5955 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:14.220326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530003bd-ba90-4682-b976-cd68378b5955 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:14.220805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530003bd-ba90-4682-b976-cd68378b5955 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:14.221240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530003bd-ba90-4682-b976-cd68378b5955 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:14.221965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530003bd-ba90-4682-b976-cd68378b5955 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:14.222418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530003bd-ba90-4682-b976-cd68378b5955 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:14.222844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-530003bd-ba90-4682-b976-cd68378b5955 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:14.347464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-530003bd-ba90-4682-b976-cd68378b5955 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:14.356200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-530003bd-ba90-4682-b976-cd68378b5955 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.146455 Aug 18 22:13:14.356774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1431/2854] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:14 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:14.447556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c8c00337-190f-4b5b-9486-7065b882db6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:14.448166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c8c00337-190f-4b5b-9486-7065b882db6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:14.454611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8c00337-190f-4b5b-9486-7065b882db6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:14.455088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8c00337-190f-4b5b-9486-7065b882db6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:14.455519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8c00337-190f-4b5b-9486-7065b882db6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:14.456199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8c00337-190f-4b5b-9486-7065b882db6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:14.456648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8c00337-190f-4b5b-9486-7065b882db6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:14.457069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8c00337-190f-4b5b-9486-7065b882db6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:14.582864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c8c00337-190f-4b5b-9486-7065b882db6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:14.591497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c8c00337-190f-4b5b-9486-7065b882db6f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.147837 Aug 18 22:13:14.592092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1424/2855] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:14 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:14.699559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-af6b1602-a6fe-4e29-8ab1-74d90795d175 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:14.700089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-af6b1602-a6fe-4e29-8ab1-74d90795d175 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:14.706203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af6b1602-a6fe-4e29-8ab1-74d90795d175 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:14.706675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af6b1602-a6fe-4e29-8ab1-74d90795d175 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:14.707107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af6b1602-a6fe-4e29-8ab1-74d90795d175 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:14.707822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af6b1602-a6fe-4e29-8ab1-74d90795d175 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:14.708379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af6b1602-a6fe-4e29-8ab1-74d90795d175 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:14.708808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af6b1602-a6fe-4e29-8ab1-74d90795d175 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:14.850308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-af6b1602-a6fe-4e29-8ab1-74d90795d175 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:14.858950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-af6b1602-a6fe-4e29-8ab1-74d90795d175 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.164103 Aug 18 22:13:14.859823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1432/2856] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:14.878665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-abfbf5e9-9de6-4fb6-aa0d-eb214d56966c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:14.879291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-abfbf5e9-9de6-4fb6-aa0d-eb214d56966c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:14.885386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abfbf5e9-9de6-4fb6-aa0d-eb214d56966c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:14.885910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abfbf5e9-9de6-4fb6-aa0d-eb214d56966c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:14.886352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abfbf5e9-9de6-4fb6-aa0d-eb214d56966c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:14.887052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abfbf5e9-9de6-4fb6-aa0d-eb214d56966c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:14.887512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abfbf5e9-9de6-4fb6-aa0d-eb214d56966c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:14.887945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-abfbf5e9-9de6-4fb6-aa0d-eb214d56966c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:15.103552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4845cc3f-ad75-449c-ae58-c4b0052726ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:15.105099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4845cc3f-ad75-449c-ae58-c4b0052726ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:15.107782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-abfbf5e9-9de6-4fb6-aa0d-eb214d56966c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:15.114572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4845cc3f-ad75-449c-ae58-c4b0052726ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:15.115768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4845cc3f-ad75-449c-ae58-c4b0052726ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:15.116435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4845cc3f-ad75-449c-ae58-c4b0052726ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:15.117332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4845cc3f-ad75-449c-ae58-c4b0052726ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:15.118027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4845cc3f-ad75-449c-ae58-c4b0052726ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:15.118458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4845cc3f-ad75-449c-ae58-c4b0052726ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:15.118588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-abfbf5e9-9de6-4fb6-aa0d-eb214d56966c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.243531 Aug 18 22:13:15.120124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1425/2857] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:15.263331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4845cc3f-ad75-449c-ae58-c4b0052726ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:15.272824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4845cc3f-ad75-449c-ae58-c4b0052726ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:15.274369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4845cc3f-ad75-449c-ae58-c4b0052726ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:15.276244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4845cc3f-ad75-449c-ae58-c4b0052726ad tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.176856 Aug 18 22:13:15.276818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1433/2858] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:15.376853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ea06632b-f6ef-4001-9fc6-bce6456585d3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:15.377474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ea06632b-f6ef-4001-9fc6-bce6456585d3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:15.383403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea06632b-f6ef-4001-9fc6-bce6456585d3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:15.383888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea06632b-f6ef-4001-9fc6-bce6456585d3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:15.384329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea06632b-f6ef-4001-9fc6-bce6456585d3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:15.385051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea06632b-f6ef-4001-9fc6-bce6456585d3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:15.385514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea06632b-f6ef-4001-9fc6-bce6456585d3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:15.385967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea06632b-f6ef-4001-9fc6-bce6456585d3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:15.513154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ea06632b-f6ef-4001-9fc6-bce6456585d3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:15.521445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ea06632b-f6ef-4001-9fc6-bce6456585d3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148439 Aug 18 22:13:15.522046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1426/2859] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:15 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:15.613338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e124f467-9e0d-4403-bf07-d3fbd4f3ea74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:15.613989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e124f467-9e0d-4403-bf07-d3fbd4f3ea74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:15.619974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e124f467-9e0d-4403-bf07-d3fbd4f3ea74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:15.620445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e124f467-9e0d-4403-bf07-d3fbd4f3ea74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:15.620878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e124f467-9e0d-4403-bf07-d3fbd4f3ea74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:15.621555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e124f467-9e0d-4403-bf07-d3fbd4f3ea74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:15.622025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e124f467-9e0d-4403-bf07-d3fbd4f3ea74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:15.622442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e124f467-9e0d-4403-bf07-d3fbd4f3ea74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:15.752338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e124f467-9e0d-4403-bf07-d3fbd4f3ea74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:15.765385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e124f467-9e0d-4403-bf07-d3fbd4f3ea74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155780 Aug 18 22:13:15.765925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1434/2860] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:15 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:15.880381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8809cef5-d23f-42f9-b72c-ecf721670063 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:15.880999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8809cef5-d23f-42f9-b72c-ecf721670063 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:15.887560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8809cef5-d23f-42f9-b72c-ecf721670063 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:15.888050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8809cef5-d23f-42f9-b72c-ecf721670063 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:15.888498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8809cef5-d23f-42f9-b72c-ecf721670063 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:15.889192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8809cef5-d23f-42f9-b72c-ecf721670063 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:15.889667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8809cef5-d23f-42f9-b72c-ecf721670063 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:15.890104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8809cef5-d23f-42f9-b72c-ecf721670063 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:16.030216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8809cef5-d23f-42f9-b72c-ecf721670063 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:16.038843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8809cef5-d23f-42f9-b72c-ecf721670063 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.162290 Aug 18 22:13:16.039431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1427/2861] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:15 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:16.142053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-24b63188-e2f1-46bb-9b84-72d37032d6d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:16.142678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-24b63188-e2f1-46bb-9b84-72d37032d6d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:16.149288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24b63188-e2f1-46bb-9b84-72d37032d6d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:16.149818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24b63188-e2f1-46bb-9b84-72d37032d6d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:16.150261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24b63188-e2f1-46bb-9b84-72d37032d6d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:16.151057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24b63188-e2f1-46bb-9b84-72d37032d6d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:16.151520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24b63188-e2f1-46bb-9b84-72d37032d6d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:16.151948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24b63188-e2f1-46bb-9b84-72d37032d6d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:16.286664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-24b63188-e2f1-46bb-9b84-72d37032d6d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:16.295528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-24b63188-e2f1-46bb-9b84-72d37032d6d2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.158123 Aug 18 22:13:16.296126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1435/2862] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:16.299607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6bf04ac7-9c17-4847-9d21-da74b6eba3b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:16.300673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6bf04ac7-9c17-4847-9d21-da74b6eba3b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:16.307590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bf04ac7-9c17-4847-9d21-da74b6eba3b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:16.308079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bf04ac7-9c17-4847-9d21-da74b6eba3b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:16.308518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bf04ac7-9c17-4847-9d21-da74b6eba3b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:16.309246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bf04ac7-9c17-4847-9d21-da74b6eba3b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:16.309743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bf04ac7-9c17-4847-9d21-da74b6eba3b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:16.310200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bf04ac7-9c17-4847-9d21-da74b6eba3b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:16.441494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6bf04ac7-9c17-4847-9d21-da74b6eba3b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:16.450782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6bf04ac7-9c17-4847-9d21-da74b6eba3b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:16.452316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6bf04ac7-9c17-4847-9d21-da74b6eba3b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:16.453485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6bf04ac7-9c17-4847-9d21-da74b6eba3b1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.158621 Aug 18 22:13:16.454078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1428/2863] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:13:16.542243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf6bea39-2021-4afe-960c-7940d869c5d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:16.542797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf6bea39-2021-4afe-960c-7940d869c5d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:16.549077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf6bea39-2021-4afe-960c-7940d869c5d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:16.549546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf6bea39-2021-4afe-960c-7940d869c5d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:16.549999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf6bea39-2021-4afe-960c-7940d869c5d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:16.550929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf6bea39-2021-4afe-960c-7940d869c5d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:16.551377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf6bea39-2021-4afe-960c-7940d869c5d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:16.551800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf6bea39-2021-4afe-960c-7940d869c5d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:16.677145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bf6bea39-2021-4afe-960c-7940d869c5d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:16.685924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf6bea39-2021-4afe-960c-7940d869c5d5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.147699 Aug 18 22:13:16.686498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1436/2864] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:16 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:16.786324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c28f53f8-924a-433d-b41d-34719bbab06e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:16.786946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c28f53f8-924a-433d-b41d-34719bbab06e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:16.793542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c28f53f8-924a-433d-b41d-34719bbab06e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:16.794013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c28f53f8-924a-433d-b41d-34719bbab06e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:16.794461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c28f53f8-924a-433d-b41d-34719bbab06e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:16.795155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c28f53f8-924a-433d-b41d-34719bbab06e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:16.795617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c28f53f8-924a-433d-b41d-34719bbab06e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:16.796048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c28f53f8-924a-433d-b41d-34719bbab06e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:16.925058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c28f53f8-924a-433d-b41d-34719bbab06e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:16.934007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c28f53f8-924a-433d-b41d-34719bbab06e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151494 Aug 18 22:13:16.934649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1429/2865] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:16 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:17.043480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:13:17.043779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:13:17.060892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9865376d-7f61-4ba1-affc-667fc826f56d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:17.061542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9865376d-7f61-4ba1-affc-667fc826f56d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:17.067517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9865376d-7f61-4ba1-affc-667fc826f56d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:17.068003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9865376d-7f61-4ba1-affc-667fc826f56d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:17.068442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9865376d-7f61-4ba1-affc-667fc826f56d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:17.069136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9865376d-7f61-4ba1-affc-667fc826f56d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:17.069605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9865376d-7f61-4ba1-affc-667fc826f56d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:17.070040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9865376d-7f61-4ba1-affc-667fc826f56d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:17.072586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:17.204686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9865376d-7f61-4ba1-affc-667fc826f56d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:17.213035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9865376d-7f61-4ba1-affc-667fc826f56d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156656 Aug 18 22:13:17.213679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1437/2866] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:17 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:17.317270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-26a129af-27ec-4b88-9878-808c811bd1af tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:17.317851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-26a129af-27ec-4b88-9878-808c811bd1af tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:17.323860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26a129af-27ec-4b88-9878-808c811bd1af tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:17.324343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26a129af-27ec-4b88-9878-808c811bd1af tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:17.324778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26a129af-27ec-4b88-9878-808c811bd1af tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:17.325462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26a129af-27ec-4b88-9878-808c811bd1af tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:17.325947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26a129af-27ec-4b88-9878-808c811bd1af tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:17.326376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26a129af-27ec-4b88-9878-808c811bd1af tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:17.451222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-26a129af-27ec-4b88-9878-808c811bd1af tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:17.459399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-26a129af-27ec-4b88-9878-808c811bd1af tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.146092 Aug 18 22:13:17.459973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1430/2867] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:17.461769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:13:17.461898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:13:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:13:17.477661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4bb79834-ca72-4252-8edd-3c7c76d4228b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:17.478288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4bb79834-ca72-4252-8edd-3c7c76d4228b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:17.485047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bb79834-ca72-4252-8edd-3c7c76d4228b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:17.485560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bb79834-ca72-4252-8edd-3c7c76d4228b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:17.486053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bb79834-ca72-4252-8edd-3c7c76d4228b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:17.486775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bb79834-ca72-4252-8edd-3c7c76d4228b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:17.487230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bb79834-ca72-4252-8edd-3c7c76d4228b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:17.487654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4bb79834-ca72-4252-8edd-3c7c76d4228b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:17.613385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4bb79834-ca72-4252-8edd-3c7c76d4228b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:17.621982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4bb79834-ca72-4252-8edd-3c7c76d4228b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:17.623477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4bb79834-ca72-4252-8edd-3c7c76d4228b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:17.624636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4bb79834-ca72-4252-8edd-3c7c76d4228b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151016 Aug 18 22:13:17.625213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1438/2868] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:17.707278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d8f8141e-69e9-4eb0-802d-dbf0617aa180 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:17.707904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d8f8141e-69e9-4eb0-802d-dbf0617aa180 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:17.714573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d8f8141e-69e9-4eb0-802d-dbf0617aa180 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:17.715067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d8f8141e-69e9-4eb0-802d-dbf0617aa180 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:17.715522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d8f8141e-69e9-4eb0-802d-dbf0617aa180 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:17.716217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d8f8141e-69e9-4eb0-802d-dbf0617aa180 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:17.716678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d8f8141e-69e9-4eb0-802d-dbf0617aa180 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:17.717111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d8f8141e-69e9-4eb0-802d-dbf0617aa180 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:17.853980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d8f8141e-69e9-4eb0-802d-dbf0617aa180 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:17.862211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d8f8141e-69e9-4eb0-802d-dbf0617aa180 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.158687 Aug 18 22:13:17.862725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1431/2869] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:17 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:17.955868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5f80dce9-5fc1-46e7-b9a3-abc9d9d3829b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:17.956496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5f80dce9-5fc1-46e7-b9a3-abc9d9d3829b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:17.962566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f80dce9-5fc1-46e7-b9a3-abc9d9d3829b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:17.963671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f80dce9-5fc1-46e7-b9a3-abc9d9d3829b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:17.964117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f80dce9-5fc1-46e7-b9a3-abc9d9d3829b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:17.964812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f80dce9-5fc1-46e7-b9a3-abc9d9d3829b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:17.965267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f80dce9-5fc1-46e7-b9a3-abc9d9d3829b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:17.965717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f80dce9-5fc1-46e7-b9a3-abc9d9d3829b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:18.096685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5f80dce9-5fc1-46e7-b9a3-abc9d9d3829b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:18.104831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5f80dce9-5fc1-46e7-b9a3-abc9d9d3829b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152971 Aug 18 22:13:18.105428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1439/2870] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:17 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:18.234491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-867cc4fe-3530-4e48-84a2-054f47e42c0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:18.235030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-867cc4fe-3530-4e48-84a2-054f47e42c0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:18.240960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-867cc4fe-3530-4e48-84a2-054f47e42c0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:18.241453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-867cc4fe-3530-4e48-84a2-054f47e42c0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:18.241929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-867cc4fe-3530-4e48-84a2-054f47e42c0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:18.242626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-867cc4fe-3530-4e48-84a2-054f47e42c0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:18.243093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-867cc4fe-3530-4e48-84a2-054f47e42c0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:18.243524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-867cc4fe-3530-4e48-84a2-054f47e42c0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:18.371727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-867cc4fe-3530-4e48-84a2-054f47e42c0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:18.380165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-867cc4fe-3530-4e48-84a2-054f47e42c0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149620 Aug 18 22:13:18.380733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1432/2871] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:18 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:18.480253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0721625c-e275-4d9e-8eeb-07a8d6aa342d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:18.480874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0721625c-e275-4d9e-8eeb-07a8d6aa342d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:18.487330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0721625c-e275-4d9e-8eeb-07a8d6aa342d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:18.487755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0721625c-e275-4d9e-8eeb-07a8d6aa342d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:18.488192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0721625c-e275-4d9e-8eeb-07a8d6aa342d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:18.488885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0721625c-e275-4d9e-8eeb-07a8d6aa342d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:18.489341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0721625c-e275-4d9e-8eeb-07a8d6aa342d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:18.489799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0721625c-e275-4d9e-8eeb-07a8d6aa342d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:18.616450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0721625c-e275-4d9e-8eeb-07a8d6aa342d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:18.625351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0721625c-e275-4d9e-8eeb-07a8d6aa342d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148987 Aug 18 22:13:18.625957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1440/2872] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:18.647512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-15d9dcaa-c138-47e6-b22a-e0bb84f8547d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:18.648126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-15d9dcaa-c138-47e6-b22a-e0bb84f8547d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:18.654055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15d9dcaa-c138-47e6-b22a-e0bb84f8547d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:18.654534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15d9dcaa-c138-47e6-b22a-e0bb84f8547d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:18.654964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15d9dcaa-c138-47e6-b22a-e0bb84f8547d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:18.655639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15d9dcaa-c138-47e6-b22a-e0bb84f8547d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:18.656086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15d9dcaa-c138-47e6-b22a-e0bb84f8547d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:18.656508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15d9dcaa-c138-47e6-b22a-e0bb84f8547d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:18.785099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-15d9dcaa-c138-47e6-b22a-e0bb84f8547d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:18.794595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-15d9dcaa-c138-47e6-b22a-e0bb84f8547d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:18.796090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-15d9dcaa-c138-47e6-b22a-e0bb84f8547d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:18.797244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-15d9dcaa-c138-47e6-b22a-e0bb84f8547d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153588 Aug 18 22:13:18.797850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1433/2873] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:18 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:18.882853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1c6e0bfb-01fd-4aa7-9909-3ba312b89238 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:18.883471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1c6e0bfb-01fd-4aa7-9909-3ba312b89238 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:18.889461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6e0bfb-01fd-4aa7-9909-3ba312b89238 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:18.890019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6e0bfb-01fd-4aa7-9909-3ba312b89238 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:18.890459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6e0bfb-01fd-4aa7-9909-3ba312b89238 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:18.891147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6e0bfb-01fd-4aa7-9909-3ba312b89238 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:18.891598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6e0bfb-01fd-4aa7-9909-3ba312b89238 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:18.892037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c6e0bfb-01fd-4aa7-9909-3ba312b89238 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:19.022629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1c6e0bfb-01fd-4aa7-9909-3ba312b89238 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:19.031431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1c6e0bfb-01fd-4aa7-9909-3ba312b89238 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152392 Aug 18 22:13:19.032003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1441/2874] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:18 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:19.126082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3b3fd9cf-487b-4c58-bf65-714b8abbebf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:19.126686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3b3fd9cf-487b-4c58-bf65-714b8abbebf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:19.132836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b3fd9cf-487b-4c58-bf65-714b8abbebf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:19.133329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b3fd9cf-487b-4c58-bf65-714b8abbebf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:19.133830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b3fd9cf-487b-4c58-bf65-714b8abbebf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:19.134534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b3fd9cf-487b-4c58-bf65-714b8abbebf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:19.134996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b3fd9cf-487b-4c58-bf65-714b8abbebf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:19.135431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b3fd9cf-487b-4c58-bf65-714b8abbebf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:19.264561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3b3fd9cf-487b-4c58-bf65-714b8abbebf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:19.272744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3b3fd9cf-487b-4c58-bf65-714b8abbebf9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150495 Aug 18 22:13:19.273709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1434/2875] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:19 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:19.402518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d4f72899-3fe1-4f44-b58d-38546cc07b3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:19.403130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d4f72899-3fe1-4f44-b58d-38546cc07b3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:19.409120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4f72899-3fe1-4f44-b58d-38546cc07b3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:19.409616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4f72899-3fe1-4f44-b58d-38546cc07b3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:19.410056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4f72899-3fe1-4f44-b58d-38546cc07b3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:19.410762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4f72899-3fe1-4f44-b58d-38546cc07b3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:19.411216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4f72899-3fe1-4f44-b58d-38546cc07b3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:19.411637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4f72899-3fe1-4f44-b58d-38546cc07b3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:19.540071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d4f72899-3fe1-4f44-b58d-38546cc07b3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:19.548183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d4f72899-3fe1-4f44-b58d-38546cc07b3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150213 Aug 18 22:13:19.548761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1442/2876] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:19 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:19.646322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f14fecdc-ffed-463b-8e51-c56bee5702ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:19.646861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f14fecdc-ffed-463b-8e51-c56bee5702ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:19.653414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f14fecdc-ffed-463b-8e51-c56bee5702ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:19.653915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f14fecdc-ffed-463b-8e51-c56bee5702ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:19.654349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f14fecdc-ffed-463b-8e51-c56bee5702ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:19.655025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f14fecdc-ffed-463b-8e51-c56bee5702ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:19.655474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f14fecdc-ffed-463b-8e51-c56bee5702ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:19.655893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f14fecdc-ffed-463b-8e51-c56bee5702ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:19.788609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f14fecdc-ffed-463b-8e51-c56bee5702ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:19.790831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:19.798126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f14fecdc-ffed-463b-8e51-c56bee5702ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155652 Aug 18 22:13:19.798696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1435/2877] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:19 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:19.820460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d28ca261-fb87-446e-ae93-ffb683fa5463 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:19.821113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d28ca261-fb87-446e-ae93-ffb683fa5463 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:19.827799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d28ca261-fb87-446e-ae93-ffb683fa5463 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:19.828281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d28ca261-fb87-446e-ae93-ffb683fa5463 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:19.828720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d28ca261-fb87-446e-ae93-ffb683fa5463 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:19.829411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d28ca261-fb87-446e-ae93-ffb683fa5463 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:19.829902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d28ca261-fb87-446e-ae93-ffb683fa5463 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:19.830332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d28ca261-fb87-446e-ae93-ffb683fa5463 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:19.956504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d28ca261-fb87-446e-ae93-ffb683fa5463 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:19.965196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d28ca261-fb87-446e-ae93-ffb683fa5463 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:19.966736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d28ca261-fb87-446e-ae93-ffb683fa5463 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:19.967907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d28ca261-fb87-446e-ae93-ffb683fa5463 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151305 Aug 18 22:13:19.968543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1443/2878] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:20.052521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0d5e095a-d9ae-405b-9a1e-0052b991c07c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:20.053150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0d5e095a-d9ae-405b-9a1e-0052b991c07c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:20.059739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d5e095a-d9ae-405b-9a1e-0052b991c07c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:20.060227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d5e095a-d9ae-405b-9a1e-0052b991c07c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:20.060675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d5e095a-d9ae-405b-9a1e-0052b991c07c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:20.061372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d5e095a-d9ae-405b-9a1e-0052b991c07c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:20.061960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d5e095a-d9ae-405b-9a1e-0052b991c07c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:20.062405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d5e095a-d9ae-405b-9a1e-0052b991c07c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:20.195580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0d5e095a-d9ae-405b-9a1e-0052b991c07c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:20.203765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0d5e095a-d9ae-405b-9a1e-0052b991c07c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155338 Aug 18 22:13:20.204336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1436/2879] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:20 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:20.295980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0088988-c192-4645-adea-3f848cf041c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:20.296641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d0088988-c192-4645-adea-3f848cf041c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:20.302981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0088988-c192-4645-adea-3f848cf041c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:20.303467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0088988-c192-4645-adea-3f848cf041c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:20.303915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0088988-c192-4645-adea-3f848cf041c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:20.304609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0088988-c192-4645-adea-3f848cf041c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:20.305065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0088988-c192-4645-adea-3f848cf041c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:20.305493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0088988-c192-4645-adea-3f848cf041c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:20.445132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d0088988-c192-4645-adea-3f848cf041c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:20.453444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d0088988-c192-4645-adea-3f848cf041c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.161382 Aug 18 22:13:20.454050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1444/2880] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:20 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:20.569580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-361e990a-f175-469b-8ff1-e9b861b31a44 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:20.570247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-361e990a-f175-469b-8ff1-e9b861b31a44 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:20.576212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-361e990a-f175-469b-8ff1-e9b861b31a44 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:20.576694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-361e990a-f175-469b-8ff1-e9b861b31a44 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:20.577128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-361e990a-f175-469b-8ff1-e9b861b31a44 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:20.577882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-361e990a-f175-469b-8ff1-e9b861b31a44 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:20.578338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-361e990a-f175-469b-8ff1-e9b861b31a44 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:20.578765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-361e990a-f175-469b-8ff1-e9b861b31a44 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:20.705825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-361e990a-f175-469b-8ff1-e9b861b31a44 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:20.714729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-361e990a-f175-469b-8ff1-e9b861b31a44 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148913 Aug 18 22:13:20.715320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1437/2881] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:20.820133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5752bd65-6e32-4d14-9fb3-e7d09d24505a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:20.820734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5752bd65-6e32-4d14-9fb3-e7d09d24505a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:20.827705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5752bd65-6e32-4d14-9fb3-e7d09d24505a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:20.828190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5752bd65-6e32-4d14-9fb3-e7d09d24505a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:20.828627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5752bd65-6e32-4d14-9fb3-e7d09d24505a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:20.829321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5752bd65-6e32-4d14-9fb3-e7d09d24505a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:20.829810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5752bd65-6e32-4d14-9fb3-e7d09d24505a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:20.830244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5752bd65-6e32-4d14-9fb3-e7d09d24505a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:20.958799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5752bd65-6e32-4d14-9fb3-e7d09d24505a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:20.967525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5752bd65-6e32-4d14-9fb3-e7d09d24505a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151365 Aug 18 22:13:20.968116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1445/2882] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:20 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:20.991940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-395f8cd2-77b9-4e3f-881f-7bde9594d4be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:20.992854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-395f8cd2-77b9-4e3f-881f-7bde9594d4be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:21.000314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-395f8cd2-77b9-4e3f-881f-7bde9594d4be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:21.000792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-395f8cd2-77b9-4e3f-881f-7bde9594d4be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:21.001227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-395f8cd2-77b9-4e3f-881f-7bde9594d4be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:21.001956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-395f8cd2-77b9-4e3f-881f-7bde9594d4be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:21.002416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-395f8cd2-77b9-4e3f-881f-7bde9594d4be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:21.002835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-395f8cd2-77b9-4e3f-881f-7bde9594d4be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:21.128447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-395f8cd2-77b9-4e3f-881f-7bde9594d4be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:21.137080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-395f8cd2-77b9-4e3f-881f-7bde9594d4be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:21.138625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-395f8cd2-77b9-4e3f-881f-7bde9594d4be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:21.139783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-395f8cd2-77b9-4e3f-881f-7bde9594d4be tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153394 Aug 18 22:13:21.140358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1438/2883] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:20 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:21.224910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e8252b9c-fe3e-4f6e-802a-a79ce1480fa1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:21.225457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e8252b9c-fe3e-4f6e-802a-a79ce1480fa1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:21.232171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8252b9c-fe3e-4f6e-802a-a79ce1480fa1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:21.232663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8252b9c-fe3e-4f6e-802a-a79ce1480fa1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:21.233107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8252b9c-fe3e-4f6e-802a-a79ce1480fa1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:21.233831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8252b9c-fe3e-4f6e-802a-a79ce1480fa1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:21.234291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8252b9c-fe3e-4f6e-802a-a79ce1480fa1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:21.234721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8252b9c-fe3e-4f6e-802a-a79ce1480fa1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:21.363332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e8252b9c-fe3e-4f6e-802a-a79ce1480fa1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:21.371460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e8252b9c-fe3e-4f6e-802a-a79ce1480fa1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150515 Aug 18 22:13:21.372016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1446/2884] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:21 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:21.474447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f13eaaad-38f5-4a8c-9e4a-817e8c2149ed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:21.475106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f13eaaad-38f5-4a8c-9e4a-817e8c2149ed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:21.482289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f13eaaad-38f5-4a8c-9e4a-817e8c2149ed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:21.482795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f13eaaad-38f5-4a8c-9e4a-817e8c2149ed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:21.483235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f13eaaad-38f5-4a8c-9e4a-817e8c2149ed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:21.483961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f13eaaad-38f5-4a8c-9e4a-817e8c2149ed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:21.484424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f13eaaad-38f5-4a8c-9e4a-817e8c2149ed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:21.484862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f13eaaad-38f5-4a8c-9e4a-817e8c2149ed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:21.626575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f13eaaad-38f5-4a8c-9e4a-817e8c2149ed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:21.635017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f13eaaad-38f5-4a8c-9e4a-817e8c2149ed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.164488 Aug 18 22:13:21.635610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1439/2885] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:21 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:21.736319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-80611e3a-8abe-42ab-b216-b6cada73a2b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:21.736867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-80611e3a-8abe-42ab-b216-b6cada73a2b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:21.742941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80611e3a-8abe-42ab-b216-b6cada73a2b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:21.743429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80611e3a-8abe-42ab-b216-b6cada73a2b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:21.743872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80611e3a-8abe-42ab-b216-b6cada73a2b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:21.745195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80611e3a-8abe-42ab-b216-b6cada73a2b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:21.745691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80611e3a-8abe-42ab-b216-b6cada73a2b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:21.746129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-80611e3a-8abe-42ab-b216-b6cada73a2b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:21.875708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-80611e3a-8abe-42ab-b216-b6cada73a2b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:21.884076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-80611e3a-8abe-42ab-b216-b6cada73a2b0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151697 Aug 18 22:13:21.884648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1447/2886] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:21.988668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1d700405-b3a2-4ee3-bbc3-2e1b2b064784 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:21.989234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1d700405-b3a2-4ee3-bbc3-2e1b2b064784 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:21.995195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d700405-b3a2-4ee3-bbc3-2e1b2b064784 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:21.995669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d700405-b3a2-4ee3-bbc3-2e1b2b064784 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:21.996109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d700405-b3a2-4ee3-bbc3-2e1b2b064784 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:21.996797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d700405-b3a2-4ee3-bbc3-2e1b2b064784 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:21.997258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d700405-b3a2-4ee3-bbc3-2e1b2b064784 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:21.997705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d700405-b3a2-4ee3-bbc3-2e1b2b064784 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:22.127330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1d700405-b3a2-4ee3-bbc3-2e1b2b064784 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:22.138462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1d700405-b3a2-4ee3-bbc3-2e1b2b064784 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154045 Aug 18 22:13:22.139045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1440/2887] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:21 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:22.162263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f50ca22b-a6d1-4408-80a6-fb78be1aa00a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:22.162882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f50ca22b-a6d1-4408-80a6-fb78be1aa00a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:22.169439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f50ca22b-a6d1-4408-80a6-fb78be1aa00a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:22.169963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f50ca22b-a6d1-4408-80a6-fb78be1aa00a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:22.170402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f50ca22b-a6d1-4408-80a6-fb78be1aa00a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:22.171097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f50ca22b-a6d1-4408-80a6-fb78be1aa00a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:22.171550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f50ca22b-a6d1-4408-80a6-fb78be1aa00a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:22.171980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f50ca22b-a6d1-4408-80a6-fb78be1aa00a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:22.297455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f50ca22b-a6d1-4408-80a6-fb78be1aa00a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:22.306267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f50ca22b-a6d1-4408-80a6-fb78be1aa00a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:22.307770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f50ca22b-a6d1-4408-80a6-fb78be1aa00a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:22.308924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f50ca22b-a6d1-4408-80a6-fb78be1aa00a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150564 Aug 18 22:13:22.309481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1448/2888] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:22.392389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-94d6ba0d-405c-4ed2-9b3a-c923b313427f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:22.393025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-94d6ba0d-405c-4ed2-9b3a-c923b313427f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:22.398998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94d6ba0d-405c-4ed2-9b3a-c923b313427f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:22.399482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94d6ba0d-405c-4ed2-9b3a-c923b313427f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:22.399920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94d6ba0d-405c-4ed2-9b3a-c923b313427f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:22.401519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94d6ba0d-405c-4ed2-9b3a-c923b313427f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:22.402003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94d6ba0d-405c-4ed2-9b3a-c923b313427f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:22.402443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-94d6ba0d-405c-4ed2-9b3a-c923b313427f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:22.536179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-94d6ba0d-405c-4ed2-9b3a-c923b313427f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:22.544432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-94d6ba0d-405c-4ed2-9b3a-c923b313427f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156183 Aug 18 22:13:22.544997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1441/2889] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:22 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:22.656714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-94ae4a15-40a1-43e4-85aa-43a5d45a42e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:22.657325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-94ae4a15-40a1-43e4-85aa-43a5d45a42e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:22.663650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94ae4a15-40a1-43e4-85aa-43a5d45a42e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:22.664197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94ae4a15-40a1-43e4-85aa-43a5d45a42e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:22.664662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94ae4a15-40a1-43e4-85aa-43a5d45a42e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:22.665278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94ae4a15-40a1-43e4-85aa-43a5d45a42e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:22.665771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94ae4a15-40a1-43e4-85aa-43a5d45a42e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:22.666204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94ae4a15-40a1-43e4-85aa-43a5d45a42e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:22.704861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:13:22.705011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:13:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e (ip 10.222.0.82) !!! Aug 18 22:13:22.806979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-94ae4a15-40a1-43e4-85aa-43a5d45a42e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:22.815242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-94ae4a15-40a1-43e4-85aa-43a5d45a42e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.162331 Aug 18 22:13:22.815821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1449/2890] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:22.905705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6759d3e6-46d9-4e41-9b22-4be957851fb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:22.906347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6759d3e6-46d9-4e41-9b22-4be957851fb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:22.912310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6759d3e6-46d9-4e41-9b22-4be957851fb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:22.912790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6759d3e6-46d9-4e41-9b22-4be957851fb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:22.913223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6759d3e6-46d9-4e41-9b22-4be957851fb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:22.913935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6759d3e6-46d9-4e41-9b22-4be957851fb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:22.914386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6759d3e6-46d9-4e41-9b22-4be957851fb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:22.914807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6759d3e6-46d9-4e41-9b22-4be957851fb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:23.043508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6759d3e6-46d9-4e41-9b22-4be957851fb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:23.052060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6759d3e6-46d9-4e41-9b22-4be957851fb3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150223 Aug 18 22:13:23.052629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1442/2891] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:22 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:23.160119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f95a5cf0-9998-4eca-a87b-2c79b5ac7acc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:23.160736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f95a5cf0-9998-4eca-a87b-2c79b5ac7acc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:23.167170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f95a5cf0-9998-4eca-a87b-2c79b5ac7acc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:23.167653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f95a5cf0-9998-4eca-a87b-2c79b5ac7acc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:23.168092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f95a5cf0-9998-4eca-a87b-2c79b5ac7acc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:23.168783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f95a5cf0-9998-4eca-a87b-2c79b5ac7acc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:23.169238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f95a5cf0-9998-4eca-a87b-2c79b5ac7acc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:23.169704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f95a5cf0-9998-4eca-a87b-2c79b5ac7acc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:23.302519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f95a5cf0-9998-4eca-a87b-2c79b5ac7acc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:23.311401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f95a5cf0-9998-4eca-a87b-2c79b5ac7acc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155213 Aug 18 22:13:23.311972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1450/2892] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:23 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:23.331192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aa260b34-2f0e-46b3-94ac-bfe69eee5f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:23.331811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-aa260b34-2f0e-46b3-94ac-bfe69eee5f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:23.337762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa260b34-2f0e-46b3-94ac-bfe69eee5f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:23.338247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa260b34-2f0e-46b3-94ac-bfe69eee5f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:23.338689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa260b34-2f0e-46b3-94ac-bfe69eee5f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:23.339373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa260b34-2f0e-46b3-94ac-bfe69eee5f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:23.339830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa260b34-2f0e-46b3-94ac-bfe69eee5f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:23.340256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa260b34-2f0e-46b3-94ac-bfe69eee5f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:23.469342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aa260b34-2f0e-46b3-94ac-bfe69eee5f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:23.478307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aa260b34-2f0e-46b3-94ac-bfe69eee5f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:23.480415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aa260b34-2f0e-46b3-94ac-bfe69eee5f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:23.481573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aa260b34-2f0e-46b3-94ac-bfe69eee5f66 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154221 Aug 18 22:13:23.482162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1443/2893] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:23.565327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-39a0b8ae-11fd-4127-a279-40328922b130 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:23.565972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-39a0b8ae-11fd-4127-a279-40328922b130 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:23.571945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39a0b8ae-11fd-4127-a279-40328922b130 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:23.572451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39a0b8ae-11fd-4127-a279-40328922b130 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:23.572894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39a0b8ae-11fd-4127-a279-40328922b130 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:23.573589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39a0b8ae-11fd-4127-a279-40328922b130 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:23.574100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39a0b8ae-11fd-4127-a279-40328922b130 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:23.574531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39a0b8ae-11fd-4127-a279-40328922b130 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:23.704325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-39a0b8ae-11fd-4127-a279-40328922b130 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:23.712437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-39a0b8ae-11fd-4127-a279-40328922b130 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150998 Aug 18 22:13:23.713540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1451/2894] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:23 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:23.837020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2df2a3c9-5db9-4c4b-a0a9-23a0be04715e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:23.837662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2df2a3c9-5db9-4c4b-a0a9-23a0be04715e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:23.844394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2df2a3c9-5db9-4c4b-a0a9-23a0be04715e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:23.844878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2df2a3c9-5db9-4c4b-a0a9-23a0be04715e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:23.845316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2df2a3c9-5db9-4c4b-a0a9-23a0be04715e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:23.846034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2df2a3c9-5db9-4c4b-a0a9-23a0be04715e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:23.846488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2df2a3c9-5db9-4c4b-a0a9-23a0be04715e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:23.846914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2df2a3c9-5db9-4c4b-a0a9-23a0be04715e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:24.073929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eced6a35-f4ae-4fbc-b607-26da2c29f60b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:24.074568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eced6a35-f4ae-4fbc-b607-26da2c29f60b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:24.080871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eced6a35-f4ae-4fbc-b607-26da2c29f60b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:24.081357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eced6a35-f4ae-4fbc-b607-26da2c29f60b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:24.081824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eced6a35-f4ae-4fbc-b607-26da2c29f60b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:24.082526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eced6a35-f4ae-4fbc-b607-26da2c29f60b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:24.082985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eced6a35-f4ae-4fbc-b607-26da2c29f60b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:24.083407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eced6a35-f4ae-4fbc-b607-26da2c29f60b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:24.191842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2df2a3c9-5db9-4c4b-a0a9-23a0be04715e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:24.200708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2df2a3c9-5db9-4c4b-a0a9-23a0be04715e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.367508 Aug 18 22:13:24.201297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1444/2895] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:23 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:24.215494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eced6a35-f4ae-4fbc-b607-26da2c29f60b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:24.223667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eced6a35-f4ae-4fbc-b607-26da2c29f60b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154152 Aug 18 22:13:24.224234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1452/2896] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:24 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:24.332079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-16993dd7-baf2-4085-a8ea-ac67a3748042 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:24.332627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-16993dd7-baf2-4085-a8ea-ac67a3748042 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:24.338493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16993dd7-baf2-4085-a8ea-ac67a3748042 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:24.338968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16993dd7-baf2-4085-a8ea-ac67a3748042 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:24.339408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16993dd7-baf2-4085-a8ea-ac67a3748042 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:24.340091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16993dd7-baf2-4085-a8ea-ac67a3748042 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:24.340540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16993dd7-baf2-4085-a8ea-ac67a3748042 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:24.340964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16993dd7-baf2-4085-a8ea-ac67a3748042 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:24.466363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-16993dd7-baf2-4085-a8ea-ac67a3748042 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:24.474596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-16993dd7-baf2-4085-a8ea-ac67a3748042 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.146390 Aug 18 22:13:24.475160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1445/2897] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:24.504220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f78298cc-c284-4ba4-ab4f-f97be14f5fd7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:24.504843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f78298cc-c284-4ba4-ab4f-f97be14f5fd7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:24.511505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f78298cc-c284-4ba4-ab4f-f97be14f5fd7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:24.511987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f78298cc-c284-4ba4-ab4f-f97be14f5fd7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:24.512427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f78298cc-c284-4ba4-ab4f-f97be14f5fd7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:24.513117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f78298cc-c284-4ba4-ab4f-f97be14f5fd7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:24.513574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f78298cc-c284-4ba4-ab4f-f97be14f5fd7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:24.514029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f78298cc-c284-4ba4-ab4f-f97be14f5fd7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:24.643615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f78298cc-c284-4ba4-ab4f-f97be14f5fd7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:24.645876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:24.654228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f78298cc-c284-4ba4-ab4f-f97be14f5fd7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:24.655740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f78298cc-c284-4ba4-ab4f-f97be14f5fd7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:24.656908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f78298cc-c284-4ba4-ab4f-f97be14f5fd7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156711 Aug 18 22:13:24.657473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1453/2898] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:24 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:24.734282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a941dd42-38b4-4420-a663-a545834e8d03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:24.735198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a941dd42-38b4-4420-a663-a545834e8d03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:24.740776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a941dd42-38b4-4420-a663-a545834e8d03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:24.741255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a941dd42-38b4-4420-a663-a545834e8d03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:24.741707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a941dd42-38b4-4420-a663-a545834e8d03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:24.742387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a941dd42-38b4-4420-a663-a545834e8d03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:24.742835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a941dd42-38b4-4420-a663-a545834e8d03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:24.743255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a941dd42-38b4-4420-a663-a545834e8d03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:24.875492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a941dd42-38b4-4420-a663-a545834e8d03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:24.884012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a941dd42-38b4-4420-a663-a545834e8d03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153583 Aug 18 22:13:24.884591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1446/2899] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:24 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:25.222000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-115b77ac-c4f3-4a85-b4f5-f85e84a3c580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:25.222561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-115b77ac-c4f3-4a85-b4f5-f85e84a3c580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:25.229047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-115b77ac-c4f3-4a85-b4f5-f85e84a3c580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:25.230310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-115b77ac-c4f3-4a85-b4f5-f85e84a3c580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:25.230787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-115b77ac-c4f3-4a85-b4f5-f85e84a3c580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:25.231479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-115b77ac-c4f3-4a85-b4f5-f85e84a3c580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:25.231937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-115b77ac-c4f3-4a85-b4f5-f85e84a3c580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:25.232366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-115b77ac-c4f3-4a85-b4f5-f85e84a3c580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:25.244916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f410c046-6f81-4986-9793-d91b702b9b66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:25.245584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f410c046-6f81-4986-9793-d91b702b9b66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:25.247906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:25.253361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f410c046-6f81-4986-9793-d91b702b9b66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:25.253884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f410c046-6f81-4986-9793-d91b702b9b66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:25.254320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f410c046-6f81-4986-9793-d91b702b9b66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:25.255042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f410c046-6f81-4986-9793-d91b702b9b66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:25.255580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f410c046-6f81-4986-9793-d91b702b9b66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:25.256006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f410c046-6f81-4986-9793-d91b702b9b66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:25.362661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-115b77ac-c4f3-4a85-b4f5-f85e84a3c580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:25.370721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-115b77ac-c4f3-4a85-b4f5-f85e84a3c580 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152822 Aug 18 22:13:25.371285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1454/2900] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:25.384263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f410c046-6f81-4986-9793-d91b702b9b66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:25.393044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f410c046-6f81-4986-9793-d91b702b9b66 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152037 Aug 18 22:13:25.393640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1447/2901] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:25 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:25.495286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dbaffd34-1bff-4797-9b09-723a99745f6f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:25.495823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dbaffd34-1bff-4797-9b09-723a99745f6f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:25.501828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbaffd34-1bff-4797-9b09-723a99745f6f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:25.502310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbaffd34-1bff-4797-9b09-723a99745f6f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:25.502743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbaffd34-1bff-4797-9b09-723a99745f6f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:25.503490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbaffd34-1bff-4797-9b09-723a99745f6f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:25.503919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbaffd34-1bff-4797-9b09-723a99745f6f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:25.504343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbaffd34-1bff-4797-9b09-723a99745f6f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:25.628158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dbaffd34-1bff-4797-9b09-723a99745f6f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:25.636765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dbaffd34-1bff-4797-9b09-723a99745f6f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.145432 Aug 18 22:13:25.637328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1455/2902] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:25 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:25.680125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6cfca440-c2fc-48e2-89cd-e7bc22cf75d2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:25.680737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6cfca440-c2fc-48e2-89cd-e7bc22cf75d2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:25.687189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cfca440-c2fc-48e2-89cd-e7bc22cf75d2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:25.687695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cfca440-c2fc-48e2-89cd-e7bc22cf75d2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:25.688130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cfca440-c2fc-48e2-89cd-e7bc22cf75d2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:25.688817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cfca440-c2fc-48e2-89cd-e7bc22cf75d2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:25.689265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cfca440-c2fc-48e2-89cd-e7bc22cf75d2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:25.689713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cfca440-c2fc-48e2-89cd-e7bc22cf75d2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:25.818835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6cfca440-c2fc-48e2-89cd-e7bc22cf75d2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:25.828302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6cfca440-c2fc-48e2-89cd-e7bc22cf75d2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:25.829826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6cfca440-c2fc-48e2-89cd-e7bc22cf75d2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:25.830996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6cfca440-c2fc-48e2-89cd-e7bc22cf75d2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154695 Aug 18 22:13:25.831560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1448/2903] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:25 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:13:25.904727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9f07072e-89e9-4384-9094-15efa20e8799 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:25.905340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9f07072e-89e9-4384-9094-15efa20e8799 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:25.911302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f07072e-89e9-4384-9094-15efa20e8799 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:25.911779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f07072e-89e9-4384-9094-15efa20e8799 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:25.912214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f07072e-89e9-4384-9094-15efa20e8799 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:25.912899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f07072e-89e9-4384-9094-15efa20e8799 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:25.913355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f07072e-89e9-4384-9094-15efa20e8799 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:25.913813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f07072e-89e9-4384-9094-15efa20e8799 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:26.044214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9f07072e-89e9-4384-9094-15efa20e8799 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:26.052563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9f07072e-89e9-4384-9094-15efa20e8799 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151735 Aug 18 22:13:26.053125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1456/2904] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:25 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:26.392592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ad27a3ef-7240-470d-afdd-bac57710bfc0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:26.393211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ad27a3ef-7240-470d-afdd-bac57710bfc0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:26.399738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad27a3ef-7240-470d-afdd-bac57710bfc0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:26.400221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad27a3ef-7240-470d-afdd-bac57710bfc0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:26.400655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad27a3ef-7240-470d-afdd-bac57710bfc0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:26.401909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad27a3ef-7240-470d-afdd-bac57710bfc0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:26.402364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad27a3ef-7240-470d-afdd-bac57710bfc0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:26.402790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad27a3ef-7240-470d-afdd-bac57710bfc0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:26.414515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e0fb3ca4-eadc-499f-9fd4-eb67e0192ef6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:26.415137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e0fb3ca4-eadc-499f-9fd4-eb67e0192ef6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:26.422282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0fb3ca4-eadc-499f-9fd4-eb67e0192ef6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:26.422768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0fb3ca4-eadc-499f-9fd4-eb67e0192ef6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:26.423213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0fb3ca4-eadc-499f-9fd4-eb67e0192ef6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:26.423909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0fb3ca4-eadc-499f-9fd4-eb67e0192ef6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:26.424370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0fb3ca4-eadc-499f-9fd4-eb67e0192ef6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:26.424802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0fb3ca4-eadc-499f-9fd4-eb67e0192ef6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:26.532373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ad27a3ef-7240-470d-afdd-bac57710bfc0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:26.540529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ad27a3ef-7240-470d-afdd-bac57710bfc0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152148 Aug 18 22:13:26.541110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1449/2905] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:26 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:26.554261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e0fb3ca4-eadc-499f-9fd4-eb67e0192ef6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:26.562366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e0fb3ca4-eadc-499f-9fd4-eb67e0192ef6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151651 Aug 18 22:13:26.562931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1457/2906] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:26 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:26.657158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9c599520-3832-4559-afdf-2a5cb71394c8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:26.657724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9c599520-3832-4559-afdf-2a5cb71394c8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:26.663553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c599520-3832-4559-afdf-2a5cb71394c8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:26.664026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c599520-3832-4559-afdf-2a5cb71394c8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:26.664458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c599520-3832-4559-afdf-2a5cb71394c8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:26.665136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c599520-3832-4559-afdf-2a5cb71394c8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:26.665584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c599520-3832-4559-afdf-2a5cb71394c8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:26.666026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c599520-3832-4559-afdf-2a5cb71394c8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:26.795003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9c599520-3832-4559-afdf-2a5cb71394c8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:26.803453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9c599520-3832-4559-afdf-2a5cb71394c8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150145 Aug 18 22:13:26.804028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1450/2907] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:26 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:26.853874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f9e76fad-36c9-4239-b009-06aad6aee8e6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:26.854489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f9e76fad-36c9-4239-b009-06aad6aee8e6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:26.860355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9e76fad-36c9-4239-b009-06aad6aee8e6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:26.860830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9e76fad-36c9-4239-b009-06aad6aee8e6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:26.861260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9e76fad-36c9-4239-b009-06aad6aee8e6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:26.861959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9e76fad-36c9-4239-b009-06aad6aee8e6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:26.862404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9e76fad-36c9-4239-b009-06aad6aee8e6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:26.862830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9e76fad-36c9-4239-b009-06aad6aee8e6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:26.993928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f9e76fad-36c9-4239-b009-06aad6aee8e6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:27.003467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f9e76fad-36c9-4239-b009-06aad6aee8e6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:27.004949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f9e76fad-36c9-4239-b009-06aad6aee8e6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:27.006136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f9e76fad-36c9-4239-b009-06aad6aee8e6 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156263 Aug 18 22:13:27.006699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1458/2908] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:26 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:27.074371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4a67b686-bf6c-4972-aadb-fa219548a391 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:27.074986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4a67b686-bf6c-4972-aadb-fa219548a391 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:27.081189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a67b686-bf6c-4972-aadb-fa219548a391 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:27.081711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a67b686-bf6c-4972-aadb-fa219548a391 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:27.082143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a67b686-bf6c-4972-aadb-fa219548a391 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:27.082859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a67b686-bf6c-4972-aadb-fa219548a391 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:27.083305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a67b686-bf6c-4972-aadb-fa219548a391 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:27.083726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a67b686-bf6c-4972-aadb-fa219548a391 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:27.208805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4a67b686-bf6c-4972-aadb-fa219548a391 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:27.217440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4a67b686-bf6c-4972-aadb-fa219548a391 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.146915 Aug 18 22:13:27.218107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1451/2909] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:27 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:27.562600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-78e33506-32f4-4a01-aea6-08a2f233ec9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:27.563256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-78e33506-32f4-4a01-aea6-08a2f233ec9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:27.569723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78e33506-32f4-4a01-aea6-08a2f233ec9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:27.570207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78e33506-32f4-4a01-aea6-08a2f233ec9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:27.570643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78e33506-32f4-4a01-aea6-08a2f233ec9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:27.571330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78e33506-32f4-4a01-aea6-08a2f233ec9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:27.571786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78e33506-32f4-4a01-aea6-08a2f233ec9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:27.572213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78e33506-32f4-4a01-aea6-08a2f233ec9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:27.583407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ae25e764-70ab-42ba-914e-556c623e1ed8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:27.584062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ae25e764-70ab-42ba-914e-556c623e1ed8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:27.591511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ae25e764-70ab-42ba-914e-556c623e1ed8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:27.592003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ae25e764-70ab-42ba-914e-556c623e1ed8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:27.592438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ae25e764-70ab-42ba-914e-556c623e1ed8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:27.593132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ae25e764-70ab-42ba-914e-556c623e1ed8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:27.593588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ae25e764-70ab-42ba-914e-556c623e1ed8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:27.594028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ae25e764-70ab-42ba-914e-556c623e1ed8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:27.609164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:27.702694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-78e33506-32f4-4a01-aea6-08a2f233ec9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:27.711081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-78e33506-32f4-4a01-aea6-08a2f233ec9c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152197 Aug 18 22:13:27.712014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1459/2910] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:27.731671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ae25e764-70ab-42ba-914e-556c623e1ed8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:27.740043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ae25e764-70ab-42ba-914e-556c623e1ed8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.160572 Aug 18 22:13:27.740619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1452/2911] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:27 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:27.824913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3a52bdc4-326b-43a5-831d-3419c122c0ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:27.825453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3a52bdc4-326b-43a5-831d-3419c122c0ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:27.831515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a52bdc4-326b-43a5-831d-3419c122c0ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:27.831997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a52bdc4-326b-43a5-831d-3419c122c0ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:27.832433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a52bdc4-326b-43a5-831d-3419c122c0ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:27.833121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a52bdc4-326b-43a5-831d-3419c122c0ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:27.833578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a52bdc4-326b-43a5-831d-3419c122c0ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:27.834049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a52bdc4-326b-43a5-831d-3419c122c0ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:27.962409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3a52bdc4-326b-43a5-831d-3419c122c0ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:27.971257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3a52bdc4-326b-43a5-831d-3419c122c0ec tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150777 Aug 18 22:13:27.971869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1460/2912] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:27 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:28.030004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-608bdeb5-7f99-45ef-a300-475ca3a5bb75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:28.030619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-608bdeb5-7f99-45ef-a300-475ca3a5bb75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:28.036729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-608bdeb5-7f99-45ef-a300-475ca3a5bb75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:28.037205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-608bdeb5-7f99-45ef-a300-475ca3a5bb75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:28.037667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-608bdeb5-7f99-45ef-a300-475ca3a5bb75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:28.038345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-608bdeb5-7f99-45ef-a300-475ca3a5bb75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:28.038792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-608bdeb5-7f99-45ef-a300-475ca3a5bb75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:28.039209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-608bdeb5-7f99-45ef-a300-475ca3a5bb75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:28.169900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-608bdeb5-7f99-45ef-a300-475ca3a5bb75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:28.178713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-608bdeb5-7f99-45ef-a300-475ca3a5bb75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:28.180207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-608bdeb5-7f99-45ef-a300-475ca3a5bb75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:28.181383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-608bdeb5-7f99-45ef-a300-475ca3a5bb75 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155796 Aug 18 22:13:28.181974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1453/2913] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:28.239785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7b599540-a191-4af1-866b-835fce6528dc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:28.240393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7b599540-a191-4af1-866b-835fce6528dc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:28.246265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b599540-a191-4af1-866b-835fce6528dc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:28.246768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b599540-a191-4af1-866b-835fce6528dc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:28.247203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b599540-a191-4af1-866b-835fce6528dc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:28.247909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b599540-a191-4af1-866b-835fce6528dc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:28.248356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b599540-a191-4af1-866b-835fce6528dc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:28.248775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7b599540-a191-4af1-866b-835fce6528dc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:28.379162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7b599540-a191-4af1-866b-835fce6528dc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:28.387679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7b599540-a191-4af1-866b-835fce6528dc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151690 Aug 18 22:13:28.388248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1461/2914] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:28 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:28.733045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c140110c-298b-46ee-948d-e6e4c0747b90 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:28.733712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c140110c-298b-46ee-948d-e6e4c0747b90 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:28.739667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c140110c-298b-46ee-948d-e6e4c0747b90 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:28.740152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c140110c-298b-46ee-948d-e6e4c0747b90 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:28.740588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c140110c-298b-46ee-948d-e6e4c0747b90 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:28.741275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c140110c-298b-46ee-948d-e6e4c0747b90 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:28.741763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c140110c-298b-46ee-948d-e6e4c0747b90 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:28.742194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c140110c-298b-46ee-948d-e6e4c0747b90 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:28.760149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-be9f00f7-8f80-485d-9cd1-ef8c2d6f2e26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:28.761562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-be9f00f7-8f80-485d-9cd1-ef8c2d6f2e26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:28.768064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be9f00f7-8f80-485d-9cd1-ef8c2d6f2e26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:28.768552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be9f00f7-8f80-485d-9cd1-ef8c2d6f2e26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:28.768989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be9f00f7-8f80-485d-9cd1-ef8c2d6f2e26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:28.769717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be9f00f7-8f80-485d-9cd1-ef8c2d6f2e26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:28.770292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be9f00f7-8f80-485d-9cd1-ef8c2d6f2e26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:28.770721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be9f00f7-8f80-485d-9cd1-ef8c2d6f2e26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:28.874788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c140110c-298b-46ee-948d-e6e4c0747b90 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:28.883152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c140110c-298b-46ee-948d-e6e4c0747b90 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153973 Aug 18 22:13:28.883729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1454/2915] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:28.905136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-be9f00f7-8f80-485d-9cd1-ef8c2d6f2e26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:28.913301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-be9f00f7-8f80-485d-9cd1-ef8c2d6f2e26 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156948 Aug 18 22:13:28.913941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1462/2916] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:28 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:28.992422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-64d4d283-43cf-49a7-994b-e1dbbacf2573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:28.993050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-64d4d283-43cf-49a7-994b-e1dbbacf2573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:28.999485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64d4d283-43cf-49a7-994b-e1dbbacf2573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:28.999964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64d4d283-43cf-49a7-994b-e1dbbacf2573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:29.000422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64d4d283-43cf-49a7-994b-e1dbbacf2573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:29.001105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64d4d283-43cf-49a7-994b-e1dbbacf2573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:29.001554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64d4d283-43cf-49a7-994b-e1dbbacf2573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:29.002002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64d4d283-43cf-49a7-994b-e1dbbacf2573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:29.135985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-64d4d283-43cf-49a7-994b-e1dbbacf2573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:29.145339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-64d4d283-43cf-49a7-994b-e1dbbacf2573 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.156930 Aug 18 22:13:29.146022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1455/2917] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:28 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:29.203813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0e326eb1-7027-48c6-952d-ae357100dfc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:29.204434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0e326eb1-7027-48c6-952d-ae357100dfc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:29.210476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e326eb1-7027-48c6-952d-ae357100dfc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:29.210959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e326eb1-7027-48c6-952d-ae357100dfc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:29.211433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e326eb1-7027-48c6-952d-ae357100dfc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:29.212123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e326eb1-7027-48c6-952d-ae357100dfc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:29.212578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e326eb1-7027-48c6-952d-ae357100dfc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:29.213008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e326eb1-7027-48c6-952d-ae357100dfc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:29.345768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0e326eb1-7027-48c6-952d-ae357100dfc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:29.354211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0e326eb1-7027-48c6-952d-ae357100dfc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:29.356187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0e326eb1-7027-48c6-952d-ae357100dfc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:29.357327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0e326eb1-7027-48c6-952d-ae357100dfc9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157453 Aug 18 22:13:29.357916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1463/2918] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:29.407828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ef3f5850-a012-49da-b0f4-84c26add9aed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:29.408480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ef3f5850-a012-49da-b0f4-84c26add9aed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:29.414458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef3f5850-a012-49da-b0f4-84c26add9aed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:29.414944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef3f5850-a012-49da-b0f4-84c26add9aed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:29.415388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef3f5850-a012-49da-b0f4-84c26add9aed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:29.416079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef3f5850-a012-49da-b0f4-84c26add9aed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:29.416534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef3f5850-a012-49da-b0f4-84c26add9aed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:29.418675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef3f5850-a012-49da-b0f4-84c26add9aed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:29.541276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ef3f5850-a012-49da-b0f4-84c26add9aed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:29.550256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ef3f5850-a012-49da-b0f4-84c26add9aed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.146178 Aug 18 22:13:29.551020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1456/2919] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:29 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:29.905454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9b45b8b0-aebb-4cf0-a14e-eb4299160336 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:29.906033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9b45b8b0-aebb-4cf0-a14e-eb4299160336 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:29.908370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:29.913651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b45b8b0-aebb-4cf0-a14e-eb4299160336 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:29.914141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b45b8b0-aebb-4cf0-a14e-eb4299160336 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:29.914581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b45b8b0-aebb-4cf0-a14e-eb4299160336 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:29.915280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b45b8b0-aebb-4cf0-a14e-eb4299160336 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:29.915732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b45b8b0-aebb-4cf0-a14e-eb4299160336 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:29.916158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9b45b8b0-aebb-4cf0-a14e-eb4299160336 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:29.934872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-74b49a20-297c-4dde-bea4-50d100d84100 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:29.935484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-74b49a20-297c-4dde-bea4-50d100d84100 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:29.941345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74b49a20-297c-4dde-bea4-50d100d84100 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:29.941861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74b49a20-297c-4dde-bea4-50d100d84100 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:29.942422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74b49a20-297c-4dde-bea4-50d100d84100 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:29.943117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74b49a20-297c-4dde-bea4-50d100d84100 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:29.943574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74b49a20-297c-4dde-bea4-50d100d84100 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:29.943998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74b49a20-297c-4dde-bea4-50d100d84100 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:30.047009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9b45b8b0-aebb-4cf0-a14e-eb4299160336 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:30.055406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9b45b8b0-aebb-4cf0-a14e-eb4299160336 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154713 Aug 18 22:13:30.056024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1464/2920] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:29 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:30.074893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-74b49a20-297c-4dde-bea4-50d100d84100 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:30.083082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-74b49a20-297c-4dde-bea4-50d100d84100 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152066 Aug 18 22:13:30.083661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1457/2921] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:29 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:30.171019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-32b56062-294a-4dfc-a5b3-6966ac440da8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:30.171577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-32b56062-294a-4dfc-a5b3-6966ac440da8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:30.179372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32b56062-294a-4dfc-a5b3-6966ac440da8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:30.179851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32b56062-294a-4dfc-a5b3-6966ac440da8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:30.180286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32b56062-294a-4dfc-a5b3-6966ac440da8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:30.180969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32b56062-294a-4dfc-a5b3-6966ac440da8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:30.181415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32b56062-294a-4dfc-a5b3-6966ac440da8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:30.181872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32b56062-294a-4dfc-a5b3-6966ac440da8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:30.227853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:13:30.228077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:13:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 (ip 10.222.0.82) !!! Aug 18 22:13:30.311876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-32b56062-294a-4dfc-a5b3-6966ac440da8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:30.320030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-32b56062-294a-4dfc-a5b3-6966ac440da8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.157285 Aug 18 22:13:30.320600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1465/2922] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:30.380380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fa79e5ec-e86a-4c87-a933-4cd82bc2493a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:30.381002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fa79e5ec-e86a-4c87-a933-4cd82bc2493a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:30.387001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa79e5ec-e86a-4c87-a933-4cd82bc2493a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:30.387484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa79e5ec-e86a-4c87-a933-4cd82bc2493a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:30.387931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa79e5ec-e86a-4c87-a933-4cd82bc2493a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:30.388624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa79e5ec-e86a-4c87-a933-4cd82bc2493a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:30.389082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa79e5ec-e86a-4c87-a933-4cd82bc2493a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:30.389515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa79e5ec-e86a-4c87-a933-4cd82bc2493a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:30.522755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fa79e5ec-e86a-4c87-a933-4cd82bc2493a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:30.532036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fa79e5ec-e86a-4c87-a933-4cd82bc2493a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:30.533552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fa79e5ec-e86a-4c87-a933-4cd82bc2493a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:30.534757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fa79e5ec-e86a-4c87-a933-4cd82bc2493a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.158268 Aug 18 22:13:30.535326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1458/2923] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:30.570401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4185e383-baac-4c9b-bb67-0dceb5185309 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:30.571024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4185e383-baac-4c9b-bb67-0dceb5185309 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:30.577673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4185e383-baac-4c9b-bb67-0dceb5185309 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:30.578161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4185e383-baac-4c9b-bb67-0dceb5185309 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:30.578603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4185e383-baac-4c9b-bb67-0dceb5185309 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:30.579294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4185e383-baac-4c9b-bb67-0dceb5185309 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:30.579752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4185e383-baac-4c9b-bb67-0dceb5185309 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:30.580183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4185e383-baac-4c9b-bb67-0dceb5185309 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:30.706103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4185e383-baac-4c9b-bb67-0dceb5185309 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:30.714984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4185e383-baac-4c9b-bb67-0dceb5185309 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148392 Aug 18 22:13:30.715859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1466/2924] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:30 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:31.078200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-43345eab-ca9b-491b-b9ec-e0f3870a0b31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:31.078825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-43345eab-ca9b-491b-b9ec-e0f3870a0b31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:31.085348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-43345eab-ca9b-491b-b9ec-e0f3870a0b31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:31.085894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-43345eab-ca9b-491b-b9ec-e0f3870a0b31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:31.086323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-43345eab-ca9b-491b-b9ec-e0f3870a0b31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:31.087017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-43345eab-ca9b-491b-b9ec-e0f3870a0b31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:31.087476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-43345eab-ca9b-491b-b9ec-e0f3870a0b31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:31.087906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-43345eab-ca9b-491b-b9ec-e0f3870a0b31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:31.104696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6385f1f8-75ad-484b-a9d8-b0b4ef3e0f7c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:31.105320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6385f1f8-75ad-484b-a9d8-b0b4ef3e0f7c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:31.112942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6385f1f8-75ad-484b-a9d8-b0b4ef3e0f7c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:31.113833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6385f1f8-75ad-484b-a9d8-b0b4ef3e0f7c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:31.113973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6385f1f8-75ad-484b-a9d8-b0b4ef3e0f7c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:31.114591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6385f1f8-75ad-484b-a9d8-b0b4ef3e0f7c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:31.115050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6385f1f8-75ad-484b-a9d8-b0b4ef3e0f7c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:31.115634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6385f1f8-75ad-484b-a9d8-b0b4ef3e0f7c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:31.228315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-43345eab-ca9b-491b-b9ec-e0f3870a0b31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:31.236895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-43345eab-ca9b-491b-b9ec-e0f3870a0b31 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.162503 Aug 18 22:13:31.237476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1459/2925] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:31 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:31.250028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6385f1f8-75ad-484b-a9d8-b0b4ef3e0f7c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:31.258255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6385f1f8-75ad-484b-a9d8-b0b4ef3e0f7c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.157555 Aug 18 22:13:31.258824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1467/2926] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:31.340163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3c44df99-1465-42e4-98c8-ffb057b9477b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:31.340807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3c44df99-1465-42e4-98c8-ffb057b9477b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:31.346723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c44df99-1465-42e4-98c8-ffb057b9477b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:31.347202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c44df99-1465-42e4-98c8-ffb057b9477b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:31.347633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c44df99-1465-42e4-98c8-ffb057b9477b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:31.348313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c44df99-1465-42e4-98c8-ffb057b9477b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:31.348768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c44df99-1465-42e4-98c8-ffb057b9477b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:31.349190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c44df99-1465-42e4-98c8-ffb057b9477b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:31.480669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3c44df99-1465-42e4-98c8-ffb057b9477b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:31.489091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3c44df99-1465-42e4-98c8-ffb057b9477b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152784 Aug 18 22:13:31.489673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1460/2927] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:31 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:31.558333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2826f292-db25-4f43-ba17-63812613ea2e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:31.558949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2826f292-db25-4f43-ba17-63812613ea2e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:31.564827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2826f292-db25-4f43-ba17-63812613ea2e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:31.565309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2826f292-db25-4f43-ba17-63812613ea2e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:31.565793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2826f292-db25-4f43-ba17-63812613ea2e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:31.566483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2826f292-db25-4f43-ba17-63812613ea2e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:31.566943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2826f292-db25-4f43-ba17-63812613ea2e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:31.567370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2826f292-db25-4f43-ba17-63812613ea2e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:31.695405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2826f292-db25-4f43-ba17-63812613ea2e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:31.704116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2826f292-db25-4f43-ba17-63812613ea2e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:31.705632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2826f292-db25-4f43-ba17-63812613ea2e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:31.706820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2826f292-db25-4f43-ba17-63812613ea2e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153006 Aug 18 22:13:31.707390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1468/2928] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:31 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:31.736407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ffdb21ff-b6b2-4f8c-af23-419a92c261e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:31.737026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ffdb21ff-b6b2-4f8c-af23-419a92c261e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:31.742984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffdb21ff-b6b2-4f8c-af23-419a92c261e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:31.743504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffdb21ff-b6b2-4f8c-af23-419a92c261e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:31.743937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffdb21ff-b6b2-4f8c-af23-419a92c261e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:31.744618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffdb21ff-b6b2-4f8c-af23-419a92c261e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:31.745142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffdb21ff-b6b2-4f8c-af23-419a92c261e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:31.745566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffdb21ff-b6b2-4f8c-af23-419a92c261e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:31.874726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ffdb21ff-b6b2-4f8c-af23-419a92c261e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:31.882826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ffdb21ff-b6b2-4f8c-af23-419a92c261e7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150230 Aug 18 22:13:31.883406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1461/2929] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:31 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:32.258750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-816e3200-6244-483a-b3d2-948668a8ad6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:32.259375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-816e3200-6244-483a-b3d2-948668a8ad6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:32.266339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-816e3200-6244-483a-b3d2-948668a8ad6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:32.266827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-816e3200-6244-483a-b3d2-948668a8ad6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:32.267274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-816e3200-6244-483a-b3d2-948668a8ad6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:32.267971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-816e3200-6244-483a-b3d2-948668a8ad6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:32.268429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-816e3200-6244-483a-b3d2-948668a8ad6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:32.268860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-816e3200-6244-483a-b3d2-948668a8ad6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:32.280415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-248e63b1-edc0-46d2-98e1-ad336390e46d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:32.281034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-248e63b1-edc0-46d2-98e1-ad336390e46d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:32.287458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-248e63b1-edc0-46d2-98e1-ad336390e46d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:32.287942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-248e63b1-edc0-46d2-98e1-ad336390e46d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:32.288375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-248e63b1-edc0-46d2-98e1-ad336390e46d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:32.289064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-248e63b1-edc0-46d2-98e1-ad336390e46d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:32.289526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-248e63b1-edc0-46d2-98e1-ad336390e46d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:32.289976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-248e63b1-edc0-46d2-98e1-ad336390e46d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:32.399288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-816e3200-6244-483a-b3d2-948668a8ad6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:32.408278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-816e3200-6244-483a-b3d2-948668a8ad6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153366 Aug 18 22:13:32.408865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1469/2930] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:32 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:32.424363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-248e63b1-edc0-46d2-98e1-ad336390e46d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:32.433269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-248e63b1-edc0-46d2-98e1-ad336390e46d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.157419 Aug 18 22:13:32.433875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1462/2931] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:32 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:32.511520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1cb5a7a0-9163-4acc-86a0-e4cc0acdbdf0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:32.511928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1cb5a7a0-9163-4acc-86a0-e4cc0acdbdf0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:32.517864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1cb5a7a0-9163-4acc-86a0-e4cc0acdbdf0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:32.518350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1cb5a7a0-9163-4acc-86a0-e4cc0acdbdf0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:32.518789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1cb5a7a0-9163-4acc-86a0-e4cc0acdbdf0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:32.519484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1cb5a7a0-9163-4acc-86a0-e4cc0acdbdf0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:32.519939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1cb5a7a0-9163-4acc-86a0-e4cc0acdbdf0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:32.520370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1cb5a7a0-9163-4acc-86a0-e4cc0acdbdf0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:32.535310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:32.649552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1cb5a7a0-9163-4acc-86a0-e4cc0acdbdf0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:32.657890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1cb5a7a0-9163-4acc-86a0-e4cc0acdbdf0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151017 Aug 18 22:13:32.658468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1470/2932] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:32.729987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5ad9cafa-bad9-4b9f-aea3-5754ac4e8609 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:32.730617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5ad9cafa-bad9-4b9f-aea3-5754ac4e8609 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:32.736614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ad9cafa-bad9-4b9f-aea3-5754ac4e8609 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:32.737090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ad9cafa-bad9-4b9f-aea3-5754ac4e8609 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:32.737517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ad9cafa-bad9-4b9f-aea3-5754ac4e8609 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:32.738222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ad9cafa-bad9-4b9f-aea3-5754ac4e8609 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:32.738670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ad9cafa-bad9-4b9f-aea3-5754ac4e8609 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:32.739090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ad9cafa-bad9-4b9f-aea3-5754ac4e8609 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:32.867186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5ad9cafa-bad9-4b9f-aea3-5754ac4e8609 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:32.876398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5ad9cafa-bad9-4b9f-aea3-5754ac4e8609 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:32.877926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5ad9cafa-bad9-4b9f-aea3-5754ac4e8609 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:32.879085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5ad9cafa-bad9-4b9f-aea3-5754ac4e8609 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153018 Aug 18 22:13:32.879648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1463/2933] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:32.902388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2705e867-9b91-48bb-805a-e5317b1622b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:32.903013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2705e867-9b91-48bb-805a-e5317b1622b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:32.909293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2705e867-9b91-48bb-805a-e5317b1622b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:32.909822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2705e867-9b91-48bb-805a-e5317b1622b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:32.910260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2705e867-9b91-48bb-805a-e5317b1622b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:32.910942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2705e867-9b91-48bb-805a-e5317b1622b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:32.911395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2705e867-9b91-48bb-805a-e5317b1622b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:32.911817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2705e867-9b91-48bb-805a-e5317b1622b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:33.038432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2705e867-9b91-48bb-805a-e5317b1622b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:33.047146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2705e867-9b91-48bb-805a-e5317b1622b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148537 Aug 18 22:13:33.047728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1471/2934] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:32 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:33.430260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3c4af179-d48c-4ea6-a302-912cc2bd4230 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:33.430819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3c4af179-d48c-4ea6-a302-912cc2bd4230 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:33.437318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c4af179-d48c-4ea6-a302-912cc2bd4230 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:33.437837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c4af179-d48c-4ea6-a302-912cc2bd4230 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:33.438280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c4af179-d48c-4ea6-a302-912cc2bd4230 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:33.438974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c4af179-d48c-4ea6-a302-912cc2bd4230 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:33.439432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c4af179-d48c-4ea6-a302-912cc2bd4230 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:33.439861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c4af179-d48c-4ea6-a302-912cc2bd4230 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:33.454606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-49e42b40-7e2a-4c97-9c1e-ece15ac2c764 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:33.455224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-49e42b40-7e2a-4c97-9c1e-ece15ac2c764 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:33.461684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49e42b40-7e2a-4c97-9c1e-ece15ac2c764 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:33.462167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49e42b40-7e2a-4c97-9c1e-ece15ac2c764 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:33.462606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49e42b40-7e2a-4c97-9c1e-ece15ac2c764 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:33.463297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49e42b40-7e2a-4c97-9c1e-ece15ac2c764 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:33.464249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49e42b40-7e2a-4c97-9c1e-ece15ac2c764 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:33.464674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-49e42b40-7e2a-4c97-9c1e-ece15ac2c764 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:33.568960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3c4af179-d48c-4ea6-a302-912cc2bd4230 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:33.578032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3c4af179-d48c-4ea6-a302-912cc2bd4230 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151596 Aug 18 22:13:33.578623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1464/2935] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:33 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:33.595218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-49e42b40-7e2a-4c97-9c1e-ece15ac2c764 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:33.603434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-49e42b40-7e2a-4c97-9c1e-ece15ac2c764 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152643 Aug 18 22:13:33.603995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1472/2936] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:33.678815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-27ff7c12-01cb-47eb-960d-eccf45fe98e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:33.679437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-27ff7c12-01cb-47eb-960d-eccf45fe98e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:33.686324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27ff7c12-01cb-47eb-960d-eccf45fe98e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:33.686785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27ff7c12-01cb-47eb-960d-eccf45fe98e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:33.687228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27ff7c12-01cb-47eb-960d-eccf45fe98e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:33.687929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27ff7c12-01cb-47eb-960d-eccf45fe98e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:33.688386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27ff7c12-01cb-47eb-960d-eccf45fe98e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:33.688817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27ff7c12-01cb-47eb-960d-eccf45fe98e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:33.822754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-27ff7c12-01cb-47eb-960d-eccf45fe98e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:33.831110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-27ff7c12-01cb-47eb-960d-eccf45fe98e1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.156635 Aug 18 22:13:33.831687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1465/2937] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:33 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:33.901858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-16a81821-dc48-4c00-b146-beae3ae5f6e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:33.902475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-16a81821-dc48-4c00-b146-beae3ae5f6e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:33.908369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16a81821-dc48-4c00-b146-beae3ae5f6e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:33.908847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16a81821-dc48-4c00-b146-beae3ae5f6e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:33.909289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16a81821-dc48-4c00-b146-beae3ae5f6e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:33.910011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16a81821-dc48-4c00-b146-beae3ae5f6e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:33.910466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16a81821-dc48-4c00-b146-beae3ae5f6e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:33.910892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16a81821-dc48-4c00-b146-beae3ae5f6e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:34.040198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-16a81821-dc48-4c00-b146-beae3ae5f6e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:34.049769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-16a81821-dc48-4c00-b146-beae3ae5f6e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:34.051551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-16a81821-dc48-4c00-b146-beae3ae5f6e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:34.059669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-16a81821-dc48-4c00-b146-beae3ae5f6e5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155301 Aug 18 22:13:34.059669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1473/2938] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:33 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:34.068171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c43be106-9fff-4fa2-ae58-1ea98dc19cc8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:34.068696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c43be106-9fff-4fa2-ae58-1ea98dc19cc8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:34.075365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c43be106-9fff-4fa2-ae58-1ea98dc19cc8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:34.075849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c43be106-9fff-4fa2-ae58-1ea98dc19cc8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:34.076285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c43be106-9fff-4fa2-ae58-1ea98dc19cc8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:34.076980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c43be106-9fff-4fa2-ae58-1ea98dc19cc8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:34.077430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c43be106-9fff-4fa2-ae58-1ea98dc19cc8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:34.077904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c43be106-9fff-4fa2-ae58-1ea98dc19cc8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:34.206239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c43be106-9fff-4fa2-ae58-1ea98dc19cc8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:34.215254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c43be106-9fff-4fa2-ae58-1ea98dc19cc8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150942 Aug 18 22:13:34.216023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1466/2939] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:34 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:34.598924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-82297e35-9280-48fe-9abe-e95fe8e114b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:34.599486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-82297e35-9280-48fe-9abe-e95fe8e114b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:34.605950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82297e35-9280-48fe-9abe-e95fe8e114b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:34.606429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82297e35-9280-48fe-9abe-e95fe8e114b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:34.606866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82297e35-9280-48fe-9abe-e95fe8e114b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:34.607550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82297e35-9280-48fe-9abe-e95fe8e114b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:34.608003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82297e35-9280-48fe-9abe-e95fe8e114b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:34.608424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82297e35-9280-48fe-9abe-e95fe8e114b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:34.624991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eb0b6ebf-8eb4-4599-a4c1-a35934c1e506 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:34.625706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eb0b6ebf-8eb4-4599-a4c1-a35934c1e506 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:34.632109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb0b6ebf-8eb4-4599-a4c1-a35934c1e506 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:34.632603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb0b6ebf-8eb4-4599-a4c1-a35934c1e506 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:34.633042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb0b6ebf-8eb4-4599-a4c1-a35934c1e506 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:34.633845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb0b6ebf-8eb4-4599-a4c1-a35934c1e506 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:34.634268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb0b6ebf-8eb4-4599-a4c1-a35934c1e506 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:34.634702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb0b6ebf-8eb4-4599-a4c1-a35934c1e506 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:34.739667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-82297e35-9280-48fe-9abe-e95fe8e114b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:34.748338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-82297e35-9280-48fe-9abe-e95fe8e114b0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153340 Aug 18 22:13:34.748966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1474/2940] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:34 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:34.768573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-eb0b6ebf-8eb4-4599-a4c1-a35934c1e506 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:34.777057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eb0b6ebf-8eb4-4599-a4c1-a35934c1e506 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155694 Aug 18 22:13:34.777653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1467/2941] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:34.852083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e55029ba-08c1-40f0-bdb1-855c48fcfe03 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:34.852619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e55029ba-08c1-40f0-bdb1-855c48fcfe03 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:34.858522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e55029ba-08c1-40f0-bdb1-855c48fcfe03 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:34.858998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e55029ba-08c1-40f0-bdb1-855c48fcfe03 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:34.859422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e55029ba-08c1-40f0-bdb1-855c48fcfe03 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:34.860103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e55029ba-08c1-40f0-bdb1-855c48fcfe03 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:34.860546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e55029ba-08c1-40f0-bdb1-855c48fcfe03 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:34.860962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e55029ba-08c1-40f0-bdb1-855c48fcfe03 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:34.991650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e55029ba-08c1-40f0-bdb1-855c48fcfe03 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:35.000258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e55029ba-08c1-40f0-bdb1-855c48fcfe03 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152051 Aug 18 22:13:35.000942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1475/2942] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:34 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:35.074677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-af35ff51-0223-4970-8609-6f48fa4616aa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:35.075302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-af35ff51-0223-4970-8609-6f48fa4616aa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:35.081617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af35ff51-0223-4970-8609-6f48fa4616aa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:35.082112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af35ff51-0223-4970-8609-6f48fa4616aa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:35.082574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af35ff51-0223-4970-8609-6f48fa4616aa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:35.083270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af35ff51-0223-4970-8609-6f48fa4616aa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:35.083729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af35ff51-0223-4970-8609-6f48fa4616aa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:35.084157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af35ff51-0223-4970-8609-6f48fa4616aa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:35.212753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-af35ff51-0223-4970-8609-6f48fa4616aa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:35.224212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-af35ff51-0223-4970-8609-6f48fa4616aa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:35.225829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-af35ff51-0223-4970-8609-6f48fa4616aa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:35.227089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-af35ff51-0223-4970-8609-6f48fa4616aa tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156314 Aug 18 22:13:35.227664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1468/2943] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:35.239559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1749e786-257f-40c4-b3fb-cbee084b223a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:35.240306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1749e786-257f-40c4-b3fb-cbee084b223a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:35.246992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1749e786-257f-40c4-b3fb-cbee084b223a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:35.247468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1749e786-257f-40c4-b3fb-cbee084b223a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:35.247900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1749e786-257f-40c4-b3fb-cbee084b223a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:35.248582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1749e786-257f-40c4-b3fb-cbee084b223a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:35.249029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1749e786-257f-40c4-b3fb-cbee084b223a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:35.249449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1749e786-257f-40c4-b3fb-cbee084b223a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:35.374245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1749e786-257f-40c4-b3fb-cbee084b223a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:35.382475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1749e786-257f-40c4-b3fb-cbee084b223a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.146694 Aug 18 22:13:35.383054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1476/2944] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:35 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:35.770694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a3d3b17d-4436-4016-acba-0eb3758b5f8d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:35.771343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a3d3b17d-4436-4016-acba-0eb3758b5f8d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:35.778364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d3b17d-4436-4016-acba-0eb3758b5f8d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:35.778847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d3b17d-4436-4016-acba-0eb3758b5f8d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:35.779286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d3b17d-4436-4016-acba-0eb3758b5f8d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:35.780000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d3b17d-4436-4016-acba-0eb3758b5f8d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:35.780455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d3b17d-4436-4016-acba-0eb3758b5f8d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:35.780884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3d3b17d-4436-4016-acba-0eb3758b5f8d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:35.785049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:35.799714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c54e6e2d-1991-40ae-ace3-988823601ee5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:35.800323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c54e6e2d-1991-40ae-ace3-988823601ee5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:35.806924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c54e6e2d-1991-40ae-ace3-988823601ee5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:35.807497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c54e6e2d-1991-40ae-ace3-988823601ee5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:35.808196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c54e6e2d-1991-40ae-ace3-988823601ee5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:35.808624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c54e6e2d-1991-40ae-ace3-988823601ee5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:35.809073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c54e6e2d-1991-40ae-ace3-988823601ee5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:35.809483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c54e6e2d-1991-40ae-ace3-988823601ee5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:35.915344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a3d3b17d-4436-4016-acba-0eb3758b5f8d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:35.924889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a3d3b17d-4436-4016-acba-0eb3758b5f8d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.157975 Aug 18 22:13:35.925877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1469/2945] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:35.945125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c54e6e2d-1991-40ae-ace3-988823601ee5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:35.954141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c54e6e2d-1991-40ae-ace3-988823601ee5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.158738 Aug 18 22:13:35.954717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1477/2946] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:35 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:36.022019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ec660afd-26c6-4c73-8619-05c9d95fca70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:36.022639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ec660afd-26c6-4c73-8619-05c9d95fca70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:36.029289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec660afd-26c6-4c73-8619-05c9d95fca70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:36.029807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec660afd-26c6-4c73-8619-05c9d95fca70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:36.030244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec660afd-26c6-4c73-8619-05c9d95fca70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:36.030936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec660afd-26c6-4c73-8619-05c9d95fca70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:36.031389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec660afd-26c6-4c73-8619-05c9d95fca70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:36.031819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec660afd-26c6-4c73-8619-05c9d95fca70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:36.161584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ec660afd-26c6-4c73-8619-05c9d95fca70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:36.169799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ec660afd-26c6-4c73-8619-05c9d95fca70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151652 Aug 18 22:13:36.170373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1470/2947] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:36 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:36.250493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e41d4bf7-393b-4775-8a3e-32ebca625568 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:36.251093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e41d4bf7-393b-4775-8a3e-32ebca625568 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:36.256953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e41d4bf7-393b-4775-8a3e-32ebca625568 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:36.257427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e41d4bf7-393b-4775-8a3e-32ebca625568 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:36.257896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e41d4bf7-393b-4775-8a3e-32ebca625568 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:36.258576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e41d4bf7-393b-4775-8a3e-32ebca625568 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:36.259020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e41d4bf7-393b-4775-8a3e-32ebca625568 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:36.259441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e41d4bf7-393b-4775-8a3e-32ebca625568 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:36.385658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e41d4bf7-393b-4775-8a3e-32ebca625568 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:36.395495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e41d4bf7-393b-4775-8a3e-32ebca625568 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:36.397032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e41d4bf7-393b-4775-8a3e-32ebca625568 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:36.398334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e41d4bf7-393b-4775-8a3e-32ebca625568 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151618 Aug 18 22:13:36.399045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1478/2948] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:36.403635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4fc1f387-b6bd-447e-9c51-d67102cc95b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:36.404284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4fc1f387-b6bd-447e-9c51-d67102cc95b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:36.410323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fc1f387-b6bd-447e-9c51-d67102cc95b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:36.410821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fc1f387-b6bd-447e-9c51-d67102cc95b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:36.411249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fc1f387-b6bd-447e-9c51-d67102cc95b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:36.411935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fc1f387-b6bd-447e-9c51-d67102cc95b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:36.412418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fc1f387-b6bd-447e-9c51-d67102cc95b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:36.412841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4fc1f387-b6bd-447e-9c51-d67102cc95b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:36.541137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4fc1f387-b6bd-447e-9c51-d67102cc95b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:36.549694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4fc1f387-b6bd-447e-9c51-d67102cc95b2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150231 Aug 18 22:13:36.550267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1471/2949] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:36 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:36.946674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c09633a-fb02-451f-8774-744541524e04 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:36.947290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c09633a-fb02-451f-8774-744541524e04 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:36.954101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c09633a-fb02-451f-8774-744541524e04 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:36.954582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c09633a-fb02-451f-8774-744541524e04 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:36.955017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c09633a-fb02-451f-8774-744541524e04 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:36.955712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c09633a-fb02-451f-8774-744541524e04 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:36.956164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c09633a-fb02-451f-8774-744541524e04 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:36.956587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c09633a-fb02-451f-8774-744541524e04 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:36.975795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c2c14274-c892-4939-935e-001a3fd0adeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:36.976352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c2c14274-c892-4939-935e-001a3fd0adeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:36.983379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2c14274-c892-4939-935e-001a3fd0adeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:36.983871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2c14274-c892-4939-935e-001a3fd0adeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:36.984314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2c14274-c892-4939-935e-001a3fd0adeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:36.985025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2c14274-c892-4939-935e-001a3fd0adeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:36.985484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2c14274-c892-4939-935e-001a3fd0adeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:36.985943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2c14274-c892-4939-935e-001a3fd0adeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:37.085919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4c09633a-fb02-451f-8774-744541524e04 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:37.097487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c09633a-fb02-451f-8774-744541524e04 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154290 Aug 18 22:13:37.098213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1479/2950] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:36 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:37.120485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c2c14274-c892-4939-935e-001a3fd0adeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:37.129309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c2c14274-c892-4939-935e-001a3fd0adeb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.157459 Aug 18 22:13:37.129914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1472/2951] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:36 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:37.191096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d3bc541-d19e-44ea-81e0-2520a131b6c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:37.191710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1d3bc541-d19e-44ea-81e0-2520a131b6c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:37.197567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d3bc541-d19e-44ea-81e0-2520a131b6c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:37.198154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d3bc541-d19e-44ea-81e0-2520a131b6c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:37.198580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d3bc541-d19e-44ea-81e0-2520a131b6c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:37.199272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d3bc541-d19e-44ea-81e0-2520a131b6c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:37.199725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d3bc541-d19e-44ea-81e0-2520a131b6c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:37.200150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d3bc541-d19e-44ea-81e0-2520a131b6c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:37.330869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1d3bc541-d19e-44ea-81e0-2520a131b6c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:37.339733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1d3bc541-d19e-44ea-81e0-2520a131b6c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152468 Aug 18 22:13:37.340310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1480/2952] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:37 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:37.421836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d0e66b7d-2065-4280-9741-ae89b1331a0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:37.422450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d0e66b7d-2065-4280-9741-ae89b1331a0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:37.428528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0e66b7d-2065-4280-9741-ae89b1331a0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:37.429007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0e66b7d-2065-4280-9741-ae89b1331a0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:37.429438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0e66b7d-2065-4280-9741-ae89b1331a0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:37.430320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0e66b7d-2065-4280-9741-ae89b1331a0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:37.430773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0e66b7d-2065-4280-9741-ae89b1331a0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:37.431196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0e66b7d-2065-4280-9741-ae89b1331a0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:37.565881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d0e66b7d-2065-4280-9741-ae89b1331a0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:37.571249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3af9af4b-ff1c-40e6-8e34-55bdc586f628 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:37.571925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3af9af4b-ff1c-40e6-8e34-55bdc586f628 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:37.575044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d0e66b7d-2065-4280-9741-ae89b1331a0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:37.576534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d0e66b7d-2065-4280-9741-ae89b1331a0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:37.577726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d0e66b7d-2065-4280-9741-ae89b1331a0a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.160093 Aug 18 22:13:37.578289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1473/2953] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:37.579243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3af9af4b-ff1c-40e6-8e34-55bdc586f628 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:37.579243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3af9af4b-ff1c-40e6-8e34-55bdc586f628 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:37.579685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3af9af4b-ff1c-40e6-8e34-55bdc586f628 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:37.580443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3af9af4b-ff1c-40e6-8e34-55bdc586f628 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:37.580968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3af9af4b-ff1c-40e6-8e34-55bdc586f628 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:37.581402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3af9af4b-ff1c-40e6-8e34-55bdc586f628 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:37.710927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3af9af4b-ff1c-40e6-8e34-55bdc586f628 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:37.719667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3af9af4b-ff1c-40e6-8e34-55bdc586f628 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152171 Aug 18 22:13:37.720256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1481/2954] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:37 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:38.119616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3b1bcb5d-83bd-4e74-a54b-59d0535db92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:38.120938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3b1bcb5d-83bd-4e74-a54b-59d0535db92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:38.127675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b1bcb5d-83bd-4e74-a54b-59d0535db92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:38.128158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b1bcb5d-83bd-4e74-a54b-59d0535db92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:38.128597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b1bcb5d-83bd-4e74-a54b-59d0535db92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:38.129286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b1bcb5d-83bd-4e74-a54b-59d0535db92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:38.129776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b1bcb5d-83bd-4e74-a54b-59d0535db92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:38.130202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3b1bcb5d-83bd-4e74-a54b-59d0535db92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:38.150698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-95660de2-91fc-4aff-aaa5-795c8cd2176c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:38.151314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-95660de2-91fc-4aff-aaa5-795c8cd2176c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:38.158003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95660de2-91fc-4aff-aaa5-795c8cd2176c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:38.158490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95660de2-91fc-4aff-aaa5-795c8cd2176c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:38.158928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95660de2-91fc-4aff-aaa5-795c8cd2176c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:38.159634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95660de2-91fc-4aff-aaa5-795c8cd2176c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:38.160087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95660de2-91fc-4aff-aaa5-795c8cd2176c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:38.160518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95660de2-91fc-4aff-aaa5-795c8cd2176c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:38.266819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3b1bcb5d-83bd-4e74-a54b-59d0535db92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:38.274986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3b1bcb5d-83bd-4e74-a54b-59d0535db92e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.159265 Aug 18 22:13:38.275568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1474/2955] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:38 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:38.301624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-95660de2-91fc-4aff-aaa5-795c8cd2176c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:38.310590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-95660de2-91fc-4aff-aaa5-795c8cd2176c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.163988 Aug 18 22:13:38.311163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1482/2956] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:38 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:38.360320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-977daa00-90f8-48c8-adf9-98c639d65870 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:38.360942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-977daa00-90f8-48c8-adf9-98c639d65870 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:38.366822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-977daa00-90f8-48c8-adf9-98c639d65870 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:38.367326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-977daa00-90f8-48c8-adf9-98c639d65870 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:38.367756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-977daa00-90f8-48c8-adf9-98c639d65870 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:38.368440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-977daa00-90f8-48c8-adf9-98c639d65870 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:38.368892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-977daa00-90f8-48c8-adf9-98c639d65870 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:38.369316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-977daa00-90f8-48c8-adf9-98c639d65870 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:38.494427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-977daa00-90f8-48c8-adf9-98c639d65870 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:38.502663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-977daa00-90f8-48c8-adf9-98c639d65870 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.146082 Aug 18 22:13:38.503427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1475/2957] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:38 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:38.600129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-36974518-f28d-4f5e-b6f8-ba1dd8206158 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:38.600760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-36974518-f28d-4f5e-b6f8-ba1dd8206158 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:38.607356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36974518-f28d-4f5e-b6f8-ba1dd8206158 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:38.607839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36974518-f28d-4f5e-b6f8-ba1dd8206158 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:38.608280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36974518-f28d-4f5e-b6f8-ba1dd8206158 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:38.608970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36974518-f28d-4f5e-b6f8-ba1dd8206158 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:38.609429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36974518-f28d-4f5e-b6f8-ba1dd8206158 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:38.609891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36974518-f28d-4f5e-b6f8-ba1dd8206158 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:38.735024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-36974518-f28d-4f5e-b6f8-ba1dd8206158 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:38.740131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8954a5bb-54a1-4805-ae5f-a127cf494c03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:38.740750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8954a5bb-54a1-4805-ae5f-a127cf494c03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:38.743715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-36974518-f28d-4f5e-b6f8-ba1dd8206158 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:38.745201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-36974518-f28d-4f5e-b6f8-ba1dd8206158 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:38.746388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-36974518-f28d-4f5e-b6f8-ba1dd8206158 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150121 Aug 18 22:13:38.746859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8954a5bb-54a1-4805-ae5f-a127cf494c03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:38.746988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1483/2958] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:38 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:38.747348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8954a5bb-54a1-4805-ae5f-a127cf494c03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:38.748064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8954a5bb-54a1-4805-ae5f-a127cf494c03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:38.748803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8954a5bb-54a1-4805-ae5f-a127cf494c03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:38.749385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8954a5bb-54a1-4805-ae5f-a127cf494c03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:38.749936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8954a5bb-54a1-4805-ae5f-a127cf494c03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:38.877558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8954a5bb-54a1-4805-ae5f-a127cf494c03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:38.886266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8954a5bb-54a1-4805-ae5f-a127cf494c03 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149374 Aug 18 22:13:38.886828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1476/2959] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:38 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:39.295741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a5b202fa-bc4f-45d6-98cc-43df7045095c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:39.296384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a5b202fa-bc4f-45d6-98cc-43df7045095c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:39.303333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b202fa-bc4f-45d6-98cc-43df7045095c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:39.303822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b202fa-bc4f-45d6-98cc-43df7045095c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:39.304263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b202fa-bc4f-45d6-98cc-43df7045095c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:39.304958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b202fa-bc4f-45d6-98cc-43df7045095c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:39.305421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b202fa-bc4f-45d6-98cc-43df7045095c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:39.305879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b202fa-bc4f-45d6-98cc-43df7045095c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:39.330732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-36c002e0-36a0-45da-a1db-4711aac76637 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:39.331381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-36c002e0-36a0-45da-a1db-4711aac76637 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:39.337784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36c002e0-36a0-45da-a1db-4711aac76637 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:39.338273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36c002e0-36a0-45da-a1db-4711aac76637 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:39.338710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36c002e0-36a0-45da-a1db-4711aac76637 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:39.339415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36c002e0-36a0-45da-a1db-4711aac76637 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:39.339864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36c002e0-36a0-45da-a1db-4711aac76637 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:39.340292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36c002e0-36a0-45da-a1db-4711aac76637 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:39.435698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a5b202fa-bc4f-45d6-98cc-43df7045095c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:39.443946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a5b202fa-bc4f-45d6-98cc-43df7045095c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152064 Aug 18 22:13:39.444534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1484/2960] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:39.473969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-36c002e0-36a0-45da-a1db-4711aac76637 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:39.482243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-36c002e0-36a0-45da-a1db-4711aac76637 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155391 Aug 18 22:13:39.482817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1477/2961] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:39 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:39.523416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8107426b-84d4-47a9-9024-5530c24e0e37 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:39.524026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8107426b-84d4-47a9-9024-5530c24e0e37 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:39.530064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8107426b-84d4-47a9-9024-5530c24e0e37 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:39.530535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8107426b-84d4-47a9-9024-5530c24e0e37 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:39.530963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8107426b-84d4-47a9-9024-5530c24e0e37 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:39.531642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8107426b-84d4-47a9-9024-5530c24e0e37 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:39.532087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8107426b-84d4-47a9-9024-5530c24e0e37 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:39.532506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8107426b-84d4-47a9-9024-5530c24e0e37 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:39.661100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8107426b-84d4-47a9-9024-5530c24e0e37 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:39.669665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8107426b-84d4-47a9-9024-5530c24e0e37 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150135 Aug 18 22:13:39.670235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1485/2962] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:39 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:39.768445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c80f023e-73f1-4cb0-9283-643662091343 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:39.769092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c80f023e-73f1-4cb0-9283-643662091343 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:39.775348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c80f023e-73f1-4cb0-9283-643662091343 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:39.775834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c80f023e-73f1-4cb0-9283-643662091343 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:39.776290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c80f023e-73f1-4cb0-9283-643662091343 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:39.776985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c80f023e-73f1-4cb0-9283-643662091343 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:39.777462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c80f023e-73f1-4cb0-9283-643662091343 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:39.777917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c80f023e-73f1-4cb0-9283-643662091343 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:39.907244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-101ba528-aa96-48b8-869a-af35e8f64883 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:39.908555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-101ba528-aa96-48b8-869a-af35e8f64883 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:39.912149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c80f023e-73f1-4cb0-9283-643662091343 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:39.914724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-101ba528-aa96-48b8-869a-af35e8f64883 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:39.915215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-101ba528-aa96-48b8-869a-af35e8f64883 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:39.915690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-101ba528-aa96-48b8-869a-af35e8f64883 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:39.916388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-101ba528-aa96-48b8-869a-af35e8f64883 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:39.917534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-101ba528-aa96-48b8-869a-af35e8f64883 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:39.917993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-101ba528-aa96-48b8-869a-af35e8f64883 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:39.921781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c80f023e-73f1-4cb0-9283-643662091343 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:39.923308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c80f023e-73f1-4cb0-9283-643662091343 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:39.924476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c80f023e-73f1-4cb0-9283-643662091343 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159959 Aug 18 22:13:39.925038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1478/2963] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:40.044979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-101ba528-aa96-48b8-869a-af35e8f64883 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:40.053335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-101ba528-aa96-48b8-869a-af35e8f64883 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150092 Aug 18 22:13:40.053937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1486/2964] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:39 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:40.466992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c5d3ada2-a02c-4e56-8b59-6de9f251b88f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:40.467614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c5d3ada2-a02c-4e56-8b59-6de9f251b88f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:40.474052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5d3ada2-a02c-4e56-8b59-6de9f251b88f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:40.474540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5d3ada2-a02c-4e56-8b59-6de9f251b88f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:40.474979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5d3ada2-a02c-4e56-8b59-6de9f251b88f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:40.475675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5d3ada2-a02c-4e56-8b59-6de9f251b88f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:40.476131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5d3ada2-a02c-4e56-8b59-6de9f251b88f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:40.476564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5d3ada2-a02c-4e56-8b59-6de9f251b88f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:40.504338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-803c05a4-5581-4a66-bca4-3801fa3e6619 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:40.504983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-803c05a4-5581-4a66-bca4-3801fa3e6619 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:40.512121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-803c05a4-5581-4a66-bca4-3801fa3e6619 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:40.512604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-803c05a4-5581-4a66-bca4-3801fa3e6619 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:40.513040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-803c05a4-5581-4a66-bca4-3801fa3e6619 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:40.513765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-803c05a4-5581-4a66-bca4-3801fa3e6619 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:40.514251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-803c05a4-5581-4a66-bca4-3801fa3e6619 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:40.514680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-803c05a4-5581-4a66-bca4-3801fa3e6619 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:40.517343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:40.608638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c5d3ada2-a02c-4e56-8b59-6de9f251b88f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:40.616805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c5d3ada2-a02c-4e56-8b59-6de9f251b88f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154439 Aug 18 22:13:40.617621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1479/2965] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:40 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:40.647314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-803c05a4-5581-4a66-bca4-3801fa3e6619 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:40.656157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-803c05a4-5581-4a66-bca4-3801fa3e6619 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155594 Aug 18 22:13:40.656729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1487/2966] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:40.691216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0aedf47c-1c34-4908-8c30-029aac9dfca6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:40.691833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0aedf47c-1c34-4908-8c30-029aac9dfca6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:40.698463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0aedf47c-1c34-4908-8c30-029aac9dfca6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:40.698944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0aedf47c-1c34-4908-8c30-029aac9dfca6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:40.699372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0aedf47c-1c34-4908-8c30-029aac9dfca6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:40.700056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0aedf47c-1c34-4908-8c30-029aac9dfca6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:40.700501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0aedf47c-1c34-4908-8c30-029aac9dfca6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:40.700921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0aedf47c-1c34-4908-8c30-029aac9dfca6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:40.827613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0aedf47c-1c34-4908-8c30-029aac9dfca6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:40.835791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0aedf47c-1c34-4908-8c30-029aac9dfca6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148559 Aug 18 22:13:40.836355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1480/2967] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:40 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:40.947490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6a572317-e80a-495a-a23e-bf9c64c78a3e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:40.948741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6a572317-e80a-495a-a23e-bf9c64c78a3e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:40.954700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a572317-e80a-495a-a23e-bf9c64c78a3e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:40.955183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a572317-e80a-495a-a23e-bf9c64c78a3e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:40.955617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a572317-e80a-495a-a23e-bf9c64c78a3e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:40.956304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a572317-e80a-495a-a23e-bf9c64c78a3e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:40.956761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a572317-e80a-495a-a23e-bf9c64c78a3e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:40.957189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a572317-e80a-495a-a23e-bf9c64c78a3e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:41.074002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1774edbb-8f9f-47da-b494-3ce23b457a79 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:41.074764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1774edbb-8f9f-47da-b494-3ce23b457a79 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:41.080781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1774edbb-8f9f-47da-b494-3ce23b457a79 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:41.081265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1774edbb-8f9f-47da-b494-3ce23b457a79 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:41.081728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1774edbb-8f9f-47da-b494-3ce23b457a79 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:41.082424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1774edbb-8f9f-47da-b494-3ce23b457a79 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:41.082870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1774edbb-8f9f-47da-b494-3ce23b457a79 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:41.083004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6a572317-e80a-495a-a23e-bf9c64c78a3e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:41.083292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1774edbb-8f9f-47da-b494-3ce23b457a79 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:41.091679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6a572317-e80a-495a-a23e-bf9c64c78a3e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:41.093210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6a572317-e80a-495a-a23e-bf9c64c78a3e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:41.094447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6a572317-e80a-495a-a23e-bf9c64c78a3e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150844 Aug 18 22:13:41.095016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1488/2968] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:41.210969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1774edbb-8f9f-47da-b494-3ce23b457a79 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:41.219038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1774edbb-8f9f-47da-b494-3ce23b457a79 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148907 Aug 18 22:13:41.219609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1481/2969] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:41 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:41.637934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bd0a5b48-fd15-4b6d-b092-c563c497e0f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:41.638533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bd0a5b48-fd15-4b6d-b092-c563c497e0f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:41.645017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd0a5b48-fd15-4b6d-b092-c563c497e0f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:41.645487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd0a5b48-fd15-4b6d-b092-c563c497e0f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:41.645950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd0a5b48-fd15-4b6d-b092-c563c497e0f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:41.646639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd0a5b48-fd15-4b6d-b092-c563c497e0f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:41.647093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd0a5b48-fd15-4b6d-b092-c563c497e0f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:41.647518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd0a5b48-fd15-4b6d-b092-c563c497e0f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:41.677613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1859b650-47fb-4b6d-a62a-e3b36c61e291 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:41.678248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1859b650-47fb-4b6d-a62a-e3b36c61e291 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:41.684773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1859b650-47fb-4b6d-a62a-e3b36c61e291 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:41.685263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1859b650-47fb-4b6d-a62a-e3b36c61e291 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:41.685732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1859b650-47fb-4b6d-a62a-e3b36c61e291 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:41.686436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1859b650-47fb-4b6d-a62a-e3b36c61e291 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:41.686898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1859b650-47fb-4b6d-a62a-e3b36c61e291 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:41.687329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1859b650-47fb-4b6d-a62a-e3b36c61e291 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:41.788566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bd0a5b48-fd15-4b6d-b092-c563c497e0f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:41.799624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bd0a5b48-fd15-4b6d-b092-c563c497e0f9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.165528 Aug 18 22:13:41.800283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1489/2970] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:41 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:41.828587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1859b650-47fb-4b6d-a62a-e3b36c61e291 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:41.836756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1859b650-47fb-4b6d-a62a-e3b36c61e291 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.163240 Aug 18 22:13:41.837330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1482/2971] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:41.856187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f56ba4e0-d00c-40c7-a60a-e025cc547b82 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:41.856845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f56ba4e0-d00c-40c7-a60a-e025cc547b82 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:41.862781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f56ba4e0-d00c-40c7-a60a-e025cc547b82 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:41.863276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f56ba4e0-d00c-40c7-a60a-e025cc547b82 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:41.863708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f56ba4e0-d00c-40c7-a60a-e025cc547b82 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:41.864398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f56ba4e0-d00c-40c7-a60a-e025cc547b82 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:41.864854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f56ba4e0-d00c-40c7-a60a-e025cc547b82 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:41.865280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f56ba4e0-d00c-40c7-a60a-e025cc547b82 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:41.989165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f56ba4e0-d00c-40c7-a60a-e025cc547b82 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:41.997577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f56ba4e0-d00c-40c7-a60a-e025cc547b82 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.145263 Aug 18 22:13:41.998172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1490/2972] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:41 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:42.117862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e71c40bc-a477-4654-9a93-e6dee31ac287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:42.118519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e71c40bc-a477-4654-9a93-e6dee31ac287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:42.124494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e71c40bc-a477-4654-9a93-e6dee31ac287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:42.124976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e71c40bc-a477-4654-9a93-e6dee31ac287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:42.125410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e71c40bc-a477-4654-9a93-e6dee31ac287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:42.126122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e71c40bc-a477-4654-9a93-e6dee31ac287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:42.126579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e71c40bc-a477-4654-9a93-e6dee31ac287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:42.127006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e71c40bc-a477-4654-9a93-e6dee31ac287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:42.239885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f96b57df-8dc3-4c45-bb3c-9c27d72fb679 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:42.240508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f96b57df-8dc3-4c45-bb3c-9c27d72fb679 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:42.246815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f96b57df-8dc3-4c45-bb3c-9c27d72fb679 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:42.247298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f96b57df-8dc3-4c45-bb3c-9c27d72fb679 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:42.247735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f96b57df-8dc3-4c45-bb3c-9c27d72fb679 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:42.248424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f96b57df-8dc3-4c45-bb3c-9c27d72fb679 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:42.249675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f96b57df-8dc3-4c45-bb3c-9c27d72fb679 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:42.249675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f96b57df-8dc3-4c45-bb3c-9c27d72fb679 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:42.257256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e71c40bc-a477-4654-9a93-e6dee31ac287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:42.266404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e71c40bc-a477-4654-9a93-e6dee31ac287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:42.267917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e71c40bc-a477-4654-9a93-e6dee31ac287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:42.269074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e71c40bc-a477-4654-9a93-e6dee31ac287 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155208 Aug 18 22:13:42.269657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1483/2973] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:42.378507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f96b57df-8dc3-4c45-bb3c-9c27d72fb679 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:42.387129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f96b57df-8dc3-4c45-bb3c-9c27d72fb679 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151054 Aug 18 22:13:42.387717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1491/2974] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:42 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:42.821450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0156fab2-a486-4e4b-9256-d5042065b418 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:42.822116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0156fab2-a486-4e4b-9256-d5042065b418 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:42.829155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0156fab2-a486-4e4b-9256-d5042065b418 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:42.829673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0156fab2-a486-4e4b-9256-d5042065b418 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:42.830123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0156fab2-a486-4e4b-9256-d5042065b418 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:42.830824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0156fab2-a486-4e4b-9256-d5042065b418 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:42.831284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0156fab2-a486-4e4b-9256-d5042065b418 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:42.831717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0156fab2-a486-4e4b-9256-d5042065b418 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:42.859230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-597893f1-9d80-40a1-99a9-5f09c27b96c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:42.859979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-597893f1-9d80-40a1-99a9-5f09c27b96c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:42.866426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-597893f1-9d80-40a1-99a9-5f09c27b96c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:42.866900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-597893f1-9d80-40a1-99a9-5f09c27b96c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:42.867331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-597893f1-9d80-40a1-99a9-5f09c27b96c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:42.868022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-597893f1-9d80-40a1-99a9-5f09c27b96c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:42.868470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-597893f1-9d80-40a1-99a9-5f09c27b96c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:42.868889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-597893f1-9d80-40a1-99a9-5f09c27b96c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:42.964920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0156fab2-a486-4e4b-9256-d5042065b418 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:42.973293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0156fab2-a486-4e4b-9256-d5042065b418 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155570 Aug 18 22:13:42.973825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1484/2975] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:43.002851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-597893f1-9d80-40a1-99a9-5f09c27b96c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:43.011252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-597893f1-9d80-40a1-99a9-5f09c27b96c4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155890 Aug 18 22:13:43.011829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1492/2976] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:42 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:43.018333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bded88ad-aadd-4632-8cb4-c8dc7bdce54b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:43.018976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bded88ad-aadd-4632-8cb4-c8dc7bdce54b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:43.024901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bded88ad-aadd-4632-8cb4-c8dc7bdce54b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:43.025379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bded88ad-aadd-4632-8cb4-c8dc7bdce54b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:43.026357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bded88ad-aadd-4632-8cb4-c8dc7bdce54b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:43.027022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bded88ad-aadd-4632-8cb4-c8dc7bdce54b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:43.027470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bded88ad-aadd-4632-8cb4-c8dc7bdce54b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:43.027891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bded88ad-aadd-4632-8cb4-c8dc7bdce54b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:43.154050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bded88ad-aadd-4632-8cb4-c8dc7bdce54b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:43.156302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:43.163631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bded88ad-aadd-4632-8cb4-c8dc7bdce54b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149089 Aug 18 22:13:43.164204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1485/2977] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:43 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:43.291073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-11db58e1-ab11-4e37-b445-c6c23c030eb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:43.292369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-11db58e1-ab11-4e37-b445-c6c23c030eb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:43.298272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11db58e1-ab11-4e37-b445-c6c23c030eb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:43.298755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11db58e1-ab11-4e37-b445-c6c23c030eb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:43.299194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11db58e1-ab11-4e37-b445-c6c23c030eb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:43.299876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11db58e1-ab11-4e37-b445-c6c23c030eb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:43.300320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11db58e1-ab11-4e37-b445-c6c23c030eb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:43.301018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-11db58e1-ab11-4e37-b445-c6c23c030eb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:43.408387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3bcae1a1-a756-457a-95c6-905c1686041e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:43.409109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3bcae1a1-a756-457a-95c6-905c1686041e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:43.415102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bcae1a1-a756-457a-95c6-905c1686041e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:43.415722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bcae1a1-a756-457a-95c6-905c1686041e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:43.416231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bcae1a1-a756-457a-95c6-905c1686041e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:43.417038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bcae1a1-a756-457a-95c6-905c1686041e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:43.417558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bcae1a1-a756-457a-95c6-905c1686041e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:43.418015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bcae1a1-a756-457a-95c6-905c1686041e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:43.427079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-11db58e1-ab11-4e37-b445-c6c23c030eb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:43.435887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-11db58e1-ab11-4e37-b445-c6c23c030eb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:43.437397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-11db58e1-ab11-4e37-b445-c6c23c030eb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:43.438580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-11db58e1-ab11-4e37-b445-c6c23c030eb1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151452 Aug 18 22:13:43.439147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1493/2978] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:43.547735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3bcae1a1-a756-457a-95c6-905c1686041e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:43.556091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3bcae1a1-a756-457a-95c6-905c1686041e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151764 Aug 18 22:13:43.556665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1486/2979] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:43 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:43.995697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cdd83a05-8b91-472b-a2f3-3826c2946b9d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:43.996313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cdd83a05-8b91-472b-a2f3-3826c2946b9d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:44.002887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdd83a05-8b91-472b-a2f3-3826c2946b9d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:44.003375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdd83a05-8b91-472b-a2f3-3826c2946b9d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:44.003803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdd83a05-8b91-472b-a2f3-3826c2946b9d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:44.004487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdd83a05-8b91-472b-a2f3-3826c2946b9d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:44.004937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdd83a05-8b91-472b-a2f3-3826c2946b9d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:44.005361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdd83a05-8b91-472b-a2f3-3826c2946b9d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:44.031789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-91b403b9-8320-4e58-a1f3-671a41e8aa4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:44.032413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-91b403b9-8320-4e58-a1f3-671a41e8aa4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:44.038938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91b403b9-8320-4e58-a1f3-671a41e8aa4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:44.039428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91b403b9-8320-4e58-a1f3-671a41e8aa4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:44.039874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91b403b9-8320-4e58-a1f3-671a41e8aa4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:44.040578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91b403b9-8320-4e58-a1f3-671a41e8aa4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:44.041037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91b403b9-8320-4e58-a1f3-671a41e8aa4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:44.042011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91b403b9-8320-4e58-a1f3-671a41e8aa4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:44.141415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cdd83a05-8b91-472b-a2f3-3826c2946b9d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:44.149660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cdd83a05-8b91-472b-a2f3-3826c2946b9d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.158271 Aug 18 22:13:44.150247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1494/2980] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:43 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:44.173626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-91b403b9-8320-4e58-a1f3-671a41e8aa4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:44.181992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-91b403b9-8320-4e58-a1f3-671a41e8aa4b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154160 Aug 18 22:13:44.183175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1487/2981] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:44 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:44.186526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-af418992-39ed-47a4-b6d3-15cb8f54ad91 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:44.187223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-af418992-39ed-47a4-b6d3-15cb8f54ad91 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:44.193078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af418992-39ed-47a4-b6d3-15cb8f54ad91 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:44.193661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af418992-39ed-47a4-b6d3-15cb8f54ad91 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:44.194189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af418992-39ed-47a4-b6d3-15cb8f54ad91 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:44.194942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af418992-39ed-47a4-b6d3-15cb8f54ad91 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:44.195466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af418992-39ed-47a4-b6d3-15cb8f54ad91 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:44.195959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af418992-39ed-47a4-b6d3-15cb8f54ad91 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:44.321182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-af418992-39ed-47a4-b6d3-15cb8f54ad91 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:44.329286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-af418992-39ed-47a4-b6d3-15cb8f54ad91 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147453 Aug 18 22:13:44.329879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1495/2982] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:44.461948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f4dcaa65-5c8b-447c-9655-b09b15316d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:44.462502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f4dcaa65-5c8b-447c-9655-b09b15316d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:44.469068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4dcaa65-5c8b-447c-9655-b09b15316d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:44.469557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4dcaa65-5c8b-447c-9655-b09b15316d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:44.470042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4dcaa65-5c8b-447c-9655-b09b15316d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:44.470738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4dcaa65-5c8b-447c-9655-b09b15316d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:44.471198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4dcaa65-5c8b-447c-9655-b09b15316d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:44.471633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4dcaa65-5c8b-447c-9655-b09b15316d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:44.576890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9bd98ed6-9e5f-4ab1-a375-e12e15be1624 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:44.577730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9bd98ed6-9e5f-4ab1-a375-e12e15be1624 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:44.583348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd98ed6-9e5f-4ab1-a375-e12e15be1624 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:44.583824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd98ed6-9e5f-4ab1-a375-e12e15be1624 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:44.584257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd98ed6-9e5f-4ab1-a375-e12e15be1624 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:44.584945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd98ed6-9e5f-4ab1-a375-e12e15be1624 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:44.585396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd98ed6-9e5f-4ab1-a375-e12e15be1624 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:44.585857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd98ed6-9e5f-4ab1-a375-e12e15be1624 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:44.598716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f4dcaa65-5c8b-447c-9655-b09b15316d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:44.608307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f4dcaa65-5c8b-447c-9655-b09b15316d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:44.609927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f4dcaa65-5c8b-447c-9655-b09b15316d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:44.611166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f4dcaa65-5c8b-447c-9655-b09b15316d97 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153190 Aug 18 22:13:44.611846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1488/2983] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:44.712937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9bd98ed6-9e5f-4ab1-a375-e12e15be1624 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:44.721956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9bd98ed6-9e5f-4ab1-a375-e12e15be1624 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148941 Aug 18 22:13:44.722537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1496/2984] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:44 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:45.171641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3dcc26a2-bfa7-467a-b717-35bcc1d26f53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:45.172260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3dcc26a2-bfa7-467a-b717-35bcc1d26f53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:45.179111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3dcc26a2-bfa7-467a-b717-35bcc1d26f53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:45.179594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3dcc26a2-bfa7-467a-b717-35bcc1d26f53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:45.180031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3dcc26a2-bfa7-467a-b717-35bcc1d26f53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:45.180717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3dcc26a2-bfa7-467a-b717-35bcc1d26f53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:45.181171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3dcc26a2-bfa7-467a-b717-35bcc1d26f53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:45.181610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3dcc26a2-bfa7-467a-b717-35bcc1d26f53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:45.202930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0ec925b4-f215-4fec-87fd-c02154fc8742 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:45.203537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0ec925b4-f215-4fec-87fd-c02154fc8742 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:45.209639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ec925b4-f215-4fec-87fd-c02154fc8742 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:45.210136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ec925b4-f215-4fec-87fd-c02154fc8742 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:45.210553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ec925b4-f215-4fec-87fd-c02154fc8742 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:45.211232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ec925b4-f215-4fec-87fd-c02154fc8742 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:45.211678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ec925b4-f215-4fec-87fd-c02154fc8742 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:45.212100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ec925b4-f215-4fec-87fd-c02154fc8742 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:45.314784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3dcc26a2-bfa7-467a-b717-35bcc1d26f53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:45.323067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3dcc26a2-bfa7-467a-b717-35bcc1d26f53 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155245 Aug 18 22:13:45.323649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1489/2985] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:45 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:45.343524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0ec925b4-f215-4fec-87fd-c02154fc8742 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:45.349679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f125a405-5a30-4406-b71c-1be0a82cd75c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:45.350306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f125a405-5a30-4406-b71c-1be0a82cd75c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:45.352051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0ec925b4-f215-4fec-87fd-c02154fc8742 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152848 Aug 18 22:13:45.352617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1497/2986] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:45 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:45.357179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f125a405-5a30-4406-b71c-1be0a82cd75c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:45.357703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f125a405-5a30-4406-b71c-1be0a82cd75c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:45.358152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f125a405-5a30-4406-b71c-1be0a82cd75c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:45.358850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f125a405-5a30-4406-b71c-1be0a82cd75c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:45.359307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f125a405-5a30-4406-b71c-1be0a82cd75c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:45.359736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f125a405-5a30-4406-b71c-1be0a82cd75c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:45.487210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f125a405-5a30-4406-b71c-1be0a82cd75c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:45.495357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f125a405-5a30-4406-b71c-1be0a82cd75c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149487 Aug 18 22:13:45.495932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1490/2987] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:45 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:45.636997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-25ce3ba8-8d29-4c62-b6fd-4b9d47de6303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:45.637625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-25ce3ba8-8d29-4c62-b6fd-4b9d47de6303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:45.643923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ce3ba8-8d29-4c62-b6fd-4b9d47de6303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:45.644405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ce3ba8-8d29-4c62-b6fd-4b9d47de6303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:45.644839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ce3ba8-8d29-4c62-b6fd-4b9d47de6303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:45.645526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ce3ba8-8d29-4c62-b6fd-4b9d47de6303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:45.646008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ce3ba8-8d29-4c62-b6fd-4b9d47de6303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:45.646432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ce3ba8-8d29-4c62-b6fd-4b9d47de6303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:45.743826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2aecc31f-8341-42f4-8a29-92324c4c7b4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:45.744442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2aecc31f-8341-42f4-8a29-92324c4c7b4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:45.750221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2aecc31f-8341-42f4-8a29-92324c4c7b4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:45.750707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2aecc31f-8341-42f4-8a29-92324c4c7b4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:45.751140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2aecc31f-8341-42f4-8a29-92324c4c7b4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:45.751832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2aecc31f-8341-42f4-8a29-92324c4c7b4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:45.752283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2aecc31f-8341-42f4-8a29-92324c4c7b4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:45.752702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2aecc31f-8341-42f4-8a29-92324c4c7b4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:45.777273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-25ce3ba8-8d29-4c62-b6fd-4b9d47de6303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:45.786102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-25ce3ba8-8d29-4c62-b6fd-4b9d47de6303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:45.787735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-25ce3ba8-8d29-4c62-b6fd-4b9d47de6303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:45.788901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-25ce3ba8-8d29-4c62-b6fd-4b9d47de6303 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156358 Aug 18 22:13:45.789501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1498/2988] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:45 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:45.882262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2aecc31f-8341-42f4-8a29-92324c4c7b4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:45.890825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2aecc31f-8341-42f4-8a29-92324c4c7b4c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150920 Aug 18 22:13:45.891393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1491/2989] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:45 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:46.344454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b5c86e85-4129-472a-9da3-bf79f77bb438 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:46.345069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b5c86e85-4129-472a-9da3-bf79f77bb438 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:46.351607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5c86e85-4129-472a-9da3-bf79f77bb438 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:46.352091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5c86e85-4129-472a-9da3-bf79f77bb438 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:46.352533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5c86e85-4129-472a-9da3-bf79f77bb438 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:46.353223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5c86e85-4129-472a-9da3-bf79f77bb438 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:46.353718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5c86e85-4129-472a-9da3-bf79f77bb438 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:46.354693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5c86e85-4129-472a-9da3-bf79f77bb438 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:46.374382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-224369c6-aaf9-4f57-8b65-3a4a70bbb347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:46.375153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-224369c6-aaf9-4f57-8b65-3a4a70bbb347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:46.381520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-224369c6-aaf9-4f57-8b65-3a4a70bbb347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:46.382043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-224369c6-aaf9-4f57-8b65-3a4a70bbb347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:46.382479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-224369c6-aaf9-4f57-8b65-3a4a70bbb347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:46.383173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-224369c6-aaf9-4f57-8b65-3a4a70bbb347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:46.383629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-224369c6-aaf9-4f57-8b65-3a4a70bbb347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:46.384056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-224369c6-aaf9-4f57-8b65-3a4a70bbb347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:46.486006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b5c86e85-4129-472a-9da3-bf79f77bb438 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:46.494637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b5c86e85-4129-472a-9da3-bf79f77bb438 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153967 Aug 18 22:13:46.495744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1499/2990] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:46 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:46.511852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-224369c6-aaf9-4f57-8b65-3a4a70bbb347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:46.516396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da9ff51f-5af4-49ec-a447-dd0d3faebb6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:46.517105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-da9ff51f-5af4-49ec-a447-dd0d3faebb6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:46.520412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-224369c6-aaf9-4f57-8b65-3a4a70bbb347 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150472 Aug 18 22:13:46.521014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1492/2991] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:46.523282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9ff51f-5af4-49ec-a447-dd0d3faebb6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:46.523760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9ff51f-5af4-49ec-a447-dd0d3faebb6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:46.524194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9ff51f-5af4-49ec-a447-dd0d3faebb6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:46.524888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9ff51f-5af4-49ec-a447-dd0d3faebb6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:46.525342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9ff51f-5af4-49ec-a447-dd0d3faebb6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:46.525885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9ff51f-5af4-49ec-a447-dd0d3faebb6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:46.654092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-da9ff51f-5af4-49ec-a447-dd0d3faebb6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:46.662204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da9ff51f-5af4-49ec-a447-dd0d3faebb6b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149889 Aug 18 22:13:46.662969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1500/2992] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:46 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:46.813411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-41ceea57-0746-4508-961d-171b61f3d6f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:46.814054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-41ceea57-0746-4508-961d-171b61f3d6f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:46.819994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41ceea57-0746-4508-961d-171b61f3d6f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:46.820476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41ceea57-0746-4508-961d-171b61f3d6f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:46.820942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41ceea57-0746-4508-961d-171b61f3d6f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:46.821650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41ceea57-0746-4508-961d-171b61f3d6f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:46.822104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41ceea57-0746-4508-961d-171b61f3d6f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:46.822530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41ceea57-0746-4508-961d-171b61f3d6f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:46.912044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-07a31f87-cc21-448c-a6f2-1d0309950e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:46.912669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-07a31f87-cc21-448c-a6f2-1d0309950e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:46.918516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07a31f87-cc21-448c-a6f2-1d0309950e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:46.919004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07a31f87-cc21-448c-a6f2-1d0309950e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:46.919513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07a31f87-cc21-448c-a6f2-1d0309950e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:46.920133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07a31f87-cc21-448c-a6f2-1d0309950e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:46.920610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07a31f87-cc21-448c-a6f2-1d0309950e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:46.921299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-07a31f87-cc21-448c-a6f2-1d0309950e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:46.949100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-41ceea57-0746-4508-961d-171b61f3d6f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:46.958183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-41ceea57-0746-4508-961d-171b61f3d6f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:46.959704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-41ceea57-0746-4508-961d-171b61f3d6f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:46.961297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-41ceea57-0746-4508-961d-171b61f3d6f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151755 Aug 18 22:13:46.962344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1493/2993] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:46 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:47.056774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-07a31f87-cc21-448c-a6f2-1d0309950e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:47.065531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-07a31f87-cc21-448c-a6f2-1d0309950e16 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157253 Aug 18 22:13:47.066160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1501/2994] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:46 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:47.516222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8ce984e9-c16a-4456-81b3-a26fde827583 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:47.516837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8ce984e9-c16a-4456-81b3-a26fde827583 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:47.523351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ce984e9-c16a-4456-81b3-a26fde827583 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:47.523826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ce984e9-c16a-4456-81b3-a26fde827583 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:47.524259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ce984e9-c16a-4456-81b3-a26fde827583 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:47.524934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ce984e9-c16a-4456-81b3-a26fde827583 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:47.525383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ce984e9-c16a-4456-81b3-a26fde827583 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:47.526319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ce984e9-c16a-4456-81b3-a26fde827583 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:47.542444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-68f6255a-9987-4ea4-90f9-913dfe56839c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:47.543215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-68f6255a-9987-4ea4-90f9-913dfe56839c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:47.551016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68f6255a-9987-4ea4-90f9-913dfe56839c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:47.551617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68f6255a-9987-4ea4-90f9-913dfe56839c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:47.552158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68f6255a-9987-4ea4-90f9-913dfe56839c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:47.552952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68f6255a-9987-4ea4-90f9-913dfe56839c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:47.553527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68f6255a-9987-4ea4-90f9-913dfe56839c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:47.554076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-68f6255a-9987-4ea4-90f9-913dfe56839c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:47.660423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8ce984e9-c16a-4456-81b3-a26fde827583 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:47.668984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8ce984e9-c16a-4456-81b3-a26fde827583 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156607 Aug 18 22:13:47.669554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1494/2995] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:47 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:47.683321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-606cbbaf-0114-431e-be8e-e85240e0426a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:47.683644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-68f6255a-9987-4ea4-90f9-913dfe56839c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:47.684065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-606cbbaf-0114-431e-be8e-e85240e0426a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:47.690552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-606cbbaf-0114-431e-be8e-e85240e0426a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:47.691061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-606cbbaf-0114-431e-be8e-e85240e0426a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:47.691495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-606cbbaf-0114-431e-be8e-e85240e0426a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:47.692382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-606cbbaf-0114-431e-be8e-e85240e0426a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:47.692742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-68f6255a-9987-4ea4-90f9-913dfe56839c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155413 Aug 18 22:13:47.692910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-606cbbaf-0114-431e-be8e-e85240e0426a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:47.693266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-606cbbaf-0114-431e-be8e-e85240e0426a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:47.693752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1502/2996] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:47.827675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-606cbbaf-0114-431e-be8e-e85240e0426a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:47.835874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-606cbbaf-0114-431e-be8e-e85240e0426a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.156410 Aug 18 22:13:47.836450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1495/2997] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:47 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:47.984600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eb1b72b4-47e9-4173-b342-b74d4168b1fe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:47.985243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eb1b72b4-47e9-4173-b342-b74d4168b1fe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:47.991334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb1b72b4-47e9-4173-b342-b74d4168b1fe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:47.991797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb1b72b4-47e9-4173-b342-b74d4168b1fe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:47.992235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb1b72b4-47e9-4173-b342-b74d4168b1fe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:47.992924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb1b72b4-47e9-4173-b342-b74d4168b1fe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:47.993377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb1b72b4-47e9-4173-b342-b74d4168b1fe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:47.993830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb1b72b4-47e9-4173-b342-b74d4168b1fe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:48.086045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-df979d95-42e8-4f36-8c16-9b44ec76c2fd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:48.086797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-df979d95-42e8-4f36-8c16-9b44ec76c2fd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:48.093558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df979d95-42e8-4f36-8c16-9b44ec76c2fd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:48.094089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df979d95-42e8-4f36-8c16-9b44ec76c2fd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:48.094534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df979d95-42e8-4f36-8c16-9b44ec76c2fd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:48.095250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df979d95-42e8-4f36-8c16-9b44ec76c2fd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:48.095798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df979d95-42e8-4f36-8c16-9b44ec76c2fd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:48.096129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df979d95-42e8-4f36-8c16-9b44ec76c2fd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:48.122909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eb1b72b4-47e9-4173-b342-b74d4168b1fe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:48.125084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:48.133058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eb1b72b4-47e9-4173-b342-b74d4168b1fe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:48.134571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eb1b72b4-47e9-4173-b342-b74d4168b1fe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:48.136248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eb1b72b4-47e9-4173-b342-b74d4168b1fe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155589 Aug 18 22:13:48.136812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1503/2998] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:47 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:48.227957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-df979d95-42e8-4f36-8c16-9b44ec76c2fd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:48.236104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-df979d95-42e8-4f36-8c16-9b44ec76c2fd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153857 Aug 18 22:13:48.236677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1496/2999] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:48 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:48.690435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f2555f48-c5cd-41f0-a6da-574ab7c0ee07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:48.691054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f2555f48-c5cd-41f0-a6da-574ab7c0ee07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:48.697924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2555f48-c5cd-41f0-a6da-574ab7c0ee07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:48.698396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2555f48-c5cd-41f0-a6da-574ab7c0ee07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:48.698823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2555f48-c5cd-41f0-a6da-574ab7c0ee07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:48.699507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2555f48-c5cd-41f0-a6da-574ab7c0ee07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:48.699951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2555f48-c5cd-41f0-a6da-574ab7c0ee07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:48.700371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2555f48-c5cd-41f0-a6da-574ab7c0ee07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:48.713874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d446c4ea-4fae-47a1-8bdc-1258149de480 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:48.714507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d446c4ea-4fae-47a1-8bdc-1258149de480 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:48.717114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:48.722789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d446c4ea-4fae-47a1-8bdc-1258149de480 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:48.723276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d446c4ea-4fae-47a1-8bdc-1258149de480 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:48.723709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d446c4ea-4fae-47a1-8bdc-1258149de480 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:48.724408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d446c4ea-4fae-47a1-8bdc-1258149de480 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:48.724880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d446c4ea-4fae-47a1-8bdc-1258149de480 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:48.725302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d446c4ea-4fae-47a1-8bdc-1258149de480 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:48.835031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f2555f48-c5cd-41f0-a6da-574ab7c0ee07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:48.844969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f2555f48-c5cd-41f0-a6da-574ab7c0ee07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.158160 Aug 18 22:13:48.845768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1504/3000] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:48 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:48.860400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d446c4ea-4fae-47a1-8bdc-1258149de480 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:48.862729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69c6a3a6-8989-4a2a-88df-c6004fee6bab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:48.863337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-69c6a3a6-8989-4a2a-88df-c6004fee6bab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:48.868639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d446c4ea-4fae-47a1-8bdc-1258149de480 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.158782 Aug 18 22:13:48.869074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69c6a3a6-8989-4a2a-88df-c6004fee6bab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:48.870166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1497/3001] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:48 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:48.870333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69c6a3a6-8989-4a2a-88df-c6004fee6bab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:48.870735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69c6a3a6-8989-4a2a-88df-c6004fee6bab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:48.871447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69c6a3a6-8989-4a2a-88df-c6004fee6bab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:48.871877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69c6a3a6-8989-4a2a-88df-c6004fee6bab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:48.872297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69c6a3a6-8989-4a2a-88df-c6004fee6bab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:48.998702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69c6a3a6-8989-4a2a-88df-c6004fee6bab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:49.006942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-69c6a3a6-8989-4a2a-88df-c6004fee6bab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147893 Aug 18 22:13:49.007511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1505/3002] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:48 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:49.158424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2c8234fa-1167-4e95-bdaf-8eb256b56797 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:49.159049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2c8234fa-1167-4e95-bdaf-8eb256b56797 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:49.164998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c8234fa-1167-4e95-bdaf-8eb256b56797 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:49.165490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c8234fa-1167-4e95-bdaf-8eb256b56797 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:49.165960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c8234fa-1167-4e95-bdaf-8eb256b56797 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:49.167302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c8234fa-1167-4e95-bdaf-8eb256b56797 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:49.167754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c8234fa-1167-4e95-bdaf-8eb256b56797 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:49.168184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c8234fa-1167-4e95-bdaf-8eb256b56797 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:49.260707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e9859abc-269f-473a-9afd-84f33e53f174 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:49.261943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e9859abc-269f-473a-9afd-84f33e53f174 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:49.272083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9859abc-269f-473a-9afd-84f33e53f174 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:49.272921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9859abc-269f-473a-9afd-84f33e53f174 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:49.273676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9859abc-269f-473a-9afd-84f33e53f174 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:49.274896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9859abc-269f-473a-9afd-84f33e53f174 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:49.276218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9859abc-269f-473a-9afd-84f33e53f174 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:49.277032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9859abc-269f-473a-9afd-84f33e53f174 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:49.315813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2c8234fa-1167-4e95-bdaf-8eb256b56797 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:49.331959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2c8234fa-1167-4e95-bdaf-8eb256b56797 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:49.333503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2c8234fa-1167-4e95-bdaf-8eb256b56797 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:49.334712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2c8234fa-1167-4e95-bdaf-8eb256b56797 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.180113 Aug 18 22:13:49.335296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1498/3003] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:49.415893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e9859abc-269f-473a-9afd-84f33e53f174 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:49.424300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e9859abc-269f-473a-9afd-84f33e53f174 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.170682 Aug 18 22:13:49.424868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1506/3004] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:49 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:49.866910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7ed26c13-4cb2-4f06-8877-548add6c811b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:49.867563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7ed26c13-4cb2-4f06-8877-548add6c811b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:49.874596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ed26c13-4cb2-4f06-8877-548add6c811b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:49.875084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ed26c13-4cb2-4f06-8877-548add6c811b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:49.875531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ed26c13-4cb2-4f06-8877-548add6c811b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:49.876229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ed26c13-4cb2-4f06-8877-548add6c811b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:49.876687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ed26c13-4cb2-4f06-8877-548add6c811b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:49.877117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ed26c13-4cb2-4f06-8877-548add6c811b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:49.891771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2267bd17-6b7e-4e07-af8d-77c047a03f6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:49.892541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2267bd17-6b7e-4e07-af8d-77c047a03f6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:49.899683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2267bd17-6b7e-4e07-af8d-77c047a03f6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:49.900167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2267bd17-6b7e-4e07-af8d-77c047a03f6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:49.900639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2267bd17-6b7e-4e07-af8d-77c047a03f6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:49.901645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2267bd17-6b7e-4e07-af8d-77c047a03f6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:49.902122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2267bd17-6b7e-4e07-af8d-77c047a03f6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:49.902547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2267bd17-6b7e-4e07-af8d-77c047a03f6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:50.008272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7ed26c13-4cb2-4f06-8877-548add6c811b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:50.017355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7ed26c13-4cb2-4f06-8877-548add6c811b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154293 Aug 18 22:13:50.017975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1499/3005] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:49 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:50.027388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1198d002-27e8-45a4-841b-e5156b6a1470 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:50.028086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1198d002-27e8-45a4-841b-e5156b6a1470 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:50.032774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2267bd17-6b7e-4e07-af8d-77c047a03f6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:50.034470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1198d002-27e8-45a4-841b-e5156b6a1470 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:50.035031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1198d002-27e8-45a4-841b-e5156b6a1470 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:50.035538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1198d002-27e8-45a4-841b-e5156b6a1470 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:50.036299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1198d002-27e8-45a4-841b-e5156b6a1470 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:50.036823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1198d002-27e8-45a4-841b-e5156b6a1470 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:50.037321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1198d002-27e8-45a4-841b-e5156b6a1470 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:50.041143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2267bd17-6b7e-4e07-af8d-77c047a03f6e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153472 Aug 18 22:13:50.042271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1507/3006] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:49 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:50.163870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1198d002-27e8-45a4-841b-e5156b6a1470 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:50.172620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1198d002-27e8-45a4-841b-e5156b6a1470 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148820 Aug 18 22:13:50.173225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1500/3007] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:50.358574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ba358f5-1b48-42fa-9e09-abba70ee6cdf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:50.359172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ba358f5-1b48-42fa-9e09-abba70ee6cdf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:50.365091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ba358f5-1b48-42fa-9e09-abba70ee6cdf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:50.365509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ba358f5-1b48-42fa-9e09-abba70ee6cdf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:50.365974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ba358f5-1b48-42fa-9e09-abba70ee6cdf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:50.366648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ba358f5-1b48-42fa-9e09-abba70ee6cdf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:50.367092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ba358f5-1b48-42fa-9e09-abba70ee6cdf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:50.367515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ba358f5-1b48-42fa-9e09-abba70ee6cdf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:50.445062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eab5e0ff-e104-4ecd-a0ef-8c2d055f75de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:50.445703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eab5e0ff-e104-4ecd-a0ef-8c2d055f75de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:50.451868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab5e0ff-e104-4ecd-a0ef-8c2d055f75de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:50.452356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab5e0ff-e104-4ecd-a0ef-8c2d055f75de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:50.452792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab5e0ff-e104-4ecd-a0ef-8c2d055f75de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:50.453488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab5e0ff-e104-4ecd-a0ef-8c2d055f75de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:50.454047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab5e0ff-e104-4ecd-a0ef-8c2d055f75de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:50.454525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab5e0ff-e104-4ecd-a0ef-8c2d055f75de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:50.494963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3ba358f5-1b48-42fa-9e09-abba70ee6cdf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:50.503713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3ba358f5-1b48-42fa-9e09-abba70ee6cdf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:50.505209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3ba358f5-1b48-42fa-9e09-abba70ee6cdf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:50.506403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ba358f5-1b48-42fa-9e09-abba70ee6cdf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151700 Aug 18 22:13:50.506972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1508/3008] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:50.585349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-eab5e0ff-e104-4ecd-a0ef-8c2d055f75de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:50.594209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eab5e0ff-e104-4ecd-a0ef-8c2d055f75de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152986 Aug 18 22:13:50.594787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1501/3009] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:50 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:51.039372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-af018972-08e4-493a-9d29-2634aa7f448a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:51.039991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-af018972-08e4-493a-9d29-2634aa7f448a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:51.046618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af018972-08e4-493a-9d29-2634aa7f448a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:51.047117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af018972-08e4-493a-9d29-2634aa7f448a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:51.047559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af018972-08e4-493a-9d29-2634aa7f448a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:51.048257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af018972-08e4-493a-9d29-2634aa7f448a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:51.048714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af018972-08e4-493a-9d29-2634aa7f448a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:51.049144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af018972-08e4-493a-9d29-2634aa7f448a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:51.062007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-875f4934-37e3-47d1-9710-00527c1e020c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:51.062630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-875f4934-37e3-47d1-9710-00527c1e020c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:51.069119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-875f4934-37e3-47d1-9710-00527c1e020c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:51.069622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-875f4934-37e3-47d1-9710-00527c1e020c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:51.070078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-875f4934-37e3-47d1-9710-00527c1e020c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:51.070776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-875f4934-37e3-47d1-9710-00527c1e020c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:51.071237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-875f4934-37e3-47d1-9710-00527c1e020c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:51.071672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-875f4934-37e3-47d1-9710-00527c1e020c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:51.087526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:51.183209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-af018972-08e4-493a-9d29-2634aa7f448a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:51.191920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-af018972-08e4-493a-9d29-2634aa7f448a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156473 Aug 18 22:13:51.192502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1509/3010] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:51 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:51.197006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6918bc16-8662-4f79-9e7e-181b8c1f3b59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:51.198450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6918bc16-8662-4f79-9e7e-181b8c1f3b59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:51.204442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6918bc16-8662-4f79-9e7e-181b8c1f3b59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:51.204924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6918bc16-8662-4f79-9e7e-181b8c1f3b59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:51.205361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6918bc16-8662-4f79-9e7e-181b8c1f3b59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:51.206083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6918bc16-8662-4f79-9e7e-181b8c1f3b59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:51.206536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6918bc16-8662-4f79-9e7e-181b8c1f3b59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:51.206960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6918bc16-8662-4f79-9e7e-181b8c1f3b59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:51.209881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-875f4934-37e3-47d1-9710-00527c1e020c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:51.218127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-875f4934-37e3-47d1-9710-00527c1e020c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159926 Aug 18 22:13:51.218647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1502/3011] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:51 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:51.338632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6918bc16-8662-4f79-9e7e-181b8c1f3b59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:51.347509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6918bc16-8662-4f79-9e7e-181b8c1f3b59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153942 Aug 18 22:13:51.348111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1510/3012] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:51.529086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-615df892-b8d0-4843-b913-e7508a716368 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:51.529742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-615df892-b8d0-4843-b913-e7508a716368 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:51.535881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-615df892-b8d0-4843-b913-e7508a716368 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:51.536370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-615df892-b8d0-4843-b913-e7508a716368 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:51.536814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-615df892-b8d0-4843-b913-e7508a716368 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:51.537510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-615df892-b8d0-4843-b913-e7508a716368 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:51.537994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-615df892-b8d0-4843-b913-e7508a716368 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:51.538428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-615df892-b8d0-4843-b913-e7508a716368 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:51.616063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3053aa6d-c10a-41d8-b997-c42a249f32db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:51.616551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3053aa6d-c10a-41d8-b997-c42a249f32db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:51.623150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3053aa6d-c10a-41d8-b997-c42a249f32db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:51.623640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3053aa6d-c10a-41d8-b997-c42a249f32db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:51.624078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3053aa6d-c10a-41d8-b997-c42a249f32db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:51.624773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3053aa6d-c10a-41d8-b997-c42a249f32db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:51.625231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3053aa6d-c10a-41d8-b997-c42a249f32db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:51.625683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3053aa6d-c10a-41d8-b997-c42a249f32db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:51.670956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-615df892-b8d0-4843-b913-e7508a716368 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:51.679854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-615df892-b8d0-4843-b913-e7508a716368 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:51.681366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-615df892-b8d0-4843-b913-e7508a716368 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:51.683132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-615df892-b8d0-4843-b913-e7508a716368 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.158005 Aug 18 22:13:51.683695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1503/3013] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:51 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:51.755614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3053aa6d-c10a-41d8-b997-c42a249f32db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:51.763758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3053aa6d-c10a-41d8-b997-c42a249f32db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151753 Aug 18 22:13:51.764522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1511/3014] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:51 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:52.214397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ebc5cbf8-b8ad-462d-84c7-ffdf8324e5b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:52.215008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ebc5cbf8-b8ad-462d-84c7-ffdf8324e5b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:52.221809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebc5cbf8-b8ad-462d-84c7-ffdf8324e5b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:52.222293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebc5cbf8-b8ad-462d-84c7-ffdf8324e5b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:52.222729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebc5cbf8-b8ad-462d-84c7-ffdf8324e5b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:52.223416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebc5cbf8-b8ad-462d-84c7-ffdf8324e5b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:52.223870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebc5cbf8-b8ad-462d-84c7-ffdf8324e5b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:52.224293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebc5cbf8-b8ad-462d-84c7-ffdf8324e5b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:52.239242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d5fcd8a0-d503-4b69-a0e3-dfc2a4d29278 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:52.239868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d5fcd8a0-d503-4b69-a0e3-dfc2a4d29278 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:52.246337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5fcd8a0-d503-4b69-a0e3-dfc2a4d29278 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:52.246820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5fcd8a0-d503-4b69-a0e3-dfc2a4d29278 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:52.247259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5fcd8a0-d503-4b69-a0e3-dfc2a4d29278 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:52.247956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5fcd8a0-d503-4b69-a0e3-dfc2a4d29278 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:52.248438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5fcd8a0-d503-4b69-a0e3-dfc2a4d29278 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:52.248891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5fcd8a0-d503-4b69-a0e3-dfc2a4d29278 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:52.363579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ebc5cbf8-b8ad-462d-84c7-ffdf8324e5b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:52.371827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ebc5cbf8-b8ad-462d-84c7-ffdf8324e5b9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.161815 Aug 18 22:13:52.372401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1504/3015] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:52 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:52.376796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-adf73c1e-34c3-4410-b61d-29beaea08456 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:52.377407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-adf73c1e-34c3-4410-b61d-29beaea08456 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:52.383112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-adf73c1e-34c3-4410-b61d-29beaea08456 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:52.383595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-adf73c1e-34c3-4410-b61d-29beaea08456 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:52.384027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-adf73c1e-34c3-4410-b61d-29beaea08456 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:52.384712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-adf73c1e-34c3-4410-b61d-29beaea08456 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:52.385714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-adf73c1e-34c3-4410-b61d-29beaea08456 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:52.386143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-adf73c1e-34c3-4410-b61d-29beaea08456 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:52.395678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d5fcd8a0-d503-4b69-a0e3-dfc2a4d29278 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:52.404605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d5fcd8a0-d503-4b69-a0e3-dfc2a4d29278 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.169236 Aug 18 22:13:52.405191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1512/3016] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:52.511739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-adf73c1e-34c3-4410-b61d-29beaea08456 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:52.519774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-adf73c1e-34c3-4410-b61d-29beaea08456 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.146441 Aug 18 22:13:52.520343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1505/3017] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:52.706084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69565754-779a-4766-8ab5-5b7dc58e8bf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:52.706699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-69565754-779a-4766-8ab5-5b7dc58e8bf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:52.713379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69565754-779a-4766-8ab5-5b7dc58e8bf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:52.713881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69565754-779a-4766-8ab5-5b7dc58e8bf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:52.714319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69565754-779a-4766-8ab5-5b7dc58e8bf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:52.715019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69565754-779a-4766-8ab5-5b7dc58e8bf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:52.715462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69565754-779a-4766-8ab5-5b7dc58e8bf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:52.715886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69565754-779a-4766-8ab5-5b7dc58e8bf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:52.784346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-88af2288-2f31-4d99-b941-c7773ac07825 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:52.785076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-88af2288-2f31-4d99-b941-c7773ac07825 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:52.791034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88af2288-2f31-4d99-b941-c7773ac07825 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:52.791526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88af2288-2f31-4d99-b941-c7773ac07825 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:52.791969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88af2288-2f31-4d99-b941-c7773ac07825 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:52.792666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88af2288-2f31-4d99-b941-c7773ac07825 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:52.793127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88af2288-2f31-4d99-b941-c7773ac07825 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:52.793559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88af2288-2f31-4d99-b941-c7773ac07825 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:52.849663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69565754-779a-4766-8ab5-5b7dc58e8bf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:52.858519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69565754-779a-4766-8ab5-5b7dc58e8bf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:52.860035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69565754-779a-4766-8ab5-5b7dc58e8bf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:52.861236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-69565754-779a-4766-8ab5-5b7dc58e8bf0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159291 Aug 18 22:13:52.861839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1513/3018] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:52 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:52.926531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-88af2288-2f31-4d99-b941-c7773ac07825 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:52.936332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-88af2288-2f31-4d99-b941-c7773ac07825 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155644 Aug 18 22:13:52.937145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1506/3019] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:52 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:53.393305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-18347f7d-96ce-43d3-ad56-480ff11e0dbe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:53.394030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-18347f7d-96ce-43d3-ad56-480ff11e0dbe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:53.396470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:53.402392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18347f7d-96ce-43d3-ad56-480ff11e0dbe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:53.402881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18347f7d-96ce-43d3-ad56-480ff11e0dbe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:53.403326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18347f7d-96ce-43d3-ad56-480ff11e0dbe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:53.404027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18347f7d-96ce-43d3-ad56-480ff11e0dbe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:53.404483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18347f7d-96ce-43d3-ad56-480ff11e0dbe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:53.405154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18347f7d-96ce-43d3-ad56-480ff11e0dbe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:53.426199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d40f3f9f-2087-4175-afc3-61caed576cdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:53.426823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d40f3f9f-2087-4175-afc3-61caed576cdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:53.433241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d40f3f9f-2087-4175-afc3-61caed576cdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:53.433768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d40f3f9f-2087-4175-afc3-61caed576cdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:53.434215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d40f3f9f-2087-4175-afc3-61caed576cdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:53.434911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d40f3f9f-2087-4175-afc3-61caed576cdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:53.435370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d40f3f9f-2087-4175-afc3-61caed576cdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:53.435802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d40f3f9f-2087-4175-afc3-61caed576cdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:53.535040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-18347f7d-96ce-43d3-ad56-480ff11e0dbe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:53.543328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-18347f7d-96ce-43d3-ad56-480ff11e0dbe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153814 Aug 18 22:13:53.543905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1514/3020] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:53 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:53.561398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7948fc1c-aad6-413e-abf4-ff072bc0f1cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:53.562069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7948fc1c-aad6-413e-abf4-ff072bc0f1cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:53.566129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d40f3f9f-2087-4175-afc3-61caed576cdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:53.567910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7948fc1c-aad6-413e-abf4-ff072bc0f1cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:53.568390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7948fc1c-aad6-413e-abf4-ff072bc0f1cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:53.568819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7948fc1c-aad6-413e-abf4-ff072bc0f1cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:53.569503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7948fc1c-aad6-413e-abf4-ff072bc0f1cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:53.569981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7948fc1c-aad6-413e-abf4-ff072bc0f1cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:53.570398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7948fc1c-aad6-413e-abf4-ff072bc0f1cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:53.575127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d40f3f9f-2087-4175-afc3-61caed576cdd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152953 Aug 18 22:13:53.575703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1507/3021] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:53.698276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7948fc1c-aad6-413e-abf4-ff072bc0f1cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:53.706435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7948fc1c-aad6-413e-abf4-ff072bc0f1cb tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.161608 Aug 18 22:13:53.707008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1515/3022] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:53 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:53.884488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-53acf84f-cb92-4e3d-b148-c4a69685d5f2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:53.885166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-53acf84f-cb92-4e3d-b148-c4a69685d5f2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:53.891035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53acf84f-cb92-4e3d-b148-c4a69685d5f2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:53.891512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53acf84f-cb92-4e3d-b148-c4a69685d5f2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:53.891944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53acf84f-cb92-4e3d-b148-c4a69685d5f2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:53.892634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53acf84f-cb92-4e3d-b148-c4a69685d5f2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:53.893080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53acf84f-cb92-4e3d-b148-c4a69685d5f2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:53.893503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-53acf84f-cb92-4e3d-b148-c4a69685d5f2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:53.958091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b326b858-1959-4e25-a7bd-f44248c8d27b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:53.958738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b326b858-1959-4e25-a7bd-f44248c8d27b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:53.964679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b326b858-1959-4e25-a7bd-f44248c8d27b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:53.965228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b326b858-1959-4e25-a7bd-f44248c8d27b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:53.965759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b326b858-1959-4e25-a7bd-f44248c8d27b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:53.966538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b326b858-1959-4e25-a7bd-f44248c8d27b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:53.967062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b326b858-1959-4e25-a7bd-f44248c8d27b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:53.967560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b326b858-1959-4e25-a7bd-f44248c8d27b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:54.031851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-53acf84f-cb92-4e3d-b148-c4a69685d5f2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:54.040752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-53acf84f-cb92-4e3d-b148-c4a69685d5f2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:54.042270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-53acf84f-cb92-4e3d-b148-c4a69685d5f2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:54.043426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-53acf84f-cb92-4e3d-b148-c4a69685d5f2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.162860 Aug 18 22:13:54.043990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1508/3023] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:53 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:54.107480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b326b858-1959-4e25-a7bd-f44248c8d27b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:54.115702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b326b858-1959-4e25-a7bd-f44248c8d27b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.161636 Aug 18 22:13:54.116271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1516/3024] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:53 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:54.565774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ebea04fc-5841-4799-b2dc-fbf8f57bb9e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:54.566404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ebea04fc-5841-4799-b2dc-fbf8f57bb9e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:54.573493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebea04fc-5841-4799-b2dc-fbf8f57bb9e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:54.574012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebea04fc-5841-4799-b2dc-fbf8f57bb9e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:54.574456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebea04fc-5841-4799-b2dc-fbf8f57bb9e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:54.575151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebea04fc-5841-4799-b2dc-fbf8f57bb9e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:54.575612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebea04fc-5841-4799-b2dc-fbf8f57bb9e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:54.576043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebea04fc-5841-4799-b2dc-fbf8f57bb9e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:54.595198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ad6a87b1-83c1-4755-809f-a446973b5c95 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:54.595805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ad6a87b1-83c1-4755-809f-a446973b5c95 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:54.602277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad6a87b1-83c1-4755-809f-a446973b5c95 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:54.602757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad6a87b1-83c1-4755-809f-a446973b5c95 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:54.603190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad6a87b1-83c1-4755-809f-a446973b5c95 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:54.603955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad6a87b1-83c1-4755-809f-a446973b5c95 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:54.604409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad6a87b1-83c1-4755-809f-a446973b5c95 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:54.604832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad6a87b1-83c1-4755-809f-a446973b5c95 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:54.708163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ebea04fc-5841-4799-b2dc-fbf8f57bb9e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:54.717640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ebea04fc-5841-4799-b2dc-fbf8f57bb9e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155617 Aug 18 22:13:54.726953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1509/3025] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:54 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:54.732076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c1d91712-8a9f-4881-8cf3-3c05947f09c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:54.732606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c1d91712-8a9f-4881-8cf3-3c05947f09c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:54.734918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ad6a87b1-83c1-4755-809f-a446973b5c95 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:54.738624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1d91712-8a9f-4881-8cf3-3c05947f09c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:54.739248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1d91712-8a9f-4881-8cf3-3c05947f09c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:54.739686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1d91712-8a9f-4881-8cf3-3c05947f09c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:54.740384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1d91712-8a9f-4881-8cf3-3c05947f09c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:54.740832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1d91712-8a9f-4881-8cf3-3c05947f09c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:54.741251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1d91712-8a9f-4881-8cf3-3c05947f09c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:54.743345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ad6a87b1-83c1-4755-809f-a446973b5c95 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151918 Aug 18 22:13:54.743922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1517/3026] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:54.871605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c1d91712-8a9f-4881-8cf3-3c05947f09c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:54.879873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c1d91712-8a9f-4881-8cf3-3c05947f09c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151716 Aug 18 22:13:54.880467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1510/3027] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:54 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:55.066376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e590efcb-5e0f-4468-a600-1828ec225b2b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:55.066983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e590efcb-5e0f-4468-a600-1828ec225b2b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:55.073537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e590efcb-5e0f-4468-a600-1828ec225b2b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:55.073984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e590efcb-5e0f-4468-a600-1828ec225b2b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:55.074413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e590efcb-5e0f-4468-a600-1828ec225b2b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:55.075088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e590efcb-5e0f-4468-a600-1828ec225b2b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:55.075533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e590efcb-5e0f-4468-a600-1828ec225b2b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:55.075955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e590efcb-5e0f-4468-a600-1828ec225b2b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:55.136773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5666722f-6475-47f4-8935-5c3876660294 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:55.137478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5666722f-6475-47f4-8935-5c3876660294 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:55.143641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5666722f-6475-47f4-8935-5c3876660294 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:55.144131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5666722f-6475-47f4-8935-5c3876660294 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:55.144577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5666722f-6475-47f4-8935-5c3876660294 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:55.145281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5666722f-6475-47f4-8935-5c3876660294 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:55.145768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5666722f-6475-47f4-8935-5c3876660294 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:55.146198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5666722f-6475-47f4-8935-5c3876660294 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:55.206565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e590efcb-5e0f-4468-a600-1828ec225b2b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:55.215517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e590efcb-5e0f-4468-a600-1828ec225b2b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:55.217125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e590efcb-5e0f-4468-a600-1828ec225b2b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:55.218339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e590efcb-5e0f-4468-a600-1828ec225b2b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155886 Aug 18 22:13:55.218912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1518/3028] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:13:55.274369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5666722f-6475-47f4-8935-5c3876660294 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:55.282649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5666722f-6475-47f4-8935-5c3876660294 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150273 Aug 18 22:13:55.283219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1511/3029] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:55 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:55.739049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fa5812fc-3e94-4831-9229-09d8d4350ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:55.739581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fa5812fc-3e94-4831-9229-09d8d4350ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:55.746099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa5812fc-3e94-4831-9229-09d8d4350ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:55.746569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa5812fc-3e94-4831-9229-09d8d4350ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:55.746998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa5812fc-3e94-4831-9229-09d8d4350ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:55.747678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa5812fc-3e94-4831-9229-09d8d4350ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:55.748124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa5812fc-3e94-4831-9229-09d8d4350ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:55.748543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa5812fc-3e94-4831-9229-09d8d4350ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:55.764478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ecdb9ac5-cf04-4184-883e-4c429886ac49 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:55.765108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ecdb9ac5-cf04-4184-883e-4c429886ac49 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:55.771569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecdb9ac5-cf04-4184-883e-4c429886ac49 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:55.772061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecdb9ac5-cf04-4184-883e-4c429886ac49 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:55.772507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecdb9ac5-cf04-4184-883e-4c429886ac49 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:55.773207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecdb9ac5-cf04-4184-883e-4c429886ac49 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:55.773695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecdb9ac5-cf04-4184-883e-4c429886ac49 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:55.774140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecdb9ac5-cf04-4184-883e-4c429886ac49 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:55.879173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fa5812fc-3e94-4831-9229-09d8d4350ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:55.887848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fa5812fc-3e94-4831-9229-09d8d4350ab8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152669 Aug 18 22:13:55.888605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1519/3030] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:55 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:55.906893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8eae362d-1af1-4558-8776-948e17aba890 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:55.907509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8eae362d-1af1-4558-8776-948e17aba890 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:55.907972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ecdb9ac5-cf04-4184-883e-4c429886ac49 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:55.913365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eae362d-1af1-4558-8776-948e17aba890 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:55.913881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eae362d-1af1-4558-8776-948e17aba890 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:55.914315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eae362d-1af1-4558-8776-948e17aba890 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:55.915006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eae362d-1af1-4558-8776-948e17aba890 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:55.915558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eae362d-1af1-4558-8776-948e17aba890 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:55.915995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8eae362d-1af1-4558-8776-948e17aba890 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:55.916270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ecdb9ac5-cf04-4184-883e-4c429886ac49 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155598 Aug 18 22:13:55.917523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1512/3031] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:55 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:55.932102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:56.042780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8eae362d-1af1-4558-8776-948e17aba890 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:56.051165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8eae362d-1af1-4558-8776-948e17aba890 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147742 Aug 18 22:13:56.051734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1520/3032] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:55 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:56.240635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1a66b5d3-5b71-4554-a2d9-7b6e0293f79c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:56.241253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1a66b5d3-5b71-4554-a2d9-7b6e0293f79c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:56.247826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a66b5d3-5b71-4554-a2d9-7b6e0293f79c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:56.248266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a66b5d3-5b71-4554-a2d9-7b6e0293f79c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:56.248740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a66b5d3-5b71-4554-a2d9-7b6e0293f79c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:56.249434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a66b5d3-5b71-4554-a2d9-7b6e0293f79c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:56.249924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a66b5d3-5b71-4554-a2d9-7b6e0293f79c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:56.250394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a66b5d3-5b71-4554-a2d9-7b6e0293f79c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:56.304129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-687ff410-447a-43d2-8d93-ef8ad70ab4b3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:56.304809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-687ff410-447a-43d2-8d93-ef8ad70ab4b3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:56.310843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-687ff410-447a-43d2-8d93-ef8ad70ab4b3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:56.312125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-687ff410-447a-43d2-8d93-ef8ad70ab4b3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:56.312567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-687ff410-447a-43d2-8d93-ef8ad70ab4b3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:56.313272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-687ff410-447a-43d2-8d93-ef8ad70ab4b3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:56.313841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-687ff410-447a-43d2-8d93-ef8ad70ab4b3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:56.314270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-687ff410-447a-43d2-8d93-ef8ad70ab4b3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:56.382967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1a66b5d3-5b71-4554-a2d9-7b6e0293f79c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:56.392239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1a66b5d3-5b71-4554-a2d9-7b6e0293f79c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:56.393772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1a66b5d3-5b71-4554-a2d9-7b6e0293f79c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:56.394985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1a66b5d3-5b71-4554-a2d9-7b6e0293f79c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.158308 Aug 18 22:13:56.395476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1513/3033] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:56.448822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-687ff410-447a-43d2-8d93-ef8ad70ab4b3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:56.456924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-687ff410-447a-43d2-8d93-ef8ad70ab4b3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156940 Aug 18 22:13:56.457502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1521/3034] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:56 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:56.910082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-35abb010-6e87-4b94-994d-d9328f174bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:56.910706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-35abb010-6e87-4b94-994d-d9328f174bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:56.917552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35abb010-6e87-4b94-994d-d9328f174bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:56.918080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35abb010-6e87-4b94-994d-d9328f174bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:56.918521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35abb010-6e87-4b94-994d-d9328f174bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:56.919223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35abb010-6e87-4b94-994d-d9328f174bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:56.919684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35abb010-6e87-4b94-994d-d9328f174bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:56.920118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35abb010-6e87-4b94-994d-d9328f174bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:56.938668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-527c50a4-ff27-44b6-8171-c9f65f11bfc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:56.939378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-527c50a4-ff27-44b6-8171-c9f65f11bfc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:56.946363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-527c50a4-ff27-44b6-8171-c9f65f11bfc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:56.946847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-527c50a4-ff27-44b6-8171-c9f65f11bfc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:56.947285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-527c50a4-ff27-44b6-8171-c9f65f11bfc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:56.947980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-527c50a4-ff27-44b6-8171-c9f65f11bfc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:56.948436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-527c50a4-ff27-44b6-8171-c9f65f11bfc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:56.948862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-527c50a4-ff27-44b6-8171-c9f65f11bfc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:57.048332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-35abb010-6e87-4b94-994d-d9328f174bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:57.057415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-35abb010-6e87-4b94-994d-d9328f174bda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150622 Aug 18 22:13:57.058033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1514/3035] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:56 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:57.071617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2571f520-1012-41eb-9a02-9f249dc9b547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:57.072243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2571f520-1012-41eb-9a02-9f249dc9b547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:57.078332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2571f520-1012-41eb-9a02-9f249dc9b547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:57.078822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2571f520-1012-41eb-9a02-9f249dc9b547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:57.079262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2571f520-1012-41eb-9a02-9f249dc9b547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:57.079867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-527c50a4-ff27-44b6-8171-c9f65f11bfc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:57.080005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2571f520-1012-41eb-9a02-9f249dc9b547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:57.080407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2571f520-1012-41eb-9a02-9f249dc9b547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:57.080839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2571f520-1012-41eb-9a02-9f249dc9b547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:57.088002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-527c50a4-ff27-44b6-8171-c9f65f11bfc0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153121 Aug 18 22:13:57.088586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1522/3036] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:56 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:57.210996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2571f520-1012-41eb-9a02-9f249dc9b547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:57.219711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2571f520-1012-41eb-9a02-9f249dc9b547 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152054 Aug 18 22:13:57.220280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1515/3037] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:57.419759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c3bc779f-4d68-4294-b38f-1b4ad14f7af1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:57.420965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c3bc779f-4d68-4294-b38f-1b4ad14f7af1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:57.427563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3bc779f-4d68-4294-b38f-1b4ad14f7af1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:57.428039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3bc779f-4d68-4294-b38f-1b4ad14f7af1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:57.428472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3bc779f-4d68-4294-b38f-1b4ad14f7af1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:57.429154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3bc779f-4d68-4294-b38f-1b4ad14f7af1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:57.429624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3bc779f-4d68-4294-b38f-1b4ad14f7af1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:57.430048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3bc779f-4d68-4294-b38f-1b4ad14f7af1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:57.477862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dcf05652-cc24-4820-87e1-74794d9d6179 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:57.478404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dcf05652-cc24-4820-87e1-74794d9d6179 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:57.484852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcf05652-cc24-4820-87e1-74794d9d6179 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:57.485331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcf05652-cc24-4820-87e1-74794d9d6179 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:57.485811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcf05652-cc24-4820-87e1-74794d9d6179 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:57.486494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcf05652-cc24-4820-87e1-74794d9d6179 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:57.486964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcf05652-cc24-4820-87e1-74794d9d6179 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:57.487385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcf05652-cc24-4820-87e1-74794d9d6179 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:57.628181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dcf05652-cc24-4820-87e1-74794d9d6179 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:57.637405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dcf05652-cc24-4820-87e1-74794d9d6179 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.163396 Aug 18 22:13:57.638220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1516/3038] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:57 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:57.788349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c3bc779f-4d68-4294-b38f-1b4ad14f7af1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:57.799959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c3bc779f-4d68-4294-b38f-1b4ad14f7af1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:57.801745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c3bc779f-4d68-4294-b38f-1b4ad14f7af1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:57.802903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c3bc779f-4d68-4294-b38f-1b4ad14f7af1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.387721 Aug 18 22:13:57.803467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1523/3039] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:58.079826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6c9978ef-187a-453f-94b3-688195b13f0e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:58.080382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6c9978ef-187a-453f-94b3-688195b13f0e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:58.086973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c9978ef-187a-453f-94b3-688195b13f0e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:58.087463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c9978ef-187a-453f-94b3-688195b13f0e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:58.087907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c9978ef-187a-453f-94b3-688195b13f0e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:58.088603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c9978ef-187a-453f-94b3-688195b13f0e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:58.089061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c9978ef-187a-453f-94b3-688195b13f0e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:58.089494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c9978ef-187a-453f-94b3-688195b13f0e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:58.109289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b7b35590-853b-454a-8db7-22ac27483311 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:58.110085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b7b35590-853b-454a-8db7-22ac27483311 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:58.116276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7b35590-853b-454a-8db7-22ac27483311 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:58.116755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7b35590-853b-454a-8db7-22ac27483311 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:58.117188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7b35590-853b-454a-8db7-22ac27483311 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:58.117902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7b35590-853b-454a-8db7-22ac27483311 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:58.118373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7b35590-853b-454a-8db7-22ac27483311 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:58.118775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b7b35590-853b-454a-8db7-22ac27483311 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:58.218299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6c9978ef-187a-453f-94b3-688195b13f0e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:58.229389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6c9978ef-187a-453f-94b3-688195b13f0e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153576 Aug 18 22:13:58.230119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1517/3040] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:58 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:58.240066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5e0b5bf1-bb19-41d2-9128-e0514195c0ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:58.240859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5e0b5bf1-bb19-41d2-9128-e0514195c0ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:58.247642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e0b5bf1-bb19-41d2-9128-e0514195c0ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:58.248134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e0b5bf1-bb19-41d2-9128-e0514195c0ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:58.248258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b7b35590-853b-454a-8db7-22ac27483311 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:58.248735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e0b5bf1-bb19-41d2-9128-e0514195c0ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:58.249490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e0b5bf1-bb19-41d2-9128-e0514195c0ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:58.249989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e0b5bf1-bb19-41d2-9128-e0514195c0ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:58.250425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5e0b5bf1-bb19-41d2-9128-e0514195c0ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:58.256512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b7b35590-853b-454a-8db7-22ac27483311 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151000 Aug 18 22:13:58.257118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1524/3041] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:58.381266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5e0b5bf1-bb19-41d2-9128-e0514195c0ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:58.389680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5e0b5bf1-bb19-41d2-9128-e0514195c0ee tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153327 Aug 18 22:13:58.390263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1518/3042] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:58 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:58.659111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f4749943-34ce-40da-a8e2-951d704b6531 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:58.659877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f4749943-34ce-40da-a8e2-951d704b6531 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:58.665625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4749943-34ce-40da-a8e2-951d704b6531 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:58.666127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4749943-34ce-40da-a8e2-951d704b6531 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:58.667216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4749943-34ce-40da-a8e2-951d704b6531 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:58.667947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4749943-34ce-40da-a8e2-951d704b6531 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:58.668405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4749943-34ce-40da-a8e2-951d704b6531 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:58.668839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4749943-34ce-40da-a8e2-951d704b6531 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:58.807087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f4749943-34ce-40da-a8e2-951d704b6531 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:58.815437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f4749943-34ce-40da-a8e2-951d704b6531 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.160368 Aug 18 22:13:58.816025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1525/3043] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:58 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:58.825314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-492aff30-638b-4174-b509-5c486590d7a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:58.825953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-492aff30-638b-4174-b509-5c486590d7a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:58.831882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-492aff30-638b-4174-b509-5c486590d7a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:58.832362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-492aff30-638b-4174-b509-5c486590d7a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:58.832794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-492aff30-638b-4174-b509-5c486590d7a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:58.833477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-492aff30-638b-4174-b509-5c486590d7a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:58.833950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-492aff30-638b-4174-b509-5c486590d7a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:58.834373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-492aff30-638b-4174-b509-5c486590d7a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:58.838719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:13:58.962894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-492aff30-638b-4174-b509-5c486590d7a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:58.972063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-492aff30-638b-4174-b509-5c486590d7a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:58.973561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-492aff30-638b-4174-b509-5c486590d7a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:58.974747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-492aff30-638b-4174-b509-5c486590d7a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153469 Aug 18 22:13:58.975303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1519/3044] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:13:59.251052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5301dc61-06ac-4dcb-a243-7f9bcca8fe4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:59.251601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5301dc61-06ac-4dcb-a243-7f9bcca8fe4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:59.258189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5301dc61-06ac-4dcb-a243-7f9bcca8fe4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:59.258693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5301dc61-06ac-4dcb-a243-7f9bcca8fe4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:59.259149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5301dc61-06ac-4dcb-a243-7f9bcca8fe4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:59.260332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5301dc61-06ac-4dcb-a243-7f9bcca8fe4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:59.260838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5301dc61-06ac-4dcb-a243-7f9bcca8fe4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:59.261264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5301dc61-06ac-4dcb-a243-7f9bcca8fe4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:59.279239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2b907819-e053-4a16-8e3c-39508eff1e2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:59.279998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2b907819-e053-4a16-8e3c-39508eff1e2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:59.286816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b907819-e053-4a16-8e3c-39508eff1e2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:59.287301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b907819-e053-4a16-8e3c-39508eff1e2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:59.287734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b907819-e053-4a16-8e3c-39508eff1e2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:59.288590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b907819-e053-4a16-8e3c-39508eff1e2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:59.289026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b907819-e053-4a16-8e3c-39508eff1e2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:59.289449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2b907819-e053-4a16-8e3c-39508eff1e2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:59.392503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5301dc61-06ac-4dcb-a243-7f9bcca8fe4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:59.400623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5301dc61-06ac-4dcb-a243-7f9bcca8fe4c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153607 Aug 18 22:13:59.401196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1526/3045] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:59 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:59.410527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0b466d5d-7029-4489-aa2f-81283b7e2ffd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:59.411249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0b466d5d-7029-4489-aa2f-81283b7e2ffd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:59.417111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b466d5d-7029-4489-aa2f-81283b7e2ffd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:59.417685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b466d5d-7029-4489-aa2f-81283b7e2ffd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:59.418188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b466d5d-7029-4489-aa2f-81283b7e2ffd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:59.418960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b466d5d-7029-4489-aa2f-81283b7e2ffd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:59.419501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b466d5d-7029-4489-aa2f-81283b7e2ffd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:59.419992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b466d5d-7029-4489-aa2f-81283b7e2ffd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:59.424687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2b907819-e053-4a16-8e3c-39508eff1e2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:59.433472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2b907819-e053-4a16-8e3c-39508eff1e2b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.158167 Aug 18 22:13:59.434366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1520/3046] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:59 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:59.550017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0b466d5d-7029-4489-aa2f-81283b7e2ffd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:59.558421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0b466d5d-7029-4489-aa2f-81283b7e2ffd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151641 Aug 18 22:13:59.558987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1527/3047] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:13:59.836342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4f47f1aa-eb43-49d6-80ea-6f74f2f32c9f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:59.836894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4f47f1aa-eb43-49d6-80ea-6f74f2f32c9f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:13:59.843564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f47f1aa-eb43-49d6-80ea-6f74f2f32c9f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:59.844086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f47f1aa-eb43-49d6-80ea-6f74f2f32c9f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:59.844532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f47f1aa-eb43-49d6-80ea-6f74f2f32c9f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:59.845223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f47f1aa-eb43-49d6-80ea-6f74f2f32c9f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:13:59.845728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f47f1aa-eb43-49d6-80ea-6f74f2f32c9f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:13:59.846182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f47f1aa-eb43-49d6-80ea-6f74f2f32c9f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:13:59.973204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4f47f1aa-eb43-49d6-80ea-6f74f2f32c9f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:13:59.981375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4f47f1aa-eb43-49d6-80ea-6f74f2f32c9f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149017 Aug 18 22:13:59.981976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1521/3048] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:13:59 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:13:59.998007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b288e696-ffda-4d09-a379-490103b62349 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:13:59.998618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b288e696-ffda-4d09-a379-490103b62349 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:00.004491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b288e696-ffda-4d09-a379-490103b62349 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:00.004970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b288e696-ffda-4d09-a379-490103b62349 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:00.005404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b288e696-ffda-4d09-a379-490103b62349 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:00.006116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b288e696-ffda-4d09-a379-490103b62349 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:00.006565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b288e696-ffda-4d09-a379-490103b62349 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:00.006987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b288e696-ffda-4d09-a379-490103b62349 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:00.137636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b288e696-ffda-4d09-a379-490103b62349 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:00.146265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b288e696-ffda-4d09-a379-490103b62349 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:00.147744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b288e696-ffda-4d09-a379-490103b62349 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:00.148882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b288e696-ffda-4d09-a379-490103b62349 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154802 Aug 18 22:14:00.149464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1528/3049] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:13:59 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:00.422251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d96451ff-e607-44fa-a2f3-f51620f0509b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:00.422805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d96451ff-e607-44fa-a2f3-f51620f0509b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:00.429903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d96451ff-e607-44fa-a2f3-f51620f0509b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:00.430394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d96451ff-e607-44fa-a2f3-f51620f0509b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:00.430839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d96451ff-e607-44fa-a2f3-f51620f0509b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:00.431536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d96451ff-e607-44fa-a2f3-f51620f0509b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:00.431997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d96451ff-e607-44fa-a2f3-f51620f0509b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:00.432428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d96451ff-e607-44fa-a2f3-f51620f0509b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:00.455897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2acd76f7-a013-4753-800d-14832c3d5e19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:00.456513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2acd76f7-a013-4753-800d-14832c3d5e19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:00.462948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2acd76f7-a013-4753-800d-14832c3d5e19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:00.463430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2acd76f7-a013-4753-800d-14832c3d5e19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:00.463865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2acd76f7-a013-4753-800d-14832c3d5e19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:00.464580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2acd76f7-a013-4753-800d-14832c3d5e19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:00.465032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2acd76f7-a013-4753-800d-14832c3d5e19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:00.465458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2acd76f7-a013-4753-800d-14832c3d5e19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:00.569850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d96451ff-e607-44fa-a2f3-f51620f0509b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:00.578734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d96451ff-e607-44fa-a2f3-f51620f0509b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.160459 Aug 18 22:14:00.579321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1522/3050] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:00 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:00.583870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ce010d89-d7f3-4a83-8e52-e2d87f869f48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:00.584481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ce010d89-d7f3-4a83-8e52-e2d87f869f48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:00.590981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce010d89-d7f3-4a83-8e52-e2d87f869f48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:00.591476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce010d89-d7f3-4a83-8e52-e2d87f869f48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:00.591914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce010d89-d7f3-4a83-8e52-e2d87f869f48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:00.592612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce010d89-d7f3-4a83-8e52-e2d87f869f48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:00.593067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce010d89-d7f3-4a83-8e52-e2d87f869f48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:00.593497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ce010d89-d7f3-4a83-8e52-e2d87f869f48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:00.599101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2acd76f7-a013-4753-800d-14832c3d5e19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:00.608031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2acd76f7-a013-4753-800d-14832c3d5e19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155964 Aug 18 22:14:00.608612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1529/3051] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:00 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:00.722361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ce010d89-d7f3-4a83-8e52-e2d87f869f48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:00.731077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ce010d89-d7f3-4a83-8e52-e2d87f869f48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150834 Aug 18 22:14:00.731654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1523/3052] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:00 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:01.003630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-73ff136e-e3d2-4b7c-bd93-415e86292a85 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:01.004158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-73ff136e-e3d2-4b7c-bd93-415e86292a85 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:01.010097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73ff136e-e3d2-4b7c-bd93-415e86292a85 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:01.010570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73ff136e-e3d2-4b7c-bd93-415e86292a85 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:01.010997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73ff136e-e3d2-4b7c-bd93-415e86292a85 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:01.011672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73ff136e-e3d2-4b7c-bd93-415e86292a85 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:01.012147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73ff136e-e3d2-4b7c-bd93-415e86292a85 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:01.012587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-73ff136e-e3d2-4b7c-bd93-415e86292a85 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:01.143313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-73ff136e-e3d2-4b7c-bd93-415e86292a85 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:01.151413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-73ff136e-e3d2-4b7c-bd93-415e86292a85 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151769 Aug 18 22:14:01.152513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1530/3053] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:00 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:01.171942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fbca5599-603b-4261-a3db-8aa70456f2e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:01.172566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fbca5599-603b-4261-a3db-8aa70456f2e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:01.178857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbca5599-603b-4261-a3db-8aa70456f2e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:01.179344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbca5599-603b-4261-a3db-8aa70456f2e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:01.179835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbca5599-603b-4261-a3db-8aa70456f2e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:01.180525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbca5599-603b-4261-a3db-8aa70456f2e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:01.180986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbca5599-603b-4261-a3db-8aa70456f2e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:01.181414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fbca5599-603b-4261-a3db-8aa70456f2e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:01.308593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fbca5599-603b-4261-a3db-8aa70456f2e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:01.317235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fbca5599-603b-4261-a3db-8aa70456f2e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:01.318783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fbca5599-603b-4261-a3db-8aa70456f2e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:01.319947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fbca5599-603b-4261-a3db-8aa70456f2e7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152578 Aug 18 22:14:01.320527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1524/3054] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:01.601327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4aa6c0f3-9198-43dc-8f84-dbcb313e400b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:01.601999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4aa6c0f3-9198-43dc-8f84-dbcb313e400b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:01.609023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa6c0f3-9198-43dc-8f84-dbcb313e400b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:01.609505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa6c0f3-9198-43dc-8f84-dbcb313e400b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:01.609992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa6c0f3-9198-43dc-8f84-dbcb313e400b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:01.610670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa6c0f3-9198-43dc-8f84-dbcb313e400b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:01.611123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa6c0f3-9198-43dc-8f84-dbcb313e400b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:01.611551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa6c0f3-9198-43dc-8f84-dbcb313e400b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:01.629517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cc6fd1bc-f59f-419d-8ce0-47952cb91bc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:01.630159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cc6fd1bc-f59f-419d-8ce0-47952cb91bc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:01.636601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc6fd1bc-f59f-419d-8ce0-47952cb91bc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:01.637078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc6fd1bc-f59f-419d-8ce0-47952cb91bc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:01.637510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc6fd1bc-f59f-419d-8ce0-47952cb91bc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:01.638218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc6fd1bc-f59f-419d-8ce0-47952cb91bc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:01.638669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc6fd1bc-f59f-419d-8ce0-47952cb91bc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:01.639093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc6fd1bc-f59f-419d-8ce0-47952cb91bc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:01.746847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4aa6c0f3-9198-43dc-8f84-dbcb313e400b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:01.755152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4aa6c0f3-9198-43dc-8f84-dbcb313e400b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.157662 Aug 18 22:14:01.755734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1531/3055] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:01 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:01.761291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f3c0f52f-440c-4cae-b165-38f380862e2c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:01.761457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f3c0f52f-440c-4cae-b165-38f380862e2c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:01.767278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3c0f52f-440c-4cae-b165-38f380862e2c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:01.767761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3c0f52f-440c-4cae-b165-38f380862e2c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:01.768198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3c0f52f-440c-4cae-b165-38f380862e2c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:01.768894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3c0f52f-440c-4cae-b165-38f380862e2c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:01.769344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3c0f52f-440c-4cae-b165-38f380862e2c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:01.769803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3c0f52f-440c-4cae-b165-38f380862e2c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:01.779623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cc6fd1bc-f59f-419d-8ce0-47952cb91bc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:01.787901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cc6fd1bc-f59f-419d-8ce0-47952cb91bc4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.162160 Aug 18 22:14:01.788473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1525/3056] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:01 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:01.899759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f3c0f52f-440c-4cae-b165-38f380862e2c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:01.909047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f3c0f52f-440c-4cae-b165-38f380862e2c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152356 Aug 18 22:14:01.909652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1532/3057] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:01 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:02.172926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-38ff9faf-8850-434c-a365-ed2baed6fd23 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:02.173463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-38ff9faf-8850-434c-a365-ed2baed6fd23 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:02.179690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38ff9faf-8850-434c-a365-ed2baed6fd23 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:02.180183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38ff9faf-8850-434c-a365-ed2baed6fd23 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:02.180622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38ff9faf-8850-434c-a365-ed2baed6fd23 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:02.181313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38ff9faf-8850-434c-a365-ed2baed6fd23 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:02.181798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38ff9faf-8850-434c-a365-ed2baed6fd23 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:02.182228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-38ff9faf-8850-434c-a365-ed2baed6fd23 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:02.312196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-38ff9faf-8850-434c-a365-ed2baed6fd23 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:02.320720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-38ff9faf-8850-434c-a365-ed2baed6fd23 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151809 Aug 18 22:14:02.321296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1526/3058] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:02 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:02.342897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dc951876-5f80-4d17-bf14-e4411139fdec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:02.343538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dc951876-5f80-4d17-bf14-e4411139fdec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:02.349626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc951876-5f80-4d17-bf14-e4411139fdec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:02.350135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc951876-5f80-4d17-bf14-e4411139fdec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:02.350574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc951876-5f80-4d17-bf14-e4411139fdec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:02.351288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc951876-5f80-4d17-bf14-e4411139fdec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:02.351744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc951876-5f80-4d17-bf14-e4411139fdec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:02.352169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc951876-5f80-4d17-bf14-e4411139fdec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:02.486245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc951876-5f80-4d17-bf14-e4411139fdec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:02.495071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc951876-5f80-4d17-bf14-e4411139fdec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:02.497055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc951876-5f80-4d17-bf14-e4411139fdec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:02.498224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dc951876-5f80-4d17-bf14-e4411139fdec tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.160049 Aug 18 22:14:02.498778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1533/3059] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:14:02.776448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-685d7dfb-2f91-4702-8c9e-c315205c663d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:02.777159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-685d7dfb-2f91-4702-8c9e-c315205c663d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:02.783639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-685d7dfb-2f91-4702-8c9e-c315205c663d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:02.784124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-685d7dfb-2f91-4702-8c9e-c315205c663d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:02.784565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-685d7dfb-2f91-4702-8c9e-c315205c663d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:02.785252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-685d7dfb-2f91-4702-8c9e-c315205c663d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:02.785741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-685d7dfb-2f91-4702-8c9e-c315205c663d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:02.786171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-685d7dfb-2f91-4702-8c9e-c315205c663d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:02.809885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-edc87352-3d24-42f0-bf61-46da5d95dbab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:02.810500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-edc87352-3d24-42f0-bf61-46da5d95dbab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:02.816878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc87352-3d24-42f0-bf61-46da5d95dbab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:02.817356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc87352-3d24-42f0-bf61-46da5d95dbab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:02.817833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc87352-3d24-42f0-bf61-46da5d95dbab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:02.818522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc87352-3d24-42f0-bf61-46da5d95dbab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:02.818976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc87352-3d24-42f0-bf61-46da5d95dbab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:02.819402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-edc87352-3d24-42f0-bf61-46da5d95dbab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:02.918754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-685d7dfb-2f91-4702-8c9e-c315205c663d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:02.928848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-685d7dfb-2f91-4702-8c9e-c315205c663d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156425 Aug 18 22:14:02.929444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1527/3060] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:02 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:02.934568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a9d4a287-463c-450f-b803-28fa4382274c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:02.935269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a9d4a287-463c-450f-b803-28fa4382274c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:02.941463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9d4a287-463c-450f-b803-28fa4382274c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:02.941718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9d4a287-463c-450f-b803-28fa4382274c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:02.942199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9d4a287-463c-450f-b803-28fa4382274c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:02.942872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9d4a287-463c-450f-b803-28fa4382274c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:02.943333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9d4a287-463c-450f-b803-28fa4382274c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:02.943760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9d4a287-463c-450f-b803-28fa4382274c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:02.951455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-edc87352-3d24-42f0-bf61-46da5d95dbab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:02.960086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-edc87352-3d24-42f0-bf61-46da5d95dbab tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154525 Aug 18 22:14:02.960678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1534/3061] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:02 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:03.069570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a9d4a287-463c-450f-b803-28fa4382274c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:03.077999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a9d4a287-463c-450f-b803-28fa4382274c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147564 Aug 18 22:14:03.078576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1528/3062] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:02 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:03.342595 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-30e3a522-1051-4495-bb12-c3530347fc01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:03.343212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-30e3a522-1051-4495-bb12-c3530347fc01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:03.349408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30e3a522-1051-4495-bb12-c3530347fc01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:03.349947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30e3a522-1051-4495-bb12-c3530347fc01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:03.350378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30e3a522-1051-4495-bb12-c3530347fc01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:03.351063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30e3a522-1051-4495-bb12-c3530347fc01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:03.351511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30e3a522-1051-4495-bb12-c3530347fc01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:03.351931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-30e3a522-1051-4495-bb12-c3530347fc01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:03.481051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-30e3a522-1051-4495-bb12-c3530347fc01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:03.489166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-30e3a522-1051-4495-bb12-c3530347fc01 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151008 Aug 18 22:14:03.489769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1535/3063] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:03 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:03.521166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-74850533-7bfc-4a19-949c-cc02f947d462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:03.521822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-74850533-7bfc-4a19-949c-cc02f947d462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:03.528420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74850533-7bfc-4a19-949c-cc02f947d462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:03.528908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74850533-7bfc-4a19-949c-cc02f947d462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:03.529347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74850533-7bfc-4a19-949c-cc02f947d462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:03.530077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74850533-7bfc-4a19-949c-cc02f947d462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:03.530541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74850533-7bfc-4a19-949c-cc02f947d462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:03.530972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74850533-7bfc-4a19-949c-cc02f947d462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:03.655333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-74850533-7bfc-4a19-949c-cc02f947d462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:03.664007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-74850533-7bfc-4a19-949c-cc02f947d462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:03.665557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-74850533-7bfc-4a19-949c-cc02f947d462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:03.666753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-74850533-7bfc-4a19-949c-cc02f947d462 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.149590 Aug 18 22:14:03.667324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1529/3064] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:03.962784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e33b086d-0a66-4e31-a5ec-fc26a210deed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:03.963405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e33b086d-0a66-4e31-a5ec-fc26a210deed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:03.969821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e33b086d-0a66-4e31-a5ec-fc26a210deed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:03.970305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e33b086d-0a66-4e31-a5ec-fc26a210deed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:03.970742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e33b086d-0a66-4e31-a5ec-fc26a210deed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:03.971439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e33b086d-0a66-4e31-a5ec-fc26a210deed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:03.971896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e33b086d-0a66-4e31-a5ec-fc26a210deed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:03.972325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e33b086d-0a66-4e31-a5ec-fc26a210deed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:03.981635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-df9cee51-56be-42cc-a337-80731f45e540 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:03.982583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-df9cee51-56be-42cc-a337-80731f45e540 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:03.989373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df9cee51-56be-42cc-a337-80731f45e540 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:03.990054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df9cee51-56be-42cc-a337-80731f45e540 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:03.990968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df9cee51-56be-42cc-a337-80731f45e540 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:03.991396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df9cee51-56be-42cc-a337-80731f45e540 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:03.991933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df9cee51-56be-42cc-a337-80731f45e540 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:03.992445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df9cee51-56be-42cc-a337-80731f45e540 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:04.102369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e33b086d-0a66-4e31-a5ec-fc26a210deed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:04.110808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e33b086d-0a66-4e31-a5ec-fc26a210deed tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151810 Aug 18 22:14:04.111391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1536/3065] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:03 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:04.116187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2ecb0726-3e7a-484b-8325-c075c3126cfc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:04.116433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2ecb0726-3e7a-484b-8325-c075c3126cfc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:04.122713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ecb0726-3e7a-484b-8325-c075c3126cfc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:04.123384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ecb0726-3e7a-484b-8325-c075c3126cfc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:04.123824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ecb0726-3e7a-484b-8325-c075c3126cfc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:04.124511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ecb0726-3e7a-484b-8325-c075c3126cfc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:04.124960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ecb0726-3e7a-484b-8325-c075c3126cfc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:04.125466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ecb0726-3e7a-484b-8325-c075c3126cfc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:04.126645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-df9cee51-56be-42cc-a337-80731f45e540 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:04.128151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:04.134796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-df9cee51-56be-42cc-a337-80731f45e540 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.157159 Aug 18 22:14:04.135363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1530/3066] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:03 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:04.260572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2ecb0726-3e7a-484b-8325-c075c3126cfc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:04.269270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2ecb0726-3e7a-484b-8325-c075c3126cfc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.156959 Aug 18 22:14:04.269872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1537/3067] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:04.510328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-51b34698-82ff-47d0-8585-b94e383ab9fe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:04.510872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-51b34698-82ff-47d0-8585-b94e383ab9fe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:04.516843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51b34698-82ff-47d0-8585-b94e383ab9fe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:04.517327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51b34698-82ff-47d0-8585-b94e383ab9fe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:04.517792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51b34698-82ff-47d0-8585-b94e383ab9fe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:04.518473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51b34698-82ff-47d0-8585-b94e383ab9fe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:04.518920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51b34698-82ff-47d0-8585-b94e383ab9fe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:04.519342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-51b34698-82ff-47d0-8585-b94e383ab9fe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:04.647535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-51b34698-82ff-47d0-8585-b94e383ab9fe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:04.656366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-51b34698-82ff-47d0-8585-b94e383ab9fe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150220 Aug 18 22:14:04.656940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1531/3068] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:04 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:04.689399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-05e29477-be06-4d14-a143-62dedc4832d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:04.690056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-05e29477-be06-4d14-a143-62dedc4832d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:04.696168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05e29477-be06-4d14-a143-62dedc4832d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:04.696653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05e29477-be06-4d14-a143-62dedc4832d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:04.697089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05e29477-be06-4d14-a143-62dedc4832d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:04.697904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05e29477-be06-4d14-a143-62dedc4832d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:04.698765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05e29477-be06-4d14-a143-62dedc4832d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:04.698765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05e29477-be06-4d14-a143-62dedc4832d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:04.825948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05e29477-be06-4d14-a143-62dedc4832d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:04.834808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05e29477-be06-4d14-a143-62dedc4832d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:04.836293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05e29477-be06-4d14-a143-62dedc4832d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:04.837466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-05e29477-be06-4d14-a143-62dedc4832d1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151953 Aug 18 22:14:04.838055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1538/3069] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:05.132744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6c9d7132-8b97-4a37-8657-18171407bd70 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:05.133369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6c9d7132-8b97-4a37-8657-18171407bd70 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:05.140440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c9d7132-8b97-4a37-8657-18171407bd70 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:05.140920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c9d7132-8b97-4a37-8657-18171407bd70 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:05.141354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c9d7132-8b97-4a37-8657-18171407bd70 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:05.142068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c9d7132-8b97-4a37-8657-18171407bd70 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:05.142520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c9d7132-8b97-4a37-8657-18171407bd70 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:05.142943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c9d7132-8b97-4a37-8657-18171407bd70 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:05.157430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f42b2be6-b6b5-4685-82df-84f057aac344 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:05.158090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f42b2be6-b6b5-4685-82df-84f057aac344 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:05.165494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f42b2be6-b6b5-4685-82df-84f057aac344 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:05.166356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f42b2be6-b6b5-4685-82df-84f057aac344 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:05.167010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f42b2be6-b6b5-4685-82df-84f057aac344 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:05.167832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f42b2be6-b6b5-4685-82df-84f057aac344 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:05.168389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f42b2be6-b6b5-4685-82df-84f057aac344 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:05.169063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f42b2be6-b6b5-4685-82df-84f057aac344 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:05.291480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6c9d7132-8b97-4a37-8657-18171407bd70 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:05.300197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6c9d7132-8b97-4a37-8657-18171407bd70 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.171628 Aug 18 22:14:05.301027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1532/3070] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:05 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:05.305658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d0fa9780-0574-4f2c-ace2-2560aee59955 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:05.306456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d0fa9780-0574-4f2c-ace2-2560aee59955 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:05.313132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0fa9780-0574-4f2c-ace2-2560aee59955 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:05.313636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0fa9780-0574-4f2c-ace2-2560aee59955 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:05.314075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0fa9780-0574-4f2c-ace2-2560aee59955 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:05.314774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0fa9780-0574-4f2c-ace2-2560aee59955 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:05.315221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0fa9780-0574-4f2c-ace2-2560aee59955 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:05.315780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d0fa9780-0574-4f2c-ace2-2560aee59955 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:05.326110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f42b2be6-b6b5-4685-82df-84f057aac344 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:05.334330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f42b2be6-b6b5-4685-82df-84f057aac344 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.180923 Aug 18 22:14:05.334930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1539/3071] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:05 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:05.442420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d0fa9780-0574-4f2c-ace2-2560aee59955 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:05.451183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d0fa9780-0574-4f2c-ace2-2560aee59955 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148914 Aug 18 22:14:05.451751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1533/3072] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:05 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:05.677961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-21364f20-03b8-44ae-91b1-f4fdc9b66e9a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:05.678516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-21364f20-03b8-44ae-91b1-f4fdc9b66e9a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:05.684800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21364f20-03b8-44ae-91b1-f4fdc9b66e9a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:05.685276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21364f20-03b8-44ae-91b1-f4fdc9b66e9a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:05.685731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21364f20-03b8-44ae-91b1-f4fdc9b66e9a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:05.686411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21364f20-03b8-44ae-91b1-f4fdc9b66e9a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:05.686854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21364f20-03b8-44ae-91b1-f4fdc9b66e9a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:05.687271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21364f20-03b8-44ae-91b1-f4fdc9b66e9a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:05.817360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-21364f20-03b8-44ae-91b1-f4fdc9b66e9a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:05.826577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-21364f20-03b8-44ae-91b1-f4fdc9b66e9a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152777 Aug 18 22:14:05.827145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1540/3073] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:05 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:05.860125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-46854fb2-ca81-4728-9506-1636caa11d41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:05.860733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46854fb2-ca81-4728-9506-1636caa11d41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:05.866716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46854fb2-ca81-4728-9506-1636caa11d41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:05.867195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46854fb2-ca81-4728-9506-1636caa11d41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:05.867626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46854fb2-ca81-4728-9506-1636caa11d41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:05.868308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46854fb2-ca81-4728-9506-1636caa11d41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:05.868779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46854fb2-ca81-4728-9506-1636caa11d41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:05.869200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46854fb2-ca81-4728-9506-1636caa11d41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:05.998281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-46854fb2-ca81-4728-9506-1636caa11d41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:06.006808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-46854fb2-ca81-4728-9506-1636caa11d41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:06.008297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-46854fb2-ca81-4728-9506-1636caa11d41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:06.009440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-46854fb2-ca81-4728-9506-1636caa11d41 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153150 Aug 18 22:14:06.010047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1534/3074] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:06.322194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f035d0e3-ea5b-4a5b-a5ad-4d8d86f03257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:06.322812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f035d0e3-ea5b-4a5b-a5ad-4d8d86f03257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:06.329994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f035d0e3-ea5b-4a5b-a5ad-4d8d86f03257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:06.330479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f035d0e3-ea5b-4a5b-a5ad-4d8d86f03257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:06.330914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f035d0e3-ea5b-4a5b-a5ad-4d8d86f03257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:06.331609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f035d0e3-ea5b-4a5b-a5ad-4d8d86f03257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:06.332071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f035d0e3-ea5b-4a5b-a5ad-4d8d86f03257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:06.332497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f035d0e3-ea5b-4a5b-a5ad-4d8d86f03257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:06.356199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-92658e1e-ea80-4b43-99fe-c06b3ef676dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:06.356823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-92658e1e-ea80-4b43-99fe-c06b3ef676dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:06.363329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92658e1e-ea80-4b43-99fe-c06b3ef676dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:06.363824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92658e1e-ea80-4b43-99fe-c06b3ef676dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:06.364270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92658e1e-ea80-4b43-99fe-c06b3ef676dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:06.364974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92658e1e-ea80-4b43-99fe-c06b3ef676dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:06.365433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92658e1e-ea80-4b43-99fe-c06b3ef676dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:06.365892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-92658e1e-ea80-4b43-99fe-c06b3ef676dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:06.463427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f035d0e3-ea5b-4a5b-a5ad-4d8d86f03257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:06.472028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f035d0e3-ea5b-4a5b-a5ad-4d8d86f03257 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153637 Aug 18 22:14:06.472616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1541/3075] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:06 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:06.477170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b0d8a171-d631-477c-b0f2-2a601852ba1e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:06.477808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b0d8a171-d631-477c-b0f2-2a601852ba1e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:06.483709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0d8a171-d631-477c-b0f2-2a601852ba1e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:06.484189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0d8a171-d631-477c-b0f2-2a601852ba1e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:06.484628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0d8a171-d631-477c-b0f2-2a601852ba1e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:06.485320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0d8a171-d631-477c-b0f2-2a601852ba1e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:06.485800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0d8a171-d631-477c-b0f2-2a601852ba1e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:06.486227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0d8a171-d631-477c-b0f2-2a601852ba1e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:06.498713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-92658e1e-ea80-4b43-99fe-c06b3ef676dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:06.501067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:06.508531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-92658e1e-ea80-4b43-99fe-c06b3ef676dc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156247 Aug 18 22:14:06.509111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1535/3076] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:06 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:06.616347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b0d8a171-d631-477c-b0f2-2a601852ba1e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:06.625139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b0d8a171-d631-477c-b0f2-2a601852ba1e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151593 Aug 18 22:14:06.625733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1542/3077] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:06 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:06.847941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-daac1f0d-7739-4cc0-a057-6731ab136e3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:06.848552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-daac1f0d-7739-4cc0-a057-6731ab136e3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:06.855296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daac1f0d-7739-4cc0-a057-6731ab136e3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:06.855777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daac1f0d-7739-4cc0-a057-6731ab136e3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:06.856213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daac1f0d-7739-4cc0-a057-6731ab136e3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:06.856885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daac1f0d-7739-4cc0-a057-6731ab136e3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:06.857337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daac1f0d-7739-4cc0-a057-6731ab136e3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:06.857809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daac1f0d-7739-4cc0-a057-6731ab136e3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:06.985861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-daac1f0d-7739-4cc0-a057-6731ab136e3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:06.994100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-daac1f0d-7739-4cc0-a057-6731ab136e3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150022 Aug 18 22:14:06.994676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1536/3078] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:06 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:07.033067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f0cde97b-9fc6-4075-b257-d44abdb10f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:07.033704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f0cde97b-9fc6-4075-b257-d44abdb10f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:07.039600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0cde97b-9fc6-4075-b257-d44abdb10f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:07.040080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0cde97b-9fc6-4075-b257-d44abdb10f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:07.040513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0cde97b-9fc6-4075-b257-d44abdb10f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:07.041198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0cde97b-9fc6-4075-b257-d44abdb10f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:07.041676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0cde97b-9fc6-4075-b257-d44abdb10f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:07.042680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0cde97b-9fc6-4075-b257-d44abdb10f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:07.171580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f0cde97b-9fc6-4075-b257-d44abdb10f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:07.180615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f0cde97b-9fc6-4075-b257-d44abdb10f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:07.182169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f0cde97b-9fc6-4075-b257-d44abdb10f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:07.183474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f0cde97b-9fc6-4075-b257-d44abdb10f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154351 Aug 18 22:14:07.183973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1543/3079] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:07.492874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-688b03c8-477d-4da9-887b-5cf1e07402f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:07.493469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-688b03c8-477d-4da9-887b-5cf1e07402f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:07.500160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-688b03c8-477d-4da9-887b-5cf1e07402f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:07.500637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-688b03c8-477d-4da9-887b-5cf1e07402f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:07.501068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-688b03c8-477d-4da9-887b-5cf1e07402f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:07.501779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-688b03c8-477d-4da9-887b-5cf1e07402f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:07.502237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-688b03c8-477d-4da9-887b-5cf1e07402f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:07.502657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-688b03c8-477d-4da9-887b-5cf1e07402f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:07.530588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-547c3c9e-cf2c-47f9-9cbf-2f84436e6cd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:07.531200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-547c3c9e-cf2c-47f9-9cbf-2f84436e6cd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:07.537901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-547c3c9e-cf2c-47f9-9cbf-2f84436e6cd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:07.538415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-547c3c9e-cf2c-47f9-9cbf-2f84436e6cd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:07.538856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-547c3c9e-cf2c-47f9-9cbf-2f84436e6cd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:07.539582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-547c3c9e-cf2c-47f9-9cbf-2f84436e6cd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:07.540071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-547c3c9e-cf2c-47f9-9cbf-2f84436e6cd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:07.540498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-547c3c9e-cf2c-47f9-9cbf-2f84436e6cd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:07.638130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-688b03c8-477d-4da9-887b-5cf1e07402f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:07.646407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-688b03c8-477d-4da9-887b-5cf1e07402f1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.157438 Aug 18 22:14:07.653650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1537/3080] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:07 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:07.653650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8c13fa0c-12aa-42b8-8d95-4c6c2b742119 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:07.653650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8c13fa0c-12aa-42b8-8d95-4c6c2b742119 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:07.657872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c13fa0c-12aa-42b8-8d95-4c6c2b742119 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:07.658356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c13fa0c-12aa-42b8-8d95-4c6c2b742119 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:07.658789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c13fa0c-12aa-42b8-8d95-4c6c2b742119 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:07.659513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c13fa0c-12aa-42b8-8d95-4c6c2b742119 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:07.659936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c13fa0c-12aa-42b8-8d95-4c6c2b742119 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:07.660658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c13fa0c-12aa-42b8-8d95-4c6c2b742119 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:07.676664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-547c3c9e-cf2c-47f9-9cbf-2f84436e6cd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:07.685413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-547c3c9e-cf2c-47f9-9cbf-2f84436e6cd7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159289 Aug 18 22:14:07.686096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1544/3081] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:07 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:07.788624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8c13fa0c-12aa-42b8-8d95-4c6c2b742119 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:07.797246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8c13fa0c-12aa-42b8-8d95-4c6c2b742119 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149177 Aug 18 22:14:07.797864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1538/3082] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:08.015572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8d9d196c-75a6-48c4-9b51-ba026f12e7f8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:08.016176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8d9d196c-75a6-48c4-9b51-ba026f12e7f8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:08.022106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d9d196c-75a6-48c4-9b51-ba026f12e7f8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:08.022579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d9d196c-75a6-48c4-9b51-ba026f12e7f8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:08.023007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d9d196c-75a6-48c4-9b51-ba026f12e7f8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:08.023693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d9d196c-75a6-48c4-9b51-ba026f12e7f8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:08.024142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d9d196c-75a6-48c4-9b51-ba026f12e7f8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:08.024559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d9d196c-75a6-48c4-9b51-ba026f12e7f8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:08.160040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8d9d196c-75a6-48c4-9b51-ba026f12e7f8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:08.168589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8d9d196c-75a6-48c4-9b51-ba026f12e7f8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157579 Aug 18 22:14:08.169156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1545/3083] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:08 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:08.205862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ec295032-9267-4ea3-b3db-6266aadb4f61 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:08.206943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ec295032-9267-4ea3-b3db-6266aadb4f61 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:08.213032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec295032-9267-4ea3-b3db-6266aadb4f61 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:08.213525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec295032-9267-4ea3-b3db-6266aadb4f61 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:08.214011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec295032-9267-4ea3-b3db-6266aadb4f61 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:08.214711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec295032-9267-4ea3-b3db-6266aadb4f61 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:08.215174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec295032-9267-4ea3-b3db-6266aadb4f61 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:08.215636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ec295032-9267-4ea3-b3db-6266aadb4f61 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:08.350938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ec295032-9267-4ea3-b3db-6266aadb4f61 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:08.360084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ec295032-9267-4ea3-b3db-6266aadb4f61 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:08.361569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ec295032-9267-4ea3-b3db-6266aadb4f61 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:08.362763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ec295032-9267-4ea3-b3db-6266aadb4f61 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.160839 Aug 18 22:14:08.363334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1539/3084] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:08.668727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-070425b7-042e-482b-beaa-1f2364b9a925 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:08.669298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-070425b7-042e-482b-beaa-1f2364b9a925 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:08.676217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-070425b7-042e-482b-beaa-1f2364b9a925 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:08.676691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-070425b7-042e-482b-beaa-1f2364b9a925 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:08.677121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-070425b7-042e-482b-beaa-1f2364b9a925 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:08.677835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-070425b7-042e-482b-beaa-1f2364b9a925 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:08.678286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-070425b7-042e-482b-beaa-1f2364b9a925 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:08.678705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-070425b7-042e-482b-beaa-1f2364b9a925 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:08.707342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2ba7ace8-e8fd-4061-abc1-8800da14d761 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:08.708109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2ba7ace8-e8fd-4061-abc1-8800da14d761 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:08.715291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ba7ace8-e8fd-4061-abc1-8800da14d761 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:08.715785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ba7ace8-e8fd-4061-abc1-8800da14d761 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:08.716228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ba7ace8-e8fd-4061-abc1-8800da14d761 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:08.716956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ba7ace8-e8fd-4061-abc1-8800da14d761 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:08.717409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ba7ace8-e8fd-4061-abc1-8800da14d761 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:08.718085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ba7ace8-e8fd-4061-abc1-8800da14d761 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:08.811304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-070425b7-042e-482b-beaa-1f2364b9a925 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:08.819765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-070425b7-042e-482b-beaa-1f2364b9a925 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155707 Aug 18 22:14:08.820344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1546/3085] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:08 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:08.825243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52e1efb0-78e5-47d8-808a-bcce13c62835 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:08.825874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-52e1efb0-78e5-47d8-808a-bcce13c62835 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:08.831537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52e1efb0-78e5-47d8-808a-bcce13c62835 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:08.832612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52e1efb0-78e5-47d8-808a-bcce13c62835 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:08.833048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52e1efb0-78e5-47d8-808a-bcce13c62835 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:08.833876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52e1efb0-78e5-47d8-808a-bcce13c62835 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:08.834334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52e1efb0-78e5-47d8-808a-bcce13c62835 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:08.834758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52e1efb0-78e5-47d8-808a-bcce13c62835 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:08.851024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2ba7ace8-e8fd-4061-abc1-8800da14d761 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:08.859926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2ba7ace8-e8fd-4061-abc1-8800da14d761 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156396 Aug 18 22:14:08.860514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1540/3086] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:08 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:08.966706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-52e1efb0-78e5-47d8-808a-bcce13c62835 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:08.974767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-52e1efb0-78e5-47d8-808a-bcce13c62835 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153510 Aug 18 22:14:08.975335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1547/3087] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:08 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:09.189749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9d4e1605-294f-4745-8eff-46abb922664c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:09.190369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9d4e1605-294f-4745-8eff-46abb922664c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:09.196281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d4e1605-294f-4745-8eff-46abb922664c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:09.196761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d4e1605-294f-4745-8eff-46abb922664c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:09.197195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d4e1605-294f-4745-8eff-46abb922664c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:09.197907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d4e1605-294f-4745-8eff-46abb922664c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:09.198992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d4e1605-294f-4745-8eff-46abb922664c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:09.199422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d4e1605-294f-4745-8eff-46abb922664c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:09.334860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9d4e1605-294f-4745-8eff-46abb922664c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:09.343204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9d4e1605-294f-4745-8eff-46abb922664c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157376 Aug 18 22:14:09.343775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1541/3088] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:09 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:09.386737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b0447c07-d287-49e9-8453-4c3547c226f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:09.387621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b0447c07-d287-49e9-8453-4c3547c226f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:09.393686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0447c07-d287-49e9-8453-4c3547c226f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:09.394173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0447c07-d287-49e9-8453-4c3547c226f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:09.394615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0447c07-d287-49e9-8453-4c3547c226f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:09.395300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0447c07-d287-49e9-8453-4c3547c226f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:09.395754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0447c07-d287-49e9-8453-4c3547c226f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:09.396214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0447c07-d287-49e9-8453-4c3547c226f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:09.520444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b0447c07-d287-49e9-8453-4c3547c226f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:09.529085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b0447c07-d287-49e9-8453-4c3547c226f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:09.531113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b0447c07-d287-49e9-8453-4c3547c226f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:09.532279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b0447c07-d287-49e9-8453-4c3547c226f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150135 Aug 18 22:14:09.532847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1548/3089] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:09.843017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d054c8e5-3fe1-44e6-a4db-758588625ba3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:09.843632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d054c8e5-3fe1-44e6-a4db-758588625ba3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:09.850118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d054c8e5-3fe1-44e6-a4db-758588625ba3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:09.850600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d054c8e5-3fe1-44e6-a4db-758588625ba3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:09.851036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d054c8e5-3fe1-44e6-a4db-758588625ba3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:09.851723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d054c8e5-3fe1-44e6-a4db-758588625ba3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:09.852177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d054c8e5-3fe1-44e6-a4db-758588625ba3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:09.852601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d054c8e5-3fe1-44e6-a4db-758588625ba3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:09.880164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf79c11e-ea82-4606-b1a8-2bdca7580ef0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:09.880779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf79c11e-ea82-4606-b1a8-2bdca7580ef0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:09.887195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf79c11e-ea82-4606-b1a8-2bdca7580ef0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:09.887693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf79c11e-ea82-4606-b1a8-2bdca7580ef0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:09.888116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf79c11e-ea82-4606-b1a8-2bdca7580ef0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:09.889241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf79c11e-ea82-4606-b1a8-2bdca7580ef0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:09.889379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf79c11e-ea82-4606-b1a8-2bdca7580ef0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:09.889803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf79c11e-ea82-4606-b1a8-2bdca7580ef0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:09.985774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d054c8e5-3fe1-44e6-a4db-758588625ba3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:09.995699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d054c8e5-3fe1-44e6-a4db-758588625ba3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156511 Aug 18 22:14:09.996291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1542/3090] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:09 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:10.001305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f9ff098c-93e6-440a-be7d-73cd28af9431 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:10.001956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f9ff098c-93e6-440a-be7d-73cd28af9431 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:10.009316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9ff098c-93e6-440a-be7d-73cd28af9431 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:10.009843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9ff098c-93e6-440a-be7d-73cd28af9431 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:10.010430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9ff098c-93e6-440a-be7d-73cd28af9431 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:10.011380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9ff098c-93e6-440a-be7d-73cd28af9431 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:10.011881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9ff098c-93e6-440a-be7d-73cd28af9431 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:10.012310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f9ff098c-93e6-440a-be7d-73cd28af9431 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:10.023545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bf79c11e-ea82-4606-b1a8-2bdca7580ef0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:10.032529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf79c11e-ea82-4606-b1a8-2bdca7580ef0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156127 Aug 18 22:14:10.033115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1549/3091] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:09 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:10.141274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f9ff098c-93e6-440a-be7d-73cd28af9431 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:10.149450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f9ff098c-93e6-440a-be7d-73cd28af9431 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152013 Aug 18 22:14:10.150049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1543/3092] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:09 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:10.363782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a4801479-d036-4d8c-a303-570d68676d4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:10.364395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a4801479-d036-4d8c-a303-570d68676d4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:10.370433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4801479-d036-4d8c-a303-570d68676d4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:10.370948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4801479-d036-4d8c-a303-570d68676d4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:10.371387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4801479-d036-4d8c-a303-570d68676d4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:10.372057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4801479-d036-4d8c-a303-570d68676d4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:10.372501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4801479-d036-4d8c-a303-570d68676d4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:10.372920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a4801479-d036-4d8c-a303-570d68676d4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:10.506843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a4801479-d036-4d8c-a303-570d68676d4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:10.516107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a4801479-d036-4d8c-a303-570d68676d4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156032 Aug 18 22:14:10.516698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1550/3093] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:10 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:10.555500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-001c3151-c25e-4079-80eb-2ae7a09e1a60 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:10.556119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-001c3151-c25e-4079-80eb-2ae7a09e1a60 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:10.562210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-001c3151-c25e-4079-80eb-2ae7a09e1a60 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:10.562699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-001c3151-c25e-4079-80eb-2ae7a09e1a60 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:10.563138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-001c3151-c25e-4079-80eb-2ae7a09e1a60 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:10.563842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-001c3151-c25e-4079-80eb-2ae7a09e1a60 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:10.564296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-001c3151-c25e-4079-80eb-2ae7a09e1a60 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:10.564752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-001c3151-c25e-4079-80eb-2ae7a09e1a60 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:10.696688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-001c3151-c25e-4079-80eb-2ae7a09e1a60 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:10.705313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-001c3151-c25e-4079-80eb-2ae7a09e1a60 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:10.706766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-001c3151-c25e-4079-80eb-2ae7a09e1a60 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:10.707916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-001c3151-c25e-4079-80eb-2ae7a09e1a60 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156324 Aug 18 22:14:10.708472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1544/3094] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:11.018528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a2becbf1-2e12-492d-9aeb-0d0d6cbab566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:11.019092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a2becbf1-2e12-492d-9aeb-0d0d6cbab566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:11.025520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2becbf1-2e12-492d-9aeb-0d0d6cbab566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:11.026032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2becbf1-2e12-492d-9aeb-0d0d6cbab566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:11.027095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2becbf1-2e12-492d-9aeb-0d0d6cbab566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:11.027782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2becbf1-2e12-492d-9aeb-0d0d6cbab566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:11.028235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2becbf1-2e12-492d-9aeb-0d0d6cbab566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:11.028659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a2becbf1-2e12-492d-9aeb-0d0d6cbab566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:11.054635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-667e2b8e-15cf-4a85-bfe0-df929d967276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:11.055294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-667e2b8e-15cf-4a85-bfe0-df929d967276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:11.062004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-667e2b8e-15cf-4a85-bfe0-df929d967276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:11.062499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-667e2b8e-15cf-4a85-bfe0-df929d967276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:11.062940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-667e2b8e-15cf-4a85-bfe0-df929d967276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:11.063646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-667e2b8e-15cf-4a85-bfe0-df929d967276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:11.064110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-667e2b8e-15cf-4a85-bfe0-df929d967276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:11.064540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-667e2b8e-15cf-4a85-bfe0-df929d967276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:11.157139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a2becbf1-2e12-492d-9aeb-0d0d6cbab566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:11.166979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a2becbf1-2e12-492d-9aeb-0d0d6cbab566 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152384 Aug 18 22:14:11.167552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1551/3095] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:11 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:11.172004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2a58437f-d409-4655-aec1-772b7be99d4b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:11.172798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2a58437f-d409-4655-aec1-772b7be99d4b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:11.178853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a58437f-d409-4655-aec1-772b7be99d4b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:11.179339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a58437f-d409-4655-aec1-772b7be99d4b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:11.179779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a58437f-d409-4655-aec1-772b7be99d4b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:11.180476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a58437f-d409-4655-aec1-772b7be99d4b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:11.180934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a58437f-d409-4655-aec1-772b7be99d4b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:11.181365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a58437f-d409-4655-aec1-772b7be99d4b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:11.199344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-667e2b8e-15cf-4a85-bfe0-df929d967276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:11.207584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-667e2b8e-15cf-4a85-bfe0-df929d967276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.157032 Aug 18 22:14:11.208310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1545/3096] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:11.310418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2a58437f-d409-4655-aec1-772b7be99d4b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:11.318762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2a58437f-d409-4655-aec1-772b7be99d4b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150279 Aug 18 22:14:11.319347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1552/3097] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:11.537048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f1be20f2-2381-4ab4-8190-6a9fc866729b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:11.537688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f1be20f2-2381-4ab4-8190-6a9fc866729b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:11.543533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f1be20f2-2381-4ab4-8190-6a9fc866729b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:11.544008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f1be20f2-2381-4ab4-8190-6a9fc866729b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:11.544437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f1be20f2-2381-4ab4-8190-6a9fc866729b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:11.545111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f1be20f2-2381-4ab4-8190-6a9fc866729b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:11.545558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f1be20f2-2381-4ab4-8190-6a9fc866729b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:11.546007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f1be20f2-2381-4ab4-8190-6a9fc866729b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:11.673398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f1be20f2-2381-4ab4-8190-6a9fc866729b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:11.681834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f1be20f2-2381-4ab4-8190-6a9fc866729b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148561 Aug 18 22:14:11.682416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1546/3098] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:11 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:11.731743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-76c765cc-672b-45c3-8274-0597542b6521 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:11.732349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-76c765cc-672b-45c3-8274-0597542b6521 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:11.738329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76c765cc-672b-45c3-8274-0597542b6521 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:11.738804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76c765cc-672b-45c3-8274-0597542b6521 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:11.739244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76c765cc-672b-45c3-8274-0597542b6521 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:11.739918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76c765cc-672b-45c3-8274-0597542b6521 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:11.740481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76c765cc-672b-45c3-8274-0597542b6521 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:11.740906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-76c765cc-672b-45c3-8274-0597542b6521 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:11.867600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-76c765cc-672b-45c3-8274-0597542b6521 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:11.869825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:11.877881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-76c765cc-672b-45c3-8274-0597542b6521 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:11.879342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-76c765cc-672b-45c3-8274-0597542b6521 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:11.880495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-76c765cc-672b-45c3-8274-0597542b6521 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153316 Aug 18 22:14:11.881094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1553/3099] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:12.189083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-170278c6-bdde-4155-81c5-5955a77f501c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:12.189670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-170278c6-bdde-4155-81c5-5955a77f501c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:12.191940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:12.197626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-170278c6-bdde-4155-81c5-5955a77f501c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:12.198139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-170278c6-bdde-4155-81c5-5955a77f501c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:12.199201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-170278c6-bdde-4155-81c5-5955a77f501c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:12.199884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-170278c6-bdde-4155-81c5-5955a77f501c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:12.200331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-170278c6-bdde-4155-81c5-5955a77f501c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:12.200755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-170278c6-bdde-4155-81c5-5955a77f501c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:12.229693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b509635b-6e1d-4d97-a00c-4655e9634bdc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:12.230372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b509635b-6e1d-4d97-a00c-4655e9634bdc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:12.237001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b509635b-6e1d-4d97-a00c-4655e9634bdc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:12.237487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b509635b-6e1d-4d97-a00c-4655e9634bdc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:12.237953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b509635b-6e1d-4d97-a00c-4655e9634bdc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:12.238652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b509635b-6e1d-4d97-a00c-4655e9634bdc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:12.239111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b509635b-6e1d-4d97-a00c-4655e9634bdc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:12.239540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b509635b-6e1d-4d97-a00c-4655e9634bdc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:12.329366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-170278c6-bdde-4155-81c5-5955a77f501c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:12.337767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-170278c6-bdde-4155-81c5-5955a77f501c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152545 Aug 18 22:14:12.338324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1547/3100] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:12 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:12.342645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-601f1276-aefc-4c1c-bb52-08718b41a130 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:12.343498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-601f1276-aefc-4c1c-bb52-08718b41a130 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:12.349098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-601f1276-aefc-4c1c-bb52-08718b41a130 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:12.349517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-601f1276-aefc-4c1c-bb52-08718b41a130 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:12.350001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-601f1276-aefc-4c1c-bb52-08718b41a130 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:12.350775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-601f1276-aefc-4c1c-bb52-08718b41a130 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:12.351240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-601f1276-aefc-4c1c-bb52-08718b41a130 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:12.351661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-601f1276-aefc-4c1c-bb52-08718b41a130 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:12.376424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b509635b-6e1d-4d97-a00c-4655e9634bdc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:12.384777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b509635b-6e1d-4d97-a00c-4655e9634bdc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.158886 Aug 18 22:14:12.385353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1554/3101] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:12 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:12.480468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-601f1276-aefc-4c1c-bb52-08718b41a130 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:12.488602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-601f1276-aefc-4c1c-bb52-08718b41a130 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149355 Aug 18 22:14:12.489181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1548/3102] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:12 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:12.703066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b2c61ca7-0a3b-4e55-9647-8db8382b550a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:12.703593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b2c61ca7-0a3b-4e55-9647-8db8382b550a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:12.709642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2c61ca7-0a3b-4e55-9647-8db8382b550a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:12.710125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2c61ca7-0a3b-4e55-9647-8db8382b550a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:12.710554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2c61ca7-0a3b-4e55-9647-8db8382b550a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:12.711232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2c61ca7-0a3b-4e55-9647-8db8382b550a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:12.711677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2c61ca7-0a3b-4e55-9647-8db8382b550a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:12.712093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2c61ca7-0a3b-4e55-9647-8db8382b550a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:12.838169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b2c61ca7-0a3b-4e55-9647-8db8382b550a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:12.846399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b2c61ca7-0a3b-4e55-9647-8db8382b550a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.147269 Aug 18 22:14:12.846978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1555/3103] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:12 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:12.903414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-84a98167-3585-4748-9f58-0326fa420009 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:12.904036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-84a98167-3585-4748-9f58-0326fa420009 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:12.910068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84a98167-3585-4748-9f58-0326fa420009 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:12.910557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84a98167-3585-4748-9f58-0326fa420009 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:12.911000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84a98167-3585-4748-9f58-0326fa420009 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:12.911693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84a98167-3585-4748-9f58-0326fa420009 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:12.912153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84a98167-3585-4748-9f58-0326fa420009 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:12.912598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-84a98167-3585-4748-9f58-0326fa420009 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:13.043171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-84a98167-3585-4748-9f58-0326fa420009 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:13.052015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-84a98167-3585-4748-9f58-0326fa420009 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:13.053534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-84a98167-3585-4748-9f58-0326fa420009 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:13.054842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-84a98167-3585-4748-9f58-0326fa420009 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155818 Aug 18 22:14:13.055409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1549/3104] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:12 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:13.359400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6f829061-2e08-49f6-a1ce-ea8acb254150 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:13.360091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6f829061-2e08-49f6-a1ce-ea8acb254150 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:13.366600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f829061-2e08-49f6-a1ce-ea8acb254150 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:13.367079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f829061-2e08-49f6-a1ce-ea8acb254150 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:13.367514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f829061-2e08-49f6-a1ce-ea8acb254150 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:13.368197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f829061-2e08-49f6-a1ce-ea8acb254150 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:13.368646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f829061-2e08-49f6-a1ce-ea8acb254150 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:13.369095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6f829061-2e08-49f6-a1ce-ea8acb254150 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:13.406814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2d596908-1cc6-435c-8d89-4d04fa7b8c0e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:13.407434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2d596908-1cc6-435c-8d89-4d04fa7b8c0e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:13.413825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d596908-1cc6-435c-8d89-4d04fa7b8c0e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:13.414316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d596908-1cc6-435c-8d89-4d04fa7b8c0e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:13.414754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d596908-1cc6-435c-8d89-4d04fa7b8c0e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:13.415452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d596908-1cc6-435c-8d89-4d04fa7b8c0e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:13.415904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d596908-1cc6-435c-8d89-4d04fa7b8c0e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:13.416330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d596908-1cc6-435c-8d89-4d04fa7b8c0e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:13.504453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6f829061-2e08-49f6-a1ce-ea8acb254150 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:13.513503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6f829061-2e08-49f6-a1ce-ea8acb254150 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.157888 Aug 18 22:14:13.525693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1556/3105] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:13 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:13.525693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-821d72b8-f8c5-49ac-9132-d1801d3f03f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:13.525693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-821d72b8-f8c5-49ac-9132-d1801d3f03f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:13.525693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-821d72b8-f8c5-49ac-9132-d1801d3f03f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:13.526405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-821d72b8-f8c5-49ac-9132-d1801d3f03f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:13.526405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-821d72b8-f8c5-49ac-9132-d1801d3f03f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:13.527992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-821d72b8-f8c5-49ac-9132-d1801d3f03f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:13.528127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-821d72b8-f8c5-49ac-9132-d1801d3f03f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:13.528591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-821d72b8-f8c5-49ac-9132-d1801d3f03f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:13.562996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2d596908-1cc6-435c-8d89-4d04fa7b8c0e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:13.571271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2d596908-1cc6-435c-8d89-4d04fa7b8c0e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.168214 Aug 18 22:14:13.571843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1550/3106] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:13.657341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-821d72b8-f8c5-49ac-9132-d1801d3f03f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:13.665574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-821d72b8-f8c5-49ac-9132-d1801d3f03f1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150507 Aug 18 22:14:13.666166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1557/3107] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:13 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:13.868966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fc62b492-2437-4c2b-91c4-5ae80e6de388 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:13.869582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fc62b492-2437-4c2b-91c4-5ae80e6de388 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:13.876427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc62b492-2437-4c2b-91c4-5ae80e6de388 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:13.876911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc62b492-2437-4c2b-91c4-5ae80e6de388 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:13.877340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc62b492-2437-4c2b-91c4-5ae80e6de388 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:13.878055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc62b492-2437-4c2b-91c4-5ae80e6de388 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:13.878504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc62b492-2437-4c2b-91c4-5ae80e6de388 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:13.878926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc62b492-2437-4c2b-91c4-5ae80e6de388 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:14.009955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fc62b492-2437-4c2b-91c4-5ae80e6de388 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:14.019333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fc62b492-2437-4c2b-91c4-5ae80e6de388 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154223 Aug 18 22:14:14.019905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1551/3108] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:13 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:14.076381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-42411ec5-f90e-4f6a-a146-274e042b4cd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:14.077012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-42411ec5-f90e-4f6a-a146-274e042b4cd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:14.082953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42411ec5-f90e-4f6a-a146-274e042b4cd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:14.083444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42411ec5-f90e-4f6a-a146-274e042b4cd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:14.083866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42411ec5-f90e-4f6a-a146-274e042b4cd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:14.084548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42411ec5-f90e-4f6a-a146-274e042b4cd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:14.085001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42411ec5-f90e-4f6a-a146-274e042b4cd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:14.085422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42411ec5-f90e-4f6a-a146-274e042b4cd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:14.213700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-42411ec5-f90e-4f6a-a146-274e042b4cd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:14.222898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-42411ec5-f90e-4f6a-a146-274e042b4cd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:14.224377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-42411ec5-f90e-4f6a-a146-274e042b4cd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:14.225522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-42411ec5-f90e-4f6a-a146-274e042b4cd5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153050 Aug 18 22:14:14.226112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1558/3109] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:14.538229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3d4e0a97-5135-40ab-b53e-57d0bdfdcd45 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:14.538850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3d4e0a97-5135-40ab-b53e-57d0bdfdcd45 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:14.546162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d4e0a97-5135-40ab-b53e-57d0bdfdcd45 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:14.546661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d4e0a97-5135-40ab-b53e-57d0bdfdcd45 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:14.547108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d4e0a97-5135-40ab-b53e-57d0bdfdcd45 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:14.547811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d4e0a97-5135-40ab-b53e-57d0bdfdcd45 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:14.548270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d4e0a97-5135-40ab-b53e-57d0bdfdcd45 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:14.548701 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d4e0a97-5135-40ab-b53e-57d0bdfdcd45 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:14.563947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:14.593245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cd5d17de-9b61-4a7d-875f-3f4c1bf4a309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:14.593842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cd5d17de-9b61-4a7d-875f-3f4c1bf4a309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:14.599869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd5d17de-9b61-4a7d-875f-3f4c1bf4a309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:14.600360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd5d17de-9b61-4a7d-875f-3f4c1bf4a309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:14.600803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd5d17de-9b61-4a7d-875f-3f4c1bf4a309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:14.601503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd5d17de-9b61-4a7d-875f-3f4c1bf4a309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:14.601992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd5d17de-9b61-4a7d-875f-3f4c1bf4a309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:14.602424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd5d17de-9b61-4a7d-875f-3f4c1bf4a309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:14.684054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3d4e0a97-5135-40ab-b53e-57d0bdfdcd45 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:14.693237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3d4e0a97-5135-40ab-b53e-57d0bdfdcd45 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.158672 Aug 18 22:14:14.693862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1552/3110] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:14 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:14.698577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c991169c-7ac1-47f1-acf9-238da653243a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:14.699190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c991169c-7ac1-47f1-acf9-238da653243a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:14.705901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c991169c-7ac1-47f1-acf9-238da653243a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:14.708115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c991169c-7ac1-47f1-acf9-238da653243a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:14.708565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c991169c-7ac1-47f1-acf9-238da653243a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:14.709279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c991169c-7ac1-47f1-acf9-238da653243a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:14.709861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c991169c-7ac1-47f1-acf9-238da653243a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:14.710277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c991169c-7ac1-47f1-acf9-238da653243a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:14.752636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cd5d17de-9b61-4a7d-875f-3f4c1bf4a309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:14.762663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cd5d17de-9b61-4a7d-875f-3f4c1bf4a309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.174312 Aug 18 22:14:14.763253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1559/3111] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:15.040182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26c5580c-7d43-4cf4-a6fb-8bb109782256 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:15.040991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26c5580c-7d43-4cf4-a6fb-8bb109782256 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:15.047319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26c5580c-7d43-4cf4-a6fb-8bb109782256 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:15.047836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26c5580c-7d43-4cf4-a6fb-8bb109782256 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:15.048261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26c5580c-7d43-4cf4-a6fb-8bb109782256 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:15.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26c5580c-7d43-4cf4-a6fb-8bb109782256 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:15.049412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26c5580c-7d43-4cf4-a6fb-8bb109782256 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:15.049864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26c5580c-7d43-4cf4-a6fb-8bb109782256 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:15.147205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c991169c-7ac1-47f1-acf9-238da653243a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:15.155758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c991169c-7ac1-47f1-acf9-238da653243a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.460815 Aug 18 22:14:15.156582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1553/3112] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:15.185045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26c5580c-7d43-4cf4-a6fb-8bb109782256 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:15.193533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26c5580c-7d43-4cf4-a6fb-8bb109782256 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157322 Aug 18 22:14:15.194142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1560/3113] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:15 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:15.250202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6a7a259c-497d-4fc9-8eb5-a79a78a7f1c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:15.250877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6a7a259c-497d-4fc9-8eb5-a79a78a7f1c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:15.256696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a7a259c-497d-4fc9-8eb5-a79a78a7f1c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:15.257175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a7a259c-497d-4fc9-8eb5-a79a78a7f1c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:15.257617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a7a259c-497d-4fc9-8eb5-a79a78a7f1c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:15.258318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a7a259c-497d-4fc9-8eb5-a79a78a7f1c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:15.258766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a7a259c-497d-4fc9-8eb5-a79a78a7f1c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:15.259183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a7a259c-497d-4fc9-8eb5-a79a78a7f1c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:15.469783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6a7a259c-497d-4fc9-8eb5-a79a78a7f1c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:15.478721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6a7a259c-497d-4fc9-8eb5-a79a78a7f1c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:15.480768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6a7a259c-497d-4fc9-8eb5-a79a78a7f1c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:15.482023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6a7a259c-497d-4fc9-8eb5-a79a78a7f1c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.235691 Aug 18 22:14:15.482960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1554/3114] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:15.716224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ce663294-4c93-4d0d-8a81-869db8099329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:15.716945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ce663294-4c93-4d0d-8a81-869db8099329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:15.722975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce663294-4c93-4d0d-8a81-869db8099329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:15.723449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce663294-4c93-4d0d-8a81-869db8099329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:15.723876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce663294-4c93-4d0d-8a81-869db8099329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:15.724553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce663294-4c93-4d0d-8a81-869db8099329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:15.725001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce663294-4c93-4d0d-8a81-869db8099329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:15.725439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce663294-4c93-4d0d-8a81-869db8099329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:15.786408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b9575b9a-0e83-4788-87fd-6296898c764b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:15.787023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b9575b9a-0e83-4788-87fd-6296898c764b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:15.793484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9575b9a-0e83-4788-87fd-6296898c764b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:15.793995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9575b9a-0e83-4788-87fd-6296898c764b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:15.794429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9575b9a-0e83-4788-87fd-6296898c764b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:15.795111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9575b9a-0e83-4788-87fd-6296898c764b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:15.795559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9575b9a-0e83-4788-87fd-6296898c764b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:15.795979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b9575b9a-0e83-4788-87fd-6296898c764b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:15.855930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ce663294-4c93-4d0d-8a81-869db8099329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:15.864199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ce663294-4c93-4d0d-8a81-869db8099329 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152366 Aug 18 22:14:15.864790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1561/3115] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:15 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:15.928754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b9575b9a-0e83-4788-87fd-6296898c764b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:15.936939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b9575b9a-0e83-4788-87fd-6296898c764b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154382 Aug 18 22:14:15.937515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1555/3116] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:15 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:16.176571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8e3dffb8-4b55-451f-b1b7-8e5bf4523873 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:16.177188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8e3dffb8-4b55-451f-b1b7-8e5bf4523873 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:16.184132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e3dffb8-4b55-451f-b1b7-8e5bf4523873 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:16.184615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e3dffb8-4b55-451f-b1b7-8e5bf4523873 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:16.185053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e3dffb8-4b55-451f-b1b7-8e5bf4523873 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:16.185779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e3dffb8-4b55-451f-b1b7-8e5bf4523873 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:16.186242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e3dffb8-4b55-451f-b1b7-8e5bf4523873 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:16.186670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e3dffb8-4b55-451f-b1b7-8e5bf4523873 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:16.214929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-20b0efc8-293f-4a38-89a4-7f0588a087de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:16.215572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-20b0efc8-293f-4a38-89a4-7f0588a087de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:16.221479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20b0efc8-293f-4a38-89a4-7f0588a087de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:16.221990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20b0efc8-293f-4a38-89a4-7f0588a087de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:16.222424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20b0efc8-293f-4a38-89a4-7f0588a087de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:16.223110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20b0efc8-293f-4a38-89a4-7f0588a087de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:16.223558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20b0efc8-293f-4a38-89a4-7f0588a087de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:16.223978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-20b0efc8-293f-4a38-89a4-7f0588a087de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:16.318815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8e3dffb8-4b55-451f-b1b7-8e5bf4523873 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:16.326933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8e3dffb8-4b55-451f-b1b7-8e5bf4523873 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154476 Aug 18 22:14:16.327510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1562/3117] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:16.351442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-20b0efc8-293f-4a38-89a4-7f0588a087de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:16.359940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-20b0efc8-293f-4a38-89a4-7f0588a087de tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148790 Aug 18 22:14:16.360501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1556/3118] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:16 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:16.504425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-36bc6d25-39c8-4ae6-804d-c9f43d4988dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:16.504958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-36bc6d25-39c8-4ae6-804d-c9f43d4988dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:16.510947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36bc6d25-39c8-4ae6-804d-c9f43d4988dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:16.511455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36bc6d25-39c8-4ae6-804d-c9f43d4988dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:16.511893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36bc6d25-39c8-4ae6-804d-c9f43d4988dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:16.512579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36bc6d25-39c8-4ae6-804d-c9f43d4988dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:16.513038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36bc6d25-39c8-4ae6-804d-c9f43d4988dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:16.513488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36bc6d25-39c8-4ae6-804d-c9f43d4988dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:16.639692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-36bc6d25-39c8-4ae6-804d-c9f43d4988dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:16.648211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-36bc6d25-39c8-4ae6-804d-c9f43d4988dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:16.649734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-36bc6d25-39c8-4ae6-804d-c9f43d4988dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:16.650884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-36bc6d25-39c8-4ae6-804d-c9f43d4988dd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150493 Aug 18 22:14:16.651995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1563/3119] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:16.885892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fe6037ab-ddaf-4231-a75d-1019e1d7e229 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:16.886553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fe6037ab-ddaf-4231-a75d-1019e1d7e229 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:16.893007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe6037ab-ddaf-4231-a75d-1019e1d7e229 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:16.893496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe6037ab-ddaf-4231-a75d-1019e1d7e229 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:16.893979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe6037ab-ddaf-4231-a75d-1019e1d7e229 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:16.894673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe6037ab-ddaf-4231-a75d-1019e1d7e229 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:16.895129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe6037ab-ddaf-4231-a75d-1019e1d7e229 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:16.895560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe6037ab-ddaf-4231-a75d-1019e1d7e229 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:16.958257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-21c32698-9222-4027-9364-f35ba679e931 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:16.958962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-21c32698-9222-4027-9364-f35ba679e931 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:16.960865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:16.966587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21c32698-9222-4027-9364-f35ba679e931 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:16.967072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21c32698-9222-4027-9364-f35ba679e931 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:16.967506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21c32698-9222-4027-9364-f35ba679e931 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:16.968246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21c32698-9222-4027-9364-f35ba679e931 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:16.968693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21c32698-9222-4027-9364-f35ba679e931 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:16.969135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-21c32698-9222-4027-9364-f35ba679e931 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:17.023815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fe6037ab-ddaf-4231-a75d-1019e1d7e229 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:17.033020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fe6037ab-ddaf-4231-a75d-1019e1d7e229 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151051 Aug 18 22:14:17.033626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1557/3120] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:16 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:17.101972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-21c32698-9222-4027-9364-f35ba679e931 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:17.110948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-21c32698-9222-4027-9364-f35ba679e931 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156482 Aug 18 22:14:17.111521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1564/3121] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:16 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:17.347485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e76b962f-02b5-4825-862e-edcd4068b37c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:17.348098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e76b962f-02b5-4825-862e-edcd4068b37c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:17.354004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e76b962f-02b5-4825-862e-edcd4068b37c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:17.354526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e76b962f-02b5-4825-862e-edcd4068b37c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:17.354957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e76b962f-02b5-4825-862e-edcd4068b37c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:17.355632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e76b962f-02b5-4825-862e-edcd4068b37c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:17.356080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e76b962f-02b5-4825-862e-edcd4068b37c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:17.356499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e76b962f-02b5-4825-862e-edcd4068b37c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:17.380375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-18162d41-6b2f-476b-95c9-49ea70cc7b70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:17.380997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-18162d41-6b2f-476b-95c9-49ea70cc7b70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:17.388093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18162d41-6b2f-476b-95c9-49ea70cc7b70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:17.388627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18162d41-6b2f-476b-95c9-49ea70cc7b70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:17.389011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18162d41-6b2f-476b-95c9-49ea70cc7b70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:17.389739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18162d41-6b2f-476b-95c9-49ea70cc7b70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:17.390194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18162d41-6b2f-476b-95c9-49ea70cc7b70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:17.390618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18162d41-6b2f-476b-95c9-49ea70cc7b70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:17.492593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e76b962f-02b5-4825-862e-edcd4068b37c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:17.501416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e76b962f-02b5-4825-862e-edcd4068b37c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.157739 Aug 18 22:14:17.513800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1558/3122] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:17.520081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-18162d41-6b2f-476b-95c9-49ea70cc7b70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:17.528364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-18162d41-6b2f-476b-95c9-49ea70cc7b70 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151960 Aug 18 22:14:17.528933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1565/3123] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:17 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:17.674037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-29501265-2b49-492b-b0d2-de31cb1d7f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:17.674582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-29501265-2b49-492b-b0d2-de31cb1d7f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:17.680801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29501265-2b49-492b-b0d2-de31cb1d7f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:17.681290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29501265-2b49-492b-b0d2-de31cb1d7f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:17.681764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29501265-2b49-492b-b0d2-de31cb1d7f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:17.683065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29501265-2b49-492b-b0d2-de31cb1d7f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:17.683524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29501265-2b49-492b-b0d2-de31cb1d7f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:17.683957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29501265-2b49-492b-b0d2-de31cb1d7f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:17.825630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-29501265-2b49-492b-b0d2-de31cb1d7f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:17.836098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-29501265-2b49-492b-b0d2-de31cb1d7f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:17.837638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-29501265-2b49-492b-b0d2-de31cb1d7f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:17.838801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-29501265-2b49-492b-b0d2-de31cb1d7f6f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.168736 Aug 18 22:14:17.839392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1559/3124] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:18.054701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-91b3bb6a-b1de-4018-b6e3-c1a190695c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:18.055321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-91b3bb6a-b1de-4018-b6e3-c1a190695c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:18.062142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91b3bb6a-b1de-4018-b6e3-c1a190695c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:18.062630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91b3bb6a-b1de-4018-b6e3-c1a190695c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:18.063074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91b3bb6a-b1de-4018-b6e3-c1a190695c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:18.064029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91b3bb6a-b1de-4018-b6e3-c1a190695c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:18.064844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91b3bb6a-b1de-4018-b6e3-c1a190695c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:18.065467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91b3bb6a-b1de-4018-b6e3-c1a190695c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:18.132831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-40c14f92-9abc-47ed-a86a-2448b113a4b9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:18.133460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-40c14f92-9abc-47ed-a86a-2448b113a4b9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:18.140547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40c14f92-9abc-47ed-a86a-2448b113a4b9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:18.141041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40c14f92-9abc-47ed-a86a-2448b113a4b9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:18.141490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40c14f92-9abc-47ed-a86a-2448b113a4b9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:18.142249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40c14f92-9abc-47ed-a86a-2448b113a4b9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:18.142711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40c14f92-9abc-47ed-a86a-2448b113a4b9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:18.143146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40c14f92-9abc-47ed-a86a-2448b113a4b9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:18.208288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-91b3bb6a-b1de-4018-b6e3-c1a190695c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:18.217494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-91b3bb6a-b1de-4018-b6e3-c1a190695c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.166852 Aug 18 22:14:18.218111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1566/3125] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:18 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:18.282606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-40c14f92-9abc-47ed-a86a-2448b113a4b9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:18.290976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-40c14f92-9abc-47ed-a86a-2448b113a4b9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.161989 Aug 18 22:14:18.291570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1560/3126] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:18 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:18.523586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2782231c-f389-44ab-a817-79d843a6df3f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:18.524203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2782231c-f389-44ab-a817-79d843a6df3f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:18.531156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2782231c-f389-44ab-a817-79d843a6df3f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:18.531628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2782231c-f389-44ab-a817-79d843a6df3f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:18.532059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2782231c-f389-44ab-a817-79d843a6df3f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:18.532732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2782231c-f389-44ab-a817-79d843a6df3f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:18.533180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2782231c-f389-44ab-a817-79d843a6df3f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:18.533618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2782231c-f389-44ab-a817-79d843a6df3f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:18.548696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dfb0ff9a-b8d9-4df7-8593-74cacdcc37a2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:18.549486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dfb0ff9a-b8d9-4df7-8593-74cacdcc37a2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:18.555622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfb0ff9a-b8d9-4df7-8593-74cacdcc37a2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:18.556109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfb0ff9a-b8d9-4df7-8593-74cacdcc37a2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:18.556552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfb0ff9a-b8d9-4df7-8593-74cacdcc37a2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:18.557249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfb0ff9a-b8d9-4df7-8593-74cacdcc37a2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:18.557796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfb0ff9a-b8d9-4df7-8593-74cacdcc37a2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:18.558260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfb0ff9a-b8d9-4df7-8593-74cacdcc37a2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:18.661442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2782231c-f389-44ab-a817-79d843a6df3f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:18.669724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2782231c-f389-44ab-a817-79d843a6df3f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149891 Aug 18 22:14:18.670306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1567/3127] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:18.687913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dfb0ff9a-b8d9-4df7-8593-74cacdcc37a2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:18.696215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dfb0ff9a-b8d9-4df7-8593-74cacdcc37a2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151356 Aug 18 22:14:18.696786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1561/3128] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:18 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:18.861103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-424ebb7e-c2d9-4263-a49d-7049f145cc46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:18.861754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-424ebb7e-c2d9-4263-a49d-7049f145cc46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:18.867770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-424ebb7e-c2d9-4263-a49d-7049f145cc46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:18.868258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-424ebb7e-c2d9-4263-a49d-7049f145cc46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:18.868694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-424ebb7e-c2d9-4263-a49d-7049f145cc46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:18.869383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-424ebb7e-c2d9-4263-a49d-7049f145cc46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:18.870454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-424ebb7e-c2d9-4263-a49d-7049f145cc46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:18.870921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-424ebb7e-c2d9-4263-a49d-7049f145cc46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:19.000423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-424ebb7e-c2d9-4263-a49d-7049f145cc46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:19.009053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-424ebb7e-c2d9-4263-a49d-7049f145cc46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:19.011198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-424ebb7e-c2d9-4263-a49d-7049f145cc46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:19.012411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-424ebb7e-c2d9-4263-a49d-7049f145cc46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155274 Aug 18 22:14:19.012971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1568/3129] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:18 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:19.240699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-46f00809-3604-4b17-a28d-aa815bed5f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:19.241362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46f00809-3604-4b17-a28d-aa815bed5f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:19.247997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46f00809-3604-4b17-a28d-aa815bed5f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:19.248488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46f00809-3604-4b17-a28d-aa815bed5f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:19.248931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46f00809-3604-4b17-a28d-aa815bed5f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:19.249663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46f00809-3604-4b17-a28d-aa815bed5f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:19.250125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46f00809-3604-4b17-a28d-aa815bed5f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:19.250567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46f00809-3604-4b17-a28d-aa815bed5f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:19.312456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f2d37cda-75db-42ea-a203-7bc05fbe5efc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:19.313104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f2d37cda-75db-42ea-a203-7bc05fbe5efc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:19.319196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2d37cda-75db-42ea-a203-7bc05fbe5efc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:19.319681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2d37cda-75db-42ea-a203-7bc05fbe5efc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:19.320117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2d37cda-75db-42ea-a203-7bc05fbe5efc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:19.320817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2d37cda-75db-42ea-a203-7bc05fbe5efc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:19.321273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2d37cda-75db-42ea-a203-7bc05fbe5efc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:19.321730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2d37cda-75db-42ea-a203-7bc05fbe5efc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:19.387668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-46f00809-3604-4b17-a28d-aa815bed5f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:19.396327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-46f00809-3604-4b17-a28d-aa815bed5f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.159466 Aug 18 22:14:19.396923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1562/3130] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:19 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:19.454537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f2d37cda-75db-42ea-a203-7bc05fbe5efc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:19.462754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f2d37cda-75db-42ea-a203-7bc05fbe5efc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154250 Aug 18 22:14:19.463338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1569/3131] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:19 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:19.691395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-59a8129a-fd37-42cf-8c34-d351731df826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:19.692022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-59a8129a-fd37-42cf-8c34-d351731df826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:19.702809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59a8129a-fd37-42cf-8c34-d351731df826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:19.704686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59a8129a-fd37-42cf-8c34-d351731df826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:19.705411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59a8129a-fd37-42cf-8c34-d351731df826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:19.706348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59a8129a-fd37-42cf-8c34-d351731df826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:19.706983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59a8129a-fd37-42cf-8c34-d351731df826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:19.707573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59a8129a-fd37-42cf-8c34-d351731df826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:19.717397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ac1e065e-88c5-44da-bea8-c2217189081a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:19.718368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ac1e065e-88c5-44da-bea8-c2217189081a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:19.725843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac1e065e-88c5-44da-bea8-c2217189081a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:19.725843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac1e065e-88c5-44da-bea8-c2217189081a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:19.726252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac1e065e-88c5-44da-bea8-c2217189081a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:19.726983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac1e065e-88c5-44da-bea8-c2217189081a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:19.727371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac1e065e-88c5-44da-bea8-c2217189081a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:19.727816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ac1e065e-88c5-44da-bea8-c2217189081a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:19.743494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:19.841168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-59a8129a-fd37-42cf-8c34-d351731df826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:19.850391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-59a8129a-fd37-42cf-8c34-d351731df826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.162883 Aug 18 22:14:19.864115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1563/3132] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:19 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:19.864518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ac1e065e-88c5-44da-bea8-c2217189081a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:19.868893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ac1e065e-88c5-44da-bea8-c2217189081a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155936 Aug 18 22:14:19.869473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1570/3133] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:19 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:20.035251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8a4f2bf5-0840-4655-984f-b03b2bb0a83e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:20.035872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8a4f2bf5-0840-4655-984f-b03b2bb0a83e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:20.042425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a4f2bf5-0840-4655-984f-b03b2bb0a83e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:20.042956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a4f2bf5-0840-4655-984f-b03b2bb0a83e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:20.043401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a4f2bf5-0840-4655-984f-b03b2bb0a83e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:20.044094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a4f2bf5-0840-4655-984f-b03b2bb0a83e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:20.044560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a4f2bf5-0840-4655-984f-b03b2bb0a83e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:20.045026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8a4f2bf5-0840-4655-984f-b03b2bb0a83e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:20.173939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8a4f2bf5-0840-4655-984f-b03b2bb0a83e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:20.183264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8a4f2bf5-0840-4655-984f-b03b2bb0a83e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:20.184768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8a4f2bf5-0840-4655-984f-b03b2bb0a83e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:20.186121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8a4f2bf5-0840-4655-984f-b03b2bb0a83e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154743 Aug 18 22:14:20.186688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1564/3134] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:20 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:20.420076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5ed7ad1d-5b24-4a19-b06c-4667337205e4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:20.420634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5ed7ad1d-5b24-4a19-b06c-4667337205e4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:20.426837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ed7ad1d-5b24-4a19-b06c-4667337205e4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:20.427307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ed7ad1d-5b24-4a19-b06c-4667337205e4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:20.427733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ed7ad1d-5b24-4a19-b06c-4667337205e4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:20.428410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ed7ad1d-5b24-4a19-b06c-4667337205e4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:20.428856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ed7ad1d-5b24-4a19-b06c-4667337205e4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:20.429276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ed7ad1d-5b24-4a19-b06c-4667337205e4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:20.484817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a4d6bde5-32a7-435b-a9d0-5cdbf506d8f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:20.485437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a4d6bde5-32a7-435b-a9d0-5cdbf506d8f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:20.492621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4d6bde5-32a7-435b-a9d0-5cdbf506d8f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:20.493267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4d6bde5-32a7-435b-a9d0-5cdbf506d8f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:20.493761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4d6bde5-32a7-435b-a9d0-5cdbf506d8f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:20.494472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4d6bde5-32a7-435b-a9d0-5cdbf506d8f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:20.494931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4d6bde5-32a7-435b-a9d0-5cdbf506d8f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:20.495359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4d6bde5-32a7-435b-a9d0-5cdbf506d8f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:20.564121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5ed7ad1d-5b24-4a19-b06c-4667337205e4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:20.572297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5ed7ad1d-5b24-4a19-b06c-4667337205e4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156736 Aug 18 22:14:20.572880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1571/3135] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:20 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:20.628868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a4d6bde5-32a7-435b-a9d0-5cdbf506d8f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:20.637188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a4d6bde5-32a7-435b-a9d0-5cdbf506d8f3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156236 Aug 18 22:14:20.637778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1565/3136] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:20.873164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0c59d5f3-e417-4618-81c9-ce28855e72b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:20.873815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0c59d5f3-e417-4618-81c9-ce28855e72b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:20.880067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c59d5f3-e417-4618-81c9-ce28855e72b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:20.880545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c59d5f3-e417-4618-81c9-ce28855e72b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:20.881004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c59d5f3-e417-4618-81c9-ce28855e72b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:20.881717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c59d5f3-e417-4618-81c9-ce28855e72b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:20.882178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c59d5f3-e417-4618-81c9-ce28855e72b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:20.882599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0c59d5f3-e417-4618-81c9-ce28855e72b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:20.890678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a5ff26c5-02ed-42ee-a9da-4d4ccc8f6bec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:20.891339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a5ff26c5-02ed-42ee-a9da-4d4ccc8f6bec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:20.897214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5ff26c5-02ed-42ee-a9da-4d4ccc8f6bec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:20.897760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5ff26c5-02ed-42ee-a9da-4d4ccc8f6bec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:20.898206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5ff26c5-02ed-42ee-a9da-4d4ccc8f6bec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:20.899304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5ff26c5-02ed-42ee-a9da-4d4ccc8f6bec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:20.902408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5ff26c5-02ed-42ee-a9da-4d4ccc8f6bec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:20.902876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5ff26c5-02ed-42ee-a9da-4d4ccc8f6bec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:21.024954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0c59d5f3-e417-4618-81c9-ce28855e72b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:21.033721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a5ff26c5-02ed-42ee-a9da-4d4ccc8f6bec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:21.034271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0c59d5f3-e417-4618-81c9-ce28855e72b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.165163 Aug 18 22:14:21.035044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1572/3137] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:20 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:21.042019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a5ff26c5-02ed-42ee-a9da-4d4ccc8f6bec tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155027 Aug 18 22:14:21.042580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1566/3138] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:20 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:21.208633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-82e43266-f2a9-47d8-a116-7b1d28760460 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:21.209246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-82e43266-f2a9-47d8-a116-7b1d28760460 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:21.215239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82e43266-f2a9-47d8-a116-7b1d28760460 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:21.215747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82e43266-f2a9-47d8-a116-7b1d28760460 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:21.216182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82e43266-f2a9-47d8-a116-7b1d28760460 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:21.216868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82e43266-f2a9-47d8-a116-7b1d28760460 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:21.217318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82e43266-f2a9-47d8-a116-7b1d28760460 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:21.217774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82e43266-f2a9-47d8-a116-7b1d28760460 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:21.349423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-82e43266-f2a9-47d8-a116-7b1d28760460 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:21.357989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-82e43266-f2a9-47d8-a116-7b1d28760460 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:21.359486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-82e43266-f2a9-47d8-a116-7b1d28760460 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:21.360628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-82e43266-f2a9-47d8-a116-7b1d28760460 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155976 Aug 18 22:14:21.361187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1573/3139] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:21.593166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6a252c8c-7361-4a68-a380-f5bb569f8429 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:21.593758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6a252c8c-7361-4a68-a380-f5bb569f8429 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:21.600169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a252c8c-7361-4a68-a380-f5bb569f8429 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:21.600647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a252c8c-7361-4a68-a380-f5bb569f8429 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:21.601077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a252c8c-7361-4a68-a380-f5bb569f8429 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:21.601792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a252c8c-7361-4a68-a380-f5bb569f8429 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:21.602244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a252c8c-7361-4a68-a380-f5bb569f8429 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:21.602667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a252c8c-7361-4a68-a380-f5bb569f8429 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:21.657508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-78ece4bf-fbf5-4e86-9ca8-85ca3fd4e3d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:21.658152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-78ece4bf-fbf5-4e86-9ca8-85ca3fd4e3d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:21.664098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78ece4bf-fbf5-4e86-9ca8-85ca3fd4e3d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:21.664586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78ece4bf-fbf5-4e86-9ca8-85ca3fd4e3d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:21.665031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78ece4bf-fbf5-4e86-9ca8-85ca3fd4e3d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:21.665753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78ece4bf-fbf5-4e86-9ca8-85ca3fd4e3d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:21.666217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78ece4bf-fbf5-4e86-9ca8-85ca3fd4e3d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:21.666655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-78ece4bf-fbf5-4e86-9ca8-85ca3fd4e3d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:21.736397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6a252c8c-7361-4a68-a380-f5bb569f8429 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:21.744632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6a252c8c-7361-4a68-a380-f5bb569f8429 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155368 Aug 18 22:14:21.745998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1567/3140] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:21 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:21.798979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-78ece4bf-fbf5-4e86-9ca8-85ca3fd4e3d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:21.808348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-78ece4bf-fbf5-4e86-9ca8-85ca3fd4e3d8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153980 Aug 18 22:14:21.808930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1574/3141] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:22.055597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-21d47f5d-6ba3-438d-b05d-b4432ab6c012 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:22.056216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-21d47f5d-6ba3-438d-b05d-b4432ab6c012 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:22.061896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-25b902d9-b08d-454b-91d4-3e502590ed63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:22.062374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d47f5d-6ba3-438d-b05d-b4432ab6c012 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:22.062520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-25b902d9-b08d-454b-91d4-3e502590ed63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:22.062864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d47f5d-6ba3-438d-b05d-b4432ab6c012 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:22.063297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d47f5d-6ba3-438d-b05d-b4432ab6c012 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:22.064021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d47f5d-6ba3-438d-b05d-b4432ab6c012 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:22.064475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d47f5d-6ba3-438d-b05d-b4432ab6c012 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:22.064899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21d47f5d-6ba3-438d-b05d-b4432ab6c012 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:22.068762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25b902d9-b08d-454b-91d4-3e502590ed63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:22.069247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25b902d9-b08d-454b-91d4-3e502590ed63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:22.069787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25b902d9-b08d-454b-91d4-3e502590ed63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:22.070490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25b902d9-b08d-454b-91d4-3e502590ed63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:22.070946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25b902d9-b08d-454b-91d4-3e502590ed63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:22.071378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25b902d9-b08d-454b-91d4-3e502590ed63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:22.196269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-21d47f5d-6ba3-438d-b05d-b4432ab6c012 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:22.204499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-25b902d9-b08d-454b-91d4-3e502590ed63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:22.204709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-21d47f5d-6ba3-438d-b05d-b4432ab6c012 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152873 Aug 18 22:14:22.205274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1568/3142] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:22 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:22.212654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-25b902d9-b08d-454b-91d4-3e502590ed63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154510 Aug 18 22:14:22.213211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1575/3143] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:22 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:22.383565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1b99058d-e334-4141-a65a-da83a837f8fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:22.384187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1b99058d-e334-4141-a65a-da83a837f8fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:22.393324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b99058d-e334-4141-a65a-da83a837f8fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:22.393786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b99058d-e334-4141-a65a-da83a837f8fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:22.394230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b99058d-e334-4141-a65a-da83a837f8fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:22.394919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b99058d-e334-4141-a65a-da83a837f8fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:22.395376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b99058d-e334-4141-a65a-da83a837f8fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:22.395800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1b99058d-e334-4141-a65a-da83a837f8fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:22.398430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:22.525219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1b99058d-e334-4141-a65a-da83a837f8fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:22.534729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1b99058d-e334-4141-a65a-da83a837f8fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:22.536230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1b99058d-e334-4141-a65a-da83a837f8fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:22.537379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1b99058d-e334-4141-a65a-da83a837f8fc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157722 Aug 18 22:14:22.537987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1569/3144] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:22.766613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fc70144a-ae53-4eae-81ec-71295c21cc05 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:22.767225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fc70144a-ae53-4eae-81ec-71295c21cc05 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:22.773206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc70144a-ae53-4eae-81ec-71295c21cc05 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:22.773718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc70144a-ae53-4eae-81ec-71295c21cc05 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:22.774157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc70144a-ae53-4eae-81ec-71295c21cc05 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:22.774841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc70144a-ae53-4eae-81ec-71295c21cc05 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:22.775295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc70144a-ae53-4eae-81ec-71295c21cc05 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:22.775725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc70144a-ae53-4eae-81ec-71295c21cc05 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:22.830110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f3167b19-b659-472b-8057-1d4e0121efbf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:22.830733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f3167b19-b659-472b-8057-1d4e0121efbf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:22.836736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3167b19-b659-472b-8057-1d4e0121efbf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:22.837224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3167b19-b659-472b-8057-1d4e0121efbf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:22.837690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3167b19-b659-472b-8057-1d4e0121efbf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:22.838380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3167b19-b659-472b-8057-1d4e0121efbf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:22.840425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3167b19-b659-472b-8057-1d4e0121efbf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:22.840861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3167b19-b659-472b-8057-1d4e0121efbf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:22.909713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fc70144a-ae53-4eae-81ec-71295c21cc05 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:22.918549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fc70144a-ae53-4eae-81ec-71295c21cc05 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155789 Aug 18 22:14:22.919135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1576/3145] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:22.973112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f3167b19-b659-472b-8057-1d4e0121efbf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:22.982024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f3167b19-b659-472b-8057-1d4e0121efbf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156224 Aug 18 22:14:22.982780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1570/3146] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:22 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:23.226522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6a38b4dc-3d0a-4f70-82b2-976fa77b0b33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:23.227096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6a38b4dc-3d0a-4f70-82b2-976fa77b0b33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:23.233524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5269e7ec-69dd-4ee2-9073-9ba926f8f52f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:23.233930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a38b4dc-3d0a-4f70-82b2-976fa77b0b33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:23.234175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5269e7ec-69dd-4ee2-9073-9ba926f8f52f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:23.234416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a38b4dc-3d0a-4f70-82b2-976fa77b0b33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:23.234853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a38b4dc-3d0a-4f70-82b2-976fa77b0b33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:23.235582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a38b4dc-3d0a-4f70-82b2-976fa77b0b33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:23.236037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a38b4dc-3d0a-4f70-82b2-976fa77b0b33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:23.236514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a38b4dc-3d0a-4f70-82b2-976fa77b0b33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:23.240146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5269e7ec-69dd-4ee2-9073-9ba926f8f52f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:23.240632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5269e7ec-69dd-4ee2-9073-9ba926f8f52f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:23.241069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5269e7ec-69dd-4ee2-9073-9ba926f8f52f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:23.241797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5269e7ec-69dd-4ee2-9073-9ba926f8f52f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:23.242255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5269e7ec-69dd-4ee2-9073-9ba926f8f52f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:23.242679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5269e7ec-69dd-4ee2-9073-9ba926f8f52f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:23.366250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6a38b4dc-3d0a-4f70-82b2-976fa77b0b33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:23.369521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5269e7ec-69dd-4ee2-9073-9ba926f8f52f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:23.375049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6a38b4dc-3d0a-4f70-82b2-976fa77b0b33 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152462 Aug 18 22:14:23.375635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1577/3147] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:23 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:23.378089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5269e7ec-69dd-4ee2-9073-9ba926f8f52f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.148460 Aug 18 22:14:23.378649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1571/3148] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:23 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:23.560587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-db45a0f3-7d5d-4faf-afd5-05e0f2ffcfeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:23.561231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-db45a0f3-7d5d-4faf-afd5-05e0f2ffcfeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:23.567203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-db45a0f3-7d5d-4faf-afd5-05e0f2ffcfeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:23.567681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-db45a0f3-7d5d-4faf-afd5-05e0f2ffcfeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:23.568111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-db45a0f3-7d5d-4faf-afd5-05e0f2ffcfeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:23.568798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-db45a0f3-7d5d-4faf-afd5-05e0f2ffcfeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:23.569249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-db45a0f3-7d5d-4faf-afd5-05e0f2ffcfeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:23.569696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-db45a0f3-7d5d-4faf-afd5-05e0f2ffcfeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:23.699255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-db45a0f3-7d5d-4faf-afd5-05e0f2ffcfeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:23.707937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-db45a0f3-7d5d-4faf-afd5-05e0f2ffcfeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:23.709436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-db45a0f3-7d5d-4faf-afd5-05e0f2ffcfeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:23.710638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-db45a0f3-7d5d-4faf-afd5-05e0f2ffcfeb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154471 Aug 18 22:14:23.711204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1578/3149] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:23.939815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-beb51062-1d53-43bb-aa88-193be1a2287b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:23.940467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-beb51062-1d53-43bb-aa88-193be1a2287b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:23.946941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-beb51062-1d53-43bb-aa88-193be1a2287b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:23.947427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-beb51062-1d53-43bb-aa88-193be1a2287b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:23.947891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-beb51062-1d53-43bb-aa88-193be1a2287b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:23.948639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-beb51062-1d53-43bb-aa88-193be1a2287b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:23.949105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-beb51062-1d53-43bb-aa88-193be1a2287b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:23.949536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-beb51062-1d53-43bb-aa88-193be1a2287b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:24.003734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-af5dd5a5-f633-4e6e-9037-e64266fa2d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:24.004491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-af5dd5a5-f633-4e6e-9037-e64266fa2d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:24.010531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af5dd5a5-f633-4e6e-9037-e64266fa2d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:24.011117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af5dd5a5-f633-4e6e-9037-e64266fa2d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:24.011545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af5dd5a5-f633-4e6e-9037-e64266fa2d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:24.012245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af5dd5a5-f633-4e6e-9037-e64266fa2d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:24.012706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af5dd5a5-f633-4e6e-9037-e64266fa2d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:24.013134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-af5dd5a5-f633-4e6e-9037-e64266fa2d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:24.082901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-beb51062-1d53-43bb-aa88-193be1a2287b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:24.091766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-beb51062-1d53-43bb-aa88-193be1a2287b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155811 Aug 18 22:14:24.092593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1572/3150] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:23 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:24.152946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-af5dd5a5-f633-4e6e-9037-e64266fa2d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:24.161271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-af5dd5a5-f633-4e6e-9037-e64266fa2d2e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.161451 Aug 18 22:14:24.161888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1579/3151] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:23 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:24.396357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9453d229-87a0-4a89-9589-77a2cb7aa9d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:24.396975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9453d229-87a0-4a89-9589-77a2cb7aa9d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:24.399304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-67251982-30f8-45b3-bf09-564dc2a70cfb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:24.399944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-67251982-30f8-45b3-bf09-564dc2a70cfb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:24.403493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9453d229-87a0-4a89-9589-77a2cb7aa9d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:24.403986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9453d229-87a0-4a89-9589-77a2cb7aa9d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:24.404558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9453d229-87a0-4a89-9589-77a2cb7aa9d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:24.405258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9453d229-87a0-4a89-9589-77a2cb7aa9d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:24.405751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9453d229-87a0-4a89-9589-77a2cb7aa9d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:24.406181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9453d229-87a0-4a89-9589-77a2cb7aa9d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:24.407000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67251982-30f8-45b3-bf09-564dc2a70cfb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:24.407491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67251982-30f8-45b3-bf09-564dc2a70cfb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:24.407931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67251982-30f8-45b3-bf09-564dc2a70cfb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:24.408666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67251982-30f8-45b3-bf09-564dc2a70cfb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:24.409123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67251982-30f8-45b3-bf09-564dc2a70cfb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:24.409550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67251982-30f8-45b3-bf09-564dc2a70cfb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:24.539573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9453d229-87a0-4a89-9589-77a2cb7aa9d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:24.542682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-67251982-30f8-45b3-bf09-564dc2a70cfb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:24.548428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9453d229-87a0-4a89-9589-77a2cb7aa9d6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155927 Aug 18 22:14:24.549022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1573/3152] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:24.551117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-67251982-30f8-45b3-bf09-564dc2a70cfb tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155292 Aug 18 22:14:24.551687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1580/3153] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:24 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:24.738121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-57c193ad-81ff-46e0-b3e8-7d2a3e006840 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:24.738741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-57c193ad-81ff-46e0-b3e8-7d2a3e006840 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:24.746938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57c193ad-81ff-46e0-b3e8-7d2a3e006840 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:24.747432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57c193ad-81ff-46e0-b3e8-7d2a3e006840 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:24.747872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57c193ad-81ff-46e0-b3e8-7d2a3e006840 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:24.748568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57c193ad-81ff-46e0-b3e8-7d2a3e006840 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:24.749076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57c193ad-81ff-46e0-b3e8-7d2a3e006840 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:24.749485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57c193ad-81ff-46e0-b3e8-7d2a3e006840 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:24.879017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-57c193ad-81ff-46e0-b3e8-7d2a3e006840 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:24.888375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-57c193ad-81ff-46e0-b3e8-7d2a3e006840 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:24.889906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-57c193ad-81ff-46e0-b3e8-7d2a3e006840 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:24.891061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-57c193ad-81ff-46e0-b3e8-7d2a3e006840 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156817 Aug 18 22:14:24.891620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1574/3154] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:24 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:14:25.114126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-55ff6740-4a12-4903-ad74-ea407dfa7302 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:25.114751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-55ff6740-4a12-4903-ad74-ea407dfa7302 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:25.121234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55ff6740-4a12-4903-ad74-ea407dfa7302 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:25.121950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55ff6740-4a12-4903-ad74-ea407dfa7302 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:25.122490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55ff6740-4a12-4903-ad74-ea407dfa7302 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:25.123273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55ff6740-4a12-4903-ad74-ea407dfa7302 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:25.124088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55ff6740-4a12-4903-ad74-ea407dfa7302 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:25.124528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55ff6740-4a12-4903-ad74-ea407dfa7302 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:25.183177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b83704e4-03a3-4c8c-a744-44e840c49abb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:25.184278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b83704e4-03a3-4c8c-a744-44e840c49abb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:25.190577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83704e4-03a3-4c8c-a744-44e840c49abb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:25.191065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83704e4-03a3-4c8c-a744-44e840c49abb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:25.191499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83704e4-03a3-4c8c-a744-44e840c49abb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:25.192191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83704e4-03a3-4c8c-a744-44e840c49abb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:25.192640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83704e4-03a3-4c8c-a744-44e840c49abb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:25.193059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83704e4-03a3-4c8c-a744-44e840c49abb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:25.260185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-55ff6740-4a12-4903-ad74-ea407dfa7302 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:25.268519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-55ff6740-4a12-4903-ad74-ea407dfa7302 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.158187 Aug 18 22:14:25.269202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1581/3155] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:25.326614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b83704e4-03a3-4c8c-a744-44e840c49abb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:25.334867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b83704e4-03a3-4c8c-a744-44e840c49abb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155415 Aug 18 22:14:25.335439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1575/3156] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:25 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:25.569706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7fe09c9b-8879-4b79-9194-93be0cebbb46 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:25.570335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7fe09c9b-8879-4b79-9194-93be0cebbb46 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:25.571532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4f0e03c0-5d43-4557-b829-49934f6b320e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:25.572158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4f0e03c0-5d43-4557-b829-49934f6b320e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:25.576868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fe09c9b-8879-4b79-9194-93be0cebbb46 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:25.577354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fe09c9b-8879-4b79-9194-93be0cebbb46 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:25.577825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fe09c9b-8879-4b79-9194-93be0cebbb46 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:25.578525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fe09c9b-8879-4b79-9194-93be0cebbb46 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:25.578670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f0e03c0-5d43-4557-b829-49934f6b320e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:25.578981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fe09c9b-8879-4b79-9194-93be0cebbb46 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:25.579190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f0e03c0-5d43-4557-b829-49934f6b320e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:25.579408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fe09c9b-8879-4b79-9194-93be0cebbb46 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:25.579628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f0e03c0-5d43-4557-b829-49934f6b320e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:25.580326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f0e03c0-5d43-4557-b829-49934f6b320e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:25.580783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f0e03c0-5d43-4557-b829-49934f6b320e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:25.581208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f0e03c0-5d43-4557-b829-49934f6b320e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:25.710359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7fe09c9b-8879-4b79-9194-93be0cebbb46 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:25.711536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4f0e03c0-5d43-4557-b829-49934f6b320e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:25.719890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7fe09c9b-8879-4b79-9194-93be0cebbb46 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153887 Aug 18 22:14:25.720280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4f0e03c0-5d43-4557-b829-49934f6b320e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152531 Aug 18 22:14:25.720630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1582/3157] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:25 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:25.721107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1576/3158] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:25 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:25.913205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-941687d3-8ff2-4d32-b72e-a4399c4cde4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:25.913852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-941687d3-8ff2-4d32-b72e-a4399c4cde4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:25.920376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-941687d3-8ff2-4d32-b72e-a4399c4cde4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:25.920850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-941687d3-8ff2-4d32-b72e-a4399c4cde4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:25.921277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-941687d3-8ff2-4d32-b72e-a4399c4cde4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:25.921984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-941687d3-8ff2-4d32-b72e-a4399c4cde4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:25.922430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-941687d3-8ff2-4d32-b72e-a4399c4cde4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:25.922850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-941687d3-8ff2-4d32-b72e-a4399c4cde4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:26.053460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-941687d3-8ff2-4d32-b72e-a4399c4cde4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:26.062436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-941687d3-8ff2-4d32-b72e-a4399c4cde4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:26.063948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-941687d3-8ff2-4d32-b72e-a4399c4cde4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:26.065102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-941687d3-8ff2-4d32-b72e-a4399c4cde4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155738 Aug 18 22:14:26.065689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1583/3159] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:25 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:26.290096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2bba3556-8e1f-40e4-bccd-2b1b1c5912f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:26.290721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2bba3556-8e1f-40e4-bccd-2b1b1c5912f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:26.297340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2bba3556-8e1f-40e4-bccd-2b1b1c5912f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:26.297863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2bba3556-8e1f-40e4-bccd-2b1b1c5912f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:26.298336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2bba3556-8e1f-40e4-bccd-2b1b1c5912f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:26.299112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2bba3556-8e1f-40e4-bccd-2b1b1c5912f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:26.299570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2bba3556-8e1f-40e4-bccd-2b1b1c5912f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:26.300000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2bba3556-8e1f-40e4-bccd-2b1b1c5912f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:26.355775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-362de2ae-ded8-4377-84ba-2489fe1dd0d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:26.356375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-362de2ae-ded8-4377-84ba-2489fe1dd0d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:26.363379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-362de2ae-ded8-4377-84ba-2489fe1dd0d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:26.363870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-362de2ae-ded8-4377-84ba-2489fe1dd0d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:26.364542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-362de2ae-ded8-4377-84ba-2489fe1dd0d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:26.365013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-362de2ae-ded8-4377-84ba-2489fe1dd0d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:26.365470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-362de2ae-ded8-4377-84ba-2489fe1dd0d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:26.365926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-362de2ae-ded8-4377-84ba-2489fe1dd0d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:26.432609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2bba3556-8e1f-40e4-bccd-2b1b1c5912f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:26.441247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2bba3556-8e1f-40e4-bccd-2b1b1c5912f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154965 Aug 18 22:14:26.441847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1577/3160] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:26 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:26.495205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-362de2ae-ded8-4377-84ba-2489fe1dd0d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:26.503918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-362de2ae-ded8-4377-84ba-2489fe1dd0d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152016 Aug 18 22:14:26.504495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1584/3161] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:26 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:26.741696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-359c058b-217f-4032-821b-4e0dae45d710 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:26.742257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c35168df-d1de-4eda-ad60-6a4ab143479a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:26.742427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-359c058b-217f-4032-821b-4e0dae45d710 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:26.742876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c35168df-d1de-4eda-ad60-6a4ab143479a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:26.748930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-359c058b-217f-4032-821b-4e0dae45d710 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:26.749412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-359c058b-217f-4032-821b-4e0dae45d710 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:26.749845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c35168df-d1de-4eda-ad60-6a4ab143479a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:26.749979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-359c058b-217f-4032-821b-4e0dae45d710 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:26.750333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c35168df-d1de-4eda-ad60-6a4ab143479a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:26.750537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-359c058b-217f-4032-821b-4e0dae45d710 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:26.750778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c35168df-d1de-4eda-ad60-6a4ab143479a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:26.750981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-359c058b-217f-4032-821b-4e0dae45d710 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:26.751399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-359c058b-217f-4032-821b-4e0dae45d710 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:26.751521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c35168df-d1de-4eda-ad60-6a4ab143479a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:26.751912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c35168df-d1de-4eda-ad60-6a4ab143479a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:26.752342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c35168df-d1de-4eda-ad60-6a4ab143479a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:26.880600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-359c058b-217f-4032-821b-4e0dae45d710 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:26.883047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c35168df-d1de-4eda-ad60-6a4ab143479a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:26.888961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-359c058b-217f-4032-821b-4e0dae45d710 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151119 Aug 18 22:14:26.889543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1578/3162] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:26 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:26.891122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c35168df-d1de-4eda-ad60-6a4ab143479a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152635 Aug 18 22:14:26.891678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1585/3163] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:26 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:27.088363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6aae5f20-f929-48f9-bfb0-a89ab20d0931 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:27.088984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6aae5f20-f929-48f9-bfb0-a89ab20d0931 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:27.095618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6aae5f20-f929-48f9-bfb0-a89ab20d0931 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:27.096103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6aae5f20-f929-48f9-bfb0-a89ab20d0931 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:27.096541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6aae5f20-f929-48f9-bfb0-a89ab20d0931 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:27.097228 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6aae5f20-f929-48f9-bfb0-a89ab20d0931 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:27.097720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6aae5f20-f929-48f9-bfb0-a89ab20d0931 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:27.098167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6aae5f20-f929-48f9-bfb0-a89ab20d0931 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:27.228344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6aae5f20-f929-48f9-bfb0-a89ab20d0931 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:27.237613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6aae5f20-f929-48f9-bfb0-a89ab20d0931 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:27.239102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6aae5f20-f929-48f9-bfb0-a89ab20d0931 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:27.240255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6aae5f20-f929-48f9-bfb0-a89ab20d0931 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155853 Aug 18 22:14:27.240814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1579/3164] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:27 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:27.463428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5e0ee67c-88be-4f55-8720-9e6c1b4b4b09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:27.463994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5e0ee67c-88be-4f55-8720-9e6c1b4b4b09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:27.470598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e0ee67c-88be-4f55-8720-9e6c1b4b4b09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:27.471082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e0ee67c-88be-4f55-8720-9e6c1b4b4b09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:27.471520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e0ee67c-88be-4f55-8720-9e6c1b4b4b09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:27.472212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e0ee67c-88be-4f55-8720-9e6c1b4b4b09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:27.472669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e0ee67c-88be-4f55-8720-9e6c1b4b4b09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:27.473102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e0ee67c-88be-4f55-8720-9e6c1b4b4b09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:27.526820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fba44a10-f343-4544-86be-97270f36b0ba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:27.527567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fba44a10-f343-4544-86be-97270f36b0ba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:27.534783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fba44a10-f343-4544-86be-97270f36b0ba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:27.535351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fba44a10-f343-4544-86be-97270f36b0ba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:27.535795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fba44a10-f343-4544-86be-97270f36b0ba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:27.536493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fba44a10-f343-4544-86be-97270f36b0ba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:27.536952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fba44a10-f343-4544-86be-97270f36b0ba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:27.537386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fba44a10-f343-4544-86be-97270f36b0ba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:27.603188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5e0ee67c-88be-4f55-8720-9e6c1b4b4b09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:27.611450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5e0ee67c-88be-4f55-8720-9e6c1b4b4b09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151914 Aug 18 22:14:27.612053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1586/3165] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:27.669814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fba44a10-f343-4544-86be-97270f36b0ba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:27.678410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fba44a10-f343-4544-86be-97270f36b0ba tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155258 Aug 18 22:14:27.678991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1580/3166] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:27 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:27.910343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-19e29993-f80a-4b55-8579-584a1187d77e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:27.910961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-19e29993-f80a-4b55-8579-584a1187d77e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:27.911759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b7926c20-f57c-4605-b0c4-b2746ec0ad88 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:27.912386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b7926c20-f57c-4605-b0c4-b2746ec0ad88 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:27.917420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19e29993-f80a-4b55-8579-584a1187d77e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:27.917933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19e29993-f80a-4b55-8579-584a1187d77e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:27.918280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7926c20-f57c-4605-b0c4-b2746ec0ad88 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:27.918405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19e29993-f80a-4b55-8579-584a1187d77e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:27.918756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7926c20-f57c-4605-b0c4-b2746ec0ad88 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:27.919046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19e29993-f80a-4b55-8579-584a1187d77e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:27.919174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7926c20-f57c-4605-b0c4-b2746ec0ad88 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:27.919497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19e29993-f80a-4b55-8579-584a1187d77e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:27.919863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7926c20-f57c-4605-b0c4-b2746ec0ad88 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:27.920197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-19e29993-f80a-4b55-8579-584a1187d77e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:27.920439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7926c20-f57c-4605-b0c4-b2746ec0ad88 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:27.920895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7926c20-f57c-4605-b0c4-b2746ec0ad88 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:27.922851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:28.049580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-19e29993-f80a-4b55-8579-584a1187d77e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:28.050283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b7926c20-f57c-4605-b0c4-b2746ec0ad88 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:28.058060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-19e29993-f80a-4b55-8579-584a1187d77e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151746 Aug 18 22:14:28.058634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1587/3167] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:27 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:28.058782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b7926c20-f57c-4605-b0c4-b2746ec0ad88 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151111 Aug 18 22:14:28.059744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1581/3168] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:27 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:28.262764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d3743c1d-0ded-4199-b9af-0438934cab55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:28.263302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d3743c1d-0ded-4199-b9af-0438934cab55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:28.269211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3743c1d-0ded-4199-b9af-0438934cab55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:28.269722 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3743c1d-0ded-4199-b9af-0438934cab55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:28.270153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3743c1d-0ded-4199-b9af-0438934cab55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:28.270832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3743c1d-0ded-4199-b9af-0438934cab55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:28.271277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3743c1d-0ded-4199-b9af-0438934cab55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:28.271697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3743c1d-0ded-4199-b9af-0438934cab55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:28.402432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d3743c1d-0ded-4199-b9af-0438934cab55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:28.411062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d3743c1d-0ded-4199-b9af-0438934cab55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:28.412565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d3743c1d-0ded-4199-b9af-0438934cab55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:28.413744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d3743c1d-0ded-4199-b9af-0438934cab55 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154994 Aug 18 22:14:28.414313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1588/3169] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:14:28.632998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fb80a8c9-afa7-419f-a1b2-d73ef37aebe5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:28.633625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fb80a8c9-afa7-419f-a1b2-d73ef37aebe5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:28.639779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb80a8c9-afa7-419f-a1b2-d73ef37aebe5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:28.640254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb80a8c9-afa7-419f-a1b2-d73ef37aebe5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:28.640685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb80a8c9-afa7-419f-a1b2-d73ef37aebe5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:28.641363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb80a8c9-afa7-419f-a1b2-d73ef37aebe5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:28.641853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb80a8c9-afa7-419f-a1b2-d73ef37aebe5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:28.642276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fb80a8c9-afa7-419f-a1b2-d73ef37aebe5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:28.699832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9d46012b-7ced-4260-8ab0-2a1afb87ea4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:28.700450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9d46012b-7ced-4260-8ab0-2a1afb87ea4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:28.706476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d46012b-7ced-4260-8ab0-2a1afb87ea4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:28.706964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d46012b-7ced-4260-8ab0-2a1afb87ea4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:28.707403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d46012b-7ced-4260-8ab0-2a1afb87ea4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:28.708106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d46012b-7ced-4260-8ab0-2a1afb87ea4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:28.708562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d46012b-7ced-4260-8ab0-2a1afb87ea4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:28.708995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d46012b-7ced-4260-8ab0-2a1afb87ea4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:28.773955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fb80a8c9-afa7-419f-a1b2-d73ef37aebe5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:28.782703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fb80a8c9-afa7-419f-a1b2-d73ef37aebe5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153563 Aug 18 22:14:28.783289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1582/3170] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:28.838522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9d46012b-7ced-4260-8ab0-2a1afb87ea4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:28.847198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9d46012b-7ced-4260-8ab0-2a1afb87ea4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151294 Aug 18 22:14:28.847960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1589/3171] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:28 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:29.079780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-91f35a62-298b-47b6-b23a-4c1b6a44aea2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:29.080357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-92cde873-e631-41a9-9dc5-faf3f0afd61e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:29.080498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-91f35a62-298b-47b6-b23a-4c1b6a44aea2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:29.080982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-92cde873-e631-41a9-9dc5-faf3f0afd61e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:29.086820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91f35a62-298b-47b6-b23a-4c1b6a44aea2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:29.087224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92cde873-e631-41a9-9dc5-faf3f0afd61e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:29.087395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91f35a62-298b-47b6-b23a-4c1b6a44aea2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:29.087688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92cde873-e631-41a9-9dc5-faf3f0afd61e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:29.087813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91f35a62-298b-47b6-b23a-4c1b6a44aea2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:29.088128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92cde873-e631-41a9-9dc5-faf3f0afd61e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:29.088393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91f35a62-298b-47b6-b23a-4c1b6a44aea2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:29.088841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92cde873-e631-41a9-9dc5-faf3f0afd61e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:29.088961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91f35a62-298b-47b6-b23a-4c1b6a44aea2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:29.089262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91f35a62-298b-47b6-b23a-4c1b6a44aea2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:29.089369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92cde873-e631-41a9-9dc5-faf3f0afd61e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:29.089740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92cde873-e631-41a9-9dc5-faf3f0afd61e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:29.219342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-91f35a62-298b-47b6-b23a-4c1b6a44aea2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:29.221683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-92cde873-e631-41a9-9dc5-faf3f0afd61e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:29.227703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-91f35a62-298b-47b6-b23a-4c1b6a44aea2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151870 Aug 18 22:14:29.228283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1583/3172] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:29 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:29.229891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-92cde873-e631-41a9-9dc5-faf3f0afd61e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153449 Aug 18 22:14:29.230532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1590/3173] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:29 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:29.436648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3aa94fe2-a36e-4e90-b5fe-878dab4d5aca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:29.437268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3aa94fe2-a36e-4e90-b5fe-878dab4d5aca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:29.443261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3aa94fe2-a36e-4e90-b5fe-878dab4d5aca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:29.443745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3aa94fe2-a36e-4e90-b5fe-878dab4d5aca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:29.444188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3aa94fe2-a36e-4e90-b5fe-878dab4d5aca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:29.444880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3aa94fe2-a36e-4e90-b5fe-878dab4d5aca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:29.445337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3aa94fe2-a36e-4e90-b5fe-878dab4d5aca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:29.445802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3aa94fe2-a36e-4e90-b5fe-878dab4d5aca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:29.574730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3aa94fe2-a36e-4e90-b5fe-878dab4d5aca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:29.584377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3aa94fe2-a36e-4e90-b5fe-878dab4d5aca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:29.585886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3aa94fe2-a36e-4e90-b5fe-878dab4d5aca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:29.587037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3aa94fe2-a36e-4e90-b5fe-878dab4d5aca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154781 Aug 18 22:14:29.587588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1584/3174] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:29.804519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2a217de7-78df-4e9d-b17a-319a4fe79254 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:29.805181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2a217de7-78df-4e9d-b17a-319a4fe79254 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:29.813210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a217de7-78df-4e9d-b17a-319a4fe79254 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:29.813785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a217de7-78df-4e9d-b17a-319a4fe79254 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:29.814217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a217de7-78df-4e9d-b17a-319a4fe79254 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:29.814897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a217de7-78df-4e9d-b17a-319a4fe79254 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:29.815361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a217de7-78df-4e9d-b17a-319a4fe79254 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:29.815763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a217de7-78df-4e9d-b17a-319a4fe79254 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:29.868306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-db4faafd-9f4e-4676-a23d-8f2336e1d80e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:29.868929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-db4faafd-9f4e-4676-a23d-8f2336e1d80e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:29.875742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db4faafd-9f4e-4676-a23d-8f2336e1d80e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:29.876230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db4faafd-9f4e-4676-a23d-8f2336e1d80e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:29.876674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db4faafd-9f4e-4676-a23d-8f2336e1d80e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:29.877377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db4faafd-9f4e-4676-a23d-8f2336e1d80e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:29.877859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db4faafd-9f4e-4676-a23d-8f2336e1d80e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:29.878291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db4faafd-9f4e-4676-a23d-8f2336e1d80e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:29.945352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2a217de7-78df-4e9d-b17a-319a4fe79254 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:29.954022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2a217de7-78df-4e9d-b17a-319a4fe79254 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153494 Aug 18 22:14:29.954637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1591/3175] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:29 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:30.006248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-db4faafd-9f4e-4676-a23d-8f2336e1d80e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:30.008435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:30.015796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-db4faafd-9f4e-4676-a23d-8f2336e1d80e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151349 Aug 18 22:14:30.016490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1585/3176] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:29 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:30.248486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-58a64d4e-b33b-4cdf-a0ad-19edd427322d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:30.249096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-58a64d4e-b33b-4cdf-a0ad-19edd427322d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:30.250629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e575b01a-b7a1-4027-88f2-954a1604ca0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:30.251245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e575b01a-b7a1-4027-88f2-954a1604ca0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:30.255610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58a64d4e-b33b-4cdf-a0ad-19edd427322d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:30.256029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58a64d4e-b33b-4cdf-a0ad-19edd427322d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:30.256459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58a64d4e-b33b-4cdf-a0ad-19edd427322d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:30.257143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58a64d4e-b33b-4cdf-a0ad-19edd427322d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:30.257469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e575b01a-b7a1-4027-88f2-954a1604ca0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:30.257591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58a64d4e-b33b-4cdf-a0ad-19edd427322d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:30.257988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e575b01a-b7a1-4027-88f2-954a1604ca0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:30.258111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58a64d4e-b33b-4cdf-a0ad-19edd427322d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:30.258423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e575b01a-b7a1-4027-88f2-954a1604ca0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:30.259107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e575b01a-b7a1-4027-88f2-954a1604ca0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:30.259558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e575b01a-b7a1-4027-88f2-954a1604ca0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:30.259978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e575b01a-b7a1-4027-88f2-954a1604ca0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:30.391899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-58a64d4e-b33b-4cdf-a0ad-19edd427322d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:30.392112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e575b01a-b7a1-4027-88f2-954a1604ca0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:30.400281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e575b01a-b7a1-4027-88f2-954a1604ca0e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153628 Aug 18 22:14:30.400464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-58a64d4e-b33b-4cdf-a0ad-19edd427322d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155708 Aug 18 22:14:30.400950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1586/3177] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:30.401083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1592/3178] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:30 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:30.609078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c913a6d4-e123-418a-8c22-15a3630dc941 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:30.609744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c913a6d4-e123-418a-8c22-15a3630dc941 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:30.615772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c913a6d4-e123-418a-8c22-15a3630dc941 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:30.616260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c913a6d4-e123-418a-8c22-15a3630dc941 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:30.616700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c913a6d4-e123-418a-8c22-15a3630dc941 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:30.617392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c913a6d4-e123-418a-8c22-15a3630dc941 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:30.617892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c913a6d4-e123-418a-8c22-15a3630dc941 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:30.618327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c913a6d4-e123-418a-8c22-15a3630dc941 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:30.748868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c913a6d4-e123-418a-8c22-15a3630dc941 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:30.757393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c913a6d4-e123-418a-8c22-15a3630dc941 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:30.758931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c913a6d4-e123-418a-8c22-15a3630dc941 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:30.760087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c913a6d4-e123-418a-8c22-15a3630dc941 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155033 Aug 18 22:14:30.760649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1587/3179] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:30.975313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64b4543f-4a8f-4b35-beeb-a2184df976dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:30.975898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64b4543f-4a8f-4b35-beeb-a2184df976dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:30.982751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64b4543f-4a8f-4b35-beeb-a2184df976dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:30.983229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64b4543f-4a8f-4b35-beeb-a2184df976dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:30.983668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64b4543f-4a8f-4b35-beeb-a2184df976dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:30.984420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64b4543f-4a8f-4b35-beeb-a2184df976dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:30.984908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64b4543f-4a8f-4b35-beeb-a2184df976dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:30.985332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64b4543f-4a8f-4b35-beeb-a2184df976dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:31.036128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9b71d27c-0f34-446e-adb1-18fdf5dac7d1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:31.036747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9b71d27c-0f34-446e-adb1-18fdf5dac7d1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:31.042822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b71d27c-0f34-446e-adb1-18fdf5dac7d1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:31.043311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b71d27c-0f34-446e-adb1-18fdf5dac7d1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:31.044365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b71d27c-0f34-446e-adb1-18fdf5dac7d1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:31.045073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b71d27c-0f34-446e-adb1-18fdf5dac7d1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:31.045537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b71d27c-0f34-446e-adb1-18fdf5dac7d1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:31.045989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b71d27c-0f34-446e-adb1-18fdf5dac7d1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:31.114241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-64b4543f-4a8f-4b35-beeb-a2184df976dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:31.122424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64b4543f-4a8f-4b35-beeb-a2184df976dd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151024 Aug 18 22:14:31.123405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1593/3180] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:30 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:31.175138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9b71d27c-0f34-446e-adb1-18fdf5dac7d1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:31.183549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9b71d27c-0f34-446e-adb1-18fdf5dac7d1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151263 Aug 18 22:14:31.184127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1588/3181] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:31.422066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4ccb45e2-12be-4ea9-ad20-000b8d3269f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:31.422688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4ccb45e2-12be-4ea9-ad20-000b8d3269f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:31.423999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7bdaa71-b534-4b6b-b92f-2189de00bb74 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:31.424642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f7bdaa71-b534-4b6b-b92f-2189de00bb74 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:31.429505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ccb45e2-12be-4ea9-ad20-000b8d3269f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:31.430020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ccb45e2-12be-4ea9-ad20-000b8d3269f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:31.430454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ccb45e2-12be-4ea9-ad20-000b8d3269f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:31.431205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ccb45e2-12be-4ea9-ad20-000b8d3269f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:31.431380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bdaa71-b534-4b6b-b92f-2189de00bb74 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:31.431687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ccb45e2-12be-4ea9-ad20-000b8d3269f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:31.431869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bdaa71-b534-4b6b-b92f-2189de00bb74 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:31.432135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ccb45e2-12be-4ea9-ad20-000b8d3269f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:31.432315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bdaa71-b534-4b6b-b92f-2189de00bb74 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:31.433010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bdaa71-b534-4b6b-b92f-2189de00bb74 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:31.433471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bdaa71-b534-4b6b-b92f-2189de00bb74 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:31.433932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bdaa71-b534-4b6b-b92f-2189de00bb74 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:31.566885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f7bdaa71-b534-4b6b-b92f-2189de00bb74 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:31.567346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4ccb45e2-12be-4ea9-ad20-000b8d3269f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:31.575679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f7bdaa71-b534-4b6b-b92f-2189de00bb74 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155509 Aug 18 22:14:31.576088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4ccb45e2-12be-4ea9-ad20-000b8d3269f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157990 Aug 18 22:14:31.576489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1589/3182] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:31 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:31.576655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1594/3183] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:31 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:31.783376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d4917fbe-5e7f-4f5b-aba3-4acd89b50294 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:31.783996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d4917fbe-5e7f-4f5b-aba3-4acd89b50294 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:31.790052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4917fbe-5e7f-4f5b-aba3-4acd89b50294 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:31.790545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4917fbe-5e7f-4f5b-aba3-4acd89b50294 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:31.790974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4917fbe-5e7f-4f5b-aba3-4acd89b50294 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:31.791660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4917fbe-5e7f-4f5b-aba3-4acd89b50294 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:31.792115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4917fbe-5e7f-4f5b-aba3-4acd89b50294 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:31.792541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4917fbe-5e7f-4f5b-aba3-4acd89b50294 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:31.936761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d4917fbe-5e7f-4f5b-aba3-4acd89b50294 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:31.945327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d4917fbe-5e7f-4f5b-aba3-4acd89b50294 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:31.946881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d4917fbe-5e7f-4f5b-aba3-4acd89b50294 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:31.948107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d4917fbe-5e7f-4f5b-aba3-4acd89b50294 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.168603 Aug 18 22:14:31.948669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1590/3184] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:31 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:32.144197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6197f6c0-6fdb-49b7-a64f-f2e5c99ebb40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:32.144747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6197f6c0-6fdb-49b7-a64f-f2e5c99ebb40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:32.150753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6197f6c0-6fdb-49b7-a64f-f2e5c99ebb40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:32.151232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6197f6c0-6fdb-49b7-a64f-f2e5c99ebb40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:32.151702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6197f6c0-6fdb-49b7-a64f-f2e5c99ebb40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:32.152389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6197f6c0-6fdb-49b7-a64f-f2e5c99ebb40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:32.152848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6197f6c0-6fdb-49b7-a64f-f2e5c99ebb40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:32.153398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6197f6c0-6fdb-49b7-a64f-f2e5c99ebb40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:32.204947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f3296261-9b6b-4215-aca2-b0d6726bd2b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:32.205556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f3296261-9b6b-4215-aca2-b0d6726bd2b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:32.211622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3296261-9b6b-4215-aca2-b0d6726bd2b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:32.212110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3296261-9b6b-4215-aca2-b0d6726bd2b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:32.212556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3296261-9b6b-4215-aca2-b0d6726bd2b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:32.213250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3296261-9b6b-4215-aca2-b0d6726bd2b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:32.213752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3296261-9b6b-4215-aca2-b0d6726bd2b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:32.214185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f3296261-9b6b-4215-aca2-b0d6726bd2b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:32.289030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6197f6c0-6fdb-49b7-a64f-f2e5c99ebb40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:32.298176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6197f6c0-6fdb-49b7-a64f-f2e5c99ebb40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.157900 Aug 18 22:14:32.298990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1595/3185] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:32 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:32.346598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f3296261-9b6b-4215-aca2-b0d6726bd2b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:32.354739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f3296261-9b6b-4215-aca2-b0d6726bd2b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153729 Aug 18 22:14:32.355306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1591/3186] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:32 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:32.596832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bee523bc-55de-4a7c-9ec5-78b0ddcac1db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:32.597457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bee523bc-55de-4a7c-9ec5-78b0ddcac1db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:32.597719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-998294aa-6c59-40d2-88d3-fec5c4168d98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:32.598396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-998294aa-6c59-40d2-88d3-fec5c4168d98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:32.603917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bee523bc-55de-4a7c-9ec5-78b0ddcac1db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:32.604404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bee523bc-55de-4a7c-9ec5-78b0ddcac1db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:32.604846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bee523bc-55de-4a7c-9ec5-78b0ddcac1db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:32.605302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-998294aa-6c59-40d2-88d3-fec5c4168d98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:32.605565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bee523bc-55de-4a7c-9ec5-78b0ddcac1db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:32.605844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-998294aa-6c59-40d2-88d3-fec5c4168d98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:32.606734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bee523bc-55de-4a7c-9ec5-78b0ddcac1db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:32.606923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-998294aa-6c59-40d2-88d3-fec5c4168d98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:32.607208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bee523bc-55de-4a7c-9ec5-78b0ddcac1db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:32.607628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-998294aa-6c59-40d2-88d3-fec5c4168d98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:32.608117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-998294aa-6c59-40d2-88d3-fec5c4168d98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:32.608547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-998294aa-6c59-40d2-88d3-fec5c4168d98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:32.737889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-998294aa-6c59-40d2-88d3-fec5c4168d98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:32.738435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bee523bc-55de-4a7c-9ec5-78b0ddcac1db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:32.746472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bee523bc-55de-4a7c-9ec5-78b0ddcac1db tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153554 Aug 18 22:14:32.746681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-998294aa-6c59-40d2-88d3-fec5c4168d98 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152743 Aug 18 22:14:32.747081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1592/3188] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:32 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:32.747249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1596/3188] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:32.971765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e4f602e1-1930-478d-9cdd-8c08fff69116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:32.972312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e4f602e1-1930-478d-9cdd-8c08fff69116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:32.978354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4f602e1-1930-478d-9cdd-8c08fff69116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:32.978840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4f602e1-1930-478d-9cdd-8c08fff69116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:32.979277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4f602e1-1930-478d-9cdd-8c08fff69116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:32.979969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4f602e1-1930-478d-9cdd-8c08fff69116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:32.980427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4f602e1-1930-478d-9cdd-8c08fff69116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:32.980857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4f602e1-1930-478d-9cdd-8c08fff69116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:33.108813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e4f602e1-1930-478d-9cdd-8c08fff69116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:33.117380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e4f602e1-1930-478d-9cdd-8c08fff69116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:33.118924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e4f602e1-1930-478d-9cdd-8c08fff69116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:33.120080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e4f602e1-1930-478d-9cdd-8c08fff69116 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152287 Aug 18 22:14:33.120644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1597/3189] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:33.320313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-82b8acb1-691a-41fc-804b-02ad259f446c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:33.320937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-82b8acb1-691a-41fc-804b-02ad259f446c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:33.327731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82b8acb1-691a-41fc-804b-02ad259f446c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:33.328225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82b8acb1-691a-41fc-804b-02ad259f446c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:33.328664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82b8acb1-691a-41fc-804b-02ad259f446c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:33.329361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82b8acb1-691a-41fc-804b-02ad259f446c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:33.329849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82b8acb1-691a-41fc-804b-02ad259f446c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:33.330280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82b8acb1-691a-41fc-804b-02ad259f446c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:33.376581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-03ecf56b-e309-4e33-a302-49b68e61187d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:33.377201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-03ecf56b-e309-4e33-a302-49b68e61187d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:33.383589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03ecf56b-e309-4e33-a302-49b68e61187d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:33.384080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03ecf56b-e309-4e33-a302-49b68e61187d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:33.384521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03ecf56b-e309-4e33-a302-49b68e61187d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:33.385216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03ecf56b-e309-4e33-a302-49b68e61187d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:33.385698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03ecf56b-e309-4e33-a302-49b68e61187d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:33.386126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03ecf56b-e309-4e33-a302-49b68e61187d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:33.458661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-82b8acb1-691a-41fc-804b-02ad259f446c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:33.467663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-82b8acb1-691a-41fc-804b-02ad259f446c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151144 Aug 18 22:14:33.468340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1593/3190] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:33 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:33.514998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-03ecf56b-e309-4e33-a302-49b68e61187d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:33.523255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-03ecf56b-e309-4e33-a302-49b68e61187d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150905 Aug 18 22:14:33.523836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1598/3191] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:33.767766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1806dad1-72ee-4189-a7ba-cd3df3dbf60a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:33.767979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0ee98a7b-963c-439a-8ce3-d5b0775019b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:33.768378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1806dad1-72ee-4189-a7ba-cd3df3dbf60a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:33.768502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0ee98a7b-963c-439a-8ce3-d5b0775019b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:33.774876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ee98a7b-963c-439a-8ce3-d5b0775019b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:33.775285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1806dad1-72ee-4189-a7ba-cd3df3dbf60a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:33.775419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ee98a7b-963c-439a-8ce3-d5b0775019b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:33.775768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1806dad1-72ee-4189-a7ba-cd3df3dbf60a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:33.775891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ee98a7b-963c-439a-8ce3-d5b0775019b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:33.776202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1806dad1-72ee-4189-a7ba-cd3df3dbf60a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:33.776481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ee98a7b-963c-439a-8ce3-d5b0775019b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:33.776888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1806dad1-72ee-4189-a7ba-cd3df3dbf60a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:33.777012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ee98a7b-963c-439a-8ce3-d5b0775019b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:33.777330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ee98a7b-963c-439a-8ce3-d5b0775019b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:33.777450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1806dad1-72ee-4189-a7ba-cd3df3dbf60a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:33.777800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1806dad1-72ee-4189-a7ba-cd3df3dbf60a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:33.907700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0ee98a7b-963c-439a-8ce3-d5b0775019b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:33.909427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1806dad1-72ee-4189-a7ba-cd3df3dbf60a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:33.916090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0ee98a7b-963c-439a-8ce3-d5b0775019b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152071 Aug 18 22:14:33.916713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1599/3192] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:33 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:33.918000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1806dad1-72ee-4189-a7ba-cd3df3dbf60a tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154068 Aug 18 22:14:33.918743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1594/3193] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:33 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:34.144099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8b8b9e0f-8b9a-415f-83f1-2a435ae41a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:34.144639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8b8b9e0f-8b9a-415f-83f1-2a435ae41a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:34.150591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b8b9e0f-8b9a-415f-83f1-2a435ae41a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:34.151073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b8b9e0f-8b9a-415f-83f1-2a435ae41a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:34.151513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b8b9e0f-8b9a-415f-83f1-2a435ae41a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:34.152201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b8b9e0f-8b9a-415f-83f1-2a435ae41a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:34.152661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b8b9e0f-8b9a-415f-83f1-2a435ae41a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:34.153142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b8b9e0f-8b9a-415f-83f1-2a435ae41a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:34.279976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8b8b9e0f-8b9a-415f-83f1-2a435ae41a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:34.288428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8b8b9e0f-8b9a-415f-83f1-2a435ae41a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:34.289959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8b8b9e0f-8b9a-415f-83f1-2a435ae41a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:34.291100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8b8b9e0f-8b9a-415f-83f1-2a435ae41a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151130 Aug 18 22:14:34.291654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1600/3194] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:34.489088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-39c6b443-79f0-436f-b222-8a52cf73d9e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:34.489665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-39c6b443-79f0-436f-b222-8a52cf73d9e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:34.495580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39c6b443-79f0-436f-b222-8a52cf73d9e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:34.496068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39c6b443-79f0-436f-b222-8a52cf73d9e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:34.496618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39c6b443-79f0-436f-b222-8a52cf73d9e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:34.498017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39c6b443-79f0-436f-b222-8a52cf73d9e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:34.498484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39c6b443-79f0-436f-b222-8a52cf73d9e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:34.498922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-39c6b443-79f0-436f-b222-8a52cf73d9e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:34.544580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9e9173fe-b5e5-4eec-a084-0e430044d101 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:34.545179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9e9173fe-b5e5-4eec-a084-0e430044d101 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:34.551351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e9173fe-b5e5-4eec-a084-0e430044d101 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:34.551824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e9173fe-b5e5-4eec-a084-0e430044d101 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:34.552252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e9173fe-b5e5-4eec-a084-0e430044d101 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:34.552932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e9173fe-b5e5-4eec-a084-0e430044d101 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:34.553376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e9173fe-b5e5-4eec-a084-0e430044d101 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:34.553827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e9173fe-b5e5-4eec-a084-0e430044d101 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:34.630521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-39c6b443-79f0-436f-b222-8a52cf73d9e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:34.638933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-39c6b443-79f0-436f-b222-8a52cf73d9e5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153913 Aug 18 22:14:34.639519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1595/3195] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:34 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:34.683073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e9173fe-b5e5-4eec-a084-0e430044d101 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:34.691351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9e9173fe-b5e5-4eec-a084-0e430044d101 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151017 Aug 18 22:14:34.692119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1601/3196] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:34.939058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8d74a13f-79fb-428e-8704-e81473414df1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:34.939501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3c88b5ff-417c-4f9f-9fc2-326c2762ea3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:34.939698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8d74a13f-79fb-428e-8704-e81473414df1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:34.940126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3c88b5ff-417c-4f9f-9fc2-326c2762ea3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:34.946168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c88b5ff-417c-4f9f-9fc2-326c2762ea3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:34.946323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d74a13f-79fb-428e-8704-e81473414df1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:34.946661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d74a13f-79fb-428e-8704-e81473414df1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:34.946793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c88b5ff-417c-4f9f-9fc2-326c2762ea3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:34.947098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c88b5ff-417c-4f9f-9fc2-326c2762ea3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:34.947217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d74a13f-79fb-428e-8704-e81473414df1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:34.947777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d74a13f-79fb-428e-8704-e81473414df1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:34.947897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c88b5ff-417c-4f9f-9fc2-326c2762ea3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:34.948221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d74a13f-79fb-428e-8704-e81473414df1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:34.948336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c88b5ff-417c-4f9f-9fc2-326c2762ea3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:34.948637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d74a13f-79fb-428e-8704-e81473414df1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:34.948747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3c88b5ff-417c-4f9f-9fc2-326c2762ea3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:35.080546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8d74a13f-79fb-428e-8704-e81473414df1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:35.081106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3c88b5ff-417c-4f9f-9fc2-326c2762ea3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:35.089201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3c88b5ff-417c-4f9f-9fc2-326c2762ea3b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155507 Aug 18 22:14:35.089423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8d74a13f-79fb-428e-8704-e81473414df1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154190 Aug 18 22:14:35.090023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1596/3197] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:34 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:35.090165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1602/3198] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:34 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:35.313618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-056bf2e8-8b2b-41b5-9207-d68331d62623 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:35.314233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-056bf2e8-8b2b-41b5-9207-d68331d62623 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:35.316076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:35.321361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-056bf2e8-8b2b-41b5-9207-d68331d62623 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:35.321911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-056bf2e8-8b2b-41b5-9207-d68331d62623 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:35.322390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-056bf2e8-8b2b-41b5-9207-d68331d62623 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:35.323087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-056bf2e8-8b2b-41b5-9207-d68331d62623 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:35.323551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-056bf2e8-8b2b-41b5-9207-d68331d62623 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:35.323983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-056bf2e8-8b2b-41b5-9207-d68331d62623 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:35.451711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-056bf2e8-8b2b-41b5-9207-d68331d62623 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:35.460299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-056bf2e8-8b2b-41b5-9207-d68331d62623 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:35.461801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-056bf2e8-8b2b-41b5-9207-d68331d62623 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:35.462948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-056bf2e8-8b2b-41b5-9207-d68331d62623 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153265 Aug 18 22:14:35.463509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1597/3199] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:35.660076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a02ca987-0e0a-437a-9d29-d39b777c4cd5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:35.660637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a02ca987-0e0a-437a-9d29-d39b777c4cd5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:35.666601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a02ca987-0e0a-437a-9d29-d39b777c4cd5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:35.667077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a02ca987-0e0a-437a-9d29-d39b777c4cd5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:35.667506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a02ca987-0e0a-437a-9d29-d39b777c4cd5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:35.668185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a02ca987-0e0a-437a-9d29-d39b777c4cd5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:35.668629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a02ca987-0e0a-437a-9d29-d39b777c4cd5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:35.669045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a02ca987-0e0a-437a-9d29-d39b777c4cd5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:35.712068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-df1dc8c3-e25d-4f96-a68d-838f1d600108 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:35.712665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-df1dc8c3-e25d-4f96-a68d-838f1d600108 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:35.719475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df1dc8c3-e25d-4f96-a68d-838f1d600108 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:35.719965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df1dc8c3-e25d-4f96-a68d-838f1d600108 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:35.720399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df1dc8c3-e25d-4f96-a68d-838f1d600108 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:35.721099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df1dc8c3-e25d-4f96-a68d-838f1d600108 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:35.721553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df1dc8c3-e25d-4f96-a68d-838f1d600108 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:35.722267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df1dc8c3-e25d-4f96-a68d-838f1d600108 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:35.800263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a02ca987-0e0a-437a-9d29-d39b777c4cd5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:35.802763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:35.810663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a02ca987-0e0a-437a-9d29-d39b777c4cd5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154443 Aug 18 22:14:35.811269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1603/3200] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:35.854107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-df1dc8c3-e25d-4f96-a68d-838f1d600108 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:35.862883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-df1dc8c3-e25d-4f96-a68d-838f1d600108 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154569 Aug 18 22:14:35.863460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1598/3201] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:35 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:36.111398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f5f1100d-a835-402c-853f-01662460e54c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:36.111659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-436abcde-803a-44e3-b7e6-66dc49eb1c69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:36.112021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f5f1100d-a835-402c-853f-01662460e54c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:36.112155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-436abcde-803a-44e3-b7e6-66dc49eb1c69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:36.118624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5f1100d-a835-402c-853f-01662460e54c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:36.118792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-436abcde-803a-44e3-b7e6-66dc49eb1c69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:36.119113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5f1100d-a835-402c-853f-01662460e54c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:36.119238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-436abcde-803a-44e3-b7e6-66dc49eb1c69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:36.119552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5f1100d-a835-402c-853f-01662460e54c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:36.119671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-436abcde-803a-44e3-b7e6-66dc49eb1c69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:36.120261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5f1100d-a835-402c-853f-01662460e54c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:36.120413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-436abcde-803a-44e3-b7e6-66dc49eb1c69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:36.120711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5f1100d-a835-402c-853f-01662460e54c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:36.120844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-436abcde-803a-44e3-b7e6-66dc49eb1c69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:36.121139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f5f1100d-a835-402c-853f-01662460e54c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:36.121252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-436abcde-803a-44e3-b7e6-66dc49eb1c69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:36.254041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f5f1100d-a835-402c-853f-01662460e54c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:36.255443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-436abcde-803a-44e3-b7e6-66dc49eb1c69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:36.262262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f5f1100d-a835-402c-853f-01662460e54c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154788 Aug 18 22:14:36.262834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1604/3202] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:36 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:36.263629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-436abcde-803a-44e3-b7e6-66dc49eb1c69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155984 Aug 18 22:14:36.264208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1599/3203] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:36 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:36.485340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e45fc21e-3ed6-484e-bdfb-9904e4a8dcba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:36.485910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e45fc21e-3ed6-484e-bdfb-9904e4a8dcba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:36.491877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e45fc21e-3ed6-484e-bdfb-9904e4a8dcba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:36.492361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e45fc21e-3ed6-484e-bdfb-9904e4a8dcba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:36.492792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e45fc21e-3ed6-484e-bdfb-9904e4a8dcba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:36.493480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e45fc21e-3ed6-484e-bdfb-9904e4a8dcba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:36.493958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e45fc21e-3ed6-484e-bdfb-9904e4a8dcba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:36.494383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e45fc21e-3ed6-484e-bdfb-9904e4a8dcba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:36.619916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e45fc21e-3ed6-484e-bdfb-9904e4a8dcba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:36.628724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e45fc21e-3ed6-484e-bdfb-9904e4a8dcba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:36.630332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e45fc21e-3ed6-484e-bdfb-9904e4a8dcba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:36.631569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e45fc21e-3ed6-484e-bdfb-9904e4a8dcba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150260 Aug 18 22:14:36.632132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1605/3204] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:14:36.831816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ff022079-914a-4512-9d44-6443324fd5af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:36.832434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ff022079-914a-4512-9d44-6443324fd5af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:36.838616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff022079-914a-4512-9d44-6443324fd5af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:36.839097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff022079-914a-4512-9d44-6443324fd5af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:36.839527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff022079-914a-4512-9d44-6443324fd5af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:36.840229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff022079-914a-4512-9d44-6443324fd5af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:36.841341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff022079-914a-4512-9d44-6443324fd5af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:36.841801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff022079-914a-4512-9d44-6443324fd5af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:36.884284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9925625a-5100-4064-8fd4-f43700d44225 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:36.884906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9925625a-5100-4064-8fd4-f43700d44225 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:36.891554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9925625a-5100-4064-8fd4-f43700d44225 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:36.892049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9925625a-5100-4064-8fd4-f43700d44225 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:36.892491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9925625a-5100-4064-8fd4-f43700d44225 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:36.893189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9925625a-5100-4064-8fd4-f43700d44225 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:36.893727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9925625a-5100-4064-8fd4-f43700d44225 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:36.894159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9925625a-5100-4064-8fd4-f43700d44225 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:36.984451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ff022079-914a-4512-9d44-6443324fd5af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:36.992799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ff022079-914a-4512-9d44-6443324fd5af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.164750 Aug 18 22:14:36.993369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1600/3205] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:36 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:37.030288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9925625a-5100-4064-8fd4-f43700d44225 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:37.038336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9925625a-5100-4064-8fd4-f43700d44225 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.157920 Aug 18 22:14:37.038829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1606/3206] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:36 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:37.284251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-840c75b0-2f10-490e-bfbc-0208c114b84a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:37.284516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-641ea364-2563-4b66-a263-33c6a7fe07c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:37.284871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-840c75b0-2f10-490e-bfbc-0208c114b84a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:37.285170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-641ea364-2563-4b66-a263-33c6a7fe07c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:37.291454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-840c75b0-2f10-490e-bfbc-0208c114b84a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:37.291611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-641ea364-2563-4b66-a263-33c6a7fe07c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:37.291881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-840c75b0-2f10-490e-bfbc-0208c114b84a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:37.292080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-641ea364-2563-4b66-a263-33c6a7fe07c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:37.292323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-840c75b0-2f10-490e-bfbc-0208c114b84a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:37.292510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-641ea364-2563-4b66-a263-33c6a7fe07c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:37.293023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-840c75b0-2f10-490e-bfbc-0208c114b84a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:37.293190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-641ea364-2563-4b66-a263-33c6a7fe07c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:37.293541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-840c75b0-2f10-490e-bfbc-0208c114b84a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:37.293728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-641ea364-2563-4b66-a263-33c6a7fe07c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:37.294070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-840c75b0-2f10-490e-bfbc-0208c114b84a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:37.294187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-641ea364-2563-4b66-a263-33c6a7fe07c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:37.426997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-840c75b0-2f10-490e-bfbc-0208c114b84a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:37.428938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-641ea364-2563-4b66-a263-33c6a7fe07c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:37.435298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-840c75b0-2f10-490e-bfbc-0208c114b84a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154873 Aug 18 22:14:37.435881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1601/3207] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:37 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:37.437127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-641ea364-2563-4b66-a263-33c6a7fe07c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.156371 Aug 18 22:14:37.437898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1607/3208] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:37 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:37.654786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0947a331-67d8-42c0-a5c1-e313af7d43b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:37.655324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0947a331-67d8-42c0-a5c1-e313af7d43b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:37.661317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0947a331-67d8-42c0-a5c1-e313af7d43b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:37.661851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0947a331-67d8-42c0-a5c1-e313af7d43b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:37.662307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0947a331-67d8-42c0-a5c1-e313af7d43b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:37.663000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0947a331-67d8-42c0-a5c1-e313af7d43b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:37.663461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0947a331-67d8-42c0-a5c1-e313af7d43b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:37.663893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0947a331-67d8-42c0-a5c1-e313af7d43b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:37.678599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:37.797892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0947a331-67d8-42c0-a5c1-e313af7d43b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:37.806709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0947a331-67d8-42c0-a5c1-e313af7d43b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:37.808213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0947a331-67d8-42c0-a5c1-e313af7d43b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:37.809990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0947a331-67d8-42c0-a5c1-e313af7d43b2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159206 Aug 18 22:14:37.810619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1602/3209] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:38.013951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f0bce9e-3dac-4ec7-b110-62aaed2e5d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:38.014508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f0bce9e-3dac-4ec7-b110-62aaed2e5d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:38.020423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f0bce9e-3dac-4ec7-b110-62aaed2e5d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:38.020899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f0bce9e-3dac-4ec7-b110-62aaed2e5d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:38.021332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f0bce9e-3dac-4ec7-b110-62aaed2e5d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:38.022045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f0bce9e-3dac-4ec7-b110-62aaed2e5d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:38.022499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f0bce9e-3dac-4ec7-b110-62aaed2e5d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:38.022922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f0bce9e-3dac-4ec7-b110-62aaed2e5d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:38.060482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-82d0c388-537e-4c6e-b284-7e2fc68a3c07 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:38.061311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-82d0c388-537e-4c6e-b284-7e2fc68a3c07 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:38.067356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82d0c388-537e-4c6e-b284-7e2fc68a3c07 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:38.067844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82d0c388-537e-4c6e-b284-7e2fc68a3c07 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:38.068287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82d0c388-537e-4c6e-b284-7e2fc68a3c07 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:38.068992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82d0c388-537e-4c6e-b284-7e2fc68a3c07 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:38.069455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82d0c388-537e-4c6e-b284-7e2fc68a3c07 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:38.069919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82d0c388-537e-4c6e-b284-7e2fc68a3c07 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:38.149980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4f0bce9e-3dac-4ec7-b110-62aaed2e5d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:38.158148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f0bce9e-3dac-4ec7-b110-62aaed2e5d55 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148182 Aug 18 22:14:38.158724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1608/3210] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:38 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:38.203202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-82d0c388-537e-4c6e-b284-7e2fc68a3c07 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:38.211323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-82d0c388-537e-4c6e-b284-7e2fc68a3c07 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155288 Aug 18 22:14:38.211887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1603/3211] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:38 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:38.456493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b9760112-0c11-4d51-9332-f823ff650fe5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:38.457223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b9760112-0c11-4d51-9332-f823ff650fe5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:38.458126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e72635b1-ab20-4e40-acf3-44ba58457fab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:38.458759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e72635b1-ab20-4e40-acf3-44ba58457fab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:38.463689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9760112-0c11-4d51-9332-f823ff650fe5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:38.464174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9760112-0c11-4d51-9332-f823ff650fe5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:38.464610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9760112-0c11-4d51-9332-f823ff650fe5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:38.465267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e72635b1-ab20-4e40-acf3-44ba58457fab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:38.465414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9760112-0c11-4d51-9332-f823ff650fe5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:38.465773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e72635b1-ab20-4e40-acf3-44ba58457fab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:38.465923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9760112-0c11-4d51-9332-f823ff650fe5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:38.466284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e72635b1-ab20-4e40-acf3-44ba58457fab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:38.466416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9760112-0c11-4d51-9332-f823ff650fe5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:38.467206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e72635b1-ab20-4e40-acf3-44ba58457fab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:38.467661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e72635b1-ab20-4e40-acf3-44ba58457fab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:38.468090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e72635b1-ab20-4e40-acf3-44ba58457fab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:38.596009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e72635b1-ab20-4e40-acf3-44ba58457fab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:38.598354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b9760112-0c11-4d51-9332-f823ff650fe5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:38.604289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e72635b1-ab20-4e40-acf3-44ba58457fab tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150053 Aug 18 22:14:38.604871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1604/3212] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:38 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:38.606536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b9760112-0c11-4d51-9332-f823ff650fe5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154088 Aug 18 22:14:38.610596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1609/3213] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:38 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:38.833483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5a4e1291-e5f7-4cef-83cc-87cf4c3e9dfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:38.834125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5a4e1291-e5f7-4cef-83cc-87cf4c3e9dfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:38.840262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a4e1291-e5f7-4cef-83cc-87cf4c3e9dfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:38.840748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a4e1291-e5f7-4cef-83cc-87cf4c3e9dfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:38.841215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a4e1291-e5f7-4cef-83cc-87cf4c3e9dfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:38.841933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a4e1291-e5f7-4cef-83cc-87cf4c3e9dfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:38.842394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a4e1291-e5f7-4cef-83cc-87cf4c3e9dfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:38.842827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a4e1291-e5f7-4cef-83cc-87cf4c3e9dfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:38.975656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5a4e1291-e5f7-4cef-83cc-87cf4c3e9dfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:38.984274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5a4e1291-e5f7-4cef-83cc-87cf4c3e9dfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:38.985858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5a4e1291-e5f7-4cef-83cc-87cf4c3e9dfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:38.987014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5a4e1291-e5f7-4cef-83cc-87cf4c3e9dfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157449 Aug 18 22:14:38.987579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1605/3214] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:38 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:39.180568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-643bdea7-8b9e-4e8c-8ae0-26b407c1e39d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:39.181180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-643bdea7-8b9e-4e8c-8ae0-26b407c1e39d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:39.188413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-643bdea7-8b9e-4e8c-8ae0-26b407c1e39d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:39.188895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-643bdea7-8b9e-4e8c-8ae0-26b407c1e39d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:39.189332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-643bdea7-8b9e-4e8c-8ae0-26b407c1e39d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:39.190244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-643bdea7-8b9e-4e8c-8ae0-26b407c1e39d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:39.190703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-643bdea7-8b9e-4e8c-8ae0-26b407c1e39d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:39.191129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-643bdea7-8b9e-4e8c-8ae0-26b407c1e39d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:39.232132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c7a60fa2-9e86-431a-8321-8fb1a128b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:39.232722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c7a60fa2-9e86-431a-8321-8fb1a128b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:39.238570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7a60fa2-9e86-431a-8321-8fb1a128b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:39.239053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7a60fa2-9e86-431a-8321-8fb1a128b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:39.239492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7a60fa2-9e86-431a-8321-8fb1a128b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:39.240179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7a60fa2-9e86-431a-8321-8fb1a128b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:39.240629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7a60fa2-9e86-431a-8321-8fb1a128b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:39.241051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7a60fa2-9e86-431a-8321-8fb1a128b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:39.324628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-643bdea7-8b9e-4e8c-8ae0-26b407c1e39d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:39.333521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-643bdea7-8b9e-4e8c-8ae0-26b407c1e39d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156753 Aug 18 22:14:39.334154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1610/3215] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:39.373279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c7a60fa2-9e86-431a-8321-8fb1a128b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:39.381474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c7a60fa2-9e86-431a-8321-8fb1a128b944 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153194 Aug 18 22:14:39.382149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1606/3216] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:39 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:39.626401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a508aa3b-a7c5-423a-b3ea-862217ca7cd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:39.627015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a508aa3b-a7c5-423a-b3ea-862217ca7cd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:39.628084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0bfaa6f2-3e2e-4caf-8e9d-7e3de584000a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:39.628714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0bfaa6f2-3e2e-4caf-8e9d-7e3de584000a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:39.633429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a508aa3b-a7c5-423a-b3ea-862217ca7cd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:39.633938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a508aa3b-a7c5-423a-b3ea-862217ca7cd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:39.634376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a508aa3b-a7c5-423a-b3ea-862217ca7cd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:39.635061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a508aa3b-a7c5-423a-b3ea-862217ca7cd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:39.635189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bfaa6f2-3e2e-4caf-8e9d-7e3de584000a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:39.635504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a508aa3b-a7c5-423a-b3ea-862217ca7cd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:39.635639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bfaa6f2-3e2e-4caf-8e9d-7e3de584000a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:39.635919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a508aa3b-a7c5-423a-b3ea-862217ca7cd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:39.636043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bfaa6f2-3e2e-4caf-8e9d-7e3de584000a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:39.636716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bfaa6f2-3e2e-4caf-8e9d-7e3de584000a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:39.637179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bfaa6f2-3e2e-4caf-8e9d-7e3de584000a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:39.637646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bfaa6f2-3e2e-4caf-8e9d-7e3de584000a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:39.765935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a508aa3b-a7c5-423a-b3ea-862217ca7cd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:39.766587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0bfaa6f2-3e2e-4caf-8e9d-7e3de584000a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:39.774246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a508aa3b-a7c5-423a-b3ea-862217ca7cd3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152643 Aug 18 22:14:39.774572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0bfaa6f2-3e2e-4caf-8e9d-7e3de584000a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150980 Aug 18 22:14:39.774816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1611/3217] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:39 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:39.775591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1607/3218] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:39 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:40.009700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8d3a565b-8459-4d43-bd9c-f08d0345523b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:40.010344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8d3a565b-8459-4d43-bd9c-f08d0345523b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:40.016423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d3a565b-8459-4d43-bd9c-f08d0345523b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:40.016906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d3a565b-8459-4d43-bd9c-f08d0345523b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:40.017351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d3a565b-8459-4d43-bd9c-f08d0345523b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:40.018057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d3a565b-8459-4d43-bd9c-f08d0345523b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:40.018517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d3a565b-8459-4d43-bd9c-f08d0345523b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:40.018941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d3a565b-8459-4d43-bd9c-f08d0345523b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:40.147407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8d3a565b-8459-4d43-bd9c-f08d0345523b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:40.156586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8d3a565b-8459-4d43-bd9c-f08d0345523b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:40.158118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8d3a565b-8459-4d43-bd9c-f08d0345523b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:40.159283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8d3a565b-8459-4d43-bd9c-f08d0345523b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153450 Aug 18 22:14:40.159856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1612/3219] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:40.355010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b7e93be0-1ceb-47f7-9a57-c63f6e7b2f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:40.355643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b7e93be0-1ceb-47f7-9a57-c63f6e7b2f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:40.361790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7e93be0-1ceb-47f7-9a57-c63f6e7b2f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:40.362275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7e93be0-1ceb-47f7-9a57-c63f6e7b2f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:40.362715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7e93be0-1ceb-47f7-9a57-c63f6e7b2f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:40.363408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7e93be0-1ceb-47f7-9a57-c63f6e7b2f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:40.363898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7e93be0-1ceb-47f7-9a57-c63f6e7b2f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:40.364334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b7e93be0-1ceb-47f7-9a57-c63f6e7b2f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:40.403296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-92783d88-6cb9-45f3-bc08-afc6c7483f2a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:40.404538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-92783d88-6cb9-45f3-bc08-afc6c7483f2a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:40.410656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92783d88-6cb9-45f3-bc08-afc6c7483f2a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:40.411146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92783d88-6cb9-45f3-bc08-afc6c7483f2a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:40.411591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92783d88-6cb9-45f3-bc08-afc6c7483f2a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:40.412291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92783d88-6cb9-45f3-bc08-afc6c7483f2a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:40.412752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92783d88-6cb9-45f3-bc08-afc6c7483f2a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:40.413184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92783d88-6cb9-45f3-bc08-afc6c7483f2a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:40.499598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b7e93be0-1ceb-47f7-9a57-c63f6e7b2f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:40.507834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b7e93be0-1ceb-47f7-9a57-c63f6e7b2f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156701 Aug 18 22:14:40.508555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1608/3220] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:40 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:40.542028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-92783d88-6cb9-45f3-bc08-afc6c7483f2a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:40.550235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-92783d88-6cb9-45f3-bc08-afc6c7483f2a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150708 Aug 18 22:14:40.551084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1613/3221] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:40.794841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b0a777af-96cf-41ab-bfa5-9544b01d9066 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:40.795158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-719d1f84-9d4b-495e-87ad-63aa800eca94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:40.795376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b0a777af-96cf-41ab-bfa5-9544b01d9066 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:40.795769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-719d1f84-9d4b-495e-87ad-63aa800eca94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:40.798113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:40.802346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0a777af-96cf-41ab-bfa5-9544b01d9066 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:40.802827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0a777af-96cf-41ab-bfa5-9544b01d9066 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:40.803262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0a777af-96cf-41ab-bfa5-9544b01d9066 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:40.803953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0a777af-96cf-41ab-bfa5-9544b01d9066 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:40.804076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-719d1f84-9d4b-495e-87ad-63aa800eca94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:40.804404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0a777af-96cf-41ab-bfa5-9544b01d9066 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:40.804523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-719d1f84-9d4b-495e-87ad-63aa800eca94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:40.804826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0a777af-96cf-41ab-bfa5-9544b01d9066 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:40.804946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-719d1f84-9d4b-495e-87ad-63aa800eca94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:40.805531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-719d1f84-9d4b-495e-87ad-63aa800eca94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:40.806008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-719d1f84-9d4b-495e-87ad-63aa800eca94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:40.806434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-719d1f84-9d4b-495e-87ad-63aa800eca94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:40.940932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-719d1f84-9d4b-495e-87ad-63aa800eca94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:40.941124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b0a777af-96cf-41ab-bfa5-9544b01d9066 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:40.949256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-719d1f84-9d4b-495e-87ad-63aa800eca94 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.158038 Aug 18 22:14:40.949436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b0a777af-96cf-41ab-bfa5-9544b01d9066 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.158554 Aug 18 22:14:40.949865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1614/3222] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:40 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:40.950282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1609/3223] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:40 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:41.181897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-31005d75-7004-4966-bdff-e520af60a38c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:41.182548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-31005d75-7004-4966-bdff-e520af60a38c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:41.189114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31005d75-7004-4966-bdff-e520af60a38c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:41.189623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31005d75-7004-4966-bdff-e520af60a38c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:41.190068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31005d75-7004-4966-bdff-e520af60a38c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:41.190761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31005d75-7004-4966-bdff-e520af60a38c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:41.191218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31005d75-7004-4966-bdff-e520af60a38c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:41.191646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-31005d75-7004-4966-bdff-e520af60a38c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:41.317157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-31005d75-7004-4966-bdff-e520af60a38c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:41.325903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-31005d75-7004-4966-bdff-e520af60a38c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:41.327410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-31005d75-7004-4966-bdff-e520af60a38c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:41.328568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-31005d75-7004-4966-bdff-e520af60a38c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150616 Aug 18 22:14:41.329139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1615/3224] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:41.530154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-660d9690-239c-43d5-8a46-1992e3054864 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:41.530782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-660d9690-239c-43d5-8a46-1992e3054864 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:41.536793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-660d9690-239c-43d5-8a46-1992e3054864 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:41.537278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-660d9690-239c-43d5-8a46-1992e3054864 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:41.537756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-660d9690-239c-43d5-8a46-1992e3054864 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:41.538452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-660d9690-239c-43d5-8a46-1992e3054864 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:41.538910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-660d9690-239c-43d5-8a46-1992e3054864 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:41.539339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-660d9690-239c-43d5-8a46-1992e3054864 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:41.571937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4ef125c9-3efb-4e77-9f35-7f1f4afb4a4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:41.572652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4ef125c9-3efb-4e77-9f35-7f1f4afb4a4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:41.579567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ef125c9-3efb-4e77-9f35-7f1f4afb4a4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:41.580075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ef125c9-3efb-4e77-9f35-7f1f4afb4a4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:41.580499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ef125c9-3efb-4e77-9f35-7f1f4afb4a4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:41.581232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ef125c9-3efb-4e77-9f35-7f1f4afb4a4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:41.581725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ef125c9-3efb-4e77-9f35-7f1f4afb4a4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:41.582160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4ef125c9-3efb-4e77-9f35-7f1f4afb4a4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:41.667077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-660d9690-239c-43d5-8a46-1992e3054864 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:41.676302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-660d9690-239c-43d5-8a46-1992e3054864 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150273 Aug 18 22:14:41.676888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1610/3225] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:41 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:41.714826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4ef125c9-3efb-4e77-9f35-7f1f4afb4a4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:41.723841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4ef125c9-3efb-4e77-9f35-7f1f4afb4a4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155602 Aug 18 22:14:41.724401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1616/3226] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:41.970049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6c8f393c-824a-4e56-9f90-b29b1315cf54 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:41.970422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bb803d22-0de3-4feb-b603-39087a095b7e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:41.970674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6c8f393c-824a-4e56-9f90-b29b1315cf54 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:41.971070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bb803d22-0de3-4feb-b603-39087a095b7e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:41.977340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c8f393c-824a-4e56-9f90-b29b1315cf54 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:41.977524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb803d22-0de3-4feb-b603-39087a095b7e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:41.977876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c8f393c-824a-4e56-9f90-b29b1315cf54 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:41.978048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb803d22-0de3-4feb-b603-39087a095b7e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:41.978323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c8f393c-824a-4e56-9f90-b29b1315cf54 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:41.978639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb803d22-0de3-4feb-b603-39087a095b7e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:41.979054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c8f393c-824a-4e56-9f90-b29b1315cf54 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:41.979342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb803d22-0de3-4feb-b603-39087a095b7e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:41.979517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c8f393c-824a-4e56-9f90-b29b1315cf54 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:41.979801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb803d22-0de3-4feb-b603-39087a095b7e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:41.979951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6c8f393c-824a-4e56-9f90-b29b1315cf54 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:41.980410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bb803d22-0de3-4feb-b603-39087a095b7e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:42.115909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6c8f393c-824a-4e56-9f90-b29b1315cf54 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:42.116255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bb803d22-0de3-4feb-b603-39087a095b7e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:42.124747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6c8f393c-824a-4e56-9f90-b29b1315cf54 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.159235 Aug 18 22:14:42.125529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1611/3227] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:41 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:42.127043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bb803d22-0de3-4feb-b603-39087a095b7e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.160899 Aug 18 22:14:42.127903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1617/3228] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:41 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:42.351623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ecbd174a-1612-4618-94dd-968f66ada6c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:42.352240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ecbd174a-1612-4618-94dd-968f66ada6c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:42.358166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecbd174a-1612-4618-94dd-968f66ada6c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:42.358654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecbd174a-1612-4618-94dd-968f66ada6c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:42.359093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecbd174a-1612-4618-94dd-968f66ada6c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:42.359805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecbd174a-1612-4618-94dd-968f66ada6c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:42.360244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecbd174a-1612-4618-94dd-968f66ada6c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:42.360676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecbd174a-1612-4618-94dd-968f66ada6c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:42.488555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ecbd174a-1612-4618-94dd-968f66ada6c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:42.497902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ecbd174a-1612-4618-94dd-968f66ada6c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:42.499469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ecbd174a-1612-4618-94dd-968f66ada6c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:42.500648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ecbd174a-1612-4618-94dd-968f66ada6c3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152977 Aug 18 22:14:42.501216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1612/3229] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:42.697924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-811db623-6bdf-4040-a2e4-6c3563f79b7d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:42.698457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-811db623-6bdf-4040-a2e4-6c3563f79b7d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:42.704465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-811db623-6bdf-4040-a2e4-6c3563f79b7d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:42.704952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-811db623-6bdf-4040-a2e4-6c3563f79b7d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:42.705385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-811db623-6bdf-4040-a2e4-6c3563f79b7d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:42.706098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-811db623-6bdf-4040-a2e4-6c3563f79b7d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:42.706555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-811db623-6bdf-4040-a2e4-6c3563f79b7d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:42.706981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-811db623-6bdf-4040-a2e4-6c3563f79b7d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:42.744117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-86710f94-fe06-4acd-940d-30e0e34c5b19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:42.745385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-86710f94-fe06-4acd-940d-30e0e34c5b19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:42.752154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86710f94-fe06-4acd-940d-30e0e34c5b19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:42.752731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86710f94-fe06-4acd-940d-30e0e34c5b19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:42.753246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86710f94-fe06-4acd-940d-30e0e34c5b19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:42.754052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86710f94-fe06-4acd-940d-30e0e34c5b19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:42.754635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86710f94-fe06-4acd-940d-30e0e34c5b19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:42.755134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-86710f94-fe06-4acd-940d-30e0e34c5b19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:42.834915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-811db623-6bdf-4040-a2e4-6c3563f79b7d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:42.844210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-811db623-6bdf-4040-a2e4-6c3563f79b7d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150291 Aug 18 22:14:42.844795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1618/3230] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:42.887731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-86710f94-fe06-4acd-940d-30e0e34c5b19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:42.895814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-86710f94-fe06-4acd-940d-30e0e34c5b19 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155485 Aug 18 22:14:42.896388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1613/3231] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:42 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:43.147429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d6e75ecd-088e-45ef-a291-98538bc7ce20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:43.147969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d6e75ecd-088e-45ef-a291-98538bc7ce20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:43.150610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0fbb1822-ea6c-4a22-907c-b68aeb18ba36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:43.151575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0fbb1822-ea6c-4a22-907c-b68aeb18ba36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:43.156119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6e75ecd-088e-45ef-a291-98538bc7ce20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:43.157072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6e75ecd-088e-45ef-a291-98538bc7ce20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:43.157789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6e75ecd-088e-45ef-a291-98538bc7ce20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:43.158561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fbb1822-ea6c-4a22-907c-b68aeb18ba36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:43.158766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6e75ecd-088e-45ef-a291-98538bc7ce20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:43.159057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fbb1822-ea6c-4a22-907c-b68aeb18ba36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:43.159399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6e75ecd-088e-45ef-a291-98538bc7ce20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:43.159511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fbb1822-ea6c-4a22-907c-b68aeb18ba36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:43.159929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6e75ecd-088e-45ef-a291-98538bc7ce20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:43.160196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fbb1822-ea6c-4a22-907c-b68aeb18ba36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:43.160691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fbb1822-ea6c-4a22-907c-b68aeb18ba36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:43.161126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0fbb1822-ea6c-4a22-907c-b68aeb18ba36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:43.291025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0fbb1822-ea6c-4a22-907c-b68aeb18ba36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:43.293879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d6e75ecd-088e-45ef-a291-98538bc7ce20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:43.299408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0fbb1822-ea6c-4a22-907c-b68aeb18ba36 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154939 Aug 18 22:14:43.299997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1614/3232] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:43 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:43.302677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d6e75ecd-088e-45ef-a291-98538bc7ce20 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.159920 Aug 18 22:14:43.303252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1619/3233] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:43 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:43.523722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b6392d33-ee51-49b7-a31d-aeb609f384e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:43.524348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b6392d33-ee51-49b7-a31d-aeb609f384e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:43.530981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6392d33-ee51-49b7-a31d-aeb609f384e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:43.531466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6392d33-ee51-49b7-a31d-aeb609f384e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:43.531937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6392d33-ee51-49b7-a31d-aeb609f384e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:43.532627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6392d33-ee51-49b7-a31d-aeb609f384e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:43.533086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6392d33-ee51-49b7-a31d-aeb609f384e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:43.533519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6392d33-ee51-49b7-a31d-aeb609f384e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:43.661520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b6392d33-ee51-49b7-a31d-aeb609f384e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:43.670154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b6392d33-ee51-49b7-a31d-aeb609f384e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:43.671671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b6392d33-ee51-49b7-a31d-aeb609f384e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:43.672822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b6392d33-ee51-49b7-a31d-aeb609f384e2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153076 Aug 18 22:14:43.673386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1615/3234] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:43.866091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c5b84572-992d-41cd-bc00-c2853abd5859 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:43.866648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c5b84572-992d-41cd-bc00-c2853abd5859 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:43.873053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5b84572-992d-41cd-bc00-c2853abd5859 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:43.873521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5b84572-992d-41cd-bc00-c2853abd5859 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:43.873972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5b84572-992d-41cd-bc00-c2853abd5859 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:43.874647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5b84572-992d-41cd-bc00-c2853abd5859 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:43.875171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5b84572-992d-41cd-bc00-c2853abd5859 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:43.875598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5b84572-992d-41cd-bc00-c2853abd5859 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:43.890744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:43.917492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-00fa11fe-0de1-4ba6-9a42-3770b29400cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:43.918147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-00fa11fe-0de1-4ba6-9a42-3770b29400cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:43.924850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00fa11fe-0de1-4ba6-9a42-3770b29400cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:43.925340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00fa11fe-0de1-4ba6-9a42-3770b29400cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:43.925811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00fa11fe-0de1-4ba6-9a42-3770b29400cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:43.926774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00fa11fe-0de1-4ba6-9a42-3770b29400cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:43.927230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00fa11fe-0de1-4ba6-9a42-3770b29400cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:43.927658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00fa11fe-0de1-4ba6-9a42-3770b29400cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:44.003929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c5b84572-992d-41cd-bc00-c2853abd5859 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:44.012172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c5b84572-992d-41cd-bc00-c2853abd5859 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149951 Aug 18 22:14:44.012751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1620/3235] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:43 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:44.055938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-00fa11fe-0de1-4ba6-9a42-3770b29400cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:44.064771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-00fa11fe-0de1-4ba6-9a42-3770b29400cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151103 Aug 18 22:14:44.065348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1616/3236] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:43 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:44.320519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5d6553fa-8abb-4d59-9455-b58e6f7781f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:44.321136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5d6553fa-8abb-4d59-9455-b58e6f7781f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:44.323076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e3c3da3d-07d7-4401-bc85-0f2384a31a04 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:44.323685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e3c3da3d-07d7-4401-bc85-0f2384a31a04 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:44.327625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d6553fa-8abb-4d59-9455-b58e6f7781f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:44.328107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d6553fa-8abb-4d59-9455-b58e6f7781f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:44.328544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d6553fa-8abb-4d59-9455-b58e6f7781f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:44.329243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d6553fa-8abb-4d59-9455-b58e6f7781f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:44.329726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d6553fa-8abb-4d59-9455-b58e6f7781f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:44.330155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d6553fa-8abb-4d59-9455-b58e6f7781f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:44.330388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3c3da3d-07d7-4401-bc85-0f2384a31a04 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:44.330865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3c3da3d-07d7-4401-bc85-0f2384a31a04 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:44.331297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3c3da3d-07d7-4401-bc85-0f2384a31a04 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:44.331981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3c3da3d-07d7-4401-bc85-0f2384a31a04 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:44.332431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3c3da3d-07d7-4401-bc85-0f2384a31a04 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:44.332851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3c3da3d-07d7-4401-bc85-0f2384a31a04 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:44.458188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e3c3da3d-07d7-4401-bc85-0f2384a31a04 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:44.461910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5d6553fa-8abb-4d59-9455-b58e6f7781f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:44.467110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e3c3da3d-07d7-4401-bc85-0f2384a31a04 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147731 Aug 18 22:14:44.468015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1617/3237] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:44.470850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5d6553fa-8abb-4d59-9455-b58e6f7781f5 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154267 Aug 18 22:14:44.471422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1621/3238] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:44 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:44.696107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ab12bc70-0470-43c8-a7ea-d42d8df1d84d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:44.696727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ab12bc70-0470-43c8-a7ea-d42d8df1d84d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:44.703341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab12bc70-0470-43c8-a7ea-d42d8df1d84d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:44.703832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab12bc70-0470-43c8-a7ea-d42d8df1d84d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:44.704275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab12bc70-0470-43c8-a7ea-d42d8df1d84d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:44.704970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab12bc70-0470-43c8-a7ea-d42d8df1d84d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:44.705430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab12bc70-0470-43c8-a7ea-d42d8df1d84d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:44.705942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab12bc70-0470-43c8-a7ea-d42d8df1d84d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:44.835793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ab12bc70-0470-43c8-a7ea-d42d8df1d84d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:44.844979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ab12bc70-0470-43c8-a7ea-d42d8df1d84d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:44.846520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ab12bc70-0470-43c8-a7ea-d42d8df1d84d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:44.847675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ab12bc70-0470-43c8-a7ea-d42d8df1d84d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155450 Aug 18 22:14:44.848240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1618/3239] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:45.033918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ceca114c-6dd4-4925-9f34-77598b43bef4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:45.034543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ceca114c-6dd4-4925-9f34-77598b43bef4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:45.040522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ceca114c-6dd4-4925-9f34-77598b43bef4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:45.041003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ceca114c-6dd4-4925-9f34-77598b43bef4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:45.041440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ceca114c-6dd4-4925-9f34-77598b43bef4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:45.042188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ceca114c-6dd4-4925-9f34-77598b43bef4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:45.042644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ceca114c-6dd4-4925-9f34-77598b43bef4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:45.043072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ceca114c-6dd4-4925-9f34-77598b43bef4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:45.085672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0d56ec96-2dd2-461d-ab8b-0236433d9e57 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:45.086572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0d56ec96-2dd2-461d-ab8b-0236433d9e57 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:45.092787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d56ec96-2dd2-461d-ab8b-0236433d9e57 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:45.093270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d56ec96-2dd2-461d-ab8b-0236433d9e57 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:45.093807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d56ec96-2dd2-461d-ab8b-0236433d9e57 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:45.094499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d56ec96-2dd2-461d-ab8b-0236433d9e57 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:45.094952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d56ec96-2dd2-461d-ab8b-0236433d9e57 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:45.095376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0d56ec96-2dd2-461d-ab8b-0236433d9e57 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:45.097896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:45.171718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ceca114c-6dd4-4925-9f34-77598b43bef4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:45.180528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ceca114c-6dd4-4925-9f34-77598b43bef4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151062 Aug 18 22:14:45.181189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1622/3240] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:45 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:45.224827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0d56ec96-2dd2-461d-ab8b-0236433d9e57 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:45.233438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0d56ec96-2dd2-461d-ab8b-0236433d9e57 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151597 Aug 18 22:14:45.234039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1619/3241] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:45 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:45.488683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-712f4906-8816-4886-81eb-ca7c20032fd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:45.489282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-712f4906-8816-4886-81eb-ca7c20032fd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:45.492071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fdc08233-173f-4b96-9ce2-95a19dae538e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:45.492696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fdc08233-173f-4b96-9ce2-95a19dae538e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:45.495450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-712f4906-8816-4886-81eb-ca7c20032fd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:45.495931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-712f4906-8816-4886-81eb-ca7c20032fd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:45.496371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-712f4906-8816-4886-81eb-ca7c20032fd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:45.497070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-712f4906-8816-4886-81eb-ca7c20032fd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:45.497646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-712f4906-8816-4886-81eb-ca7c20032fd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:45.498378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-712f4906-8816-4886-81eb-ca7c20032fd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:45.500221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdc08233-173f-4b96-9ce2-95a19dae538e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:45.500710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdc08233-173f-4b96-9ce2-95a19dae538e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:45.501177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdc08233-173f-4b96-9ce2-95a19dae538e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:45.501941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdc08233-173f-4b96-9ce2-95a19dae538e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:45.502512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdc08233-173f-4b96-9ce2-95a19dae538e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:45.502973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdc08233-173f-4b96-9ce2-95a19dae538e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:45.626914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-712f4906-8816-4886-81eb-ca7c20032fd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:45.633672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fdc08233-173f-4b96-9ce2-95a19dae538e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:45.635224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-712f4906-8816-4886-81eb-ca7c20032fd2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150566 Aug 18 22:14:45.635806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1623/3242] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:45 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:45.641979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fdc08233-173f-4b96-9ce2-95a19dae538e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153680 Aug 18 22:14:45.642551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1620/3243] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:45 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:45.870159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-20478638-009d-4a5b-b2f5-e737f7b1dd4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:45.870777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-20478638-009d-4a5b-b2f5-e737f7b1dd4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:45.876641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20478638-009d-4a5b-b2f5-e737f7b1dd4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:45.877107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20478638-009d-4a5b-b2f5-e737f7b1dd4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:45.877554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20478638-009d-4a5b-b2f5-e737f7b1dd4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:45.878249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20478638-009d-4a5b-b2f5-e737f7b1dd4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:45.878696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20478638-009d-4a5b-b2f5-e737f7b1dd4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:45.879110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20478638-009d-4a5b-b2f5-e737f7b1dd4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:46.007648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-20478638-009d-4a5b-b2f5-e737f7b1dd4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:46.016284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-20478638-009d-4a5b-b2f5-e737f7b1dd4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:46.017826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-20478638-009d-4a5b-b2f5-e737f7b1dd4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:46.018985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-20478638-009d-4a5b-b2f5-e737f7b1dd4e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152666 Aug 18 22:14:46.019553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1624/3244] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:45 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:46.204245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4e2a7538-9813-4c46-b85f-8aa0849e0e20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:46.204803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4e2a7538-9813-4c46-b85f-8aa0849e0e20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:46.210764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e2a7538-9813-4c46-b85f-8aa0849e0e20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:46.211241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e2a7538-9813-4c46-b85f-8aa0849e0e20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:46.211674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e2a7538-9813-4c46-b85f-8aa0849e0e20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:46.212353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e2a7538-9813-4c46-b85f-8aa0849e0e20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:46.212803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e2a7538-9813-4c46-b85f-8aa0849e0e20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:46.213226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e2a7538-9813-4c46-b85f-8aa0849e0e20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:46.255152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-67e82db8-0439-472f-bde5-e9d94d2dd32b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:46.255801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-67e82db8-0439-472f-bde5-e9d94d2dd32b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:46.262268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67e82db8-0439-472f-bde5-e9d94d2dd32b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:46.262755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67e82db8-0439-472f-bde5-e9d94d2dd32b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:46.263195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67e82db8-0439-472f-bde5-e9d94d2dd32b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:46.263904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67e82db8-0439-472f-bde5-e9d94d2dd32b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:46.264861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67e82db8-0439-472f-bde5-e9d94d2dd32b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:46.265289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-67e82db8-0439-472f-bde5-e9d94d2dd32b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:46.341866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4e2a7538-9813-4c46-b85f-8aa0849e0e20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:46.351209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4e2a7538-9813-4c46-b85f-8aa0849e0e20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151340 Aug 18 22:14:46.351917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1621/3245] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:46 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:46.401773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-67e82db8-0439-472f-bde5-e9d94d2dd32b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:46.410539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-67e82db8-0439-472f-bde5-e9d94d2dd32b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159201 Aug 18 22:14:46.411122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1625/3246] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:46.656350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b526c982-8194-438e-a819-77dc7012758e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:46.656975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b526c982-8194-438e-a819-77dc7012758e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:46.662392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d5e53aab-0f7f-4c03-986c-70c6dfb9aa72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:46.663201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d5e53aab-0f7f-4c03-986c-70c6dfb9aa72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:46.663610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b526c982-8194-438e-a819-77dc7012758e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:46.664106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b526c982-8194-438e-a819-77dc7012758e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:46.664610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b526c982-8194-438e-a819-77dc7012758e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:46.665304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b526c982-8194-438e-a819-77dc7012758e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:46.665793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b526c982-8194-438e-a819-77dc7012758e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:46.666223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b526c982-8194-438e-a819-77dc7012758e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:46.668983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5e53aab-0f7f-4c03-986c-70c6dfb9aa72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:46.669527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5e53aab-0f7f-4c03-986c-70c6dfb9aa72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:46.669996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5e53aab-0f7f-4c03-986c-70c6dfb9aa72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:46.670679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5e53aab-0f7f-4c03-986c-70c6dfb9aa72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:46.671129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5e53aab-0f7f-4c03-986c-70c6dfb9aa72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:46.671551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5e53aab-0f7f-4c03-986c-70c6dfb9aa72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:46.794638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b526c982-8194-438e-a819-77dc7012758e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:46.801448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d5e53aab-0f7f-4c03-986c-70c6dfb9aa72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:46.803120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b526c982-8194-438e-a819-77dc7012758e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150565 Aug 18 22:14:46.803704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1622/3247] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:46 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:46.809896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d5e53aab-0f7f-4c03-986c-70c6dfb9aa72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151162 Aug 18 22:14:46.810803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1626/3248] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:46 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:47.042138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1f0d77ba-ceaa-4bff-ada8-dce5ddab7734 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:47.042751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1f0d77ba-ceaa-4bff-ada8-dce5ddab7734 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:47.049176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f0d77ba-ceaa-4bff-ada8-dce5ddab7734 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:47.049682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f0d77ba-ceaa-4bff-ada8-dce5ddab7734 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:47.050117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f0d77ba-ceaa-4bff-ada8-dce5ddab7734 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:47.050796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f0d77ba-ceaa-4bff-ada8-dce5ddab7734 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:47.051511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f0d77ba-ceaa-4bff-ada8-dce5ddab7734 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:47.051931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f0d77ba-ceaa-4bff-ada8-dce5ddab7734 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:47.181458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1f0d77ba-ceaa-4bff-ada8-dce5ddab7734 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:47.190687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1f0d77ba-ceaa-4bff-ada8-dce5ddab7734 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:47.192201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1f0d77ba-ceaa-4bff-ada8-dce5ddab7734 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:47.193365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1f0d77ba-ceaa-4bff-ada8-dce5ddab7734 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155118 Aug 18 22:14:47.193960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1623/3249] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:47 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:47.372142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3e2efeb8-eb91-40b4-8b0d-1c337e4a39ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:47.372827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3e2efeb8-eb91-40b4-8b0d-1c337e4a39ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:47.379194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3e2efeb8-eb91-40b4-8b0d-1c337e4a39ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:47.379681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3e2efeb8-eb91-40b4-8b0d-1c337e4a39ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:47.380130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3e2efeb8-eb91-40b4-8b0d-1c337e4a39ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:47.380824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3e2efeb8-eb91-40b4-8b0d-1c337e4a39ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:47.381281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3e2efeb8-eb91-40b4-8b0d-1c337e4a39ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:47.381809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3e2efeb8-eb91-40b4-8b0d-1c337e4a39ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:47.432332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9c0f19bf-cddd-45a6-ac39-b6d6ee9108d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:47.432954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9c0f19bf-cddd-45a6-ac39-b6d6ee9108d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:47.439033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c0f19bf-cddd-45a6-ac39-b6d6ee9108d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:47.439517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c0f19bf-cddd-45a6-ac39-b6d6ee9108d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:47.439948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c0f19bf-cddd-45a6-ac39-b6d6ee9108d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:47.440636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c0f19bf-cddd-45a6-ac39-b6d6ee9108d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:47.441088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c0f19bf-cddd-45a6-ac39-b6d6ee9108d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:47.441511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c0f19bf-cddd-45a6-ac39-b6d6ee9108d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:47.512168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3e2efeb8-eb91-40b4-8b0d-1c337e4a39ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:47.520411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3e2efeb8-eb91-40b4-8b0d-1c337e4a39ec tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152054 Aug 18 22:14:47.520988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1627/3250] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:47 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:47.568907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9c0f19bf-cddd-45a6-ac39-b6d6ee9108d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:47.577125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9c0f19bf-cddd-45a6-ac39-b6d6ee9108d7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148721 Aug 18 22:14:47.577845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1624/3251] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:47.824719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae06e3ce-f3cb-4650-8e70-6cac04f059b6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:47.825408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ae06e3ce-f3cb-4650-8e70-6cac04f059b6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:47.831967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3a3b5908-d02b-46a0-a5dc-a8296581f0e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:47.832169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae06e3ce-f3cb-4650-8e70-6cac04f059b6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:47.832454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae06e3ce-f3cb-4650-8e70-6cac04f059b6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:47.832574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3a3b5908-d02b-46a0-a5dc-a8296581f0e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:47.832895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae06e3ce-f3cb-4650-8e70-6cac04f059b6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:47.833590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae06e3ce-f3cb-4650-8e70-6cac04f059b6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:47.834070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae06e3ce-f3cb-4650-8e70-6cac04f059b6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:47.834501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae06e3ce-f3cb-4650-8e70-6cac04f059b6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:47.839109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a3b5908-d02b-46a0-a5dc-a8296581f0e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:47.839623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a3b5908-d02b-46a0-a5dc-a8296581f0e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:47.840065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a3b5908-d02b-46a0-a5dc-a8296581f0e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:47.840757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a3b5908-d02b-46a0-a5dc-a8296581f0e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:47.841212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a3b5908-d02b-46a0-a5dc-a8296581f0e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:47.841660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a3b5908-d02b-46a0-a5dc-a8296581f0e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:47.970601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ae06e3ce-f3cb-4650-8e70-6cac04f059b6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:47.974537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3a3b5908-d02b-46a0-a5dc-a8296581f0e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:47.978832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ae06e3ce-f3cb-4650-8e70-6cac04f059b6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.157954 Aug 18 22:14:47.979418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1628/3252] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:47 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:47.982888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3a3b5908-d02b-46a0-a5dc-a8296581f0e6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154832 Aug 18 22:14:47.983453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1625/3253] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:47 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:48.215927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-96512c7e-197d-49e9-a8c9-55805ac06c0e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:48.216537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-96512c7e-197d-49e9-a8c9-55805ac06c0e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:48.223926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96512c7e-197d-49e9-a8c9-55805ac06c0e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:48.224422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96512c7e-197d-49e9-a8c9-55805ac06c0e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:48.224863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96512c7e-197d-49e9-a8c9-55805ac06c0e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:48.225549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96512c7e-197d-49e9-a8c9-55805ac06c0e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:48.226021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96512c7e-197d-49e9-a8c9-55805ac06c0e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:48.226443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96512c7e-197d-49e9-a8c9-55805ac06c0e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:48.352288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-96512c7e-197d-49e9-a8c9-55805ac06c0e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:48.360831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-96512c7e-197d-49e9-a8c9-55805ac06c0e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:48.362368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-96512c7e-197d-49e9-a8c9-55805ac06c0e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:48.363520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-96512c7e-197d-49e9-a8c9-55805ac06c0e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151521 Aug 18 22:14:48.364080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1629/3254] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:48.542028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e67ba998-7261-4ef4-9636-1342f2378e54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:48.542650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e67ba998-7261-4ef4-9636-1342f2378e54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:48.553014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e67ba998-7261-4ef4-9636-1342f2378e54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:48.553477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e67ba998-7261-4ef4-9636-1342f2378e54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:48.553941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e67ba998-7261-4ef4-9636-1342f2378e54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:48.554631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e67ba998-7261-4ef4-9636-1342f2378e54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:48.555085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e67ba998-7261-4ef4-9636-1342f2378e54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:48.555510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e67ba998-7261-4ef4-9636-1342f2378e54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:48.598666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6122d837-96b4-4a2f-a59e-2df0003da8c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:48.599286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6122d837-96b4-4a2f-a59e-2df0003da8c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:48.605589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6122d837-96b4-4a2f-a59e-2df0003da8c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:48.606100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6122d837-96b4-4a2f-a59e-2df0003da8c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:48.606540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6122d837-96b4-4a2f-a59e-2df0003da8c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:48.607237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6122d837-96b4-4a2f-a59e-2df0003da8c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:48.608266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6122d837-96b4-4a2f-a59e-2df0003da8c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:48.608940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6122d837-96b4-4a2f-a59e-2df0003da8c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:48.692268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e67ba998-7261-4ef4-9636-1342f2378e54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:48.700220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e67ba998-7261-4ef4-9636-1342f2378e54 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.162008 Aug 18 22:14:48.701252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1626/3255] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:48 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:48.738291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6122d837-96b4-4a2f-a59e-2df0003da8c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:48.746410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6122d837-96b4-4a2f-a59e-2df0003da8c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151638 Aug 18 22:14:48.746978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1630/3256] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:48 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:48.999976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ecee6e30-3ea2-4839-82d3-938ade10b462 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:49.000523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ecee6e30-3ea2-4839-82d3-938ade10b462 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:49.003450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9d8e7c42-92ef-45cc-bd0e-4ac3229f91d2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:49.004070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9d8e7c42-92ef-45cc-bd0e-4ac3229f91d2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:49.007118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecee6e30-3ea2-4839-82d3-938ade10b462 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:49.007616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecee6e30-3ea2-4839-82d3-938ade10b462 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:49.008062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecee6e30-3ea2-4839-82d3-938ade10b462 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:49.008771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecee6e30-3ea2-4839-82d3-938ade10b462 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:49.009233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecee6e30-3ea2-4839-82d3-938ade10b462 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:49.009689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecee6e30-3ea2-4839-82d3-938ade10b462 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:49.009841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d8e7c42-92ef-45cc-bd0e-4ac3229f91d2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:49.010323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d8e7c42-92ef-45cc-bd0e-4ac3229f91d2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:49.010760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d8e7c42-92ef-45cc-bd0e-4ac3229f91d2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:49.011508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d8e7c42-92ef-45cc-bd0e-4ac3229f91d2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:49.011968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d8e7c42-92ef-45cc-bd0e-4ac3229f91d2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:49.012396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d8e7c42-92ef-45cc-bd0e-4ac3229f91d2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:49.142560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ecee6e30-3ea2-4839-82d3-938ade10b462 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:49.143174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9d8e7c42-92ef-45cc-bd0e-4ac3229f91d2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:49.151044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ecee6e30-3ea2-4839-82d3-938ade10b462 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154989 Aug 18 22:14:49.151228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9d8e7c42-92ef-45cc-bd0e-4ac3229f91d2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151727 Aug 18 22:14:49.151965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1627/3257] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:48 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:49.152079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1631/3258] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:48 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:49.386092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-de2923e2-6d79-41d6-818c-39eca1f4d6e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:49.386702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-de2923e2-6d79-41d6-818c-39eca1f4d6e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:49.393109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de2923e2-6d79-41d6-818c-39eca1f4d6e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:49.393587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de2923e2-6d79-41d6-818c-39eca1f4d6e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:49.394051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de2923e2-6d79-41d6-818c-39eca1f4d6e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:49.394731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de2923e2-6d79-41d6-818c-39eca1f4d6e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:49.395180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de2923e2-6d79-41d6-818c-39eca1f4d6e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:49.395598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de2923e2-6d79-41d6-818c-39eca1f4d6e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:49.522588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-de2923e2-6d79-41d6-818c-39eca1f4d6e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:49.531899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-de2923e2-6d79-41d6-818c-39eca1f4d6e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:49.533419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-de2923e2-6d79-41d6-818c-39eca1f4d6e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:49.534592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-de2923e2-6d79-41d6-818c-39eca1f4d6e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152403 Aug 18 22:14:49.535147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1628/3259] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:49.721819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-24bae80c-f46b-4a8f-a019-cf9a13db824c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:49.722446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-24bae80c-f46b-4a8f-a019-cf9a13db824c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:49.729008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24bae80c-f46b-4a8f-a019-cf9a13db824c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:49.729496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24bae80c-f46b-4a8f-a019-cf9a13db824c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:49.729972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24bae80c-f46b-4a8f-a019-cf9a13db824c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:49.730662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24bae80c-f46b-4a8f-a019-cf9a13db824c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:49.731122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24bae80c-f46b-4a8f-a019-cf9a13db824c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:49.731550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24bae80c-f46b-4a8f-a019-cf9a13db824c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:49.768727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-99435752-d885-4408-9a71-91cbc18388fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:49.769348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-99435752-d885-4408-9a71-91cbc18388fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:49.775687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99435752-d885-4408-9a71-91cbc18388fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:49.776178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99435752-d885-4408-9a71-91cbc18388fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:49.776619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99435752-d885-4408-9a71-91cbc18388fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:49.777318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99435752-d885-4408-9a71-91cbc18388fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:49.777806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99435752-d885-4408-9a71-91cbc18388fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:49.778252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99435752-d885-4408-9a71-91cbc18388fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:49.859431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-24bae80c-f46b-4a8f-a019-cf9a13db824c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:49.867632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-24bae80c-f46b-4a8f-a019-cf9a13db824c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149683 Aug 18 22:14:49.868234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1632/3260] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:49 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:49.908873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-99435752-d885-4408-9a71-91cbc18388fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:49.916927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-99435752-d885-4408-9a71-91cbc18388fe tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152710 Aug 18 22:14:49.917501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1629/3261] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:49 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:50.173001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8d2424e9-921e-4798-afb4-06a493aec77d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:50.173239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d195fd78-a69e-424a-a60c-99d287a21813 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:50.173620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8d2424e9-921e-4798-afb4-06a493aec77d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:50.173777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d195fd78-a69e-424a-a60c-99d287a21813 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:50.179835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d2424e9-921e-4798-afb4-06a493aec77d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:50.180307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d2424e9-921e-4798-afb4-06a493aec77d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:50.180436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d195fd78-a69e-424a-a60c-99d287a21813 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:50.180737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d2424e9-921e-4798-afb4-06a493aec77d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:50.180849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d195fd78-a69e-424a-a60c-99d287a21813 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:50.181245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d195fd78-a69e-424a-a60c-99d287a21813 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:50.181419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d2424e9-921e-4798-afb4-06a493aec77d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:50.181894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d2424e9-921e-4798-afb4-06a493aec77d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:50.182006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d195fd78-a69e-424a-a60c-99d287a21813 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:50.182312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d2424e9-921e-4798-afb4-06a493aec77d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:50.182421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d195fd78-a69e-424a-a60c-99d287a21813 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:50.182844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d195fd78-a69e-424a-a60c-99d287a21813 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:50.315776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8d2424e9-921e-4798-afb4-06a493aec77d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:50.316713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d195fd78-a69e-424a-a60c-99d287a21813 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:50.324050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8d2424e9-921e-4798-afb4-06a493aec77d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155498 Aug 18 22:14:50.324632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1633/3262] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:50.324923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d195fd78-a69e-424a-a60c-99d287a21813 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156099 Aug 18 22:14:50.326100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1630/3263] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:50 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:50.556373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-deda5c32-8f2d-4c8b-9363-968aed2f7fb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:50.556997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-deda5c32-8f2d-4c8b-9363-968aed2f7fb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:50.562877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-deda5c32-8f2d-4c8b-9363-968aed2f7fb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:50.563363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-deda5c32-8f2d-4c8b-9363-968aed2f7fb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:50.563803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-deda5c32-8f2d-4c8b-9363-968aed2f7fb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:50.564495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-deda5c32-8f2d-4c8b-9363-968aed2f7fb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:50.564949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-deda5c32-8f2d-4c8b-9363-968aed2f7fb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:50.565373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-deda5c32-8f2d-4c8b-9363-968aed2f7fb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:50.691786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-deda5c32-8f2d-4c8b-9363-968aed2f7fb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:50.700386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-deda5c32-8f2d-4c8b-9363-968aed2f7fb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:50.701960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-deda5c32-8f2d-4c8b-9363-968aed2f7fb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:50.703612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-deda5c32-8f2d-4c8b-9363-968aed2f7fb4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151042 Aug 18 22:14:50.704170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1634/3264] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:50.889810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3d7db0c9-7e16-44d6-95be-9242815b7727 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:50.890965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3d7db0c9-7e16-44d6-95be-9242815b7727 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:50.896775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d7db0c9-7e16-44d6-95be-9242815b7727 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:50.897255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d7db0c9-7e16-44d6-95be-9242815b7727 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:50.897829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d7db0c9-7e16-44d6-95be-9242815b7727 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:50.898517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d7db0c9-7e16-44d6-95be-9242815b7727 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:50.898968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d7db0c9-7e16-44d6-95be-9242815b7727 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:50.899393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d7db0c9-7e16-44d6-95be-9242815b7727 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:50.939147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c4933559-34ed-4c6e-9aff-9ce5cbeb2b78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:50.939760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c4933559-34ed-4c6e-9aff-9ce5cbeb2b78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:50.946259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4933559-34ed-4c6e-9aff-9ce5cbeb2b78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:50.946807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4933559-34ed-4c6e-9aff-9ce5cbeb2b78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:50.947321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4933559-34ed-4c6e-9aff-9ce5cbeb2b78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:50.948036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4933559-34ed-4c6e-9aff-9ce5cbeb2b78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:50.948485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4933559-34ed-4c6e-9aff-9ce5cbeb2b78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:50.948907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4933559-34ed-4c6e-9aff-9ce5cbeb2b78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:51.028479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3d7db0c9-7e16-44d6-95be-9242815b7727 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:51.036965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3d7db0c9-7e16-44d6-95be-9242815b7727 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151138 Aug 18 22:14:51.037543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1631/3265] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:50 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:51.077505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c4933559-34ed-4c6e-9aff-9ce5cbeb2b78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:51.086207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c4933559-34ed-4c6e-9aff-9ce5cbeb2b78 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150868 Aug 18 22:14:51.086778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1635/3266] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:50 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:51.345081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-03a4c0f5-1026-4412-8987-cbc144ae57f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:51.345397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9d4a4e4d-089c-4624-8638-b570188d37d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:51.345726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-03a4c0f5-1026-4412-8987-cbc144ae57f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:51.346037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9d4a4e4d-089c-4624-8638-b570188d37d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:51.352225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d4a4e4d-089c-4624-8638-b570188d37d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:51.352386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03a4c0f5-1026-4412-8987-cbc144ae57f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:51.352711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d4a4e4d-089c-4624-8638-b570188d37d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:51.352836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03a4c0f5-1026-4412-8987-cbc144ae57f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:51.353147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d4a4e4d-089c-4624-8638-b570188d37d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:51.353308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03a4c0f5-1026-4412-8987-cbc144ae57f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:51.353870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d4a4e4d-089c-4624-8638-b570188d37d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:51.353999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03a4c0f5-1026-4412-8987-cbc144ae57f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:51.354319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d4a4e4d-089c-4624-8638-b570188d37d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:51.354445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03a4c0f5-1026-4412-8987-cbc144ae57f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:51.354742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d4a4e4d-089c-4624-8638-b570188d37d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:51.354871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03a4c0f5-1026-4412-8987-cbc144ae57f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:51.485376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9d4a4e4d-089c-4624-8638-b570188d37d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:51.487695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-03a4c0f5-1026-4412-8987-cbc144ae57f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:51.494085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9d4a4e4d-089c-4624-8638-b570188d37d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152425 Aug 18 22:14:51.494666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1636/3267] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:51 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:51.495764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-03a4c0f5-1026-4412-8987-cbc144ae57f9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154500 Aug 18 22:14:51.496330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1632/3268] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:51.727152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ecad6b4f-007b-4541-9e44-497dcb0ff05e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:51.727764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ecad6b4f-007b-4541-9e44-497dcb0ff05e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:51.734283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecad6b4f-007b-4541-9e44-497dcb0ff05e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:51.734760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecad6b4f-007b-4541-9e44-497dcb0ff05e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:51.735186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecad6b4f-007b-4541-9e44-497dcb0ff05e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:51.735861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecad6b4f-007b-4541-9e44-497dcb0ff05e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:51.736573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecad6b4f-007b-4541-9e44-497dcb0ff05e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:51.736996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecad6b4f-007b-4541-9e44-497dcb0ff05e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:51.739503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:51.865402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ecad6b4f-007b-4541-9e44-497dcb0ff05e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:51.874488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ecad6b4f-007b-4541-9e44-497dcb0ff05e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:51.876009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ecad6b4f-007b-4541-9e44-497dcb0ff05e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:51.877170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ecad6b4f-007b-4541-9e44-497dcb0ff05e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154151 Aug 18 22:14:51.877770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1637/3269] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:51 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:52.059419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3a427c7c-dcf6-40b4-b6fb-106a998fd1cf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:52.060039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3a427c7c-dcf6-40b4-b6fb-106a998fd1cf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:52.066141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a427c7c-dcf6-40b4-b6fb-106a998fd1cf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:52.066628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a427c7c-dcf6-40b4-b6fb-106a998fd1cf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:52.067300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a427c7c-dcf6-40b4-b6fb-106a998fd1cf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:52.067995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a427c7c-dcf6-40b4-b6fb-106a998fd1cf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:52.068450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a427c7c-dcf6-40b4-b6fb-106a998fd1cf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:52.068877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a427c7c-dcf6-40b4-b6fb-106a998fd1cf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:52.107202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-60b83ae4-5998-4be5-a85d-b3e9ccd7b253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:52.107797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-60b83ae4-5998-4be5-a85d-b3e9ccd7b253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:52.115030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60b83ae4-5998-4be5-a85d-b3e9ccd7b253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:52.115725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60b83ae4-5998-4be5-a85d-b3e9ccd7b253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:52.116175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60b83ae4-5998-4be5-a85d-b3e9ccd7b253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:52.116898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60b83ae4-5998-4be5-a85d-b3e9ccd7b253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:52.117357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60b83ae4-5998-4be5-a85d-b3e9ccd7b253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:52.117860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-60b83ae4-5998-4be5-a85d-b3e9ccd7b253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:52.197624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3a427c7c-dcf6-40b4-b6fb-106a998fd1cf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:52.206767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3a427c7c-dcf6-40b4-b6fb-106a998fd1cf tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151100 Aug 18 22:14:52.207358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1633/3270] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:52 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:52.258196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-60b83ae4-5998-4be5-a85d-b3e9ccd7b253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:52.268559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-60b83ae4-5998-4be5-a85d-b3e9ccd7b253 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.164943 Aug 18 22:14:52.269424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1638/3271] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:52.519189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b6312ba5-c59f-47b3-9e63-6264cf0ea636 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:52.519436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-29c9c974-e930-4297-a6a6-e49aafec4fba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:52.520307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b6312ba5-c59f-47b3-9e63-6264cf0ea636 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:52.520431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-29c9c974-e930-4297-a6a6-e49aafec4fba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:52.529537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29c9c974-e930-4297-a6a6-e49aafec4fba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:52.530088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6312ba5-c59f-47b3-9e63-6264cf0ea636 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:52.530338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29c9c974-e930-4297-a6a6-e49aafec4fba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:52.530864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6312ba5-c59f-47b3-9e63-6264cf0ea636 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:52.531547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6312ba5-c59f-47b3-9e63-6264cf0ea636 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:52.531735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29c9c974-e930-4297-a6a6-e49aafec4fba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:52.532670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6312ba5-c59f-47b3-9e63-6264cf0ea636 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:52.532822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29c9c974-e930-4297-a6a6-e49aafec4fba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:52.533426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6312ba5-c59f-47b3-9e63-6264cf0ea636 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:52.533535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29c9c974-e930-4297-a6a6-e49aafec4fba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:52.534161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b6312ba5-c59f-47b3-9e63-6264cf0ea636 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:52.534284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-29c9c974-e930-4297-a6a6-e49aafec4fba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:52.675606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-29c9c974-e930-4297-a6a6-e49aafec4fba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:52.679690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b6312ba5-c59f-47b3-9e63-6264cf0ea636 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:52.685585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-29c9c974-e930-4297-a6a6-e49aafec4fba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.173018 Aug 18 22:14:52.686213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1639/3272] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:52.689093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b6312ba5-c59f-47b3-9e63-6264cf0ea636 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.177116 Aug 18 22:14:52.689848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1634/3273] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:52 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:52.899118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d323bc3d-2d78-4398-ad28-6c189f5fb0c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:52.899734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d323bc3d-2d78-4398-ad28-6c189f5fb0c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:52.905907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d323bc3d-2d78-4398-ad28-6c189f5fb0c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:52.906459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d323bc3d-2d78-4398-ad28-6c189f5fb0c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:52.906946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d323bc3d-2d78-4398-ad28-6c189f5fb0c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:52.908001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d323bc3d-2d78-4398-ad28-6c189f5fb0c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:52.908695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d323bc3d-2d78-4398-ad28-6c189f5fb0c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:52.909338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d323bc3d-2d78-4398-ad28-6c189f5fb0c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:53.048535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d323bc3d-2d78-4398-ad28-6c189f5fb0c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:53.057317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d323bc3d-2d78-4398-ad28-6c189f5fb0c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:53.058848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d323bc3d-2d78-4398-ad28-6c189f5fb0c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:53.060092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d323bc3d-2d78-4398-ad28-6c189f5fb0c1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.164853 Aug 18 22:14:53.060658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1640/3274] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:52 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:53.229584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-46b61687-909c-446b-8ca5-5de30b9a0f11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:53.230252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46b61687-909c-446b-8ca5-5de30b9a0f11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:53.236747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b61687-909c-446b-8ca5-5de30b9a0f11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:53.237232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b61687-909c-446b-8ca5-5de30b9a0f11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:53.237730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b61687-909c-446b-8ca5-5de30b9a0f11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:53.238421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b61687-909c-446b-8ca5-5de30b9a0f11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:53.238874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b61687-909c-446b-8ca5-5de30b9a0f11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:53.239299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46b61687-909c-446b-8ca5-5de30b9a0f11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:53.290931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8453f90b-8684-40ef-9db6-3f49690c0520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:53.291578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8453f90b-8684-40ef-9db6-3f49690c0520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:53.298912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8453f90b-8684-40ef-9db6-3f49690c0520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:53.299400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8453f90b-8684-40ef-9db6-3f49690c0520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:53.299842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8453f90b-8684-40ef-9db6-3f49690c0520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:53.300540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8453f90b-8684-40ef-9db6-3f49690c0520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:53.301251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8453f90b-8684-40ef-9db6-3f49690c0520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:53.301967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8453f90b-8684-40ef-9db6-3f49690c0520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:53.372268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-46b61687-909c-446b-8ca5-5de30b9a0f11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:53.374594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:53.382128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-46b61687-909c-446b-8ca5-5de30b9a0f11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156327 Aug 18 22:14:53.382752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1635/3275] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:53 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:53.648931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8453f90b-8684-40ef-9db6-3f49690c0520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:53.657774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8453f90b-8684-40ef-9db6-3f49690c0520 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.370690 Aug 18 22:14:53.658348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1641/3276] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:53.707718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d598cdb3-1a14-49b7-8e9f-4d69edad6e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:53.708435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d598cdb3-1a14-49b7-8e9f-4d69edad6e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:53.709688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-06a8dd21-8668-48ce-b2fe-a4495677cc71 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:53.710330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-06a8dd21-8668-48ce-b2fe-a4495677cc71 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:53.716582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06a8dd21-8668-48ce-b2fe-a4495677cc71 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:53.716794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d598cdb3-1a14-49b7-8e9f-4d69edad6e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:53.717067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06a8dd21-8668-48ce-b2fe-a4495677cc71 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:53.717192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d598cdb3-1a14-49b7-8e9f-4d69edad6e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:53.717500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06a8dd21-8668-48ce-b2fe-a4495677cc71 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:53.717654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d598cdb3-1a14-49b7-8e9f-4d69edad6e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:53.718863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d598cdb3-1a14-49b7-8e9f-4d69edad6e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:53.718984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06a8dd21-8668-48ce-b2fe-a4495677cc71 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:53.719832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06a8dd21-8668-48ce-b2fe-a4495677cc71 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:53.719928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d598cdb3-1a14-49b7-8e9f-4d69edad6e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:53.720028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06a8dd21-8668-48ce-b2fe-a4495677cc71 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:53.720118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d598cdb3-1a14-49b7-8e9f-4d69edad6e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:53.848667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-06a8dd21-8668-48ce-b2fe-a4495677cc71 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:53.856785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-06a8dd21-8668-48ce-b2fe-a4495677cc71 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151018 Aug 18 22:14:53.857375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1642/3277] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:53 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:53.858245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d598cdb3-1a14-49b7-8e9f-4d69edad6e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:53.866692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d598cdb3-1a14-49b7-8e9f-4d69edad6e84 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.163041 Aug 18 22:14:53.867416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1636/3278] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:53 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:54.083881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2426ec7a-4233-4ec6-b5d7-33fa3f2f4a21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:54.084530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2426ec7a-4233-4ec6-b5d7-33fa3f2f4a21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:54.090491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2426ec7a-4233-4ec6-b5d7-33fa3f2f4a21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:54.090975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2426ec7a-4233-4ec6-b5d7-33fa3f2f4a21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:54.091413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2426ec7a-4233-4ec6-b5d7-33fa3f2f4a21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:54.092099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2426ec7a-4233-4ec6-b5d7-33fa3f2f4a21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:54.092555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2426ec7a-4233-4ec6-b5d7-33fa3f2f4a21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:54.092979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2426ec7a-4233-4ec6-b5d7-33fa3f2f4a21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:54.219201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2426ec7a-4233-4ec6-b5d7-33fa3f2f4a21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:54.227725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2426ec7a-4233-4ec6-b5d7-33fa3f2f4a21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:54.229224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2426ec7a-4233-4ec6-b5d7-33fa3f2f4a21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:54.230400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2426ec7a-4233-4ec6-b5d7-33fa3f2f4a21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150472 Aug 18 22:14:54.230967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1643/3279] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:54 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:54.403145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2c0ca451-1111-403b-97f1-1c3a2dd39626 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:54.403803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2c0ca451-1111-403b-97f1-1c3a2dd39626 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:54.409781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c0ca451-1111-403b-97f1-1c3a2dd39626 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:54.410265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c0ca451-1111-403b-97f1-1c3a2dd39626 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:54.410704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c0ca451-1111-403b-97f1-1c3a2dd39626 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:54.411390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c0ca451-1111-403b-97f1-1c3a2dd39626 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:54.411844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c0ca451-1111-403b-97f1-1c3a2dd39626 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:54.412269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c0ca451-1111-403b-97f1-1c3a2dd39626 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:54.543282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2c0ca451-1111-403b-97f1-1c3a2dd39626 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:54.552291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2c0ca451-1111-403b-97f1-1c3a2dd39626 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153028 Aug 18 22:14:54.552873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1637/3280] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:54 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:54.679372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ca261360-280e-48b4-bde8-3d1465b6434f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:54.680015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ca261360-280e-48b4-bde8-3d1465b6434f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:54.686497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca261360-280e-48b4-bde8-3d1465b6434f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:54.687564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca261360-280e-48b4-bde8-3d1465b6434f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:54.687996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca261360-280e-48b4-bde8-3d1465b6434f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:54.688686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca261360-280e-48b4-bde8-3d1465b6434f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:54.689136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca261360-280e-48b4-bde8-3d1465b6434f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:54.689552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ca261360-280e-48b4-bde8-3d1465b6434f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:54.816368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ca261360-280e-48b4-bde8-3d1465b6434f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:54.824451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ca261360-280e-48b4-bde8-3d1465b6434f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149177 Aug 18 22:14:54.825014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1644/3281] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:54.876863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4e8f1069-a717-4f87-9d9b-0e7744b839cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:54.877476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4e8f1069-a717-4f87-9d9b-0e7744b839cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:54.884129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e8f1069-a717-4f87-9d9b-0e7744b839cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:54.884695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e8f1069-a717-4f87-9d9b-0e7744b839cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:54.885214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e8f1069-a717-4f87-9d9b-0e7744b839cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:54.885952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e8f1069-a717-4f87-9d9b-0e7744b839cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:54.886417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e8f1069-a717-4f87-9d9b-0e7744b839cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:54.886988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e8f1069-a717-4f87-9d9b-0e7744b839cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:54.887149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-acb7bbd4-a5d3-423e-a4ae-dcc475cb133d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:54.887971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-acb7bbd4-a5d3-423e-a4ae-dcc475cb133d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:54.894337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acb7bbd4-a5d3-423e-a4ae-dcc475cb133d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:54.894819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acb7bbd4-a5d3-423e-a4ae-dcc475cb133d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:54.895254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acb7bbd4-a5d3-423e-a4ae-dcc475cb133d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:54.895968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acb7bbd4-a5d3-423e-a4ae-dcc475cb133d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:54.896422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acb7bbd4-a5d3-423e-a4ae-dcc475cb133d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:54.896844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-acb7bbd4-a5d3-423e-a4ae-dcc475cb133d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:55.029369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4e8f1069-a717-4f87-9d9b-0e7744b839cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:55.038264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4e8f1069-a717-4f87-9d9b-0e7744b839cd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.165232 Aug 18 22:14:55.039042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1638/3282] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:54 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:55.040667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-acb7bbd4-a5d3-423e-a4ae-dcc475cb133d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:55.049449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-acb7bbd4-a5d3-423e-a4ae-dcc475cb133d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.165973 Aug 18 22:14:55.050044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1645/3283] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:54 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:55.252643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-37709c6f-5168-4a6b-b83c-53cccd037f6e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:55.253390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-37709c6f-5168-4a6b-b83c-53cccd037f6e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:55.259548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37709c6f-5168-4a6b-b83c-53cccd037f6e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:55.260027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37709c6f-5168-4a6b-b83c-53cccd037f6e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:55.260459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37709c6f-5168-4a6b-b83c-53cccd037f6e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:55.261146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37709c6f-5168-4a6b-b83c-53cccd037f6e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:55.261612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37709c6f-5168-4a6b-b83c-53cccd037f6e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:55.262036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37709c6f-5168-4a6b-b83c-53cccd037f6e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:55.394628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-37709c6f-5168-4a6b-b83c-53cccd037f6e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:55.403113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-37709c6f-5168-4a6b-b83c-53cccd037f6e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:55.404599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-37709c6f-5168-4a6b-b83c-53cccd037f6e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:55.406404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-37709c6f-5168-4a6b-b83c-53cccd037f6e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157277 Aug 18 22:14:55.406966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1639/3284] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:55.533387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:14:55.533795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:14:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:14:55.573849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bd61af29-011b-4fe5-b925-0176dfa3eaf7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:55.574490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bd61af29-011b-4fe5-b925-0176dfa3eaf7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:55.581760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd61af29-011b-4fe5-b925-0176dfa3eaf7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:55.582243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd61af29-011b-4fe5-b925-0176dfa3eaf7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:55.582680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd61af29-011b-4fe5-b925-0176dfa3eaf7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:55.583368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd61af29-011b-4fe5-b925-0176dfa3eaf7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:55.583820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd61af29-011b-4fe5-b925-0176dfa3eaf7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:55.584272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd61af29-011b-4fe5-b925-0176dfa3eaf7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:55.709719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bd61af29-011b-4fe5-b925-0176dfa3eaf7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:55.718092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bd61af29-011b-4fe5-b925-0176dfa3eaf7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.147845 Aug 18 22:14:55.719198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1646/3285] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:55 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:55.845270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-75a159ec-79e6-487b-86dc-7db7ffd332c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:55.845901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-75a159ec-79e6-487b-86dc-7db7ffd332c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:55.852486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75a159ec-79e6-487b-86dc-7db7ffd332c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:55.853272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75a159ec-79e6-487b-86dc-7db7ffd332c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:55.853750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75a159ec-79e6-487b-86dc-7db7ffd332c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:55.854450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75a159ec-79e6-487b-86dc-7db7ffd332c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:55.854901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75a159ec-79e6-487b-86dc-7db7ffd332c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:55.855323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75a159ec-79e6-487b-86dc-7db7ffd332c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:55.988575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-75a159ec-79e6-487b-86dc-7db7ffd332c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:55.996908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-75a159ec-79e6-487b-86dc-7db7ffd332c1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155339 Aug 18 22:14:55.997489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1640/3286] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:55 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:56.060328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e6a1cea3-b406-4f02-b2e6-3038eae120ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:56.060935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e6a1cea3-b406-4f02-b2e6-3038eae120ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:56.067952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6a1cea3-b406-4f02-b2e6-3038eae120ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:56.068435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6a1cea3-b406-4f02-b2e6-3038eae120ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:56.068867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6a1cea3-b406-4f02-b2e6-3038eae120ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:56.069275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a289fcd7-9313-4c97-bac5-031a7fb0bff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:56.069556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6a1cea3-b406-4f02-b2e6-3038eae120ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:56.069907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a289fcd7-9313-4c97-bac5-031a7fb0bff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:56.070031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6a1cea3-b406-4f02-b2e6-3038eae120ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:56.070464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e6a1cea3-b406-4f02-b2e6-3038eae120ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:56.075651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a289fcd7-9313-4c97-bac5-031a7fb0bff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:56.076128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a289fcd7-9313-4c97-bac5-031a7fb0bff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:56.076562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a289fcd7-9313-4c97-bac5-031a7fb0bff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:56.077242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a289fcd7-9313-4c97-bac5-031a7fb0bff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:56.077886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a289fcd7-9313-4c97-bac5-031a7fb0bff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:56.078352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a289fcd7-9313-4c97-bac5-031a7fb0bff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:56.201836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e6a1cea3-b406-4f02-b2e6-3038eae120ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:56.206625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a289fcd7-9313-4c97-bac5-031a7fb0bff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:56.210167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e6a1cea3-b406-4f02-b2e6-3038eae120ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153797 Aug 18 22:14:56.210755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1647/3287] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:56 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:56.214976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a289fcd7-9313-4c97-bac5-031a7fb0bff2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149354 Aug 18 22:14:56.215547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1641/3288] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:56 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:56.429275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4134c22b-0ef5-4291-9555-ae13e9031707 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:56.429921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4134c22b-0ef5-4291-9555-ae13e9031707 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:56.435895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4134c22b-0ef5-4291-9555-ae13e9031707 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:56.436418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4134c22b-0ef5-4291-9555-ae13e9031707 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:56.436858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4134c22b-0ef5-4291-9555-ae13e9031707 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:56.437544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4134c22b-0ef5-4291-9555-ae13e9031707 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:56.438091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4134c22b-0ef5-4291-9555-ae13e9031707 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:56.438522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4134c22b-0ef5-4291-9555-ae13e9031707 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:56.564632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4134c22b-0ef5-4291-9555-ae13e9031707 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:56.573105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4134c22b-0ef5-4291-9555-ae13e9031707 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:56.574625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4134c22b-0ef5-4291-9555-ae13e9031707 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:56.575862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4134c22b-0ef5-4291-9555-ae13e9031707 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150689 Aug 18 22:14:56.576420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1648/3289] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:56.739545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-730e512e-fceb-400f-873b-e05bbc562f4e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:56.740166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-730e512e-fceb-400f-873b-e05bbc562f4e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:56.746149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-730e512e-fceb-400f-873b-e05bbc562f4e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:56.746631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-730e512e-fceb-400f-873b-e05bbc562f4e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:56.747074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-730e512e-fceb-400f-873b-e05bbc562f4e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:56.747753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-730e512e-fceb-400f-873b-e05bbc562f4e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:56.748208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-730e512e-fceb-400f-873b-e05bbc562f4e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:56.748631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-730e512e-fceb-400f-873b-e05bbc562f4e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:56.876641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-730e512e-fceb-400f-873b-e05bbc562f4e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:56.884770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-730e512e-fceb-400f-873b-e05bbc562f4e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149066 Aug 18 22:14:56.885347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1642/3290] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:56 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:57.020013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3a729e83-82be-47ba-a6cc-8b0efc664186 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:57.020775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3a729e83-82be-47ba-a6cc-8b0efc664186 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:57.026750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a729e83-82be-47ba-a6cc-8b0efc664186 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:57.027236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a729e83-82be-47ba-a6cc-8b0efc664186 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:57.027674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a729e83-82be-47ba-a6cc-8b0efc664186 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:57.028375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a729e83-82be-47ba-a6cc-8b0efc664186 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:57.028833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a729e83-82be-47ba-a6cc-8b0efc664186 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:57.029261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3a729e83-82be-47ba-a6cc-8b0efc664186 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:57.156191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3a729e83-82be-47ba-a6cc-8b0efc664186 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:57.164476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3a729e83-82be-47ba-a6cc-8b0efc664186 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149894 Aug 18 22:14:57.165054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1649/3291] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:57 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:57.231205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c6d892ae-9f3a-4bb4-8e73-98b19de5771c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:57.232208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c6d892ae-9f3a-4bb4-8e73-98b19de5771c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:57.235369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5f4b088a-296f-4210-ae3b-ccd916bb7adc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:57.235993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5f4b088a-296f-4210-ae3b-ccd916bb7adc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:57.238980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6d892ae-9f3a-4bb4-8e73-98b19de5771c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:57.239472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6d892ae-9f3a-4bb4-8e73-98b19de5771c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:57.239916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6d892ae-9f3a-4bb4-8e73-98b19de5771c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:57.240624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6d892ae-9f3a-4bb4-8e73-98b19de5771c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:57.241085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6d892ae-9f3a-4bb4-8e73-98b19de5771c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:57.241516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6d892ae-9f3a-4bb4-8e73-98b19de5771c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:57.241888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f4b088a-296f-4210-ae3b-ccd916bb7adc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:57.242378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f4b088a-296f-4210-ae3b-ccd916bb7adc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:57.242822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f4b088a-296f-4210-ae3b-ccd916bb7adc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:57.243512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f4b088a-296f-4210-ae3b-ccd916bb7adc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:57.243972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f4b088a-296f-4210-ae3b-ccd916bb7adc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:57.244401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f4b088a-296f-4210-ae3b-ccd916bb7adc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:57.373499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c6d892ae-9f3a-4bb4-8e73-98b19de5771c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:57.375347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5f4b088a-296f-4210-ae3b-ccd916bb7adc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:57.382725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c6d892ae-9f3a-4bb4-8e73-98b19de5771c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155301 Aug 18 22:14:57.383314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1643/3292] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:57 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:57.383679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5f4b088a-296f-4210-ae3b-ccd916bb7adc tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152146 Aug 18 22:14:57.384335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1650/3293] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:57.669857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b91137b6-46b7-4c9b-a218-16f7db968a90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:57.670470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b91137b6-46b7-4c9b-a218-16f7db968a90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:57.677110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b91137b6-46b7-4c9b-a218-16f7db968a90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:57.677584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b91137b6-46b7-4c9b-a218-16f7db968a90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:57.678046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b91137b6-46b7-4c9b-a218-16f7db968a90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:57.678721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b91137b6-46b7-4c9b-a218-16f7db968a90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:57.679171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b91137b6-46b7-4c9b-a218-16f7db968a90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:57.679597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b91137b6-46b7-4c9b-a218-16f7db968a90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:57.812968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b91137b6-46b7-4c9b-a218-16f7db968a90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:57.821665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b91137b6-46b7-4c9b-a218-16f7db968a90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:57.823173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b91137b6-46b7-4c9b-a218-16f7db968a90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:57.824330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b91137b6-46b7-4c9b-a218-16f7db968a90 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.229623 Aug 18 22:14:57.824900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1644/3294] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:57.907353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8176e514-d7e8-419f-8482-583c78d254b6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:57.907902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8176e514-d7e8-419f-8482-583c78d254b6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:57.913876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8176e514-d7e8-419f-8482-583c78d254b6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:57.914356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8176e514-d7e8-419f-8482-583c78d254b6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:57.914789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8176e514-d7e8-419f-8482-583c78d254b6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:57.915501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8176e514-d7e8-419f-8482-583c78d254b6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:57.915927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8176e514-d7e8-419f-8482-583c78d254b6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:57.916353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8176e514-d7e8-419f-8482-583c78d254b6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:58.041806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8176e514-d7e8-419f-8482-583c78d254b6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:58.051204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8176e514-d7e8-419f-8482-583c78d254b6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.147975 Aug 18 22:14:58.051797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1651/3295] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:57 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:58.185940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-238747e8-0412-4dd2-907a-f72ed0c36a01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:58.186492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-238747e8-0412-4dd2-907a-f72ed0c36a01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:58.192465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-238747e8-0412-4dd2-907a-f72ed0c36a01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:58.192949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-238747e8-0412-4dd2-907a-f72ed0c36a01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:58.193410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-238747e8-0412-4dd2-907a-f72ed0c36a01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:58.194108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-238747e8-0412-4dd2-907a-f72ed0c36a01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:58.194568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-238747e8-0412-4dd2-907a-f72ed0c36a01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:58.194998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-238747e8-0412-4dd2-907a-f72ed0c36a01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:58.319417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-238747e8-0412-4dd2-907a-f72ed0c36a01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:58.328071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-238747e8-0412-4dd2-907a-f72ed0c36a01 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.145572 Aug 18 22:14:58.328891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1645/3296] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:58.403457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e8a0b804-37e3-4b55-8604-98c209545214 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:58.404064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e8a0b804-37e3-4b55-8604-98c209545214 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:58.406048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-59098669-1e4e-464b-aede-57d3318bfdcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:58.406671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-59098669-1e4e-464b-aede-57d3318bfdcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:58.410435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8a0b804-37e3-4b55-8604-98c209545214 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:58.410918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8a0b804-37e3-4b55-8604-98c209545214 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:58.411354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8a0b804-37e3-4b55-8604-98c209545214 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:58.412036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8a0b804-37e3-4b55-8604-98c209545214 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:58.412484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8a0b804-37e3-4b55-8604-98c209545214 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:58.412626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59098669-1e4e-464b-aede-57d3318bfdcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:58.412900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e8a0b804-37e3-4b55-8604-98c209545214 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:58.413022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59098669-1e4e-464b-aede-57d3318bfdcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:58.413448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59098669-1e4e-464b-aede-57d3318bfdcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:58.414164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59098669-1e4e-464b-aede-57d3318bfdcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:58.414615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59098669-1e4e-464b-aede-57d3318bfdcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:58.415180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-59098669-1e4e-464b-aede-57d3318bfdcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:58.544069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e8a0b804-37e3-4b55-8604-98c209545214 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:58.545666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-59098669-1e4e-464b-aede-57d3318bfdcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:58.552713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e8a0b804-37e3-4b55-8604-98c209545214 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153521 Aug 18 22:14:58.553285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1652/3297] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:58 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:58.553974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-59098669-1e4e-464b-aede-57d3318bfdcd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152302 Aug 18 22:14:58.554543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1646/3298] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:58 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:58.846759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-05c0c86b-2c51-44d8-88dc-adfc75182386 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:58.847372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-05c0c86b-2c51-44d8-88dc-adfc75182386 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:58.853331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05c0c86b-2c51-44d8-88dc-adfc75182386 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:58.853846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05c0c86b-2c51-44d8-88dc-adfc75182386 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:58.854283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05c0c86b-2c51-44d8-88dc-adfc75182386 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:58.854963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05c0c86b-2c51-44d8-88dc-adfc75182386 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:58.855415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05c0c86b-2c51-44d8-88dc-adfc75182386 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:58.855859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-05c0c86b-2c51-44d8-88dc-adfc75182386 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:58.981264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05c0c86b-2c51-44d8-88dc-adfc75182386 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:58.983933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:58.991681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05c0c86b-2c51-44d8-88dc-adfc75182386 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:58.993173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-05c0c86b-2c51-44d8-88dc-adfc75182386 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:58.994370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-05c0c86b-2c51-44d8-88dc-adfc75182386 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151483 Aug 18 22:14:58.994932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1653/3299] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:14:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:14:59.071541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d7eac982-ba2c-417b-9c2e-eb8be133df9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:59.072169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d7eac982-ba2c-417b-9c2e-eb8be133df9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:59.074529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:14:59.080323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7eac982-ba2c-417b-9c2e-eb8be133df9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:59.080803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7eac982-ba2c-417b-9c2e-eb8be133df9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:59.081235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7eac982-ba2c-417b-9c2e-eb8be133df9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:59.081954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7eac982-ba2c-417b-9c2e-eb8be133df9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:59.082446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7eac982-ba2c-417b-9c2e-eb8be133df9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:59.082882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d7eac982-ba2c-417b-9c2e-eb8be133df9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:59.349159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ece236a7-b4f3-443d-9781-9e0371bac30e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:59.349883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ece236a7-b4f3-443d-9781-9e0371bac30e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:59.356541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ece236a7-b4f3-443d-9781-9e0371bac30e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:59.357301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ece236a7-b4f3-443d-9781-9e0371bac30e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:59.357441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ece236a7-b4f3-443d-9781-9e0371bac30e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:59.358181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ece236a7-b4f3-443d-9781-9e0371bac30e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:59.359277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ece236a7-b4f3-443d-9781-9e0371bac30e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:59.360091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ece236a7-b4f3-443d-9781-9e0371bac30e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:59.435406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d7eac982-ba2c-417b-9c2e-eb8be133df9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:59.443714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d7eac982-ba2c-417b-9c2e-eb8be133df9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.375983 Aug 18 22:14:59.444296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1647/3300] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:59 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:59.488556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ece236a7-b4f3-443d-9781-9e0371bac30e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:59.496664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ece236a7-b4f3-443d-9781-9e0371bac30e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151474 Aug 18 22:14:59.497278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1654/3301] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:59 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:14:59.574188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b8b444cc-3d12-4307-9501-d0d44855ab94 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:59.574756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3d7e687f-060b-4ec3-b7ed-e047d1bea5ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:14:59.574888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b8b444cc-3d12-4307-9501-d0d44855ab94 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:59.575441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3d7e687f-060b-4ec3-b7ed-e047d1bea5ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:14:59.580816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8b444cc-3d12-4307-9501-d0d44855ab94 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:59.581332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8b444cc-3d12-4307-9501-d0d44855ab94 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:59.581469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d7e687f-060b-4ec3-b7ed-e047d1bea5ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:59.581803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8b444cc-3d12-4307-9501-d0d44855ab94 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:59.582023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d7e687f-060b-4ec3-b7ed-e047d1bea5ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:59.582467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d7e687f-060b-4ec3-b7ed-e047d1bea5ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:59.582597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8b444cc-3d12-4307-9501-d0d44855ab94 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:59.582937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8b444cc-3d12-4307-9501-d0d44855ab94 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:59.583164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d7e687f-060b-4ec3-b7ed-e047d1bea5ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:14:59.583363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8b444cc-3d12-4307-9501-d0d44855ab94 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:59.583621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d7e687f-060b-4ec3-b7ed-e047d1bea5ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:14:59.584049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3d7e687f-060b-4ec3-b7ed-e047d1bea5ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:14:59.712420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b8b444cc-3d12-4307-9501-d0d44855ab94 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:59.716891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3d7e687f-060b-4ec3-b7ed-e047d1bea5ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:14:59.722050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b8b444cc-3d12-4307-9501-d0d44855ab94 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151623 Aug 18 22:14:59.722639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1648/3302] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:59 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:14:59.725536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3d7e687f-060b-4ec3-b7ed-e047d1bea5ed tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154615 Aug 18 22:14:59.726119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1655/3303] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:14:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:00.018567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-37340832-9209-44b5-8494-21b51110baea tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:00.019104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-37340832-9209-44b5-8494-21b51110baea tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:00.025129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37340832-9209-44b5-8494-21b51110baea tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:00.025644 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37340832-9209-44b5-8494-21b51110baea tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:00.026104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37340832-9209-44b5-8494-21b51110baea tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:00.026786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37340832-9209-44b5-8494-21b51110baea tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:00.027248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37340832-9209-44b5-8494-21b51110baea tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:00.027679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37340832-9209-44b5-8494-21b51110baea tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:00.157000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-37340832-9209-44b5-8494-21b51110baea tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:00.165975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-37340832-9209-44b5-8494-21b51110baea tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:00.167495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-37340832-9209-44b5-8494-21b51110baea tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:00.168669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-37340832-9209-44b5-8494-21b51110baea tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154773 Aug 18 22:15:00.169237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1649/3304] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:00 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:00.464961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2c516aed-0cac-49f3-9a5e-433685bd57ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:00.465582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2c516aed-0cac-49f3-9a5e-433685bd57ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:00.472137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c516aed-0cac-49f3-9a5e-433685bd57ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:00.472620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c516aed-0cac-49f3-9a5e-433685bd57ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:00.473119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c516aed-0cac-49f3-9a5e-433685bd57ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:00.473869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c516aed-0cac-49f3-9a5e-433685bd57ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:00.474330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c516aed-0cac-49f3-9a5e-433685bd57ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:00.474754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c516aed-0cac-49f3-9a5e-433685bd57ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:00.589732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-29439602-7a8d-435e-8efe-65b76ace019e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:00.590364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-29439602-7a8d-435e-8efe-65b76ace019e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:00.596347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29439602-7a8d-435e-8efe-65b76ace019e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:00.596831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29439602-7a8d-435e-8efe-65b76ace019e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:00.597269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29439602-7a8d-435e-8efe-65b76ace019e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:00.598014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29439602-7a8d-435e-8efe-65b76ace019e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:00.598524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29439602-7a8d-435e-8efe-65b76ace019e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:00.598955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29439602-7a8d-435e-8efe-65b76ace019e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:00.605536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2c516aed-0cac-49f3-9a5e-433685bd57ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:00.614685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2c516aed-0cac-49f3-9a5e-433685bd57ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153615 Aug 18 22:15:00.615370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1656/3305] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:00 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:00.729403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-29439602-7a8d-435e-8efe-65b76ace019e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:00.738147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-29439602-7a8d-435e-8efe-65b76ace019e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.223973 Aug 18 22:15:00.738725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1650/3306] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:00 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:00.743256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-baa230a3-849b-43f9-ab76-d9993cd19c75 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:00.743875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-baa230a3-849b-43f9-ab76-d9993cd19c75 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:00.745623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-155323e6-1301-409e-8af6-e135816aefae tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:00.746304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-155323e6-1301-409e-8af6-e135816aefae tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:00.751514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-baa230a3-849b-43f9-ab76-d9993cd19c75 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:00.752003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-baa230a3-849b-43f9-ab76-d9993cd19c75 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:00.752725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-baa230a3-849b-43f9-ab76-d9993cd19c75 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:00.753436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-baa230a3-849b-43f9-ab76-d9993cd19c75 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:00.753909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-155323e6-1301-409e-8af6-e135816aefae tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:00.754079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-baa230a3-849b-43f9-ab76-d9993cd19c75 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:00.754331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-baa230a3-849b-43f9-ab76-d9993cd19c75 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:00.754447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-155323e6-1301-409e-8af6-e135816aefae tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:00.754830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-155323e6-1301-409e-8af6-e135816aefae tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:00.755531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-155323e6-1301-409e-8af6-e135816aefae tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:00.755992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-155323e6-1301-409e-8af6-e135816aefae tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:00.756423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-155323e6-1301-409e-8af6-e135816aefae tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:00.893908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-baa230a3-849b-43f9-ab76-d9993cd19c75 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:00.897093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-155323e6-1301-409e-8af6-e135816aefae tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:00.903386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-baa230a3-849b-43f9-ab76-d9993cd19c75 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.163954 Aug 18 22:15:00.904089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1657/3307] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:00 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:00.906620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-155323e6-1301-409e-8af6-e135816aefae tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.164547 Aug 18 22:15:00.907275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1651/3308] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:00 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:01.192236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bfd39241-4930-40a0-af0a-a92b4ca583ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:01.192856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bfd39241-4930-40a0-af0a-a92b4ca583ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:01.198824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfd39241-4930-40a0-af0a-a92b4ca583ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:01.199308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfd39241-4930-40a0-af0a-a92b4ca583ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:01.199746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfd39241-4930-40a0-af0a-a92b4ca583ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:01.200439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfd39241-4930-40a0-af0a-a92b4ca583ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:01.200889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfd39241-4930-40a0-af0a-a92b4ca583ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:01.201317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfd39241-4930-40a0-af0a-a92b4ca583ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:01.336604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bfd39241-4930-40a0-af0a-a92b4ca583ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:01.346282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bfd39241-4930-40a0-af0a-a92b4ca583ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:01.347785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bfd39241-4930-40a0-af0a-a92b4ca583ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:01.348973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bfd39241-4930-40a0-af0a-a92b4ca583ae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.160672 Aug 18 22:15:01.349530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1658/3309] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:01.635717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c02a330a-b978-4396-a47c-81e3d046d8ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:01.636359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c02a330a-b978-4396-a47c-81e3d046d8ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:01.643435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c02a330a-b978-4396-a47c-81e3d046d8ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:01.643914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c02a330a-b978-4396-a47c-81e3d046d8ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:01.644349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c02a330a-b978-4396-a47c-81e3d046d8ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:01.645028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c02a330a-b978-4396-a47c-81e3d046d8ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:01.645478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c02a330a-b978-4396-a47c-81e3d046d8ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:01.645924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c02a330a-b978-4396-a47c-81e3d046d8ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:01.660374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:01.759372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-70abd7d3-8449-4e4b-96f8-c856fed0ea8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:01.760186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-70abd7d3-8449-4e4b-96f8-c856fed0ea8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:01.768084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70abd7d3-8449-4e4b-96f8-c856fed0ea8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:01.768574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70abd7d3-8449-4e4b-96f8-c856fed0ea8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:01.769006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70abd7d3-8449-4e4b-96f8-c856fed0ea8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:01.769732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70abd7d3-8449-4e4b-96f8-c856fed0ea8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:01.770181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70abd7d3-8449-4e4b-96f8-c856fed0ea8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:01.770703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70abd7d3-8449-4e4b-96f8-c856fed0ea8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:01.775931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c02a330a-b978-4396-a47c-81e3d046d8ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:01.784086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c02a330a-b978-4396-a47c-81e3d046d8ea tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152208 Aug 18 22:15:01.784686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1652/3310] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:01 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:01.903290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-70abd7d3-8449-4e4b-96f8-c856fed0ea8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:01.911516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-70abd7d3-8449-4e4b-96f8-c856fed0ea8c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155982 Aug 18 22:15:01.912087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1659/3311] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:01 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:01.925051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9fe678f6-6442-4454-9d80-fb1298ed2114 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:01.926292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9fe678f6-6442-4454-9d80-fb1298ed2114 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:01.928171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-36008263-1d26-49f5-bd2a-c0e0cb7f9505 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:01.928864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-36008263-1d26-49f5-bd2a-c0e0cb7f9505 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:01.932116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fe678f6-6442-4454-9d80-fb1298ed2114 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:01.932599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fe678f6-6442-4454-9d80-fb1298ed2114 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:01.933033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fe678f6-6442-4454-9d80-fb1298ed2114 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:01.933748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fe678f6-6442-4454-9d80-fb1298ed2114 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:01.934206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fe678f6-6442-4454-9d80-fb1298ed2114 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:01.934724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36008263-1d26-49f5-bd2a-c0e0cb7f9505 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:01.934860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9fe678f6-6442-4454-9d80-fb1298ed2114 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:01.935205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36008263-1d26-49f5-bd2a-c0e0cb7f9505 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:01.935648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36008263-1d26-49f5-bd2a-c0e0cb7f9505 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:01.936339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36008263-1d26-49f5-bd2a-c0e0cb7f9505 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:01.936877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36008263-1d26-49f5-bd2a-c0e0cb7f9505 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:01.937309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36008263-1d26-49f5-bd2a-c0e0cb7f9505 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:02.066214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-36008263-1d26-49f5-bd2a-c0e0cb7f9505 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:02.066531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9fe678f6-6442-4454-9d80-fb1298ed2114 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:02.074847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9fe678f6-6442-4454-9d80-fb1298ed2114 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154053 Aug 18 22:15:02.075055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-36008263-1d26-49f5-bd2a-c0e0cb7f9505 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150920 Aug 18 22:15:02.075425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1653/3312] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:01 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:02.075642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1660/3313] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:01 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:02.371591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-deba4a2a-ea18-423f-bd7d-432ffd267da1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:02.372211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-deba4a2a-ea18-423f-bd7d-432ffd267da1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:02.378662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deba4a2a-ea18-423f-bd7d-432ffd267da1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:02.379146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deba4a2a-ea18-423f-bd7d-432ffd267da1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:02.379581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deba4a2a-ea18-423f-bd7d-432ffd267da1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:02.380271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deba4a2a-ea18-423f-bd7d-432ffd267da1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:02.380727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deba4a2a-ea18-423f-bd7d-432ffd267da1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:02.381152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-deba4a2a-ea18-423f-bd7d-432ffd267da1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:02.513199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-deba4a2a-ea18-423f-bd7d-432ffd267da1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:02.522503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-deba4a2a-ea18-423f-bd7d-432ffd267da1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:02.523994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-deba4a2a-ea18-423f-bd7d-432ffd267da1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:02.525131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-deba4a2a-ea18-423f-bd7d-432ffd267da1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157356 Aug 18 22:15:02.525707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1654/3314] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:02.805755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fcff9165-761a-4daa-a724-9dbaf4a66114 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:02.806368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fcff9165-761a-4daa-a724-9dbaf4a66114 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:02.813355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcff9165-761a-4daa-a724-9dbaf4a66114 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:02.813857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcff9165-761a-4daa-a724-9dbaf4a66114 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:02.814292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcff9165-761a-4daa-a724-9dbaf4a66114 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:02.814967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcff9165-761a-4daa-a724-9dbaf4a66114 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:02.815445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcff9165-761a-4daa-a724-9dbaf4a66114 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:02.815863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcff9165-761a-4daa-a724-9dbaf4a66114 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:02.932644 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6fb69b0f-8e1a-4fda-87ea-5785e016eab4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:02.933269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6fb69b0f-8e1a-4fda-87ea-5785e016eab4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:02.941667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fcff9165-761a-4daa-a724-9dbaf4a66114 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:02.943937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6fb69b0f-8e1a-4fda-87ea-5785e016eab4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:02.944794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6fb69b0f-8e1a-4fda-87ea-5785e016eab4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:02.945485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6fb69b0f-8e1a-4fda-87ea-5785e016eab4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:02.946244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6fb69b0f-8e1a-4fda-87ea-5785e016eab4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:02.946707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6fb69b0f-8e1a-4fda-87ea-5785e016eab4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:02.947143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6fb69b0f-8e1a-4fda-87ea-5785e016eab4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:02.950721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fcff9165-761a-4daa-a724-9dbaf4a66114 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148762 Aug 18 22:15:02.951307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1661/3315] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:02 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:03.074684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6fb69b0f-8e1a-4fda-87ea-5785e016eab4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:03.082935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6fb69b0f-8e1a-4fda-87ea-5785e016eab4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154181 Aug 18 22:15:03.083510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1655/3316] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:02 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:03.096647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7f62d834-665a-4626-ab1d-8308b81926f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:03.097259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7f62d834-665a-4626-ab1d-8308b81926f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:03.097833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ebfd3723-0478-41d4-b80c-435e2f9c4437 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:03.098455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ebfd3723-0478-41d4-b80c-435e2f9c4437 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:03.103134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f62d834-665a-4626-ab1d-8308b81926f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:03.103639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f62d834-665a-4626-ab1d-8308b81926f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:03.104064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f62d834-665a-4626-ab1d-8308b81926f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:03.104289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebfd3723-0478-41d4-b80c-435e2f9c4437 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:03.104741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f62d834-665a-4626-ab1d-8308b81926f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:03.104865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebfd3723-0478-41d4-b80c-435e2f9c4437 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:03.105186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f62d834-665a-4626-ab1d-8308b81926f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:03.105303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebfd3723-0478-41d4-b80c-435e2f9c4437 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:03.105634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7f62d834-665a-4626-ab1d-8308b81926f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:03.105953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebfd3723-0478-41d4-b80c-435e2f9c4437 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:03.106414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebfd3723-0478-41d4-b80c-435e2f9c4437 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:03.106839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ebfd3723-0478-41d4-b80c-435e2f9c4437 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:03.240376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ebfd3723-0478-41d4-b80c-435e2f9c4437 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:03.241766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7f62d834-665a-4626-ab1d-8308b81926f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:03.248648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ebfd3723-0478-41d4-b80c-435e2f9c4437 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155909 Aug 18 22:15:03.249568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1656/3317] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:03 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:03.251250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7f62d834-665a-4626-ab1d-8308b81926f3 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.158946 Aug 18 22:15:03.251839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1662/3318] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:03 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:03.547808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-28fd099d-eed0-4941-a8ba-e7b8e61c5bcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:03.548424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-28fd099d-eed0-4941-a8ba-e7b8e61c5bcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:03.554718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28fd099d-eed0-4941-a8ba-e7b8e61c5bcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:03.555202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28fd099d-eed0-4941-a8ba-e7b8e61c5bcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:03.555638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28fd099d-eed0-4941-a8ba-e7b8e61c5bcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:03.556328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28fd099d-eed0-4941-a8ba-e7b8e61c5bcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:03.556780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28fd099d-eed0-4941-a8ba-e7b8e61c5bcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:03.557205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-28fd099d-eed0-4941-a8ba-e7b8e61c5bcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:03.684007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-28fd099d-eed0-4941-a8ba-e7b8e61c5bcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:03.693075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-28fd099d-eed0-4941-a8ba-e7b8e61c5bcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:03.694636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-28fd099d-eed0-4941-a8ba-e7b8e61c5bcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:03.695795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-28fd099d-eed0-4941-a8ba-e7b8e61c5bcc tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151937 Aug 18 22:15:03.696359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1657/3319] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:03.973612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2f597747-b60f-4e72-8d39-8c2e70b02f91 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:03.974169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2f597747-b60f-4e72-8d39-8c2e70b02f91 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:03.981563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f597747-b60f-4e72-8d39-8c2e70b02f91 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:03.982071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f597747-b60f-4e72-8d39-8c2e70b02f91 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:03.982510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f597747-b60f-4e72-8d39-8c2e70b02f91 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:03.983206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f597747-b60f-4e72-8d39-8c2e70b02f91 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:03.983693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f597747-b60f-4e72-8d39-8c2e70b02f91 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:03.984120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f597747-b60f-4e72-8d39-8c2e70b02f91 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:04.104007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ea582b7a-63fe-49e4-bfbc-6e82a148172d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:04.104709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ea582b7a-63fe-49e4-bfbc-6e82a148172d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:04.111849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2f597747-b60f-4e72-8d39-8c2e70b02f91 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:04.112029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea582b7a-63fe-49e4-bfbc-6e82a148172d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:04.112402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea582b7a-63fe-49e4-bfbc-6e82a148172d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:04.112842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea582b7a-63fe-49e4-bfbc-6e82a148172d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:04.113545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea582b7a-63fe-49e4-bfbc-6e82a148172d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:04.114031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea582b7a-63fe-49e4-bfbc-6e82a148172d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:04.114454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea582b7a-63fe-49e4-bfbc-6e82a148172d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:04.120335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2f597747-b60f-4e72-8d39-8c2e70b02f91 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151711 Aug 18 22:15:04.120914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1663/3320] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:03 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:04.246875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ea582b7a-63fe-49e4-bfbc-6e82a148172d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:04.255825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ea582b7a-63fe-49e4-bfbc-6e82a148172d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155589 Aug 18 22:15:04.256412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1658/3321] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:04 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:04.270426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3690dc12-fb79-47a0-8783-5b5c6559b7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:04.271044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3690dc12-fb79-47a0-8783-5b5c6559b7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:04.271482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-90a529ef-1ca2-43ac-b353-9bbc3db2bcee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:04.272102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-90a529ef-1ca2-43ac-b353-9bbc3db2bcee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:04.272879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:04.278322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90a529ef-1ca2-43ac-b353-9bbc3db2bcee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:04.278815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90a529ef-1ca2-43ac-b353-9bbc3db2bcee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:04.279261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90a529ef-1ca2-43ac-b353-9bbc3db2bcee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:04.279959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90a529ef-1ca2-43ac-b353-9bbc3db2bcee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:04.280422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90a529ef-1ca2-43ac-b353-9bbc3db2bcee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:04.280849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90a529ef-1ca2-43ac-b353-9bbc3db2bcee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:04.282973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3690dc12-fb79-47a0-8783-5b5c6559b7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:04.283925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3690dc12-fb79-47a0-8783-5b5c6559b7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:04.284575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3690dc12-fb79-47a0-8783-5b5c6559b7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:04.285655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3690dc12-fb79-47a0-8783-5b5c6559b7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:04.286385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3690dc12-fb79-47a0-8783-5b5c6559b7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:04.287033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3690dc12-fb79-47a0-8783-5b5c6559b7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:04.414674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-90a529ef-1ca2-43ac-b353-9bbc3db2bcee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:04.428612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-90a529ef-1ca2-43ac-b353-9bbc3db2bcee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.160779 Aug 18 22:15:04.431964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3690dc12-fb79-47a0-8783-5b5c6559b7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:04.435729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1659/3322] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:04 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:04.441275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3690dc12-fb79-47a0-8783-5b5c6559b7b0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.175016 Aug 18 22:15:04.442116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1664/3323] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:04.721314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-97349f6b-9b19-4331-86a2-11b563046b3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:04.721966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-97349f6b-9b19-4331-86a2-11b563046b3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:04.727937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97349f6b-9b19-4331-86a2-11b563046b3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:04.728409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97349f6b-9b19-4331-86a2-11b563046b3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:04.728837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97349f6b-9b19-4331-86a2-11b563046b3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:04.729518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97349f6b-9b19-4331-86a2-11b563046b3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:04.729987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97349f6b-9b19-4331-86a2-11b563046b3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:04.730409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97349f6b-9b19-4331-86a2-11b563046b3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:04.855611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97349f6b-9b19-4331-86a2-11b563046b3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:04.865081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97349f6b-9b19-4331-86a2-11b563046b3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:04.866601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97349f6b-9b19-4331-86a2-11b563046b3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:04.867760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-97349f6b-9b19-4331-86a2-11b563046b3d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152369 Aug 18 22:15:04.868519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1660/3324] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:05.142862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-954f4a04-b6f5-4195-b3f2-7522810683f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:05.143455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-954f4a04-b6f5-4195-b3f2-7522810683f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:05.149782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-954f4a04-b6f5-4195-b3f2-7522810683f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:05.150255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-954f4a04-b6f5-4195-b3f2-7522810683f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:05.150683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-954f4a04-b6f5-4195-b3f2-7522810683f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:05.151357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-954f4a04-b6f5-4195-b3f2-7522810683f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:05.151803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-954f4a04-b6f5-4195-b3f2-7522810683f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:05.152219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-954f4a04-b6f5-4195-b3f2-7522810683f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:05.276921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-038e33c5-7bb7-433c-b2a4-e11639e038cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:05.277528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-038e33c5-7bb7-433c-b2a4-e11639e038cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:05.283928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-954f4a04-b6f5-4195-b3f2-7522810683f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:05.284523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-038e33c5-7bb7-433c-b2a4-e11639e038cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:05.285012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-038e33c5-7bb7-433c-b2a4-e11639e038cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:05.285451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-038e33c5-7bb7-433c-b2a4-e11639e038cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:05.286188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-038e33c5-7bb7-433c-b2a4-e11639e038cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:05.286791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-038e33c5-7bb7-433c-b2a4-e11639e038cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:05.287223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-038e33c5-7bb7-433c-b2a4-e11639e038cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:05.292208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-954f4a04-b6f5-4195-b3f2-7522810683f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153830 Aug 18 22:15:05.292855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1665/3325] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:05 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:05.417649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-038e33c5-7bb7-433c-b2a4-e11639e038cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:05.426273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-038e33c5-7bb7-433c-b2a4-e11639e038cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153127 Aug 18 22:15:05.426850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1661/3326] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:05 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:05.456746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-39fc4ac1-64e0-4fe8-a6df-afdaea6f62fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:05.457382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-39fc4ac1-64e0-4fe8-a6df-afdaea6f62fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:05.461834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-44b22cb8-b7ac-4076-97e9-f10fb992d297 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:05.462486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-44b22cb8-b7ac-4076-97e9-f10fb992d297 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:05.463312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39fc4ac1-64e0-4fe8-a6df-afdaea6f62fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:05.463793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39fc4ac1-64e0-4fe8-a6df-afdaea6f62fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:05.464223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39fc4ac1-64e0-4fe8-a6df-afdaea6f62fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:05.464904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39fc4ac1-64e0-4fe8-a6df-afdaea6f62fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:05.465354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39fc4ac1-64e0-4fe8-a6df-afdaea6f62fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:05.465803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-39fc4ac1-64e0-4fe8-a6df-afdaea6f62fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:05.468478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44b22cb8-b7ac-4076-97e9-f10fb992d297 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:05.468962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44b22cb8-b7ac-4076-97e9-f10fb992d297 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:05.469398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44b22cb8-b7ac-4076-97e9-f10fb992d297 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:05.470128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44b22cb8-b7ac-4076-97e9-f10fb992d297 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:05.470586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44b22cb8-b7ac-4076-97e9-f10fb992d297 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:05.471013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44b22cb8-b7ac-4076-97e9-f10fb992d297 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:05.600020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-44b22cb8-b7ac-4076-97e9-f10fb992d297 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:05.601352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-39fc4ac1-64e0-4fe8-a6df-afdaea6f62fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:05.609247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-44b22cb8-b7ac-4076-97e9-f10fb992d297 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150496 Aug 18 22:15:05.609854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1662/3327] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:05 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:05.610664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-39fc4ac1-64e0-4fe8-a6df-afdaea6f62fa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.158271 Aug 18 22:15:05.611332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1666/3328] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:05 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:05.890181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2d3da828-b366-49fd-85e3-2d522c13039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:05.890801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2d3da828-b366-49fd-85e3-2d522c13039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:05.896879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d3da828-b366-49fd-85e3-2d522c13039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:05.897354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d3da828-b366-49fd-85e3-2d522c13039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:05.897828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d3da828-b366-49fd-85e3-2d522c13039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:05.898522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d3da828-b366-49fd-85e3-2d522c13039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:05.898980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d3da828-b366-49fd-85e3-2d522c13039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:05.899409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d3da828-b366-49fd-85e3-2d522c13039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:06.031035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2d3da828-b366-49fd-85e3-2d522c13039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:06.039703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2d3da828-b366-49fd-85e3-2d522c13039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:06.041206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2d3da828-b366-49fd-85e3-2d522c13039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:06.042400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2d3da828-b366-49fd-85e3-2d522c13039c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156106 Aug 18 22:15:06.042964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1663/3329] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:06.314845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2ccbaf82-ebf8-4ecb-85a2-98f05fcf1a9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:06.315524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2ccbaf82-ebf8-4ecb-85a2-98f05fcf1a9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:06.321996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ccbaf82-ebf8-4ecb-85a2-98f05fcf1a9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:06.322479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ccbaf82-ebf8-4ecb-85a2-98f05fcf1a9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:06.322916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ccbaf82-ebf8-4ecb-85a2-98f05fcf1a9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:06.323607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ccbaf82-ebf8-4ecb-85a2-98f05fcf1a9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:06.324062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ccbaf82-ebf8-4ecb-85a2-98f05fcf1a9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:06.324491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ccbaf82-ebf8-4ecb-85a2-98f05fcf1a9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:06.446983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-450448d0-38c5-466e-843f-f17ecd13549d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:06.447770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-450448d0-38c5-466e-843f-f17ecd13549d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:06.454362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2ccbaf82-ebf8-4ecb-85a2-98f05fcf1a9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:06.454854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-450448d0-38c5-466e-843f-f17ecd13549d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:06.455343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-450448d0-38c5-466e-843f-f17ecd13549d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:06.455779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-450448d0-38c5-466e-843f-f17ecd13549d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:06.456475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-450448d0-38c5-466e-843f-f17ecd13549d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:06.456924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-450448d0-38c5-466e-843f-f17ecd13549d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:06.457343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-450448d0-38c5-466e-843f-f17ecd13549d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:06.462698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2ccbaf82-ebf8-4ecb-85a2-98f05fcf1a9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151697 Aug 18 22:15:06.463265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1667/3330] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:06 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:06.585590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-450448d0-38c5-466e-843f-f17ecd13549d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:06.594473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-450448d0-38c5-466e-843f-f17ecd13549d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151292 Aug 18 22:15:06.595050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1664/3331] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:06 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:06.629990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0e6ca9c5-8146-4a54-953b-4f19841717aa tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:06.630610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0e6ca9c5-8146-4a54-953b-4f19841717aa tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:06.631804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a89d1c47-2469-4125-bf81-0749541ad72d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:06.632424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a89d1c47-2469-4125-bf81-0749541ad72d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:06.636532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e6ca9c5-8146-4a54-953b-4f19841717aa tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:06.637015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e6ca9c5-8146-4a54-953b-4f19841717aa tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:06.637450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e6ca9c5-8146-4a54-953b-4f19841717aa tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:06.638181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e6ca9c5-8146-4a54-953b-4f19841717aa tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:06.638295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a89d1c47-2469-4125-bf81-0749541ad72d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:06.638639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e6ca9c5-8146-4a54-953b-4f19841717aa tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:06.638790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a89d1c47-2469-4125-bf81-0749541ad72d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:06.639072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e6ca9c5-8146-4a54-953b-4f19841717aa tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:06.639249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a89d1c47-2469-4125-bf81-0749541ad72d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:06.640342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a89d1c47-2469-4125-bf81-0749541ad72d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:06.640801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a89d1c47-2469-4125-bf81-0749541ad72d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:06.641232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a89d1c47-2469-4125-bf81-0749541ad72d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:06.768236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0e6ca9c5-8146-4a54-953b-4f19841717aa tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:06.772583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a89d1c47-2469-4125-bf81-0749541ad72d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:06.776724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0e6ca9c5-8146-4a54-953b-4f19841717aa tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150439 Aug 18 22:15:06.777443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1668/3332] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:06 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:06.782562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a89d1c47-2469-4125-bf81-0749541ad72d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154349 Aug 18 22:15:06.783139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1665/3333] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:06 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:07.065911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4b30f771-0720-4d69-a472-37ede1d016ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:07.066531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4b30f771-0720-4d69-a472-37ede1d016ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:07.072502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b30f771-0720-4d69-a472-37ede1d016ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:07.072984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b30f771-0720-4d69-a472-37ede1d016ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:07.073422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b30f771-0720-4d69-a472-37ede1d016ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:07.074138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b30f771-0720-4d69-a472-37ede1d016ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:07.074594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b30f771-0720-4d69-a472-37ede1d016ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:07.075021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4b30f771-0720-4d69-a472-37ede1d016ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:07.206529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4b30f771-0720-4d69-a472-37ede1d016ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:07.215122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4b30f771-0720-4d69-a472-37ede1d016ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:07.216634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4b30f771-0720-4d69-a472-37ede1d016ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:07.218439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4b30f771-0720-4d69-a472-37ede1d016ba tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156297 Aug 18 22:15:07.219012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1669/3334] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:07.485527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7a04c023-eb58-4070-bce2-9b9df2ed734a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:07.486086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7a04c023-eb58-4070-bce2-9b9df2ed734a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:07.492569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a04c023-eb58-4070-bce2-9b9df2ed734a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:07.493057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a04c023-eb58-4070-bce2-9b9df2ed734a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:07.493500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a04c023-eb58-4070-bce2-9b9df2ed734a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:07.494226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a04c023-eb58-4070-bce2-9b9df2ed734a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:07.494682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a04c023-eb58-4070-bce2-9b9df2ed734a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:07.495112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a04c023-eb58-4070-bce2-9b9df2ed734a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:07.620548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-61528f78-c5fe-4693-ae59-aa8b549c5f15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:07.621356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-61528f78-c5fe-4693-ae59-aa8b549c5f15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:07.629986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61528f78-c5fe-4693-ae59-aa8b549c5f15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:07.630424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7a04c023-eb58-4070-bce2-9b9df2ed734a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:07.630682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61528f78-c5fe-4693-ae59-aa8b549c5f15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:07.631189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61528f78-c5fe-4693-ae59-aa8b549c5f15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:07.631962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61528f78-c5fe-4693-ae59-aa8b549c5f15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:07.632484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61528f78-c5fe-4693-ae59-aa8b549c5f15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:07.632975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61528f78-c5fe-4693-ae59-aa8b549c5f15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:07.638933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7a04c023-eb58-4070-bce2-9b9df2ed734a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.157505 Aug 18 22:15:07.640365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1666/3335] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:07 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:07.649481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:07.763395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-61528f78-c5fe-4693-ae59-aa8b549c5f15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:07.772139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-61528f78-c5fe-4693-ae59-aa8b549c5f15 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.160395 Aug 18 22:15:07.772715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1670/3336] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:07 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:07.797585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1fb60784-fa7b-40fb-b23b-308246e314a0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:07.798262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1fb60784-fa7b-40fb-b23b-308246e314a0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:07.803424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-def5626c-f8e0-4eb5-aa78-9d8184371886 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:07.804037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-def5626c-f8e0-4eb5-aa78-9d8184371886 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:07.804539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fb60784-fa7b-40fb-b23b-308246e314a0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:07.805103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fb60784-fa7b-40fb-b23b-308246e314a0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:07.805544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fb60784-fa7b-40fb-b23b-308246e314a0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:07.806269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fb60784-fa7b-40fb-b23b-308246e314a0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:07.806729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fb60784-fa7b-40fb-b23b-308246e314a0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:07.807157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1fb60784-fa7b-40fb-b23b-308246e314a0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:07.810074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-def5626c-f8e0-4eb5-aa78-9d8184371886 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:07.810432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-def5626c-f8e0-4eb5-aa78-9d8184371886 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:07.810866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-def5626c-f8e0-4eb5-aa78-9d8184371886 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:07.812058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-def5626c-f8e0-4eb5-aa78-9d8184371886 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:07.812518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-def5626c-f8e0-4eb5-aa78-9d8184371886 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:07.812944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-def5626c-f8e0-4eb5-aa78-9d8184371886 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:07.942311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1fb60784-fa7b-40fb-b23b-308246e314a0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:07.948324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-def5626c-f8e0-4eb5-aa78-9d8184371886 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:07.950606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1fb60784-fa7b-40fb-b23b-308246e314a0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.156813 Aug 18 22:15:07.951186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1667/3337] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:07.956796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-def5626c-f8e0-4eb5-aa78-9d8184371886 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157330 Aug 18 22:15:07.957508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1671/3338] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:07 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:08.241448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8cced7dc-7e68-4038-aed5-2f160237928e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:08.242101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8cced7dc-7e68-4038-aed5-2f160237928e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:08.248083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cced7dc-7e68-4038-aed5-2f160237928e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:08.248559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cced7dc-7e68-4038-aed5-2f160237928e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:08.249684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cced7dc-7e68-4038-aed5-2f160237928e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:08.250372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cced7dc-7e68-4038-aed5-2f160237928e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:08.250822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cced7dc-7e68-4038-aed5-2f160237928e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:08.251245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8cced7dc-7e68-4038-aed5-2f160237928e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:08.382298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8cced7dc-7e68-4038-aed5-2f160237928e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:08.390929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8cced7dc-7e68-4038-aed5-2f160237928e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:08.392426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8cced7dc-7e68-4038-aed5-2f160237928e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:08.393587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8cced7dc-7e68-4038-aed5-2f160237928e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156071 Aug 18 22:15:08.394180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1668/3339] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:08.660876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae1986e3-e1ed-45db-9426-8ae6e05f79a7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:08.661495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ae1986e3-e1ed-45db-9426-8ae6e05f79a7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:08.667992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae1986e3-e1ed-45db-9426-8ae6e05f79a7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:08.668470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae1986e3-e1ed-45db-9426-8ae6e05f79a7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:08.668905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae1986e3-e1ed-45db-9426-8ae6e05f79a7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:08.669606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae1986e3-e1ed-45db-9426-8ae6e05f79a7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:08.670073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae1986e3-e1ed-45db-9426-8ae6e05f79a7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:08.670501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae1986e3-e1ed-45db-9426-8ae6e05f79a7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:08.792968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bda5889d-c993-403b-85b1-4a00810a42ae tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:08.793612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bda5889d-c993-403b-85b1-4a00810a42ae tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:08.797449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ae1986e3-e1ed-45db-9426-8ae6e05f79a7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:08.800091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bda5889d-c993-403b-85b1-4a00810a42ae tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:08.800586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bda5889d-c993-403b-85b1-4a00810a42ae tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:08.801282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bda5889d-c993-403b-85b1-4a00810a42ae tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:08.802011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bda5889d-c993-403b-85b1-4a00810a42ae tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:08.802474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bda5889d-c993-403b-85b1-4a00810a42ae tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:08.802905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bda5889d-c993-403b-85b1-4a00810a42ae tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:08.805836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ae1986e3-e1ed-45db-9426-8ae6e05f79a7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148743 Aug 18 22:15:08.806419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1672/3340] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:08 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:08.806874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:08.932586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bda5889d-c993-403b-85b1-4a00810a42ae tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:08.940731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bda5889d-c993-403b-85b1-4a00810a42ae tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151563 Aug 18 22:15:08.941298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1669/3341] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:08 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:08.971745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f1b66ce7-f854-403b-b470-1bd690b25913 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:08.972591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f1b66ce7-f854-403b-b470-1bd690b25913 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:08.976945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-243e7a4d-3e8e-4651-9b53-51bbe93146dd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:08.977554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-243e7a4d-3e8e-4651-9b53-51bbe93146dd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:08.978685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b66ce7-f854-403b-b470-1bd690b25913 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:08.979168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b66ce7-f854-403b-b470-1bd690b25913 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:08.979603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b66ce7-f854-403b-b470-1bd690b25913 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:08.980365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b66ce7-f854-403b-b470-1bd690b25913 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:08.980820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b66ce7-f854-403b-b470-1bd690b25913 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:08.981241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f1b66ce7-f854-403b-b470-1bd690b25913 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:08.983543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-243e7a4d-3e8e-4651-9b53-51bbe93146dd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:08.984016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-243e7a4d-3e8e-4651-9b53-51bbe93146dd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:08.984446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-243e7a4d-3e8e-4651-9b53-51bbe93146dd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:08.985123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-243e7a4d-3e8e-4651-9b53-51bbe93146dd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:08.985575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-243e7a4d-3e8e-4651-9b53-51bbe93146dd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:08.986026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-243e7a4d-3e8e-4651-9b53-51bbe93146dd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:09.111695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f1b66ce7-f854-403b-b470-1bd690b25913 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:09.117188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-243e7a4d-3e8e-4651-9b53-51bbe93146dd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:09.120297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f1b66ce7-f854-403b-b470-1bd690b25913 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152792 Aug 18 22:15:09.120891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1673/3342] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:08 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:09.126128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-243e7a4d-3e8e-4651-9b53-51bbe93146dd tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152764 Aug 18 22:15:09.126709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1670/3343] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:08 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:09.416758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-272b49e8-385c-4363-b104-dbecc0623b16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:09.417403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-272b49e8-385c-4363-b104-dbecc0623b16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:09.423847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-272b49e8-385c-4363-b104-dbecc0623b16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:09.424326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-272b49e8-385c-4363-b104-dbecc0623b16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:09.424761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-272b49e8-385c-4363-b104-dbecc0623b16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:09.425445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-272b49e8-385c-4363-b104-dbecc0623b16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:09.425926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-272b49e8-385c-4363-b104-dbecc0623b16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:09.426615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-272b49e8-385c-4363-b104-dbecc0623b16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:09.555438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-272b49e8-385c-4363-b104-dbecc0623b16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:09.565735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-272b49e8-385c-4363-b104-dbecc0623b16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:09.567265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-272b49e8-385c-4363-b104-dbecc0623b16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:09.568430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-272b49e8-385c-4363-b104-dbecc0623b16 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155520 Aug 18 22:15:09.569002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1674/3344] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:15:09.827253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-226aec7f-bffb-4b8d-9028-59470116236d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:09.827787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-226aec7f-bffb-4b8d-9028-59470116236d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:09.834187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-226aec7f-bffb-4b8d-9028-59470116236d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:09.834667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-226aec7f-bffb-4b8d-9028-59470116236d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:09.835099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-226aec7f-bffb-4b8d-9028-59470116236d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:09.835776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-226aec7f-bffb-4b8d-9028-59470116236d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:09.836226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-226aec7f-bffb-4b8d-9028-59470116236d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:09.836650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-226aec7f-bffb-4b8d-9028-59470116236d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:09.962290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dd6f4193-6749-4bff-8d0d-c4c6a77bd6aa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:09.963030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dd6f4193-6749-4bff-8d0d-c4c6a77bd6aa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:09.964889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-226aec7f-bffb-4b8d-9028-59470116236d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:09.970739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd6f4193-6749-4bff-8d0d-c4c6a77bd6aa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:09.971231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd6f4193-6749-4bff-8d0d-c4c6a77bd6aa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:09.971675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd6f4193-6749-4bff-8d0d-c4c6a77bd6aa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:09.972421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd6f4193-6749-4bff-8d0d-c4c6a77bd6aa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:09.972879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd6f4193-6749-4bff-8d0d-c4c6a77bd6aa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:09.973309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dd6f4193-6749-4bff-8d0d-c4c6a77bd6aa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:09.973628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-226aec7f-bffb-4b8d-9028-59470116236d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150169 Aug 18 22:15:09.974206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1671/3345] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:09 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:10.099549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dd6f4193-6749-4bff-8d0d-c4c6a77bd6aa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:10.107708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dd6f4193-6749-4bff-8d0d-c4c6a77bd6aa tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149226 Aug 18 22:15:10.108886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1675/3346] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:09 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:10.142141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cbb470b2-5db4-4870-b0bd-9162d5b34d28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:10.142767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cbb470b2-5db4-4870-b0bd-9162d5b34d28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:10.146472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7ec43eb9-ddf2-4aa1-a904-682d7122667f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:10.147085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7ec43eb9-ddf2-4aa1-a904-682d7122667f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:10.148836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbb470b2-5db4-4870-b0bd-9162d5b34d28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:10.149327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbb470b2-5db4-4870-b0bd-9162d5b34d28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:10.149800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbb470b2-5db4-4870-b0bd-9162d5b34d28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:10.150501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbb470b2-5db4-4870-b0bd-9162d5b34d28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:10.150960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbb470b2-5db4-4870-b0bd-9162d5b34d28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:10.151389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbb470b2-5db4-4870-b0bd-9162d5b34d28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:10.152987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ec43eb9-ddf2-4aa1-a904-682d7122667f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:10.153497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ec43eb9-ddf2-4aa1-a904-682d7122667f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:10.154041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ec43eb9-ddf2-4aa1-a904-682d7122667f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:10.154727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ec43eb9-ddf2-4aa1-a904-682d7122667f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:10.155822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ec43eb9-ddf2-4aa1-a904-682d7122667f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:10.156251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7ec43eb9-ddf2-4aa1-a904-682d7122667f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:10.281795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cbb470b2-5db4-4870-b0bd-9162d5b34d28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:10.290038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7ec43eb9-ddf2-4aa1-a904-682d7122667f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:10.290202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cbb470b2-5db4-4870-b0bd-9162d5b34d28 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152289 Aug 18 22:15:10.290654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1672/3347] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:10 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:10.298354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7ec43eb9-ddf2-4aa1-a904-682d7122667f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155730 Aug 18 22:15:10.298925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1676/3348] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:10 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:10.590910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a53ffff7-f24c-4851-b6f2-49b5a32b1c5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:10.591539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a53ffff7-f24c-4851-b6f2-49b5a32b1c5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:10.597580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a53ffff7-f24c-4851-b6f2-49b5a32b1c5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:10.598098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a53ffff7-f24c-4851-b6f2-49b5a32b1c5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:10.598536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a53ffff7-f24c-4851-b6f2-49b5a32b1c5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:10.599264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a53ffff7-f24c-4851-b6f2-49b5a32b1c5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:10.599721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a53ffff7-f24c-4851-b6f2-49b5a32b1c5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:10.600150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a53ffff7-f24c-4851-b6f2-49b5a32b1c5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:10.740397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a53ffff7-f24c-4851-b6f2-49b5a32b1c5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:10.750049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a53ffff7-f24c-4851-b6f2-49b5a32b1c5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:10.751574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a53ffff7-f24c-4851-b6f2-49b5a32b1c5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:10.752749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a53ffff7-f24c-4851-b6f2-49b5a32b1c5c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.165738 Aug 18 22:15:10.753510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1673/3349] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:10.995963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a5177ecd-698b-469a-b6aa-c74576b372bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:10.996519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a5177ecd-698b-469a-b6aa-c74576b372bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:11.003982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5177ecd-698b-469a-b6aa-c74576b372bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:11.004531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5177ecd-698b-469a-b6aa-c74576b372bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:11.005074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5177ecd-698b-469a-b6aa-c74576b372bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:11.005670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5177ecd-698b-469a-b6aa-c74576b372bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:11.006130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5177ecd-698b-469a-b6aa-c74576b372bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:11.006559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5177ecd-698b-469a-b6aa-c74576b372bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:11.129061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-042dce72-cb5b-441b-877f-241f3aa3c7b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:11.129717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-042dce72-cb5b-441b-877f-241f3aa3c7b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:11.133192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a5177ecd-698b-469a-b6aa-c74576b372bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:11.136145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-042dce72-cb5b-441b-877f-241f3aa3c7b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:11.136640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-042dce72-cb5b-441b-877f-241f3aa3c7b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:11.137082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-042dce72-cb5b-441b-877f-241f3aa3c7b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:11.137815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-042dce72-cb5b-441b-877f-241f3aa3c7b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:11.138276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-042dce72-cb5b-441b-877f-241f3aa3c7b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:11.138708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-042dce72-cb5b-441b-877f-241f3aa3c7b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:11.141670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a5177ecd-698b-469a-b6aa-c74576b372bc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149631 Aug 18 22:15:11.142502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1677/3350] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:10 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:11.268861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-042dce72-cb5b-441b-877f-241f3aa3c7b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:11.277156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-042dce72-cb5b-441b-877f-241f3aa3c7b4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151977 Aug 18 22:15:11.277756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1674/3351] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:11.311415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9d91f2c6-9b8b-481b-85bd-f3f88bdc9369 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:11.312068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9d91f2c6-9b8b-481b-85bd-f3f88bdc9369 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:11.317946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c00f4141-953f-4f6e-a97f-3a993610f838 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:11.318308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d91f2c6-9b8b-481b-85bd-f3f88bdc9369 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:11.318563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c00f4141-953f-4f6e-a97f-3a993610f838 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:11.318787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d91f2c6-9b8b-481b-85bd-f3f88bdc9369 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:11.319217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d91f2c6-9b8b-481b-85bd-f3f88bdc9369 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:11.319930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d91f2c6-9b8b-481b-85bd-f3f88bdc9369 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:11.320384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d91f2c6-9b8b-481b-85bd-f3f88bdc9369 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:11.320807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d91f2c6-9b8b-481b-85bd-f3f88bdc9369 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:11.324331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c00f4141-953f-4f6e-a97f-3a993610f838 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:11.325006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c00f4141-953f-4f6e-a97f-3a993610f838 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:11.325342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c00f4141-953f-4f6e-a97f-3a993610f838 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:11.326077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c00f4141-953f-4f6e-a97f-3a993610f838 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:11.326531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c00f4141-953f-4f6e-a97f-3a993610f838 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:11.326957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c00f4141-953f-4f6e-a97f-3a993610f838 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:11.449193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9d91f2c6-9b8b-481b-85bd-f3f88bdc9369 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:11.457567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9d91f2c6-9b8b-481b-85bd-f3f88bdc9369 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149915 Aug 18 22:15:11.458179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1678/3352] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:11.458315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c00f4141-953f-4f6e-a97f-3a993610f838 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:11.466401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c00f4141-953f-4f6e-a97f-3a993610f838 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152194 Aug 18 22:15:11.466958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1675/3353] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:11 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:11.775243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-887f98fe-c84a-41b6-8861-c8d8e126c87a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:11.775870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-887f98fe-c84a-41b6-8861-c8d8e126c87a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:11.782614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-887f98fe-c84a-41b6-8861-c8d8e126c87a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:11.783104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-887f98fe-c84a-41b6-8861-c8d8e126c87a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:11.783545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-887f98fe-c84a-41b6-8861-c8d8e126c87a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:11.784237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-887f98fe-c84a-41b6-8861-c8d8e126c87a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:11.784692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-887f98fe-c84a-41b6-8861-c8d8e126c87a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:11.785121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-887f98fe-c84a-41b6-8861-c8d8e126c87a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:11.915770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-887f98fe-c84a-41b6-8861-c8d8e126c87a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:11.924648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-887f98fe-c84a-41b6-8861-c8d8e126c87a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:11.926519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-887f98fe-c84a-41b6-8861-c8d8e126c87a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:11.927656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-887f98fe-c84a-41b6-8861-c8d8e126c87a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156274 Aug 18 22:15:11.928209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1679/3354] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:12.162458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9a72ab23-bdd5-469a-af12-8ab3aada86eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:12.163081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9a72ab23-bdd5-469a-af12-8ab3aada86eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:12.169640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a72ab23-bdd5-469a-af12-8ab3aada86eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:12.170130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a72ab23-bdd5-469a-af12-8ab3aada86eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:12.170574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a72ab23-bdd5-469a-af12-8ab3aada86eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:12.171272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a72ab23-bdd5-469a-af12-8ab3aada86eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:12.171738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a72ab23-bdd5-469a-af12-8ab3aada86eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:12.172169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a72ab23-bdd5-469a-af12-8ab3aada86eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:12.298928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2bbd6701-7b51-4030-aa1e-e4529fc39f1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:12.299548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2bbd6701-7b51-4030-aa1e-e4529fc39f1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:12.300546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9a72ab23-bdd5-469a-af12-8ab3aada86eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:12.306348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bbd6701-7b51-4030-aa1e-e4529fc39f1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:12.306829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bbd6701-7b51-4030-aa1e-e4529fc39f1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:12.307274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bbd6701-7b51-4030-aa1e-e4529fc39f1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:12.307968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bbd6701-7b51-4030-aa1e-e4529fc39f1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:12.308423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bbd6701-7b51-4030-aa1e-e4529fc39f1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:12.308847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2bbd6701-7b51-4030-aa1e-e4529fc39f1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:12.308961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9a72ab23-bdd5-469a-af12-8ab3aada86eb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150344 Aug 18 22:15:12.309659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1676/3355] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:12 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:12.438488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2bbd6701-7b51-4030-aa1e-e4529fc39f1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:12.446514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2bbd6701-7b51-4030-aa1e-e4529fc39f1c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151464 Aug 18 22:15:12.447221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1680/3356] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:12 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:12.479235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c281e85b-583e-4849-bca4-9cb45b30faff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:12.479854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c281e85b-583e-4849-bca4-9cb45b30faff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:12.486365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c281e85b-583e-4849-bca4-9cb45b30faff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:12.486848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c281e85b-583e-4849-bca4-9cb45b30faff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:12.487288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c281e85b-583e-4849-bca4-9cb45b30faff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:12.487942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9d57c392-370b-4d27-be3f-849f04254b19 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:12.488073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c281e85b-583e-4849-bca4-9cb45b30faff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:12.488505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c281e85b-583e-4849-bca4-9cb45b30faff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:12.488636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9d57c392-370b-4d27-be3f-849f04254b19 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:12.488929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c281e85b-583e-4849-bca4-9cb45b30faff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:12.494486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d57c392-370b-4d27-be3f-849f04254b19 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:12.494966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d57c392-370b-4d27-be3f-849f04254b19 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:12.495403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d57c392-370b-4d27-be3f-849f04254b19 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:12.496088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d57c392-370b-4d27-be3f-849f04254b19 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:12.496598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d57c392-370b-4d27-be3f-849f04254b19 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:12.497033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d57c392-370b-4d27-be3f-849f04254b19 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:12.630285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c281e85b-583e-4849-bca4-9cb45b30faff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:12.632400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9d57c392-370b-4d27-be3f-849f04254b19 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:12.638571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c281e85b-583e-4849-bca4-9cb45b30faff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.163180 Aug 18 22:15:12.639149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1677/3357] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:12 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:12.640490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9d57c392-370b-4d27-be3f-849f04254b19 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156310 Aug 18 22:15:12.641058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1681/3358] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:12 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:12.949335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-758a5e7d-e7a7-4e77-8f08-56671aa49999 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:12.949987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-758a5e7d-e7a7-4e77-8f08-56671aa49999 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:12.955970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-758a5e7d-e7a7-4e77-8f08-56671aa49999 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:12.956454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-758a5e7d-e7a7-4e77-8f08-56671aa49999 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:12.956898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-758a5e7d-e7a7-4e77-8f08-56671aa49999 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:12.957588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-758a5e7d-e7a7-4e77-8f08-56671aa49999 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:12.958075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-758a5e7d-e7a7-4e77-8f08-56671aa49999 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:12.958504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-758a5e7d-e7a7-4e77-8f08-56671aa49999 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:13.085460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-758a5e7d-e7a7-4e77-8f08-56671aa49999 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:13.094750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-758a5e7d-e7a7-4e77-8f08-56671aa49999 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:13.096263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-758a5e7d-e7a7-4e77-8f08-56671aa49999 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:13.097415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-758a5e7d-e7a7-4e77-8f08-56671aa49999 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151983 Aug 18 22:15:13.098006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1678/3359] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:12 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:13.332709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5a9af3c2-1a72-4b44-9d24-077eb280752a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:13.333228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5a9af3c2-1a72-4b44-9d24-077eb280752a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:13.339666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9af3c2-1a72-4b44-9d24-077eb280752a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:13.340139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9af3c2-1a72-4b44-9d24-077eb280752a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:13.340568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9af3c2-1a72-4b44-9d24-077eb280752a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:13.341243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9af3c2-1a72-4b44-9d24-077eb280752a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:13.341714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9af3c2-1a72-4b44-9d24-077eb280752a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:13.342131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a9af3c2-1a72-4b44-9d24-077eb280752a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:13.468391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e892c249-0506-4c42-90f8-aeb970ce54f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:13.468896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5a9af3c2-1a72-4b44-9d24-077eb280752a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:13.469065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e892c249-0506-4c42-90f8-aeb970ce54f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:13.475362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e892c249-0506-4c42-90f8-aeb970ce54f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:13.475842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e892c249-0506-4c42-90f8-aeb970ce54f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:13.476276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e892c249-0506-4c42-90f8-aeb970ce54f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:13.476862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5a9af3c2-1a72-4b44-9d24-077eb280752a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148024 Aug 18 22:15:13.476978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e892c249-0506-4c42-90f8-aeb970ce54f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:13.477397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e892c249-0506-4c42-90f8-aeb970ce54f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:13.477527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1682/3360] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:13 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:13.477843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e892c249-0506-4c42-90f8-aeb970ce54f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:13.605224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e892c249-0506-4c42-90f8-aeb970ce54f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:13.613419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e892c249-0506-4c42-90f8-aeb970ce54f8 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149657 Aug 18 22:15:13.614015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1679/3361] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:13.659493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f5eaf19-74a7-4fb1-9063-7c67bffa85f3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:13.660019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e043d276-bead-4410-bb4e-fdc13bfff31c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:13.660139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f5eaf19-74a7-4fb1-9063-7c67bffa85f3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:13.660642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e043d276-bead-4410-bb4e-fdc13bfff31c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:13.666037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f5eaf19-74a7-4fb1-9063-7c67bffa85f3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:13.666495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e043d276-bead-4410-bb4e-fdc13bfff31c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:13.666622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f5eaf19-74a7-4fb1-9063-7c67bffa85f3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:13.666947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f5eaf19-74a7-4fb1-9063-7c67bffa85f3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:13.667066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e043d276-bead-4410-bb4e-fdc13bfff31c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:13.667417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e043d276-bead-4410-bb4e-fdc13bfff31c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:13.667622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f5eaf19-74a7-4fb1-9063-7c67bffa85f3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:13.668074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f5eaf19-74a7-4fb1-9063-7c67bffa85f3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:13.668187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e043d276-bead-4410-bb4e-fdc13bfff31c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:13.668588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e043d276-bead-4410-bb4e-fdc13bfff31c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:13.668715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f5eaf19-74a7-4fb1-9063-7c67bffa85f3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:13.668991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e043d276-bead-4410-bb4e-fdc13bfff31c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:13.800907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4f5eaf19-74a7-4fb1-9063-7c67bffa85f3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:13.801792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e043d276-bead-4410-bb4e-fdc13bfff31c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:13.809497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f5eaf19-74a7-4fb1-9063-7c67bffa85f3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153866 Aug 18 22:15:13.809809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e043d276-bead-4410-bb4e-fdc13bfff31c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153327 Aug 18 22:15:13.810116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1683/3362] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:13 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:13.810383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1680/3363] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:13 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:14.120191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-896f4a9e-47c6-4c3f-9706-1e855ed50bf5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:14.120802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-896f4a9e-47c6-4c3f-9706-1e855ed50bf5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:14.127429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-896f4a9e-47c6-4c3f-9706-1e855ed50bf5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:14.127905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-896f4a9e-47c6-4c3f-9706-1e855ed50bf5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:14.128332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-896f4a9e-47c6-4c3f-9706-1e855ed50bf5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:14.129012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-896f4a9e-47c6-4c3f-9706-1e855ed50bf5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:14.129460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-896f4a9e-47c6-4c3f-9706-1e855ed50bf5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:14.129941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-896f4a9e-47c6-4c3f-9706-1e855ed50bf5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:14.257453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-896f4a9e-47c6-4c3f-9706-1e855ed50bf5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:14.265943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-896f4a9e-47c6-4c3f-9706-1e855ed50bf5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:14.267430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-896f4a9e-47c6-4c3f-9706-1e855ed50bf5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:14.268563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-896f4a9e-47c6-4c3f-9706-1e855ed50bf5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152233 Aug 18 22:15:14.269118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1684/3364] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:14.498682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2d76069f-e21f-469a-bbb9-77d6f7d8b9a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:14.499270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2d76069f-e21f-469a-bbb9-77d6f7d8b9a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:14.505751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d76069f-e21f-469a-bbb9-77d6f7d8b9a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:14.506241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d76069f-e21f-469a-bbb9-77d6f7d8b9a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:14.506691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d76069f-e21f-469a-bbb9-77d6f7d8b9a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:14.507391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d76069f-e21f-469a-bbb9-77d6f7d8b9a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:14.507849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d76069f-e21f-469a-bbb9-77d6f7d8b9a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:14.508285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d76069f-e21f-469a-bbb9-77d6f7d8b9a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:14.634706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2d76069f-e21f-469a-bbb9-77d6f7d8b9a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:14.635216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b414cf39-2355-43c2-9a44-d91f19d795a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:14.635860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b414cf39-2355-43c2-9a44-d91f19d795a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:14.642518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b414cf39-2355-43c2-9a44-d91f19d795a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:14.642994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b414cf39-2355-43c2-9a44-d91f19d795a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:14.643433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b414cf39-2355-43c2-9a44-d91f19d795a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:14.643655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2d76069f-e21f-469a-bbb9-77d6f7d8b9a6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149230 Aug 18 22:15:14.644146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b414cf39-2355-43c2-9a44-d91f19d795a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:14.644534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1681/3365] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:14 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:14.644830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b414cf39-2355-43c2-9a44-d91f19d795a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:14.645442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b414cf39-2355-43c2-9a44-d91f19d795a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:14.773325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b414cf39-2355-43c2-9a44-d91f19d795a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:14.782108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b414cf39-2355-43c2-9a44-d91f19d795a5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150660 Aug 18 22:15:14.782676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1685/3366] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:14.841176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c6c97622-9db5-4542-9d78-0f8de2d4db04 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:14.841376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a50b1449-eb68-4081-9f9a-497493b7b6c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:14.841808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c6c97622-9db5-4542-9d78-0f8de2d4db04 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:14.841941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a50b1449-eb68-4081-9f9a-497493b7b6c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:14.848332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6c97622-9db5-4542-9d78-0f8de2d4db04 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:14.848804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6c97622-9db5-4542-9d78-0f8de2d4db04 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:14.849118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a50b1449-eb68-4081-9f9a-497493b7b6c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:14.849242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6c97622-9db5-4542-9d78-0f8de2d4db04 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:14.849622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a50b1449-eb68-4081-9f9a-497493b7b6c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:14.849926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6c97622-9db5-4542-9d78-0f8de2d4db04 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:14.850064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a50b1449-eb68-4081-9f9a-497493b7b6c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:14.850373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6c97622-9db5-4542-9d78-0f8de2d4db04 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:14.850748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a50b1449-eb68-4081-9f9a-497493b7b6c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:14.850859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6c97622-9db5-4542-9d78-0f8de2d4db04 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:14.851200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a50b1449-eb68-4081-9f9a-497493b7b6c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:14.851622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a50b1449-eb68-4081-9f9a-497493b7b6c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:14.983962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a50b1449-eb68-4081-9f9a-497493b7b6c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:14.989564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c6c97622-9db5-4542-9d78-0f8de2d4db04 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:14.993025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a50b1449-eb68-4081-9f9a-497493b7b6c4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155494 Aug 18 22:15:14.993631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1682/3367] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:14.999236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c6c97622-9db5-4542-9d78-0f8de2d4db04 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.161232 Aug 18 22:15:15.001947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1686/3368] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:14 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:15.291838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7ea2f774-c008-44e8-994f-2afd82e85d94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:15.292391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7ea2f774-c008-44e8-994f-2afd82e85d94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:15.298533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ea2f774-c008-44e8-994f-2afd82e85d94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:15.299021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ea2f774-c008-44e8-994f-2afd82e85d94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:15.299464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ea2f774-c008-44e8-994f-2afd82e85d94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:15.300158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ea2f774-c008-44e8-994f-2afd82e85d94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:15.300626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ea2f774-c008-44e8-994f-2afd82e85d94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:15.301303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ea2f774-c008-44e8-994f-2afd82e85d94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:15.427590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7ea2f774-c008-44e8-994f-2afd82e85d94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:15.436874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7ea2f774-c008-44e8-994f-2afd82e85d94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:15.438734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7ea2f774-c008-44e8-994f-2afd82e85d94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:15.439874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7ea2f774-c008-44e8-994f-2afd82e85d94 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152087 Aug 18 22:15:15.440448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1683/3369] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:15.666042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6b36aed6-a47e-4408-a6fd-dbfd0517f10b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:15.666573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6b36aed6-a47e-4408-a6fd-dbfd0517f10b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:15.673099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b36aed6-a47e-4408-a6fd-dbfd0517f10b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:15.673614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b36aed6-a47e-4408-a6fd-dbfd0517f10b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:15.674059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b36aed6-a47e-4408-a6fd-dbfd0517f10b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:15.674764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b36aed6-a47e-4408-a6fd-dbfd0517f10b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:15.675223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b36aed6-a47e-4408-a6fd-dbfd0517f10b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:15.675653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b36aed6-a47e-4408-a6fd-dbfd0517f10b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:15.678599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:15.803388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-24c89fdb-fb6b-46ff-8030-23a3e005f798 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:15.804138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-24c89fdb-fb6b-46ff-8030-23a3e005f798 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:15.808089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6b36aed6-a47e-4408-a6fd-dbfd0517f10b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:15.811332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24c89fdb-fb6b-46ff-8030-23a3e005f798 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:15.811822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24c89fdb-fb6b-46ff-8030-23a3e005f798 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:15.812257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24c89fdb-fb6b-46ff-8030-23a3e005f798 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:15.812958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24c89fdb-fb6b-46ff-8030-23a3e005f798 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:15.813409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24c89fdb-fb6b-46ff-8030-23a3e005f798 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:15.813891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-24c89fdb-fb6b-46ff-8030-23a3e005f798 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:15.817128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6b36aed6-a47e-4408-a6fd-dbfd0517f10b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155146 Aug 18 22:15:15.817927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1687/3370] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:15 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:16.015364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-161906ab-6e26-4e9a-913d-814e21004327 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:16.015985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-161906ab-6e26-4e9a-913d-814e21004327 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:16.022022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-161906ab-6e26-4e9a-913d-814e21004327 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:16.022509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-161906ab-6e26-4e9a-913d-814e21004327 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:16.022950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-161906ab-6e26-4e9a-913d-814e21004327 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:16.023642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-161906ab-6e26-4e9a-913d-814e21004327 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:16.024099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-161906ab-6e26-4e9a-913d-814e21004327 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:16.024524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-161906ab-6e26-4e9a-913d-814e21004327 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:16.028770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-24c89fdb-fb6b-46ff-8030-23a3e005f798 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:16.037626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-24c89fdb-fb6b-46ff-8030-23a3e005f798 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.238220 Aug 18 22:15:16.038200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1684/3371] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:15 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:16.058781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ab067dce-7af2-48f5-bc3f-c34fa1536de7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:16.060716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ab067dce-7af2-48f5-bc3f-c34fa1536de7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:16.065532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab067dce-7af2-48f5-bc3f-c34fa1536de7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:16.066074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab067dce-7af2-48f5-bc3f-c34fa1536de7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:16.066509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab067dce-7af2-48f5-bc3f-c34fa1536de7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:16.067205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab067dce-7af2-48f5-bc3f-c34fa1536de7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:16.067658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab067dce-7af2-48f5-bc3f-c34fa1536de7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:16.068082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab067dce-7af2-48f5-bc3f-c34fa1536de7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:16.172776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-161906ab-6e26-4e9a-913d-814e21004327 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:16.181298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-161906ab-6e26-4e9a-913d-814e21004327 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.169954 Aug 18 22:15:16.181921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1688/3372] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:16.269877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ab067dce-7af2-48f5-bc3f-c34fa1536de7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:16.272049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:16.279885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ab067dce-7af2-48f5-bc3f-c34fa1536de7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.226894 Aug 18 22:15:16.281188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1685/3373] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:16 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:16.462765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5cd6fc42-dabb-4136-b64f-01d9ca0fbd46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:16.463382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5cd6fc42-dabb-4136-b64f-01d9ca0fbd46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:16.470271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cd6fc42-dabb-4136-b64f-01d9ca0fbd46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:16.470762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cd6fc42-dabb-4136-b64f-01d9ca0fbd46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:16.471204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cd6fc42-dabb-4136-b64f-01d9ca0fbd46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:16.471898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cd6fc42-dabb-4136-b64f-01d9ca0fbd46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:16.472355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cd6fc42-dabb-4136-b64f-01d9ca0fbd46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:16.472788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cd6fc42-dabb-4136-b64f-01d9ca0fbd46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:16.596786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5cd6fc42-dabb-4136-b64f-01d9ca0fbd46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:16.605288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5cd6fc42-dabb-4136-b64f-01d9ca0fbd46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:16.606861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5cd6fc42-dabb-4136-b64f-01d9ca0fbd46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:16.608019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5cd6fc42-dabb-4136-b64f-01d9ca0fbd46 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.149177 Aug 18 22:15:16.608661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1689/3374] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:16.838901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a4876c20-08a1-41d7-b433-0b4a15841988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:16.839548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a4876c20-08a1-41d7-b433-0b4a15841988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:16.846050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4876c20-08a1-41d7-b433-0b4a15841988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:16.846538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4876c20-08a1-41d7-b433-0b4a15841988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:16.846979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4876c20-08a1-41d7-b433-0b4a15841988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:16.847674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4876c20-08a1-41d7-b433-0b4a15841988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:16.848469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4876c20-08a1-41d7-b433-0b4a15841988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:16.848910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4876c20-08a1-41d7-b433-0b4a15841988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:16.979741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a4876c20-08a1-41d7-b433-0b4a15841988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:16.988463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a4876c20-08a1-41d7-b433-0b4a15841988 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153472 Aug 18 22:15:16.989034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1686/3375] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:16 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:17.059272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-61d55edf-d91d-4ee3-b1c6-6732da1c9306 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:17.059888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-61d55edf-d91d-4ee3-b1c6-6732da1c9306 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:17.067020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61d55edf-d91d-4ee3-b1c6-6732da1c9306 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:17.067503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61d55edf-d91d-4ee3-b1c6-6732da1c9306 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:17.067942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61d55edf-d91d-4ee3-b1c6-6732da1c9306 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:17.068637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61d55edf-d91d-4ee3-b1c6-6732da1c9306 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:17.069097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61d55edf-d91d-4ee3-b1c6-6732da1c9306 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:17.069527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61d55edf-d91d-4ee3-b1c6-6732da1c9306 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:17.196519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-61d55edf-d91d-4ee3-b1c6-6732da1c9306 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:17.202087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7e8398f2-a1e8-41c4-824d-cf5e0b25f0de tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:17.202707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7e8398f2-a1e8-41c4-824d-cf5e0b25f0de tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:17.204683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-61d55edf-d91d-4ee3-b1c6-6732da1c9306 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149176 Aug 18 22:15:17.205255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1690/3376] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:17 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:17.208607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e8398f2-a1e8-41c4-824d-cf5e0b25f0de tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:17.209174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e8398f2-a1e8-41c4-824d-cf5e0b25f0de tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:17.209713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e8398f2-a1e8-41c4-824d-cf5e0b25f0de tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:17.210467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e8398f2-a1e8-41c4-824d-cf5e0b25f0de tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:17.210992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e8398f2-a1e8-41c4-824d-cf5e0b25f0de tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:17.211483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e8398f2-a1e8-41c4-824d-cf5e0b25f0de tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:17.301351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ae0fa96-b6d1-428e-936f-a392daaaf67b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:17.302272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ae0fa96-b6d1-428e-936f-a392daaaf67b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:17.308290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ae0fa96-b6d1-428e-936f-a392daaaf67b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:17.308770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ae0fa96-b6d1-428e-936f-a392daaaf67b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:17.309397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ae0fa96-b6d1-428e-936f-a392daaaf67b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:17.309947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ae0fa96-b6d1-428e-936f-a392daaaf67b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:17.310431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ae0fa96-b6d1-428e-936f-a392daaaf67b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:17.310867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ae0fa96-b6d1-428e-936f-a392daaaf67b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:17.340140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7e8398f2-a1e8-41c4-824d-cf5e0b25f0de tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:17.351163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7e8398f2-a1e8-41c4-824d-cf5e0b25f0de tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152812 Aug 18 22:15:17.351752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1687/3377] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:17.441808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3ae0fa96-b6d1-428e-936f-a392daaaf67b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:17.449934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ae0fa96-b6d1-428e-936f-a392daaaf67b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152635 Aug 18 22:15:17.450503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1691/3378] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:17 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:17.630328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3e0c3d8e-bfe0-4186-b3f5-ab463c8a8616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:17.630944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3e0c3d8e-bfe0-4186-b3f5-ab463c8a8616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:17.636955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e0c3d8e-bfe0-4186-b3f5-ab463c8a8616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:17.637570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e0c3d8e-bfe0-4186-b3f5-ab463c8a8616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:17.638203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e0c3d8e-bfe0-4186-b3f5-ab463c8a8616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:17.638892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e0c3d8e-bfe0-4186-b3f5-ab463c8a8616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:17.639833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e0c3d8e-bfe0-4186-b3f5-ab463c8a8616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:17.640255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e0c3d8e-bfe0-4186-b3f5-ab463c8a8616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:17.772464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3e0c3d8e-bfe0-4186-b3f5-ab463c8a8616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:17.781719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3e0c3d8e-bfe0-4186-b3f5-ab463c8a8616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:17.783210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3e0c3d8e-bfe0-4186-b3f5-ab463c8a8616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:17.784351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3e0c3d8e-bfe0-4186-b3f5-ab463c8a8616 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157899 Aug 18 22:15:17.784913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1688/3379] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:18.010567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-234befca-2307-4a02-af1b-2a57bc710f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:18.011098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-234befca-2307-4a02-af1b-2a57bc710f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:18.017773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-234befca-2307-4a02-af1b-2a57bc710f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:18.018265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-234befca-2307-4a02-af1b-2a57bc710f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:18.018697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-234befca-2307-4a02-af1b-2a57bc710f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:18.019393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-234befca-2307-4a02-af1b-2a57bc710f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:18.020164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-234befca-2307-4a02-af1b-2a57bc710f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:18.020881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-234befca-2307-4a02-af1b-2a57bc710f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:18.166432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-234befca-2307-4a02-af1b-2a57bc710f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:18.175085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-234befca-2307-4a02-af1b-2a57bc710f4f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.168377 Aug 18 22:15:18.175592 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1692/3380] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:18 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:18.225761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e1c2ee91-6873-4786-a6ba-4893f9da0c12 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:18.226380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e1c2ee91-6873-4786-a6ba-4893f9da0c12 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:18.233421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e1c2ee91-6873-4786-a6ba-4893f9da0c12 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:18.234001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e1c2ee91-6873-4786-a6ba-4893f9da0c12 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:18.234439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e1c2ee91-6873-4786-a6ba-4893f9da0c12 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:18.235125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e1c2ee91-6873-4786-a6ba-4893f9da0c12 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:18.235576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e1c2ee91-6873-4786-a6ba-4893f9da0c12 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:18.235997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e1c2ee91-6873-4786-a6ba-4893f9da0c12 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:18.372406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e1c2ee91-6873-4786-a6ba-4893f9da0c12 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:18.376393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-92a967b2-1660-43d5-b1e3-99ea9e8eac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:18.377014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-92a967b2-1660-43d5-b1e3-99ea9e8eac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:18.381647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e1c2ee91-6873-4786-a6ba-4893f9da0c12 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159711 Aug 18 22:15:18.382507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1689/3381] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:18 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:18.383151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92a967b2-1660-43d5-b1e3-99ea9e8eac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:18.383637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92a967b2-1660-43d5-b1e3-99ea9e8eac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:18.384069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92a967b2-1660-43d5-b1e3-99ea9e8eac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:18.384768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92a967b2-1660-43d5-b1e3-99ea9e8eac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:18.385214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92a967b2-1660-43d5-b1e3-99ea9e8eac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:18.385870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92a967b2-1660-43d5-b1e3-99ea9e8eac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:18.470992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5fe79216-630a-49a8-900c-596a1c90aace tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:18.471818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5fe79216-630a-49a8-900c-596a1c90aace tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:18.477948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fe79216-630a-49a8-900c-596a1c90aace tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:18.478444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fe79216-630a-49a8-900c-596a1c90aace tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:18.478888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fe79216-630a-49a8-900c-596a1c90aace tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:18.479588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fe79216-630a-49a8-900c-596a1c90aace tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:18.480047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fe79216-630a-49a8-900c-596a1c90aace tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:18.480476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fe79216-630a-49a8-900c-596a1c90aace tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:18.522056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-92a967b2-1660-43d5-b1e3-99ea9e8eac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:18.530310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-92a967b2-1660-43d5-b1e3-99ea9e8eac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.158341 Aug 18 22:15:18.530901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1693/3382] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:18.609108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5fe79216-630a-49a8-900c-596a1c90aace tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:18.617363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5fe79216-630a-49a8-900c-596a1c90aace tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150297 Aug 18 22:15:18.617969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1690/3383] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:18 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:18.807334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6557a2b1-d675-42eb-8ab5-65f07e033b33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:18.807947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6557a2b1-d675-42eb-8ab5-65f07e033b33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:18.813988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6557a2b1-d675-42eb-8ab5-65f07e033b33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:18.814467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6557a2b1-d675-42eb-8ab5-65f07e033b33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:18.814896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6557a2b1-d675-42eb-8ab5-65f07e033b33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:18.815609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6557a2b1-d675-42eb-8ab5-65f07e033b33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:18.816059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6557a2b1-d675-42eb-8ab5-65f07e033b33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:18.816481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6557a2b1-d675-42eb-8ab5-65f07e033b33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:18.943014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6557a2b1-d675-42eb-8ab5-65f07e033b33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:18.951848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6557a2b1-d675-42eb-8ab5-65f07e033b33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:18.953350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6557a2b1-d675-42eb-8ab5-65f07e033b33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:18.954579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6557a2b1-d675-42eb-8ab5-65f07e033b33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151165 Aug 18 22:15:18.955148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1694/3384] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:18 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:19.196141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0091f8a8-6d12-47aa-adc4-c1f7cf236251 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:19.196764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0091f8a8-6d12-47aa-adc4-c1f7cf236251 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:19.203309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0091f8a8-6d12-47aa-adc4-c1f7cf236251 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:19.203790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0091f8a8-6d12-47aa-adc4-c1f7cf236251 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:19.204227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0091f8a8-6d12-47aa-adc4-c1f7cf236251 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:19.204908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0091f8a8-6d12-47aa-adc4-c1f7cf236251 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:19.205358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0091f8a8-6d12-47aa-adc4-c1f7cf236251 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:19.205817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0091f8a8-6d12-47aa-adc4-c1f7cf236251 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:19.338986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0091f8a8-6d12-47aa-adc4-c1f7cf236251 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:19.347804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0091f8a8-6d12-47aa-adc4-c1f7cf236251 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155463 Aug 18 22:15:19.348377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1691/3385] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:19 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:19.406328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d4ad8277-ac5c-48af-8f6e-bc7224f6a616 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:19.406923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d4ad8277-ac5c-48af-8f6e-bc7224f6a616 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:19.413796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4ad8277-ac5c-48af-8f6e-bc7224f6a616 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:19.414271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4ad8277-ac5c-48af-8f6e-bc7224f6a616 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:19.414700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4ad8277-ac5c-48af-8f6e-bc7224f6a616 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:19.415381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4ad8277-ac5c-48af-8f6e-bc7224f6a616 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:19.415828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4ad8277-ac5c-48af-8f6e-bc7224f6a616 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:19.416246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4ad8277-ac5c-48af-8f6e-bc7224f6a616 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:19.545307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d4ad8277-ac5c-48af-8f6e-bc7224f6a616 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:19.551074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3e7500e4-8bdf-46e3-863d-9a31330a37b9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:19.552191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3e7500e4-8bdf-46e3-863d-9a31330a37b9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:19.554179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d4ad8277-ac5c-48af-8f6e-bc7224f6a616 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152886 Aug 18 22:15:19.554964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1695/3386] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:19 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:19.558124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e7500e4-8bdf-46e3-863d-9a31330a37b9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:19.558603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e7500e4-8bdf-46e3-863d-9a31330a37b9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:19.559219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e7500e4-8bdf-46e3-863d-9a31330a37b9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:19.559909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e7500e4-8bdf-46e3-863d-9a31330a37b9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:19.560361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e7500e4-8bdf-46e3-863d-9a31330a37b9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:19.560785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e7500e4-8bdf-46e3-863d-9a31330a37b9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:19.638965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8df4cf8f-bff2-4766-a873-0080a698d216 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:19.640347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8df4cf8f-bff2-4766-a873-0080a698d216 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:19.647368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8df4cf8f-bff2-4766-a873-0080a698d216 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:19.647882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8df4cf8f-bff2-4766-a873-0080a698d216 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:19.648330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8df4cf8f-bff2-4766-a873-0080a698d216 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:19.649033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8df4cf8f-bff2-4766-a873-0080a698d216 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:19.649488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8df4cf8f-bff2-4766-a873-0080a698d216 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:19.649942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8df4cf8f-bff2-4766-a873-0080a698d216 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:19.691502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3e7500e4-8bdf-46e3-863d-9a31330a37b9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:19.700188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3e7500e4-8bdf-46e3-863d-9a31330a37b9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152679 Aug 18 22:15:19.700775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1692/3387] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:19 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:19.793765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8df4cf8f-bff2-4766-a873-0080a698d216 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:19.802286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8df4cf8f-bff2-4766-a873-0080a698d216 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.167300 Aug 18 22:15:19.802859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1696/3388] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:19 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:19.978489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9f81dbd9-0a18-4527-b51c-58f334d87f34 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:19.979131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9f81dbd9-0a18-4527-b51c-58f334d87f34 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:19.985609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f81dbd9-0a18-4527-b51c-58f334d87f34 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:19.986102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f81dbd9-0a18-4527-b51c-58f334d87f34 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:19.986530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f81dbd9-0a18-4527-b51c-58f334d87f34 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:19.987217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f81dbd9-0a18-4527-b51c-58f334d87f34 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:19.987664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f81dbd9-0a18-4527-b51c-58f334d87f34 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:19.988083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f81dbd9-0a18-4527-b51c-58f334d87f34 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:20.119957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9f81dbd9-0a18-4527-b51c-58f334d87f34 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:20.129224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9f81dbd9-0a18-4527-b51c-58f334d87f34 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:20.130736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9f81dbd9-0a18-4527-b51c-58f334d87f34 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:20.131879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9f81dbd9-0a18-4527-b51c-58f334d87f34 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157287 Aug 18 22:15:20.132434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1693/3389] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:20.368055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b229cfca-42ed-465e-b637-88e42ff4326d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:20.368678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b229cfca-42ed-465e-b637-88e42ff4326d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:20.374618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b229cfca-42ed-465e-b637-88e42ff4326d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:20.375101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b229cfca-42ed-465e-b637-88e42ff4326d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:20.375537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b229cfca-42ed-465e-b637-88e42ff4326d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:20.376335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b229cfca-42ed-465e-b637-88e42ff4326d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:20.376797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b229cfca-42ed-465e-b637-88e42ff4326d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:20.377225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b229cfca-42ed-465e-b637-88e42ff4326d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:20.504164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b229cfca-42ed-465e-b637-88e42ff4326d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:20.513132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b229cfca-42ed-465e-b637-88e42ff4326d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148810 Aug 18 22:15:20.513756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1697/3390] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:20 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:20.575928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d2fc6291-9dc3-4dd0-a5aa-ea476d05faa2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:20.576507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d2fc6291-9dc3-4dd0-a5aa-ea476d05faa2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:20.583035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d2fc6291-9dc3-4dd0-a5aa-ea476d05faa2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:20.583517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d2fc6291-9dc3-4dd0-a5aa-ea476d05faa2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:20.583960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d2fc6291-9dc3-4dd0-a5aa-ea476d05faa2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:20.584640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d2fc6291-9dc3-4dd0-a5aa-ea476d05faa2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:20.585093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d2fc6291-9dc3-4dd0-a5aa-ea476d05faa2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:20.585522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d2fc6291-9dc3-4dd0-a5aa-ea476d05faa2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:20.713111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d2fc6291-9dc3-4dd0-a5aa-ea476d05faa2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:20.722596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d2fc6291-9dc3-4dd0-a5aa-ea476d05faa2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150579 Aug 18 22:15:20.722895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ba7d05a9-f561-4fb1-b947-7b64fb774d77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:20.723178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1694/3391] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:20.723600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ba7d05a9-f561-4fb1-b947-7b64fb774d77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:20.729611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba7d05a9-f561-4fb1-b947-7b64fb774d77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:20.730104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba7d05a9-f561-4fb1-b947-7b64fb774d77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:20.730542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba7d05a9-f561-4fb1-b947-7b64fb774d77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:20.731231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba7d05a9-f561-4fb1-b947-7b64fb774d77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:20.731683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba7d05a9-f561-4fb1-b947-7b64fb774d77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:20.732102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba7d05a9-f561-4fb1-b947-7b64fb774d77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:20.822555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-04fe91ee-b51f-4e09-a251-49485d553c88 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:20.823262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-04fe91ee-b51f-4e09-a251-49485d553c88 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:20.829906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04fe91ee-b51f-4e09-a251-49485d553c88 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:20.830436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04fe91ee-b51f-4e09-a251-49485d553c88 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:20.830949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04fe91ee-b51f-4e09-a251-49485d553c88 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:20.831715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04fe91ee-b51f-4e09-a251-49485d553c88 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:20.832242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04fe91ee-b51f-4e09-a251-49485d553c88 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:20.832676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04fe91ee-b51f-4e09-a251-49485d553c88 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:20.861528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ba7d05a9-f561-4fb1-b947-7b64fb774d77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:20.869975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ba7d05a9-f561-4fb1-b947-7b64fb774d77 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150961 Aug 18 22:15:20.870878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1698/3392] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:20 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:20.964374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-04fe91ee-b51f-4e09-a251-49485d553c88 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:20.973286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-04fe91ee-b51f-4e09-a251-49485d553c88 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154619 Aug 18 22:15:20.973891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1695/3393] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:20 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:21.154905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c6e4dbaf-f141-4f25-902f-01e01bc831bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:21.155429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c6e4dbaf-f141-4f25-902f-01e01bc831bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:21.161385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6e4dbaf-f141-4f25-902f-01e01bc831bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:21.161900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6e4dbaf-f141-4f25-902f-01e01bc831bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:21.162342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6e4dbaf-f141-4f25-902f-01e01bc831bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:21.163027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6e4dbaf-f141-4f25-902f-01e01bc831bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:21.163481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6e4dbaf-f141-4f25-902f-01e01bc831bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:21.163907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6e4dbaf-f141-4f25-902f-01e01bc831bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:21.291389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c6e4dbaf-f141-4f25-902f-01e01bc831bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:21.300098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c6e4dbaf-f141-4f25-902f-01e01bc831bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:21.302906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c6e4dbaf-f141-4f25-902f-01e01bc831bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:21.304325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c6e4dbaf-f141-4f25-902f-01e01bc831bf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153542 Aug 18 22:15:21.305027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1699/3394] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:21.533732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-feefa30f-f022-4b4e-a2a6-814436917c66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:21.534357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-feefa30f-f022-4b4e-a2a6-814436917c66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:21.540326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feefa30f-f022-4b4e-a2a6-814436917c66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:21.540810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feefa30f-f022-4b4e-a2a6-814436917c66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:21.541248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feefa30f-f022-4b4e-a2a6-814436917c66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:21.541963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feefa30f-f022-4b4e-a2a6-814436917c66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:21.542425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feefa30f-f022-4b4e-a2a6-814436917c66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:21.542854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feefa30f-f022-4b4e-a2a6-814436917c66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:21.673269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-feefa30f-f022-4b4e-a2a6-814436917c66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:21.681726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-feefa30f-f022-4b4e-a2a6-814436917c66 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151945 Aug 18 22:15:21.682294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1696/3395] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:21 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:21.743475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-03a22038-8165-42ba-beac-35a7b8a47c42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:21.744094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-03a22038-8165-42ba-beac-35a7b8a47c42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:21.751415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03a22038-8165-42ba-beac-35a7b8a47c42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:21.751895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03a22038-8165-42ba-beac-35a7b8a47c42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:21.752331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03a22038-8165-42ba-beac-35a7b8a47c42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:21.753023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03a22038-8165-42ba-beac-35a7b8a47c42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:21.753478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03a22038-8165-42ba-beac-35a7b8a47c42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:21.753943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-03a22038-8165-42ba-beac-35a7b8a47c42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:21.884496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-03a22038-8165-42ba-beac-35a7b8a47c42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:21.892114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dff21d52-44e1-4881-99b1-e5e9686f10c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:21.892752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dff21d52-44e1-4881-99b1-e5e9686f10c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:21.893228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-03a22038-8165-42ba-beac-35a7b8a47c42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153449 Aug 18 22:15:21.893797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1700/3396] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:21.894776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:21.900010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dff21d52-44e1-4881-99b1-e5e9686f10c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:21.900582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dff21d52-44e1-4881-99b1-e5e9686f10c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:21.901097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dff21d52-44e1-4881-99b1-e5e9686f10c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:21.901813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dff21d52-44e1-4881-99b1-e5e9686f10c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:21.902264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dff21d52-44e1-4881-99b1-e5e9686f10c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:21.902689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dff21d52-44e1-4881-99b1-e5e9686f10c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:21.993712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f833dcc7-9ec2-4567-ab97-1602e9ac3fb1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:21.994343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f833dcc7-9ec2-4567-ab97-1602e9ac3fb1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:22.000267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f833dcc7-9ec2-4567-ab97-1602e9ac3fb1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:22.000748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f833dcc7-9ec2-4567-ab97-1602e9ac3fb1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:22.001185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f833dcc7-9ec2-4567-ab97-1602e9ac3fb1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:22.001901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f833dcc7-9ec2-4567-ab97-1602e9ac3fb1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:22.002350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f833dcc7-9ec2-4567-ab97-1602e9ac3fb1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:22.002774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f833dcc7-9ec2-4567-ab97-1602e9ac3fb1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:22.031209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dff21d52-44e1-4881-99b1-e5e9686f10c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:22.039546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dff21d52-44e1-4881-99b1-e5e9686f10c6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151627 Aug 18 22:15:22.040119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1697/3397] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:21 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:22.130629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f833dcc7-9ec2-4567-ab97-1602e9ac3fb1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:22.138781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f833dcc7-9ec2-4567-ab97-1602e9ac3fb1 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149085 Aug 18 22:15:22.139855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1701/3398] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:21 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:22.328055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-83aaec0b-8cef-4559-9b62-3ef1a10de8b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:22.328696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-83aaec0b-8cef-4559-9b62-3ef1a10de8b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:22.334986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83aaec0b-8cef-4559-9b62-3ef1a10de8b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:22.335424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83aaec0b-8cef-4559-9b62-3ef1a10de8b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:22.335917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83aaec0b-8cef-4559-9b62-3ef1a10de8b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:22.336611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83aaec0b-8cef-4559-9b62-3ef1a10de8b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:22.337068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83aaec0b-8cef-4559-9b62-3ef1a10de8b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:22.337525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-83aaec0b-8cef-4559-9b62-3ef1a10de8b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:22.470806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-83aaec0b-8cef-4559-9b62-3ef1a10de8b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:22.479300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-83aaec0b-8cef-4559-9b62-3ef1a10de8b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:22.480782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-83aaec0b-8cef-4559-9b62-3ef1a10de8b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:22.481947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-83aaec0b-8cef-4559-9b62-3ef1a10de8b7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.158289 Aug 18 22:15:22.482496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1698/3399] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:22.704522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-574b19c5-8736-4f3d-945d-5862104ec606 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:22.705057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-574b19c5-8736-4f3d-945d-5862104ec606 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:22.711291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-574b19c5-8736-4f3d-945d-5862104ec606 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:22.711774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-574b19c5-8736-4f3d-945d-5862104ec606 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:22.712211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-574b19c5-8736-4f3d-945d-5862104ec606 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:22.712916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-574b19c5-8736-4f3d-945d-5862104ec606 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:22.713370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-574b19c5-8736-4f3d-945d-5862104ec606 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:22.713828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-574b19c5-8736-4f3d-945d-5862104ec606 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:22.915323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7905e7d9-6d8d-4d2f-a8d2-0169b7b7143f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:22.916010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7905e7d9-6d8d-4d2f-a8d2-0169b7b7143f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:22.923024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7905e7d9-6d8d-4d2f-a8d2-0169b7b7143f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:22.923516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7905e7d9-6d8d-4d2f-a8d2-0169b7b7143f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:22.923954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7905e7d9-6d8d-4d2f-a8d2-0169b7b7143f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:22.924650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7905e7d9-6d8d-4d2f-a8d2-0169b7b7143f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:22.925108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7905e7d9-6d8d-4d2f-a8d2-0169b7b7143f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:22.926404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7905e7d9-6d8d-4d2f-a8d2-0169b7b7143f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:22.988342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-574b19c5-8736-4f3d-945d-5862104ec606 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:22.996818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-574b19c5-8736-4f3d-945d-5862104ec606 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.296989 Aug 18 22:15:22.997405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1702/3400] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:23.062919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7905e7d9-6d8d-4d2f-a8d2-0169b7b7143f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:23.064464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aba16fe9-0f30-4455-9ce0-db44273138ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:23.065459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aba16fe9-0f30-4455-9ce0-db44273138ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:23.072035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aba16fe9-0f30-4455-9ce0-db44273138ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:23.072518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aba16fe9-0f30-4455-9ce0-db44273138ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:23.072651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7905e7d9-6d8d-4d2f-a8d2-0169b7b7143f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.161101 Aug 18 22:15:23.072956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aba16fe9-0f30-4455-9ce0-db44273138ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:23.077721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1699/3401] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:22 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:23.077905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aba16fe9-0f30-4455-9ce0-db44273138ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:23.077905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aba16fe9-0f30-4455-9ce0-db44273138ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:23.077905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aba16fe9-0f30-4455-9ce0-db44273138ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:23.160396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4e71a08d-3a14-4ff8-aec8-79eaba4c1bcf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:23.161276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4e71a08d-3a14-4ff8-aec8-79eaba4c1bcf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:23.167463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e71a08d-3a14-4ff8-aec8-79eaba4c1bcf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:23.167960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e71a08d-3a14-4ff8-aec8-79eaba4c1bcf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:23.168411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e71a08d-3a14-4ff8-aec8-79eaba4c1bcf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:23.169494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e71a08d-3a14-4ff8-aec8-79eaba4c1bcf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:23.169805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e71a08d-3a14-4ff8-aec8-79eaba4c1bcf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:23.170237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e71a08d-3a14-4ff8-aec8-79eaba4c1bcf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:23.206827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aba16fe9-0f30-4455-9ce0-db44273138ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:23.209092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:23.216312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aba16fe9-0f30-4455-9ce0-db44273138ca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.158434 Aug 18 22:15:23.216888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1703/3402] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:23 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:23.302483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4e71a08d-3a14-4ff8-aec8-79eaba4c1bcf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:23.310572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4e71a08d-3a14-4ff8-aec8-79eaba4c1bcf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154237 Aug 18 22:15:23.311223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1700/3403] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:23 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:23.504695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0a19535-7cb7-4057-9e78-8383026fb8e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:23.505390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d0a19535-7cb7-4057-9e78-8383026fb8e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:23.511274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0a19535-7cb7-4057-9e78-8383026fb8e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:23.511755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0a19535-7cb7-4057-9e78-8383026fb8e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:23.512192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0a19535-7cb7-4057-9e78-8383026fb8e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:23.512881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0a19535-7cb7-4057-9e78-8383026fb8e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:23.513332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0a19535-7cb7-4057-9e78-8383026fb8e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:23.513798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0a19535-7cb7-4057-9e78-8383026fb8e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:23.639046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d0a19535-7cb7-4057-9e78-8383026fb8e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:23.648431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d0a19535-7cb7-4057-9e78-8383026fb8e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:23.649950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d0a19535-7cb7-4057-9e78-8383026fb8e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:23.651115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d0a19535-7cb7-4057-9e78-8383026fb8e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150660 Aug 18 22:15:23.651669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1704/3404] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:24.019621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8ed94389-cffa-47c6-a112-5e222132e6f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:24.020245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8ed94389-cffa-47c6-a112-5e222132e6f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:24.026770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ed94389-cffa-47c6-a112-5e222132e6f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:24.027254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ed94389-cffa-47c6-a112-5e222132e6f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:24.027694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ed94389-cffa-47c6-a112-5e222132e6f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:24.028387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ed94389-cffa-47c6-a112-5e222132e6f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:24.028834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ed94389-cffa-47c6-a112-5e222132e6f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:24.029258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ed94389-cffa-47c6-a112-5e222132e6f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:24.094023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ff150ca8-8ae1-415d-b4ca-c9c4ce0b0e62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:24.094640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ff150ca8-8ae1-415d-b4ca-c9c4ce0b0e62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:24.100999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff150ca8-8ae1-415d-b4ca-c9c4ce0b0e62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:24.101488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff150ca8-8ae1-415d-b4ca-c9c4ce0b0e62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:24.101954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff150ca8-8ae1-415d-b4ca-c9c4ce0b0e62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:24.102647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff150ca8-8ae1-415d-b4ca-c9c4ce0b0e62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:24.103103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff150ca8-8ae1-415d-b4ca-c9c4ce0b0e62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:24.103531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff150ca8-8ae1-415d-b4ca-c9c4ce0b0e62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:24.157524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8ed94389-cffa-47c6-a112-5e222132e6f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:24.165787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8ed94389-cffa-47c6-a112-5e222132e6f4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150014 Aug 18 22:15:24.166361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1701/3405] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:24 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:24.235142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ff150ca8-8ae1-415d-b4ca-c9c4ce0b0e62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:24.236489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2ec32f0e-a26f-4deb-afd7-865390b5ba27 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:24.237203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2ec32f0e-a26f-4deb-afd7-865390b5ba27 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:24.243103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ec32f0e-a26f-4deb-afd7-865390b5ba27 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:24.243581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ec32f0e-a26f-4deb-afd7-865390b5ba27 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:24.243713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ff150ca8-8ae1-415d-b4ca-c9c4ce0b0e62 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153401 Aug 18 22:15:24.244011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ec32f0e-a26f-4deb-afd7-865390b5ba27 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:24.244225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1705/3406] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:24 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:24.244695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ec32f0e-a26f-4deb-afd7-865390b5ba27 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:24.245140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ec32f0e-a26f-4deb-afd7-865390b5ba27 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:24.245559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ec32f0e-a26f-4deb-afd7-865390b5ba27 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:24.260630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:24.332851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-842b2a92-da46-4b85-9ca0-00217942f091 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:24.333476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-842b2a92-da46-4b85-9ca0-00217942f091 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:24.339520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-842b2a92-da46-4b85-9ca0-00217942f091 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:24.339998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-842b2a92-da46-4b85-9ca0-00217942f091 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:24.340428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-842b2a92-da46-4b85-9ca0-00217942f091 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:24.341114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-842b2a92-da46-4b85-9ca0-00217942f091 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:24.341563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-842b2a92-da46-4b85-9ca0-00217942f091 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:24.342041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-842b2a92-da46-4b85-9ca0-00217942f091 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:24.372788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2ec32f0e-a26f-4deb-afd7-865390b5ba27 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:24.382060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2ec32f0e-a26f-4deb-afd7-865390b5ba27 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149529 Aug 18 22:15:24.382649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1702/3407] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:24.468765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-842b2a92-da46-4b85-9ca0-00217942f091 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:24.476874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-842b2a92-da46-4b85-9ca0-00217942f091 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.147911 Aug 18 22:15:24.477446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1706/3408] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:24 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:24.675129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1d2a65ab-3126-4c2f-9971-6232f0642a11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:24.675697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1d2a65ab-3126-4c2f-9971-6232f0642a11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:24.683012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d2a65ab-3126-4c2f-9971-6232f0642a11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:24.683012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d2a65ab-3126-4c2f-9971-6232f0642a11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:24.683012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d2a65ab-3126-4c2f-9971-6232f0642a11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:24.683012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d2a65ab-3126-4c2f-9971-6232f0642a11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:24.684614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d2a65ab-3126-4c2f-9971-6232f0642a11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:24.684614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d2a65ab-3126-4c2f-9971-6232f0642a11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:24.816378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1d2a65ab-3126-4c2f-9971-6232f0642a11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:24.825184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1d2a65ab-3126-4c2f-9971-6232f0642a11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:24.826722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1d2a65ab-3126-4c2f-9971-6232f0642a11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:24.827859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1d2a65ab-3126-4c2f-9971-6232f0642a11 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157225 Aug 18 22:15:24.828426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1703/3409] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:24 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:25.187242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-222f9156-b324-4485-94d9-2c3dfd205ff6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:25.187868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-222f9156-b324-4485-94d9-2c3dfd205ff6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:25.194405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-222f9156-b324-4485-94d9-2c3dfd205ff6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:25.194826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-222f9156-b324-4485-94d9-2c3dfd205ff6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:25.195264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-222f9156-b324-4485-94d9-2c3dfd205ff6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:25.195953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-222f9156-b324-4485-94d9-2c3dfd205ff6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:25.196409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-222f9156-b324-4485-94d9-2c3dfd205ff6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:25.196837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-222f9156-b324-4485-94d9-2c3dfd205ff6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:25.265862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-835e5b0c-0185-47ce-a063-bd4c826fe70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:25.266493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-835e5b0c-0185-47ce-a063-bd4c826fe70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:25.272686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-835e5b0c-0185-47ce-a063-bd4c826fe70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:25.273177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-835e5b0c-0185-47ce-a063-bd4c826fe70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:25.273638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-835e5b0c-0185-47ce-a063-bd4c826fe70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:25.274345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-835e5b0c-0185-47ce-a063-bd4c826fe70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:25.274814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-835e5b0c-0185-47ce-a063-bd4c826fe70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:25.275252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-835e5b0c-0185-47ce-a063-bd4c826fe70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:25.330767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-222f9156-b324-4485-94d9-2c3dfd205ff6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:25.340251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-222f9156-b324-4485-94d9-2c3dfd205ff6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156951 Aug 18 22:15:25.341004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1707/3410] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:25.402851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-783ab53d-c9d8-43b1-85fe-480942e5d4cf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:25.403429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-783ab53d-c9d8-43b1-85fe-480942e5d4cf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:25.407604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-835e5b0c-0185-47ce-a063-bd4c826fe70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:25.409984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-783ab53d-c9d8-43b1-85fe-480942e5d4cf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:25.410602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-783ab53d-c9d8-43b1-85fe-480942e5d4cf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:25.411027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-783ab53d-c9d8-43b1-85fe-480942e5d4cf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:25.411736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-783ab53d-c9d8-43b1-85fe-480942e5d4cf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:25.412196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-783ab53d-c9d8-43b1-85fe-480942e5d4cf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:25.412625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-783ab53d-c9d8-43b1-85fe-480942e5d4cf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:25.416265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-835e5b0c-0185-47ce-a063-bd4c826fe70d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154885 Aug 18 22:15:25.416840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1704/3411] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:25 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:25.498377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b70eafec-c03e-451c-9d49-a53eeba18492 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:25.499557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b70eafec-c03e-451c-9d49-a53eeba18492 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:25.505507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b70eafec-c03e-451c-9d49-a53eeba18492 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:25.506030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b70eafec-c03e-451c-9d49-a53eeba18492 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:25.506468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b70eafec-c03e-451c-9d49-a53eeba18492 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:25.507165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b70eafec-c03e-451c-9d49-a53eeba18492 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:25.507623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b70eafec-c03e-451c-9d49-a53eeba18492 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:25.508058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b70eafec-c03e-451c-9d49-a53eeba18492 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:25.539938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-783ab53d-c9d8-43b1-85fe-480942e5d4cf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:25.548857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-783ab53d-c9d8-43b1-85fe-480942e5d4cf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149919 Aug 18 22:15:25.549438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1708/3412] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:25 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:25.640424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b70eafec-c03e-451c-9d49-a53eeba18492 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:25.648884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b70eafec-c03e-451c-9d49-a53eeba18492 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154461 Aug 18 22:15:25.649478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1705/3413] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:25 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:25.850862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0f596a57-fcd8-479d-b086-b2a7e881c28a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:25.851152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0f596a57-fcd8-479d-b086-b2a7e881c28a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:25.857246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f596a57-fcd8-479d-b086-b2a7e881c28a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:25.857757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f596a57-fcd8-479d-b086-b2a7e881c28a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:25.858691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f596a57-fcd8-479d-b086-b2a7e881c28a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:25.859385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f596a57-fcd8-479d-b086-b2a7e881c28a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:25.859841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f596a57-fcd8-479d-b086-b2a7e881c28a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:25.860269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f596a57-fcd8-479d-b086-b2a7e881c28a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:25.985188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0f596a57-fcd8-479d-b086-b2a7e881c28a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:25.993795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0f596a57-fcd8-479d-b086-b2a7e881c28a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:25.995294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0f596a57-fcd8-479d-b086-b2a7e881c28a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:25.996475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0f596a57-fcd8-479d-b086-b2a7e881c28a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.149911 Aug 18 22:15:25.997039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1709/3414] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:25 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:26.363846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4693a657-6a2f-49cc-a72a-9df78a41bc87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:26.364553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4693a657-6a2f-49cc-a72a-9df78a41bc87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:26.370927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4693a657-6a2f-49cc-a72a-9df78a41bc87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:26.371412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4693a657-6a2f-49cc-a72a-9df78a41bc87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:26.371853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4693a657-6a2f-49cc-a72a-9df78a41bc87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:26.372542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4693a657-6a2f-49cc-a72a-9df78a41bc87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:26.372998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4693a657-6a2f-49cc-a72a-9df78a41bc87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:26.373426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4693a657-6a2f-49cc-a72a-9df78a41bc87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:26.437564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d7f1782b-98ca-4b2d-ac59-62ac77e59a2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:26.438199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d7f1782b-98ca-4b2d-ac59-62ac77e59a2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:26.444563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7f1782b-98ca-4b2d-ac59-62ac77e59a2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:26.445047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7f1782b-98ca-4b2d-ac59-62ac77e59a2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:26.445484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7f1782b-98ca-4b2d-ac59-62ac77e59a2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:26.446210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7f1782b-98ca-4b2d-ac59-62ac77e59a2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:26.446666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7f1782b-98ca-4b2d-ac59-62ac77e59a2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:26.447094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7f1782b-98ca-4b2d-ac59-62ac77e59a2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:26.508750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4693a657-6a2f-49cc-a72a-9df78a41bc87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:26.517066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4693a657-6a2f-49cc-a72a-9df78a41bc87 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.157079 Aug 18 22:15:26.517754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1706/3415] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:26 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:26.569449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-21267954-0e1a-4114-87a5-72a646489696 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:26.570096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-21267954-0e1a-4114-87a5-72a646489696 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:26.575966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21267954-0e1a-4114-87a5-72a646489696 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:26.576606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21267954-0e1a-4114-87a5-72a646489696 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:26.576874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21267954-0e1a-4114-87a5-72a646489696 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:26.577615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21267954-0e1a-4114-87a5-72a646489696 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:26.578066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21267954-0e1a-4114-87a5-72a646489696 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:26.578488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-21267954-0e1a-4114-87a5-72a646489696 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:26.579219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d7f1782b-98ca-4b2d-ac59-62ac77e59a2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:26.587493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d7f1782b-98ca-4b2d-ac59-62ac77e59a2f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153781 Aug 18 22:15:26.588070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1710/3416] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:26 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:26.669744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d98c9617-a281-4845-9c61-44c7ec3adf72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:26.670401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d98c9617-a281-4845-9c61-44c7ec3adf72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:26.676525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d98c9617-a281-4845-9c61-44c7ec3adf72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:26.677019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d98c9617-a281-4845-9c61-44c7ec3adf72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:26.677427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d98c9617-a281-4845-9c61-44c7ec3adf72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:26.678171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d98c9617-a281-4845-9c61-44c7ec3adf72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:26.678632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d98c9617-a281-4845-9c61-44c7ec3adf72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:26.679068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d98c9617-a281-4845-9c61-44c7ec3adf72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:26.710866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-21267954-0e1a-4114-87a5-72a646489696 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:26.720118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-21267954-0e1a-4114-87a5-72a646489696 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154387 Aug 18 22:15:26.720938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1707/3417] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:26 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:26.813142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d98c9617-a281-4845-9c61-44c7ec3adf72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:26.821346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d98c9617-a281-4845-9c61-44c7ec3adf72 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155543 Aug 18 22:15:26.821986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1711/3418] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:26 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:27.020394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1a6f1b80-3f19-4e62-a884-57d99e0001eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:27.020936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1a6f1b80-3f19-4e62-a884-57d99e0001eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:27.027039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a6f1b80-3f19-4e62-a884-57d99e0001eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:27.027531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a6f1b80-3f19-4e62-a884-57d99e0001eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:27.027979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a6f1b80-3f19-4e62-a884-57d99e0001eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:27.028663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a6f1b80-3f19-4e62-a884-57d99e0001eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:27.029127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a6f1b80-3f19-4e62-a884-57d99e0001eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:27.029559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1a6f1b80-3f19-4e62-a884-57d99e0001eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:27.157865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1a6f1b80-3f19-4e62-a884-57d99e0001eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:27.166440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1a6f1b80-3f19-4e62-a884-57d99e0001eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:27.167945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1a6f1b80-3f19-4e62-a884-57d99e0001eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:27.169106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1a6f1b80-3f19-4e62-a884-57d99e0001eb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152698 Aug 18 22:15:27.169680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1708/3419] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:27 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:27.538766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eab7d9fd-6975-4055-9418-8d7528ed766c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:27.539366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eab7d9fd-6975-4055-9418-8d7528ed766c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:27.546448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eab7d9fd-6975-4055-9418-8d7528ed766c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:27.546929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eab7d9fd-6975-4055-9418-8d7528ed766c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:27.547365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eab7d9fd-6975-4055-9418-8d7528ed766c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:27.548051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eab7d9fd-6975-4055-9418-8d7528ed766c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:27.548501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eab7d9fd-6975-4055-9418-8d7528ed766c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:27.548926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eab7d9fd-6975-4055-9418-8d7528ed766c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:27.609996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cf3637db-b2bb-4b1c-ae0c-d31a55a6388f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:27.611148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cf3637db-b2bb-4b1c-ae0c-d31a55a6388f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:27.617527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf3637db-b2bb-4b1c-ae0c-d31a55a6388f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:27.618436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf3637db-b2bb-4b1c-ae0c-d31a55a6388f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:27.618581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf3637db-b2bb-4b1c-ae0c-d31a55a6388f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:27.619315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf3637db-b2bb-4b1c-ae0c-d31a55a6388f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:27.619845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf3637db-b2bb-4b1c-ae0c-d31a55a6388f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:27.620345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf3637db-b2bb-4b1c-ae0c-d31a55a6388f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:27.681391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eab7d9fd-6975-4055-9418-8d7528ed766c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:27.690245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eab7d9fd-6975-4055-9418-8d7528ed766c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155265 Aug 18 22:15:27.691088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1712/3420] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:27.742494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-93cbd8f1-ca3f-42de-b749-955396baa62e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:27.743242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-93cbd8f1-ca3f-42de-b749-955396baa62e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:27.750569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93cbd8f1-ca3f-42de-b749-955396baa62e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:27.751556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93cbd8f1-ca3f-42de-b749-955396baa62e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:27.752875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93cbd8f1-ca3f-42de-b749-955396baa62e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:27.754139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93cbd8f1-ca3f-42de-b749-955396baa62e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:27.754497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93cbd8f1-ca3f-42de-b749-955396baa62e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:27.754983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93cbd8f1-ca3f-42de-b749-955396baa62e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:27.767514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cf3637db-b2bb-4b1c-ae0c-d31a55a6388f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:27.775878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cf3637db-b2bb-4b1c-ae0c-d31a55a6388f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.170291 Aug 18 22:15:27.781734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1709/3421] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:27 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:27.843935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-68fb625b-546b-46b6-aec3-1005f0a0f02d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:27.844660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-68fb625b-546b-46b6-aec3-1005f0a0f02d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:27.850845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68fb625b-546b-46b6-aec3-1005f0a0f02d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:27.851331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68fb625b-546b-46b6-aec3-1005f0a0f02d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:27.851771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68fb625b-546b-46b6-aec3-1005f0a0f02d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:27.852465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68fb625b-546b-46b6-aec3-1005f0a0f02d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:27.852922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68fb625b-546b-46b6-aec3-1005f0a0f02d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:27.853349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68fb625b-546b-46b6-aec3-1005f0a0f02d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:27.883891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-93cbd8f1-ca3f-42de-b749-955396baa62e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:27.892852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-93cbd8f1-ca3f-42de-b749-955396baa62e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154516 Aug 18 22:15:27.893655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1713/3422] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:27 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:27.984304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-68fb625b-546b-46b6-aec3-1005f0a0f02d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:27.992541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-68fb625b-546b-46b6-aec3-1005f0a0f02d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153298 Aug 18 22:15:27.993116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1710/3423] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:27 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:28.192130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-72ce72c5-fe8d-4f2f-a5dc-ccf676b0db25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:28.192666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-72ce72c5-fe8d-4f2f-a5dc-ccf676b0db25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:28.194552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:28.199774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72ce72c5-fe8d-4f2f-a5dc-ccf676b0db25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:28.200255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72ce72c5-fe8d-4f2f-a5dc-ccf676b0db25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:28.200691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72ce72c5-fe8d-4f2f-a5dc-ccf676b0db25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:28.201376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72ce72c5-fe8d-4f2f-a5dc-ccf676b0db25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:28.202447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72ce72c5-fe8d-4f2f-a5dc-ccf676b0db25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:28.202876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-72ce72c5-fe8d-4f2f-a5dc-ccf676b0db25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:28.328443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-72ce72c5-fe8d-4f2f-a5dc-ccf676b0db25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:28.336971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-72ce72c5-fe8d-4f2f-a5dc-ccf676b0db25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:28.338478 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-72ce72c5-fe8d-4f2f-a5dc-ccf676b0db25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:28.339621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-72ce72c5-fe8d-4f2f-a5dc-ccf676b0db25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151541 Aug 18 22:15:28.340175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1714/3424] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:28.712167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f8fbceda-7b37-4a3e-97a2-d5e61d5a1c86 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:28.712815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f8fbceda-7b37-4a3e-97a2-d5e61d5a1c86 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:28.719181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8fbceda-7b37-4a3e-97a2-d5e61d5a1c86 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:28.719326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8fbceda-7b37-4a3e-97a2-d5e61d5a1c86 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:28.719763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8fbceda-7b37-4a3e-97a2-d5e61d5a1c86 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:28.720446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8fbceda-7b37-4a3e-97a2-d5e61d5a1c86 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:28.720914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8fbceda-7b37-4a3e-97a2-d5e61d5a1c86 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:28.721337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8fbceda-7b37-4a3e-97a2-d5e61d5a1c86 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:28.798508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c1c6457f-2496-4701-a631-0ffb4d104535 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:28.799089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c1c6457f-2496-4701-a631-0ffb4d104535 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:28.806167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1c6457f-2496-4701-a631-0ffb4d104535 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:28.806658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1c6457f-2496-4701-a631-0ffb4d104535 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:28.807126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1c6457f-2496-4701-a631-0ffb4d104535 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:28.807829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1c6457f-2496-4701-a631-0ffb4d104535 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:28.808287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1c6457f-2496-4701-a631-0ffb4d104535 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:28.808748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1c6457f-2496-4701-a631-0ffb4d104535 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:28.854479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8fbceda-7b37-4a3e-97a2-d5e61d5a1c86 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:28.863719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f8fbceda-7b37-4a3e-97a2-d5e61d5a1c86 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155371 Aug 18 22:15:28.864291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1711/3425] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:28.914239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-34d57fbe-85a7-4cb3-8de7-4a505b242548 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:28.914865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-34d57fbe-85a7-4cb3-8de7-4a505b242548 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:28.921737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-34d57fbe-85a7-4cb3-8de7-4a505b242548 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:28.922231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-34d57fbe-85a7-4cb3-8de7-4a505b242548 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:28.922674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-34d57fbe-85a7-4cb3-8de7-4a505b242548 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:28.923376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-34d57fbe-85a7-4cb3-8de7-4a505b242548 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:28.923854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-34d57fbe-85a7-4cb3-8de7-4a505b242548 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:28.924265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-34d57fbe-85a7-4cb3-8de7-4a505b242548 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:28.945194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c1c6457f-2496-4701-a631-0ffb4d104535 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:28.953711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c1c6457f-2496-4701-a631-0ffb4d104535 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159570 Aug 18 22:15:28.954296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1715/3426] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:28 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:29.013145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4946174b-d621-4c48-9c59-4d246001ddbf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:29.013893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4946174b-d621-4c48-9c59-4d246001ddbf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:29.019845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4946174b-d621-4c48-9c59-4d246001ddbf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:29.020331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4946174b-d621-4c48-9c59-4d246001ddbf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:29.020773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4946174b-d621-4c48-9c59-4d246001ddbf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:29.021471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4946174b-d621-4c48-9c59-4d246001ddbf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:29.021960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4946174b-d621-4c48-9c59-4d246001ddbf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:29.022395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4946174b-d621-4c48-9c59-4d246001ddbf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:29.057115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-34d57fbe-85a7-4cb3-8de7-4a505b242548 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:29.066147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-34d57fbe-85a7-4cb3-8de7-4a505b242548 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155711 Aug 18 22:15:29.066772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1712/3427] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:28 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:29.148520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4946174b-d621-4c48-9c59-4d246001ddbf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:29.156635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4946174b-d621-4c48-9c59-4d246001ddbf tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.147274 Aug 18 22:15:29.157207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1716/3428] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:29 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:29.366058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7dc078e1-5906-4ae4-85fe-a4560777d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:29.366683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7dc078e1-5906-4ae4-85fe-a4560777d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:29.372550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7dc078e1-5906-4ae4-85fe-a4560777d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:29.373027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7dc078e1-5906-4ae4-85fe-a4560777d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:29.373454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7dc078e1-5906-4ae4-85fe-a4560777d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:29.374159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7dc078e1-5906-4ae4-85fe-a4560777d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:29.374605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7dc078e1-5906-4ae4-85fe-a4560777d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:29.375024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7dc078e1-5906-4ae4-85fe-a4560777d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:29.500012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7dc078e1-5906-4ae4-85fe-a4560777d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:29.508828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7dc078e1-5906-4ae4-85fe-a4560777d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:29.510377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7dc078e1-5906-4ae4-85fe-a4560777d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:29.511533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7dc078e1-5906-4ae4-85fe-a4560777d940 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.149451 Aug 18 22:15:29.512115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1713/3429] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:15:29.887425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fe94674b-4ca2-474a-9ae9-a68e67116b52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:29.888036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fe94674b-4ca2-474a-9ae9-a68e67116b52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:29.894886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe94674b-4ca2-474a-9ae9-a68e67116b52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:29.895361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe94674b-4ca2-474a-9ae9-a68e67116b52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:29.895793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe94674b-4ca2-474a-9ae9-a68e67116b52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:29.896471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe94674b-4ca2-474a-9ae9-a68e67116b52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:29.896919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe94674b-4ca2-474a-9ae9-a68e67116b52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:29.897340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe94674b-4ca2-474a-9ae9-a68e67116b52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:29.975298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c1899e20-2c58-485c-98a9-627e6a1000a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:29.975847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c1899e20-2c58-485c-98a9-627e6a1000a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:29.982399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1899e20-2c58-485c-98a9-627e6a1000a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:29.982968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1899e20-2c58-485c-98a9-627e6a1000a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:29.983450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1899e20-2c58-485c-98a9-627e6a1000a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:29.984127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1899e20-2c58-485c-98a9-627e6a1000a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:29.984640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1899e20-2c58-485c-98a9-627e6a1000a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:29.985074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c1899e20-2c58-485c-98a9-627e6a1000a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:30.029295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fe94674b-4ca2-474a-9ae9-a68e67116b52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:30.037525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fe94674b-4ca2-474a-9ae9-a68e67116b52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153895 Aug 18 22:15:30.038130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1717/3430] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:29 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:30.087399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-429ceacc-7edc-41ae-a62b-acbd8caa671f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:30.088048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-429ceacc-7edc-41ae-a62b-acbd8caa671f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:30.093952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-429ceacc-7edc-41ae-a62b-acbd8caa671f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:30.094441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-429ceacc-7edc-41ae-a62b-acbd8caa671f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:30.094880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-429ceacc-7edc-41ae-a62b-acbd8caa671f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:30.095637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-429ceacc-7edc-41ae-a62b-acbd8caa671f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:30.096103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-429ceacc-7edc-41ae-a62b-acbd8caa671f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:30.096543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-429ceacc-7edc-41ae-a62b-acbd8caa671f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:30.115028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c1899e20-2c58-485c-98a9-627e6a1000a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:30.123916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c1899e20-2c58-485c-98a9-627e6a1000a7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152020 Aug 18 22:15:30.124504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1714/3431] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:29 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:30.177447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-16995d1e-a163-41a2-9fc9-e2619e17a0ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:30.178097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-16995d1e-a163-41a2-9fc9-e2619e17a0ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:30.184083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16995d1e-a163-41a2-9fc9-e2619e17a0ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:30.184584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16995d1e-a163-41a2-9fc9-e2619e17a0ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:30.185027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16995d1e-a163-41a2-9fc9-e2619e17a0ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:30.185754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16995d1e-a163-41a2-9fc9-e2619e17a0ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:30.186740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16995d1e-a163-41a2-9fc9-e2619e17a0ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:30.187173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-16995d1e-a163-41a2-9fc9-e2619e17a0ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:30.225126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-429ceacc-7edc-41ae-a62b-acbd8caa671f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:30.233664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-429ceacc-7edc-41ae-a62b-acbd8caa671f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150012 Aug 18 22:15:30.234175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1718/3432] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:30.316110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-16995d1e-a163-41a2-9fc9-e2619e17a0ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:30.324273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-16995d1e-a163-41a2-9fc9-e2619e17a0ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150848 Aug 18 22:15:30.324849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1715/3433] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:30 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:30.534493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dc597952-12e6-408c-a305-4eb9818701a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:30.535135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dc597952-12e6-408c-a305-4eb9818701a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:30.541008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc597952-12e6-408c-a305-4eb9818701a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:30.541492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc597952-12e6-408c-a305-4eb9818701a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:30.541959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc597952-12e6-408c-a305-4eb9818701a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:30.542649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc597952-12e6-408c-a305-4eb9818701a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:30.543113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc597952-12e6-408c-a305-4eb9818701a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:30.543550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc597952-12e6-408c-a305-4eb9818701a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:30.674969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc597952-12e6-408c-a305-4eb9818701a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:30.683836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc597952-12e6-408c-a305-4eb9818701a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:30.685351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc597952-12e6-408c-a305-4eb9818701a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:30.687159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dc597952-12e6-408c-a305-4eb9818701a8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156620 Aug 18 22:15:30.687726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1719/3434] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:31.059274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9eb57720-eb10-4adb-8958-556e87d59f07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:31.059886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9eb57720-eb10-4adb-8958-556e87d59f07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:31.066421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9eb57720-eb10-4adb-8958-556e87d59f07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:31.066910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9eb57720-eb10-4adb-8958-556e87d59f07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:31.067349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9eb57720-eb10-4adb-8958-556e87d59f07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:31.068042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9eb57720-eb10-4adb-8958-556e87d59f07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:31.068503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9eb57720-eb10-4adb-8958-556e87d59f07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:31.068934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9eb57720-eb10-4adb-8958-556e87d59f07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:31.144886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0df8ba2-fd31-4b34-ade6-a53ca4c2b25e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:31.145421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c0df8ba2-fd31-4b34-ade6-a53ca4c2b25e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:31.152138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0df8ba2-fd31-4b34-ade6-a53ca4c2b25e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:31.153225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0df8ba2-fd31-4b34-ade6-a53ca4c2b25e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:31.153225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0df8ba2-fd31-4b34-ade6-a53ca4c2b25e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:31.153930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0df8ba2-fd31-4b34-ade6-a53ca4c2b25e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:31.154392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0df8ba2-fd31-4b34-ade6-a53ca4c2b25e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:31.155447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0df8ba2-fd31-4b34-ade6-a53ca4c2b25e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:31.170594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:31.197324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9eb57720-eb10-4adb-8958-556e87d59f07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:31.206220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9eb57720-eb10-4adb-8958-556e87d59f07 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150760 Aug 18 22:15:31.206802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1716/3435] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:31 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:31.253498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-df50b062-c21b-4684-9a88-68ec703a4f09 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:31.254157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-df50b062-c21b-4684-9a88-68ec703a4f09 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:31.260021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df50b062-c21b-4684-9a88-68ec703a4f09 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:31.260511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df50b062-c21b-4684-9a88-68ec703a4f09 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:31.260951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df50b062-c21b-4684-9a88-68ec703a4f09 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:31.261669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df50b062-c21b-4684-9a88-68ec703a4f09 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:31.262184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df50b062-c21b-4684-9a88-68ec703a4f09 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:31.262899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-df50b062-c21b-4684-9a88-68ec703a4f09 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:31.283775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c0df8ba2-fd31-4b34-ade6-a53ca4c2b25e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:31.292003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c0df8ba2-fd31-4b34-ade6-a53ca4c2b25e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151074 Aug 18 22:15:31.292573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1720/3436] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:31.346385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1fb4ff64-8171-4644-9f4f-3b5e7996837a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:31.347015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1fb4ff64-8171-4644-9f4f-3b5e7996837a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:31.352963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fb4ff64-8171-4644-9f4f-3b5e7996837a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:31.353444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fb4ff64-8171-4644-9f4f-3b5e7996837a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:31.353915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fb4ff64-8171-4644-9f4f-3b5e7996837a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:31.354606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fb4ff64-8171-4644-9f4f-3b5e7996837a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:31.355060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fb4ff64-8171-4644-9f4f-3b5e7996837a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:31.355529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fb4ff64-8171-4644-9f4f-3b5e7996837a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:31.394951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-df50b062-c21b-4684-9a88-68ec703a4f09 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:31.403355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-df50b062-c21b-4684-9a88-68ec703a4f09 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153683 Aug 18 22:15:31.403944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1717/3437] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:31 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:31.485151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1fb4ff64-8171-4644-9f4f-3b5e7996837a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:31.493231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1fb4ff64-8171-4644-9f4f-3b5e7996837a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151245 Aug 18 22:15:31.493867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1721/3438] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:31 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:31.710392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-68be85e6-cf10-41d5-ac23-3b50549d4a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:31.710930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-68be85e6-cf10-41d5-ac23-3b50549d4a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:31.716951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68be85e6-cf10-41d5-ac23-3b50549d4a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:31.717446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68be85e6-cf10-41d5-ac23-3b50549d4a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:31.717922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68be85e6-cf10-41d5-ac23-3b50549d4a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:31.718615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68be85e6-cf10-41d5-ac23-3b50549d4a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:31.719265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68be85e6-cf10-41d5-ac23-3b50549d4a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:31.719509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68be85e6-cf10-41d5-ac23-3b50549d4a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:31.846733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-68be85e6-cf10-41d5-ac23-3b50549d4a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:31.855293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-68be85e6-cf10-41d5-ac23-3b50549d4a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:31.856903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-68be85e6-cf10-41d5-ac23-3b50549d4a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:31.858611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-68be85e6-cf10-41d5-ac23-3b50549d4a08 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151756 Aug 18 22:15:31.859255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1718/3439] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:31 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:32.228307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-10884341-8db5-4558-9b73-fef028377e99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:32.228869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-10884341-8db5-4558-9b73-fef028377e99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:32.235735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10884341-8db5-4558-9b73-fef028377e99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:32.236212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10884341-8db5-4558-9b73-fef028377e99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:32.236672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10884341-8db5-4558-9b73-fef028377e99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:32.237348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10884341-8db5-4558-9b73-fef028377e99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:32.237828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10884341-8db5-4558-9b73-fef028377e99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:32.238248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10884341-8db5-4558-9b73-fef028377e99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:32.313074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f4c28c3a-0cb3-43f3-87aa-a040d4a67e42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:32.313756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f4c28c3a-0cb3-43f3-87aa-a040d4a67e42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:32.320317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4c28c3a-0cb3-43f3-87aa-a040d4a67e42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:32.321023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4c28c3a-0cb3-43f3-87aa-a040d4a67e42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:32.321350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4c28c3a-0cb3-43f3-87aa-a040d4a67e42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:32.322078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4c28c3a-0cb3-43f3-87aa-a040d4a67e42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:32.322547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4c28c3a-0cb3-43f3-87aa-a040d4a67e42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:32.322979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f4c28c3a-0cb3-43f3-87aa-a040d4a67e42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:32.325569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:32.373654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-10884341-8db5-4558-9b73-fef028377e99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:32.381849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-10884341-8db5-4558-9b73-fef028377e99 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.157398 Aug 18 22:15:32.382432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1722/3440] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:32 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:32.424784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0597e573-0d6d-43d8-b781-765860cfe07f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:32.425414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0597e573-0d6d-43d8-b781-765860cfe07f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:32.431600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0597e573-0d6d-43d8-b781-765860cfe07f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:32.432088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0597e573-0d6d-43d8-b781-765860cfe07f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:32.432573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0597e573-0d6d-43d8-b781-765860cfe07f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:32.433260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0597e573-0d6d-43d8-b781-765860cfe07f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:32.434172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0597e573-0d6d-43d8-b781-765860cfe07f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:32.434172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0597e573-0d6d-43d8-b781-765860cfe07f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:32.452184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f4c28c3a-0cb3-43f3-87aa-a040d4a67e42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:32.460428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f4c28c3a-0cb3-43f3-87aa-a040d4a67e42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151605 Aug 18 22:15:32.461013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1719/3441] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:32 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:32.514589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e46ff5a3-42f3-436c-b6e0-72f856562731 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:32.515389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e46ff5a3-42f3-436c-b6e0-72f856562731 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:32.521703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e46ff5a3-42f3-436c-b6e0-72f856562731 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:32.522197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e46ff5a3-42f3-436c-b6e0-72f856562731 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:32.522641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e46ff5a3-42f3-436c-b6e0-72f856562731 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:32.523341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e46ff5a3-42f3-436c-b6e0-72f856562731 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:32.523803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e46ff5a3-42f3-436c-b6e0-72f856562731 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:32.524234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e46ff5a3-42f3-436c-b6e0-72f856562731 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:32.562572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0597e573-0d6d-43d8-b781-765860cfe07f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:32.570717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0597e573-0d6d-43d8-b781-765860cfe07f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150326 Aug 18 22:15:32.571306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1723/3442] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:32.655635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e46ff5a3-42f3-436c-b6e0-72f856562731 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:32.663744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e46ff5a3-42f3-436c-b6e0-72f856562731 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153032 Aug 18 22:15:32.664318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1720/3443] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:32 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:32.881854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d42ec158-2fa5-49c1-82dc-74ad487286f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:32.882467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d42ec158-2fa5-49c1-82dc-74ad487286f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:32.888327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d42ec158-2fa5-49c1-82dc-74ad487286f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:32.888787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d42ec158-2fa5-49c1-82dc-74ad487286f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:32.889734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d42ec158-2fa5-49c1-82dc-74ad487286f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:32.890414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d42ec158-2fa5-49c1-82dc-74ad487286f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:32.890861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d42ec158-2fa5-49c1-82dc-74ad487286f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:32.891277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d42ec158-2fa5-49c1-82dc-74ad487286f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:33.021455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d42ec158-2fa5-49c1-82dc-74ad487286f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:33.030026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d42ec158-2fa5-49c1-82dc-74ad487286f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:33.031687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d42ec158-2fa5-49c1-82dc-74ad487286f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:33.032836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d42ec158-2fa5-49c1-82dc-74ad487286f0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154896 Aug 18 22:15:33.033386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1724/3444] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:32 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:33.403508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07dd497d-aff5-464f-a440-12508013f922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:33.404130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07dd497d-aff5-464f-a440-12508013f922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:33.410696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07dd497d-aff5-464f-a440-12508013f922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:33.411184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07dd497d-aff5-464f-a440-12508013f922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:33.411632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07dd497d-aff5-464f-a440-12508013f922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:33.412321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07dd497d-aff5-464f-a440-12508013f922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:33.412777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07dd497d-aff5-464f-a440-12508013f922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:33.413209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07dd497d-aff5-464f-a440-12508013f922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:33.483863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da989ab5-a367-4573-bdc4-7e9a0d09b539 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:33.484766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-da989ab5-a367-4573-bdc4-7e9a0d09b539 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:33.491497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da989ab5-a367-4573-bdc4-7e9a0d09b539 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:33.492072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da989ab5-a367-4573-bdc4-7e9a0d09b539 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:33.492615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da989ab5-a367-4573-bdc4-7e9a0d09b539 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:33.493394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da989ab5-a367-4573-bdc4-7e9a0d09b539 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:33.494123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da989ab5-a367-4573-bdc4-7e9a0d09b539 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:33.494645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da989ab5-a367-4573-bdc4-7e9a0d09b539 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:33.549716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-07dd497d-aff5-464f-a440-12508013f922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:33.558287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07dd497d-aff5-464f-a440-12508013f922 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.159455 Aug 18 22:15:33.558876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1721/3445] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:33 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:33.591546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b613bd1b-a7ee-4e90-b69b-9e7e8c76c826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:33.592262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b613bd1b-a7ee-4e90-b69b-9e7e8c76c826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:33.598294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b613bd1b-a7ee-4e90-b69b-9e7e8c76c826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:33.598904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b613bd1b-a7ee-4e90-b69b-9e7e8c76c826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:33.599348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b613bd1b-a7ee-4e90-b69b-9e7e8c76c826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:33.600052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b613bd1b-a7ee-4e90-b69b-9e7e8c76c826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:33.600515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b613bd1b-a7ee-4e90-b69b-9e7e8c76c826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:33.600945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b613bd1b-a7ee-4e90-b69b-9e7e8c76c826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:33.625579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-da989ab5-a367-4573-bdc4-7e9a0d09b539 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:33.634036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da989ab5-a367-4573-bdc4-7e9a0d09b539 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155281 Aug 18 22:15:33.634622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1725/3446] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:33.684258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1808baa8-aed5-4f70-b0f4-08af80eb29da tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:33.684902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1808baa8-aed5-4f70-b0f4-08af80eb29da tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:33.691597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1808baa8-aed5-4f70-b0f4-08af80eb29da tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:33.692085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1808baa8-aed5-4f70-b0f4-08af80eb29da tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:33.692521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1808baa8-aed5-4f70-b0f4-08af80eb29da tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:33.693217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1808baa8-aed5-4f70-b0f4-08af80eb29da tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:33.693689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1808baa8-aed5-4f70-b0f4-08af80eb29da tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:33.694111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1808baa8-aed5-4f70-b0f4-08af80eb29da tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:33.734093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b613bd1b-a7ee-4e90-b69b-9e7e8c76c826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:33.742871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b613bd1b-a7ee-4e90-b69b-9e7e8c76c826 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155143 Aug 18 22:15:33.743545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1722/3447] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:33 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:33.823895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1808baa8-aed5-4f70-b0f4-08af80eb29da tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:33.832074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1808baa8-aed5-4f70-b0f4-08af80eb29da tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151682 Aug 18 22:15:33.832634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1726/3448] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:33 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:34.055879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-01d56e48-2d3a-4555-96e4-21fe47f83a01 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:34.056518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-01d56e48-2d3a-4555-96e4-21fe47f83a01 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:34.062467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01d56e48-2d3a-4555-96e4-21fe47f83a01 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:34.062953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01d56e48-2d3a-4555-96e4-21fe47f83a01 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:34.063390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01d56e48-2d3a-4555-96e4-21fe47f83a01 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:34.064083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01d56e48-2d3a-4555-96e4-21fe47f83a01 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:34.064533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01d56e48-2d3a-4555-96e4-21fe47f83a01 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:34.064960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01d56e48-2d3a-4555-96e4-21fe47f83a01 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:34.193642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-01d56e48-2d3a-4555-96e4-21fe47f83a01 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:34.202843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-01d56e48-2d3a-4555-96e4-21fe47f83a01 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:34.204345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-01d56e48-2d3a-4555-96e4-21fe47f83a01 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:34.205499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-01d56e48-2d3a-4555-96e4-21fe47f83a01 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154042 Aug 18 22:15:34.206107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1723/3449] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:34.580869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-23ab800b-08fd-4521-9c1e-57ffe4725e69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:34.581494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-23ab800b-08fd-4521-9c1e-57ffe4725e69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:34.588073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23ab800b-08fd-4521-9c1e-57ffe4725e69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:34.588559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23ab800b-08fd-4521-9c1e-57ffe4725e69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:34.589006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23ab800b-08fd-4521-9c1e-57ffe4725e69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:34.589734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23ab800b-08fd-4521-9c1e-57ffe4725e69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:34.590197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23ab800b-08fd-4521-9c1e-57ffe4725e69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:34.590630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23ab800b-08fd-4521-9c1e-57ffe4725e69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:34.655259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-414a5ef0-507f-4876-a832-771815849064 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:34.655993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-414a5ef0-507f-4876-a832-771815849064 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:34.662453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-414a5ef0-507f-4876-a832-771815849064 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:34.662951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-414a5ef0-507f-4876-a832-771815849064 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:34.663394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-414a5ef0-507f-4876-a832-771815849064 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:34.664097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-414a5ef0-507f-4876-a832-771815849064 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:34.664562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-414a5ef0-507f-4876-a832-771815849064 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:34.665075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-414a5ef0-507f-4876-a832-771815849064 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:34.721503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-23ab800b-08fd-4521-9c1e-57ffe4725e69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:34.729846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-23ab800b-08fd-4521-9c1e-57ffe4725e69 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153476 Aug 18 22:15:34.730425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1727/3450] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:34 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:34.764764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c77c318f-7b31-43e4-a1eb-b93509e4fdf8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:34.765491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c77c318f-7b31-43e4-a1eb-b93509e4fdf8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:34.772149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c77c318f-7b31-43e4-a1eb-b93509e4fdf8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:34.772705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c77c318f-7b31-43e4-a1eb-b93509e4fdf8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:34.773210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c77c318f-7b31-43e4-a1eb-b93509e4fdf8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:34.774010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c77c318f-7b31-43e4-a1eb-b93509e4fdf8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:34.774536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c77c318f-7b31-43e4-a1eb-b93509e4fdf8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:34.775029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c77c318f-7b31-43e4-a1eb-b93509e4fdf8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:34.799009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-414a5ef0-507f-4876-a832-771815849064 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:34.807629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-414a5ef0-507f-4876-a832-771815849064 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156199 Aug 18 22:15:34.808514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1724/3451] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:34.853658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-99d782a5-98d0-48b3-9afc-1b38d3b4f495 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:34.854274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-99d782a5-98d0-48b3-9afc-1b38d3b4f495 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:34.860746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99d782a5-98d0-48b3-9afc-1b38d3b4f495 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:34.861235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99d782a5-98d0-48b3-9afc-1b38d3b4f495 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:34.861703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99d782a5-98d0-48b3-9afc-1b38d3b4f495 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:34.862402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99d782a5-98d0-48b3-9afc-1b38d3b4f495 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:34.862859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99d782a5-98d0-48b3-9afc-1b38d3b4f495 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:34.863291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99d782a5-98d0-48b3-9afc-1b38d3b4f495 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:34.917514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c77c318f-7b31-43e4-a1eb-b93509e4fdf8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:34.929057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c77c318f-7b31-43e4-a1eb-b93509e4fdf8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.168502 Aug 18 22:15:34.929957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1728/3452] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:34 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:34.997224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-99d782a5-98d0-48b3-9afc-1b38d3b4f495 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:35.006168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-99d782a5-98d0-48b3-9afc-1b38d3b4f495 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156446 Aug 18 22:15:35.006744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1725/3453] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:34 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:35.228942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab7a0141-78d0-4bf6-b6f4-06a8526e8b21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:35.229560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab7a0141-78d0-4bf6-b6f4-06a8526e8b21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:35.236200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab7a0141-78d0-4bf6-b6f4-06a8526e8b21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:35.236706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab7a0141-78d0-4bf6-b6f4-06a8526e8b21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:35.237141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab7a0141-78d0-4bf6-b6f4-06a8526e8b21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:35.237866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab7a0141-78d0-4bf6-b6f4-06a8526e8b21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:35.238347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab7a0141-78d0-4bf6-b6f4-06a8526e8b21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:35.238765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab7a0141-78d0-4bf6-b6f4-06a8526e8b21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:35.368640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ab7a0141-78d0-4bf6-b6f4-06a8526e8b21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:35.377324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ab7a0141-78d0-4bf6-b6f4-06a8526e8b21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:35.378841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ab7a0141-78d0-4bf6-b6f4-06a8526e8b21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:35.380009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab7a0141-78d0-4bf6-b6f4-06a8526e8b21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154985 Aug 18 22:15:35.380571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1729/3454] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:35.751406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-207ec311-59ef-4199-8d33-bc95d19dd578 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:35.752023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-207ec311-59ef-4199-8d33-bc95d19dd578 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:35.758520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-207ec311-59ef-4199-8d33-bc95d19dd578 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:35.759002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-207ec311-59ef-4199-8d33-bc95d19dd578 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:35.759431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-207ec311-59ef-4199-8d33-bc95d19dd578 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:35.760103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-207ec311-59ef-4199-8d33-bc95d19dd578 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:35.760549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-207ec311-59ef-4199-8d33-bc95d19dd578 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:35.760966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-207ec311-59ef-4199-8d33-bc95d19dd578 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:35.830095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0e6abd3c-7812-478c-bcb3-77167bb5ea3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:35.831062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0e6abd3c-7812-478c-bcb3-77167bb5ea3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:35.839642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e6abd3c-7812-478c-bcb3-77167bb5ea3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:35.840234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e6abd3c-7812-478c-bcb3-77167bb5ea3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:35.840684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e6abd3c-7812-478c-bcb3-77167bb5ea3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:35.841385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e6abd3c-7812-478c-bcb3-77167bb5ea3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:35.841884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e6abd3c-7812-478c-bcb3-77167bb5ea3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:35.843036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0e6abd3c-7812-478c-bcb3-77167bb5ea3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:35.890756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-207ec311-59ef-4199-8d33-bc95d19dd578 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:35.898905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-207ec311-59ef-4199-8d33-bc95d19dd578 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151351 Aug 18 22:15:35.899485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1726/3455] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:35.951098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f8bf00e3-f591-452e-aff2-8eaa8769c2ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:35.952332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f8bf00e3-f591-452e-aff2-8eaa8769c2ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:35.958298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8bf00e3-f591-452e-aff2-8eaa8769c2ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:35.958779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8bf00e3-f591-452e-aff2-8eaa8769c2ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:35.959207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8bf00e3-f591-452e-aff2-8eaa8769c2ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:35.959894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8bf00e3-f591-452e-aff2-8eaa8769c2ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:35.960345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8bf00e3-f591-452e-aff2-8eaa8769c2ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:35.960767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8bf00e3-f591-452e-aff2-8eaa8769c2ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:35.973799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0e6abd3c-7812-478c-bcb3-77167bb5ea3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:35.981879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0e6abd3c-7812-478c-bcb3-77167bb5ea3d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156444 Aug 18 22:15:35.982462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1730/3456] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:35 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:36.027329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-06bf5180-33b4-418f-9137-8ea6d7ba71b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:36.027960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-06bf5180-33b4-418f-9137-8ea6d7ba71b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:36.033845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06bf5180-33b4-418f-9137-8ea6d7ba71b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:36.034338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06bf5180-33b4-418f-9137-8ea6d7ba71b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:36.034787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06bf5180-33b4-418f-9137-8ea6d7ba71b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:36.035491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06bf5180-33b4-418f-9137-8ea6d7ba71b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:36.035950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06bf5180-33b4-418f-9137-8ea6d7ba71b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:36.036382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06bf5180-33b4-418f-9137-8ea6d7ba71b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:36.091485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8bf00e3-f591-452e-aff2-8eaa8769c2ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:36.099776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f8bf00e3-f591-452e-aff2-8eaa8769c2ba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152788 Aug 18 22:15:36.100356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1727/3457] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:35 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:36.161875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-06bf5180-33b4-418f-9137-8ea6d7ba71b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:36.170287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-06bf5180-33b4-418f-9137-8ea6d7ba71b0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.146786 Aug 18 22:15:36.170879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1731/3458] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:36 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:36.402715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-64c0768a-4d71-4473-be1d-2ff98b873f1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:36.403317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-64c0768a-4d71-4473-be1d-2ff98b873f1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:36.409171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c0768a-4d71-4473-be1d-2ff98b873f1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:36.409675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c0768a-4d71-4473-be1d-2ff98b873f1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:36.410107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c0768a-4d71-4473-be1d-2ff98b873f1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:36.410784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c0768a-4d71-4473-be1d-2ff98b873f1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:36.411233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c0768a-4d71-4473-be1d-2ff98b873f1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:36.411661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64c0768a-4d71-4473-be1d-2ff98b873f1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:36.538407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-64c0768a-4d71-4473-be1d-2ff98b873f1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:36.547339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-64c0768a-4d71-4473-be1d-2ff98b873f1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:36.548841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-64c0768a-4d71-4473-be1d-2ff98b873f1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:36.550001 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-64c0768a-4d71-4473-be1d-2ff98b873f1b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151127 Aug 18 22:15:36.550561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1728/3459] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:36.921662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-744e9b0b-4c78-45b8-9fbe-b6c08b4ff29d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:36.922288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-744e9b0b-4c78-45b8-9fbe-b6c08b4ff29d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:36.929163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-744e9b0b-4c78-45b8-9fbe-b6c08b4ff29d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:36.929689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-744e9b0b-4c78-45b8-9fbe-b6c08b4ff29d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:36.930133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-744e9b0b-4c78-45b8-9fbe-b6c08b4ff29d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:36.930827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-744e9b0b-4c78-45b8-9fbe-b6c08b4ff29d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:36.931283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-744e9b0b-4c78-45b8-9fbe-b6c08b4ff29d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:36.931712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-744e9b0b-4c78-45b8-9fbe-b6c08b4ff29d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:37.003200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c6f0ec7a-66da-447a-9f0a-89270ed9769f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:37.003824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c6f0ec7a-66da-447a-9f0a-89270ed9769f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:37.010279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6f0ec7a-66da-447a-9f0a-89270ed9769f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:37.010774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6f0ec7a-66da-447a-9f0a-89270ed9769f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:37.011224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6f0ec7a-66da-447a-9f0a-89270ed9769f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:37.011925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6f0ec7a-66da-447a-9f0a-89270ed9769f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:37.012391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6f0ec7a-66da-447a-9f0a-89270ed9769f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:37.012810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c6f0ec7a-66da-447a-9f0a-89270ed9769f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:37.127918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-744e9b0b-4c78-45b8-9fbe-b6c08b4ff29d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:37.136434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-744e9b0b-4c78-45b8-9fbe-b6c08b4ff29d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.219257 Aug 18 22:15:37.137241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1732/3460] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:36 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:37.141908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-836e257a-e546-4d28-bb2c-42e498584aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:37.142513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-836e257a-e546-4d28-bb2c-42e498584aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:37.148041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-836e257a-e546-4d28-bb2c-42e498584aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:37.148516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-836e257a-e546-4d28-bb2c-42e498584aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:37.149819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-836e257a-e546-4d28-bb2c-42e498584aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:37.150607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-836e257a-e546-4d28-bb2c-42e498584aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:37.151107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-836e257a-e546-4d28-bb2c-42e498584aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:37.151546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-836e257a-e546-4d28-bb2c-42e498584aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:37.151665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c6f0ec7a-66da-447a-9f0a-89270ed9769f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:37.160415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c6f0ec7a-66da-447a-9f0a-89270ed9769f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.161042 Aug 18 22:15:37.160992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1729/3461] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:36 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:37.191482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-26e9c5c9-4449-4b7e-8aeb-637872b63d59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:37.192103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-26e9c5c9-4449-4b7e-8aeb-637872b63d59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:37.198041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26e9c5c9-4449-4b7e-8aeb-637872b63d59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:37.198526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26e9c5c9-4449-4b7e-8aeb-637872b63d59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:37.198961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26e9c5c9-4449-4b7e-8aeb-637872b63d59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:37.199660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26e9c5c9-4449-4b7e-8aeb-637872b63d59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:37.200116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26e9c5c9-4449-4b7e-8aeb-637872b63d59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:37.200538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26e9c5c9-4449-4b7e-8aeb-637872b63d59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:37.285019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-836e257a-e546-4d28-bb2c-42e498584aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:37.293767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-836e257a-e546-4d28-bb2c-42e498584aa2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155511 Aug 18 22:15:37.294455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1733/3462] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:37 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:37.332864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-26e9c5c9-4449-4b7e-8aeb-637872b63d59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:37.340945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-26e9c5c9-4449-4b7e-8aeb-637872b63d59 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153266 Aug 18 22:15:37.341545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1730/3463] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:37 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:37.573749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-405e573e-33a2-4362-afef-e54d33e7c678 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:37.574378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-405e573e-33a2-4362-afef-e54d33e7c678 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:37.581031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-405e573e-33a2-4362-afef-e54d33e7c678 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:37.581520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-405e573e-33a2-4362-afef-e54d33e7c678 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:37.582007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-405e573e-33a2-4362-afef-e54d33e7c678 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:37.582702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-405e573e-33a2-4362-afef-e54d33e7c678 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:37.583161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-405e573e-33a2-4362-afef-e54d33e7c678 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:37.583593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-405e573e-33a2-4362-afef-e54d33e7c678 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:37.715655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-405e573e-33a2-4362-afef-e54d33e7c678 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:37.723839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-405e573e-33a2-4362-afef-e54d33e7c678 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:37.725319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-405e573e-33a2-4362-afef-e54d33e7c678 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:37.726493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-405e573e-33a2-4362-afef-e54d33e7c678 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156864 Aug 18 22:15:37.727051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1734/3464] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:38.158435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9ef77d36-00d1-44bf-b694-aaa059d13cb9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:38.159059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9ef77d36-00d1-44bf-b694-aaa059d13cb9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:38.165516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ef77d36-00d1-44bf-b694-aaa059d13cb9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:38.166060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ef77d36-00d1-44bf-b694-aaa059d13cb9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:38.166499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ef77d36-00d1-44bf-b694-aaa059d13cb9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:38.167195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ef77d36-00d1-44bf-b694-aaa059d13cb9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:38.167656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ef77d36-00d1-44bf-b694-aaa059d13cb9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:38.168181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9ef77d36-00d1-44bf-b694-aaa059d13cb9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:38.181940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b4d7f2e0-8801-4ebd-b774-11632dcd9f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:38.182550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b4d7f2e0-8801-4ebd-b774-11632dcd9f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:38.189809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4d7f2e0-8801-4ebd-b774-11632dcd9f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:38.190290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4d7f2e0-8801-4ebd-b774-11632dcd9f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:38.190724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4d7f2e0-8801-4ebd-b774-11632dcd9f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:38.191415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4d7f2e0-8801-4ebd-b774-11632dcd9f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:38.191864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4d7f2e0-8801-4ebd-b774-11632dcd9f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:38.192291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4d7f2e0-8801-4ebd-b774-11632dcd9f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:38.332803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b4d7f2e0-8801-4ebd-b774-11632dcd9f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:38.335328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b4d7f2e0-8801-4ebd-b774-11632dcd9f5f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.157287 Aug 18 22:15:38.335989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1735/3465] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:38 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:38.340792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-510b6bf8-465d-494b-93e9-e89a9b3d7636 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:38.341657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-510b6bf8-465d-494b-93e9-e89a9b3d7636 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:38.347952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-510b6bf8-465d-494b-93e9-e89a9b3d7636 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:38.348509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-510b6bf8-465d-494b-93e9-e89a9b3d7636 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:38.349026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-510b6bf8-465d-494b-93e9-e89a9b3d7636 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:38.349827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-510b6bf8-465d-494b-93e9-e89a9b3d7636 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:38.350357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-510b6bf8-465d-494b-93e9-e89a9b3d7636 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:38.350858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-510b6bf8-465d-494b-93e9-e89a9b3d7636 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:38.357321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9ef77d36-00d1-44bf-b694-aaa059d13cb9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:38.365900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9ef77d36-00d1-44bf-b694-aaa059d13cb9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.211324 Aug 18 22:15:38.366484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1731/3466] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:38 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:38.370808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a6077d53-0cee-436e-b37a-f3986784558a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:38.371450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a6077d53-0cee-436e-b37a-f3986784558a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:38.376996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6077d53-0cee-436e-b37a-f3986784558a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:38.377477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6077d53-0cee-436e-b37a-f3986784558a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:38.377944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6077d53-0cee-436e-b37a-f3986784558a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:38.378628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6077d53-0cee-436e-b37a-f3986784558a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:38.379077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6077d53-0cee-436e-b37a-f3986784558a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:38.379500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6077d53-0cee-436e-b37a-f3986784558a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:38.486573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-510b6bf8-465d-494b-93e9-e89a9b3d7636 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:38.494831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-510b6bf8-465d-494b-93e9-e89a9b3d7636 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.157818 Aug 18 22:15:38.495418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1736/3467] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:38 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:38.519911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a6077d53-0cee-436e-b37a-f3986784558a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:38.528743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a6077d53-0cee-436e-b37a-f3986784558a tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.161312 Aug 18 22:15:38.529968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1732/3468] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:38 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:38.749243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6fd0a4cf-3f4f-4f19-a68c-ce33405a66b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:38.749880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6fd0a4cf-3f4f-4f19-a68c-ce33405a66b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:38.755735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd0a4cf-3f4f-4f19-a68c-ce33405a66b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:38.756213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd0a4cf-3f4f-4f19-a68c-ce33405a66b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:38.756649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd0a4cf-3f4f-4f19-a68c-ce33405a66b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:38.757333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd0a4cf-3f4f-4f19-a68c-ce33405a66b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:38.757815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd0a4cf-3f4f-4f19-a68c-ce33405a66b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:38.758241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fd0a4cf-3f4f-4f19-a68c-ce33405a66b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:38.760726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:38.887775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6fd0a4cf-3f4f-4f19-a68c-ce33405a66b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:38.896738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6fd0a4cf-3f4f-4f19-a68c-ce33405a66b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:38.898277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6fd0a4cf-3f4f-4f19-a68c-ce33405a66b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:38.899422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6fd0a4cf-3f4f-4f19-a68c-ce33405a66b9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154098 Aug 18 22:15:38.899976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1737/3469] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:38 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:39.357258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a8ec0bd3-0dad-4fc2-84f6-13d3456031cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:39.358541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a8ec0bd3-0dad-4fc2-84f6-13d3456031cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:39.365059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8ec0bd3-0dad-4fc2-84f6-13d3456031cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:39.365486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8ec0bd3-0dad-4fc2-84f6-13d3456031cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:39.365956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8ec0bd3-0dad-4fc2-84f6-13d3456031cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:39.366647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8ec0bd3-0dad-4fc2-84f6-13d3456031cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:39.367102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8ec0bd3-0dad-4fc2-84f6-13d3456031cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:39.367525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a8ec0bd3-0dad-4fc2-84f6-13d3456031cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:39.387562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c8ecc7c1-01bd-4b45-92e8-baa4a89e43b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:39.388302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c8ecc7c1-01bd-4b45-92e8-baa4a89e43b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:39.394984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8ecc7c1-01bd-4b45-92e8-baa4a89e43b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:39.395546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8ecc7c1-01bd-4b45-92e8-baa4a89e43b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:39.396059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8ecc7c1-01bd-4b45-92e8-baa4a89e43b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:39.396872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8ecc7c1-01bd-4b45-92e8-baa4a89e43b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:39.397404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8ecc7c1-01bd-4b45-92e8-baa4a89e43b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:39.397939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8ecc7c1-01bd-4b45-92e8-baa4a89e43b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:39.497174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a8ec0bd3-0dad-4fc2-84f6-13d3456031cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:39.505974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a8ec0bd3-0dad-4fc2-84f6-13d3456031cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152520 Aug 18 22:15:39.506624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1733/3470] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:39 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:39.515988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eab084fb-c9d0-421d-8c6b-4753ad5ed5a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:39.516599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eab084fb-c9d0-421d-8c6b-4753ad5ed5a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:39.522565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab084fb-c9d0-421d-8c6b-4753ad5ed5a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:39.523140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab084fb-c9d0-421d-8c6b-4753ad5ed5a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:39.523469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab084fb-c9d0-421d-8c6b-4753ad5ed5a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:39.524154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab084fb-c9d0-421d-8c6b-4753ad5ed5a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:39.524603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab084fb-c9d0-421d-8c6b-4753ad5ed5a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:39.525025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab084fb-c9d0-421d-8c6b-4753ad5ed5a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:39.525834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c8ecc7c1-01bd-4b45-92e8-baa4a89e43b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:39.534165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c8ecc7c1-01bd-4b45-92e8-baa4a89e43b5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150406 Aug 18 22:15:39.534751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1738/3471] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:39.551716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-63c1ae2a-918a-45fc-896a-3cee077587d6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:39.552325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-63c1ae2a-918a-45fc-896a-3cee077587d6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:39.558188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63c1ae2a-918a-45fc-896a-3cee077587d6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:39.558664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63c1ae2a-918a-45fc-896a-3cee077587d6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:39.559095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63c1ae2a-918a-45fc-896a-3cee077587d6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:39.559784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63c1ae2a-918a-45fc-896a-3cee077587d6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:39.560234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63c1ae2a-918a-45fc-896a-3cee077587d6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:39.560655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63c1ae2a-918a-45fc-896a-3cee077587d6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:39.659826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-eab084fb-c9d0-421d-8c6b-4753ad5ed5a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:39.668037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eab084fb-c9d0-421d-8c6b-4753ad5ed5a4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155738 Aug 18 22:15:39.668744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1734/3472] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:39 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:39.692901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-63c1ae2a-918a-45fc-896a-3cee077587d6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:39.701212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-63c1ae2a-918a-45fc-896a-3cee077587d6 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153386 Aug 18 22:15:39.702300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1739/3473] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:39 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:39.922297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-06c2ea50-3ece-406d-b2a8-2942850f109f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:39.922838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-06c2ea50-3ece-406d-b2a8-2942850f109f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:39.929174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06c2ea50-3ece-406d-b2a8-2942850f109f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:39.929692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06c2ea50-3ece-406d-b2a8-2942850f109f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:39.930142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06c2ea50-3ece-406d-b2a8-2942850f109f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:39.930836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06c2ea50-3ece-406d-b2a8-2942850f109f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:39.931295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06c2ea50-3ece-406d-b2a8-2942850f109f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:39.931725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-06c2ea50-3ece-406d-b2a8-2942850f109f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:40.058168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-06c2ea50-3ece-406d-b2a8-2942850f109f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:40.060484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:40.068872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-06c2ea50-3ece-406d-b2a8-2942850f109f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:40.070466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-06c2ea50-3ece-406d-b2a8-2942850f109f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:40.071610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-06c2ea50-3ece-406d-b2a8-2942850f109f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153290 Aug 18 22:15:40.072167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1735/3474] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:40.527098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2a8feaeb-edde-4a49-b462-42376615e527 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:40.527746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2a8feaeb-edde-4a49-b462-42376615e527 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:40.535105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a8feaeb-edde-4a49-b462-42376615e527 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:40.535801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a8feaeb-edde-4a49-b462-42376615e527 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:40.536434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a8feaeb-edde-4a49-b462-42376615e527 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:40.537336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a8feaeb-edde-4a49-b462-42376615e527 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:40.537821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a8feaeb-edde-4a49-b462-42376615e527 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:40.538241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2a8feaeb-edde-4a49-b462-42376615e527 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:40.557328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cb935ecb-d907-461d-9348-a91787801f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:40.557978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cb935ecb-d907-461d-9348-a91787801f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:40.564335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb935ecb-d907-461d-9348-a91787801f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:40.564825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb935ecb-d907-461d-9348-a91787801f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:40.565267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb935ecb-d907-461d-9348-a91787801f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:40.565994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb935ecb-d907-461d-9348-a91787801f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:40.566454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb935ecb-d907-461d-9348-a91787801f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:40.566888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb935ecb-d907-461d-9348-a91787801f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:40.668807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2a8feaeb-edde-4a49-b462-42376615e527 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:40.677901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2a8feaeb-edde-4a49-b462-42376615e527 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154771 Aug 18 22:15:40.678487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1740/3475] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:40.689860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1e396aea-5dab-43ef-bc3a-d0ac22fd88e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:40.690749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1e396aea-5dab-43ef-bc3a-d0ac22fd88e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:40.697221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e396aea-5dab-43ef-bc3a-d0ac22fd88e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:40.697994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e396aea-5dab-43ef-bc3a-d0ac22fd88e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:40.698435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e396aea-5dab-43ef-bc3a-d0ac22fd88e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:40.699142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e396aea-5dab-43ef-bc3a-d0ac22fd88e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:40.699771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e396aea-5dab-43ef-bc3a-d0ac22fd88e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:40.700138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cb935ecb-d907-461d-9348-a91787801f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:40.700394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1e396aea-5dab-43ef-bc3a-d0ac22fd88e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:40.708474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cb935ecb-d907-461d-9348-a91787801f6e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154965 Aug 18 22:15:40.709056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1736/3476] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:40 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:40.725372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-576bae41-7bf6-4a17-ad4c-ed01f37876a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:40.726109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-576bae41-7bf6-4a17-ad4c-ed01f37876a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:40.732067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-576bae41-7bf6-4a17-ad4c-ed01f37876a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:40.732555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-576bae41-7bf6-4a17-ad4c-ed01f37876a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:40.733553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-576bae41-7bf6-4a17-ad4c-ed01f37876a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:40.734325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-576bae41-7bf6-4a17-ad4c-ed01f37876a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:40.734792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-576bae41-7bf6-4a17-ad4c-ed01f37876a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:40.735225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-576bae41-7bf6-4a17-ad4c-ed01f37876a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:40.839544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1e396aea-5dab-43ef-bc3a-d0ac22fd88e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:40.848191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1e396aea-5dab-43ef-bc3a-d0ac22fd88e3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.162247 Aug 18 22:15:40.848770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1741/3477] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:40 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:40.867448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-576bae41-7bf6-4a17-ad4c-ed01f37876a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:40.876527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-576bae41-7bf6-4a17-ad4c-ed01f37876a9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155119 Aug 18 22:15:40.877169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1737/3478] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:40 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:41.095208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8ffff2c6-f0e3-42ac-a7bc-7f53bcd686a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:41.095828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8ffff2c6-f0e3-42ac-a7bc-7f53bcd686a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:41.101817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ffff2c6-f0e3-42ac-a7bc-7f53bcd686a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:41.102297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ffff2c6-f0e3-42ac-a7bc-7f53bcd686a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:41.102737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ffff2c6-f0e3-42ac-a7bc-7f53bcd686a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:41.103426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ffff2c6-f0e3-42ac-a7bc-7f53bcd686a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:41.103879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ffff2c6-f0e3-42ac-a7bc-7f53bcd686a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:41.104302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ffff2c6-f0e3-42ac-a7bc-7f53bcd686a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:41.231134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8ffff2c6-f0e3-42ac-a7bc-7f53bcd686a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:41.239730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8ffff2c6-f0e3-42ac-a7bc-7f53bcd686a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:41.241237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8ffff2c6-f0e3-42ac-a7bc-7f53bcd686a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:41.242452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8ffff2c6-f0e3-42ac-a7bc-7f53bcd686a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151706 Aug 18 22:15:41.243015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1742/3479] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:41.699088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6955a5c8-7e0c-4ea6-85b8-bee33d20c70c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:41.699792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6955a5c8-7e0c-4ea6-85b8-bee33d20c70c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:41.706676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6955a5c8-7e0c-4ea6-85b8-bee33d20c70c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:41.707150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6955a5c8-7e0c-4ea6-85b8-bee33d20c70c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:41.707580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6955a5c8-7e0c-4ea6-85b8-bee33d20c70c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:41.708265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6955a5c8-7e0c-4ea6-85b8-bee33d20c70c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:41.708716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6955a5c8-7e0c-4ea6-85b8-bee33d20c70c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:41.709135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6955a5c8-7e0c-4ea6-85b8-bee33d20c70c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:41.730155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-88153340-6f28-43f0-9959-cce31b25ee23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:41.730815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-88153340-6f28-43f0-9959-cce31b25ee23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:41.737347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88153340-6f28-43f0-9959-cce31b25ee23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:41.737864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88153340-6f28-43f0-9959-cce31b25ee23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:41.738308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88153340-6f28-43f0-9959-cce31b25ee23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:41.739002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88153340-6f28-43f0-9959-cce31b25ee23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:41.739460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88153340-6f28-43f0-9959-cce31b25ee23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:41.739895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-88153340-6f28-43f0-9959-cce31b25ee23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:41.838252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6955a5c8-7e0c-4ea6-85b8-bee33d20c70c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:41.847331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6955a5c8-7e0c-4ea6-85b8-bee33d20c70c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152062 Aug 18 22:15:41.847919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1738/3480] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:41.869552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-88153340-6f28-43f0-9959-cce31b25ee23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:41.869811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-13823f1a-bbd6-4fa2-afd3-dcc22dbb7763 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:41.870516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-13823f1a-bbd6-4fa2-afd3-dcc22dbb7763 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:41.876630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13823f1a-bbd6-4fa2-afd3-dcc22dbb7763 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:41.877199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13823f1a-bbd6-4fa2-afd3-dcc22dbb7763 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:41.877765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13823f1a-bbd6-4fa2-afd3-dcc22dbb7763 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:41.878552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13823f1a-bbd6-4fa2-afd3-dcc22dbb7763 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:41.878734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-88153340-6f28-43f0-9959-cce31b25ee23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152243 Aug 18 22:15:41.879157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13823f1a-bbd6-4fa2-afd3-dcc22dbb7763 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:41.879348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1743/3481] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:41 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:41.879714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13823f1a-bbd6-4fa2-afd3-dcc22dbb7763 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:41.897538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-93fcde63-e6e2-4181-8654-107ae90444df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:41.898187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-93fcde63-e6e2-4181-8654-107ae90444df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:41.904363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93fcde63-e6e2-4181-8654-107ae90444df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:41.905493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93fcde63-e6e2-4181-8654-107ae90444df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:41.905995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93fcde63-e6e2-4181-8654-107ae90444df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:41.906729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93fcde63-e6e2-4181-8654-107ae90444df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:41.907190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93fcde63-e6e2-4181-8654-107ae90444df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:41.907642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-93fcde63-e6e2-4181-8654-107ae90444df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:42.044917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-93fcde63-e6e2-4181-8654-107ae90444df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:42.053982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-93fcde63-e6e2-4181-8654-107ae90444df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.160051 Aug 18 22:15:42.054587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1744/3482] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:41 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:42.234111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-13823f1a-bbd6-4fa2-afd3-dcc22dbb7763 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:42.242266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-13823f1a-bbd6-4fa2-afd3-dcc22dbb7763 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.376382 Aug 18 22:15:42.242788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1739/3483] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:41 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:42.266155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ce16cf50-5b00-469f-b0e6-f4fc13b59451 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:42.266782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ce16cf50-5b00-469f-b0e6-f4fc13b59451 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:42.272614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce16cf50-5b00-469f-b0e6-f4fc13b59451 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:42.273097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce16cf50-5b00-469f-b0e6-f4fc13b59451 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:42.273535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce16cf50-5b00-469f-b0e6-f4fc13b59451 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:42.274254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce16cf50-5b00-469f-b0e6-f4fc13b59451 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:42.274712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce16cf50-5b00-469f-b0e6-f4fc13b59451 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:42.275142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce16cf50-5b00-469f-b0e6-f4fc13b59451 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:42.401120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ce16cf50-5b00-469f-b0e6-f4fc13b59451 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:42.409738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ce16cf50-5b00-469f-b0e6-f4fc13b59451 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:42.411229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ce16cf50-5b00-469f-b0e6-f4fc13b59451 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:42.412384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ce16cf50-5b00-469f-b0e6-f4fc13b59451 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150808 Aug 18 22:15:42.412943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1745/3484] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:42.868690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9d64635d-dd0f-4010-9e02-db39d89d41f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:42.869377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9d64635d-dd0f-4010-9e02-db39d89d41f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:42.875998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d64635d-dd0f-4010-9e02-db39d89d41f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:42.876486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d64635d-dd0f-4010-9e02-db39d89d41f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:42.876930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d64635d-dd0f-4010-9e02-db39d89d41f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:42.877647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d64635d-dd0f-4010-9e02-db39d89d41f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:42.878109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d64635d-dd0f-4010-9e02-db39d89d41f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:42.878538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d64635d-dd0f-4010-9e02-db39d89d41f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:42.901754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ecce7eef-49a0-48c1-8871-7cd655ebc605 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:42.902431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ecce7eef-49a0-48c1-8871-7cd655ebc605 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:42.909391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecce7eef-49a0-48c1-8871-7cd655ebc605 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:42.909908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecce7eef-49a0-48c1-8871-7cd655ebc605 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:42.910352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecce7eef-49a0-48c1-8871-7cd655ebc605 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:42.911071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecce7eef-49a0-48c1-8871-7cd655ebc605 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:42.911533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecce7eef-49a0-48c1-8871-7cd655ebc605 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:42.911965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ecce7eef-49a0-48c1-8871-7cd655ebc605 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:43.005095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9d64635d-dd0f-4010-9e02-db39d89d41f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:43.013335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9d64635d-dd0f-4010-9e02-db39d89d41f7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148477 Aug 18 22:15:43.013958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1740/3485] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:42 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:43.044386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ecce7eef-49a0-48c1-8871-7cd655ebc605 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:43.053294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ecce7eef-49a0-48c1-8871-7cd655ebc605 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155374 Aug 18 22:15:43.053894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1746/3486] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:43.075468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4eb0332b-bed4-4cef-9ae1-d13fe3298caa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:43.076090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4eb0332b-bed4-4cef-9ae1-d13fe3298caa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:43.082036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eb0332b-bed4-4cef-9ae1-d13fe3298caa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:43.082527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eb0332b-bed4-4cef-9ae1-d13fe3298caa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:43.082970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eb0332b-bed4-4cef-9ae1-d13fe3298caa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:43.083671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eb0332b-bed4-4cef-9ae1-d13fe3298caa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:43.084132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eb0332b-bed4-4cef-9ae1-d13fe3298caa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:43.084563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eb0332b-bed4-4cef-9ae1-d13fe3298caa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:43.214832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4eb0332b-bed4-4cef-9ae1-d13fe3298caa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:43.223601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4eb0332b-bed4-4cef-9ae1-d13fe3298caa tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152077 Aug 18 22:15:43.224178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1741/3487] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:43 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:43.262944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-abbd3881-0bb3-41f6-b118-7124b72456b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:43.263552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-abbd3881-0bb3-41f6-b118-7124b72456b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:43.269880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abbd3881-0bb3-41f6-b118-7124b72456b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:43.270356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abbd3881-0bb3-41f6-b118-7124b72456b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:43.270785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abbd3881-0bb3-41f6-b118-7124b72456b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:43.271464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abbd3881-0bb3-41f6-b118-7124b72456b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:43.271909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abbd3881-0bb3-41f6-b118-7124b72456b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:43.272326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-abbd3881-0bb3-41f6-b118-7124b72456b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:43.397141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-abbd3881-0bb3-41f6-b118-7124b72456b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:43.405841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-abbd3881-0bb3-41f6-b118-7124b72456b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.146806 Aug 18 22:15:43.406409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1747/3488] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:43 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:43.435235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4f5efdf2-db43-4d0c-aa14-ca7fdf330ccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:43.435787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4f5efdf2-db43-4d0c-aa14-ca7fdf330ccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:43.441902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f5efdf2-db43-4d0c-aa14-ca7fdf330ccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:43.442386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f5efdf2-db43-4d0c-aa14-ca7fdf330ccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:43.442818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f5efdf2-db43-4d0c-aa14-ca7fdf330ccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:43.443507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f5efdf2-db43-4d0c-aa14-ca7fdf330ccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:43.443985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f5efdf2-db43-4d0c-aa14-ca7fdf330ccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:43.444406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f5efdf2-db43-4d0c-aa14-ca7fdf330ccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:43.723415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4f5efdf2-db43-4d0c-aa14-ca7fdf330ccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:43.732143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4f5efdf2-db43-4d0c-aa14-ca7fdf330ccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:43.733736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4f5efdf2-db43-4d0c-aa14-ca7fdf330ccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:43.734908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4f5efdf2-db43-4d0c-aa14-ca7fdf330ccd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.303605 Aug 18 22:15:43.735470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1742/3489] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:44.034591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-058a715f-6228-48df-a4d0-c748babaf815 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:44.035211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-058a715f-6228-48df-a4d0-c748babaf815 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:44.041832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-058a715f-6228-48df-a4d0-c748babaf815 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:44.042320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-058a715f-6228-48df-a4d0-c748babaf815 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:44.042765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-058a715f-6228-48df-a4d0-c748babaf815 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:44.043461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-058a715f-6228-48df-a4d0-c748babaf815 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:44.043951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-058a715f-6228-48df-a4d0-c748babaf815 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:44.044383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-058a715f-6228-48df-a4d0-c748babaf815 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:44.074254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1cdfcdf4-79c3-4dae-bf06-05380ec1684d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:44.074884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1cdfcdf4-79c3-4dae-bf06-05380ec1684d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:44.081361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1cdfcdf4-79c3-4dae-bf06-05380ec1684d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:44.081881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1cdfcdf4-79c3-4dae-bf06-05380ec1684d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:44.082326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1cdfcdf4-79c3-4dae-bf06-05380ec1684d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:44.083019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1cdfcdf4-79c3-4dae-bf06-05380ec1684d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:44.083481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1cdfcdf4-79c3-4dae-bf06-05380ec1684d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:44.083910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1cdfcdf4-79c3-4dae-bf06-05380ec1684d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:44.177109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-058a715f-6228-48df-a4d0-c748babaf815 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:44.186397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-058a715f-6228-48df-a4d0-c748babaf815 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155047 Aug 18 22:15:44.186988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1748/3490] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:44 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:44.215030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1cdfcdf4-79c3-4dae-bf06-05380ec1684d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:44.223246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1cdfcdf4-79c3-4dae-bf06-05380ec1684d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152793 Aug 18 22:15:44.223809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1743/3491] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:44 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:44.244347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5e43c1f2-4ee3-49d5-a08a-1dd710bd6202 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:44.244954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5e43c1f2-4ee3-49d5-a08a-1dd710bd6202 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:44.251821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e43c1f2-4ee3-49d5-a08a-1dd710bd6202 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:44.252305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e43c1f2-4ee3-49d5-a08a-1dd710bd6202 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:44.252885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e43c1f2-4ee3-49d5-a08a-1dd710bd6202 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:44.253644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e43c1f2-4ee3-49d5-a08a-1dd710bd6202 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:44.254113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e43c1f2-4ee3-49d5-a08a-1dd710bd6202 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:44.254544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e43c1f2-4ee3-49d5-a08a-1dd710bd6202 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:44.378563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5e43c1f2-4ee3-49d5-a08a-1dd710bd6202 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:44.386706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5e43c1f2-4ee3-49d5-a08a-1dd710bd6202 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.146147 Aug 18 22:15:44.387282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1749/3492] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:44 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:44.427333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b332f176-a651-4b3a-998a-fbade6cdef59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:44.427951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b332f176-a651-4b3a-998a-fbade6cdef59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:44.433840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b332f176-a651-4b3a-998a-fbade6cdef59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:44.434319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b332f176-a651-4b3a-998a-fbade6cdef59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:44.434756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b332f176-a651-4b3a-998a-fbade6cdef59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:44.435441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b332f176-a651-4b3a-998a-fbade6cdef59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:44.435952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b332f176-a651-4b3a-998a-fbade6cdef59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:44.436384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b332f176-a651-4b3a-998a-fbade6cdef59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:44.561050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b332f176-a651-4b3a-998a-fbade6cdef59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:44.569171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b332f176-a651-4b3a-998a-fbade6cdef59 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.145980 Aug 18 22:15:44.569766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1744/3493] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:44.757993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b85aff20-7cec-4052-af08-0fc2d0e5d43c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:44.758617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b85aff20-7cec-4052-af08-0fc2d0e5d43c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:44.765076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b85aff20-7cec-4052-af08-0fc2d0e5d43c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:44.765568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b85aff20-7cec-4052-af08-0fc2d0e5d43c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:44.766035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b85aff20-7cec-4052-af08-0fc2d0e5d43c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:44.766727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b85aff20-7cec-4052-af08-0fc2d0e5d43c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:44.767184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b85aff20-7cec-4052-af08-0fc2d0e5d43c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:44.767611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b85aff20-7cec-4052-af08-0fc2d0e5d43c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:44.894176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b85aff20-7cec-4052-af08-0fc2d0e5d43c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:44.902706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b85aff20-7cec-4052-af08-0fc2d0e5d43c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:44.904214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b85aff20-7cec-4052-af08-0fc2d0e5d43c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:44.906035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b85aff20-7cec-4052-af08-0fc2d0e5d43c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152022 Aug 18 22:15:44.906599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1750/3494] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:45.208624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dc6bd9d5-4ffe-4dc0-8eda-5cd6b2f22650 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:45.209242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dc6bd9d5-4ffe-4dc0-8eda-5cd6b2f22650 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:45.216134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6bd9d5-4ffe-4dc0-8eda-5cd6b2f22650 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:45.216623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6bd9d5-4ffe-4dc0-8eda-5cd6b2f22650 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:45.217071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6bd9d5-4ffe-4dc0-8eda-5cd6b2f22650 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:45.217820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6bd9d5-4ffe-4dc0-8eda-5cd6b2f22650 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:45.218296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6bd9d5-4ffe-4dc0-8eda-5cd6b2f22650 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:45.218725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dc6bd9d5-4ffe-4dc0-8eda-5cd6b2f22650 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:45.244614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-23a7da42-9550-4c18-b61a-e6a2278049c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:45.245238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-23a7da42-9550-4c18-b61a-e6a2278049c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:45.252270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23a7da42-9550-4c18-b61a-e6a2278049c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:45.252761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23a7da42-9550-4c18-b61a-e6a2278049c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:45.253208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23a7da42-9550-4c18-b61a-e6a2278049c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:45.253933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23a7da42-9550-4c18-b61a-e6a2278049c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:45.254395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23a7da42-9550-4c18-b61a-e6a2278049c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:45.254824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-23a7da42-9550-4c18-b61a-e6a2278049c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:45.346857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dc6bd9d5-4ffe-4dc0-8eda-5cd6b2f22650 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:45.355155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dc6bd9d5-4ffe-4dc0-8eda-5cd6b2f22650 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150437 Aug 18 22:15:45.355735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1745/3495] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:45 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:45.387452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-23a7da42-9550-4c18-b61a-e6a2278049c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:45.395700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-23a7da42-9550-4c18-b61a-e6a2278049c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154986 Aug 18 22:15:45.396268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1751/3496] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:45 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:45.407335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-14af7285-9ec4-4dee-a267-313b4fe144f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:45.407983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-14af7285-9ec4-4dee-a267-313b4fe144f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:45.413960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14af7285-9ec4-4dee-a267-313b4fe144f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:45.414447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14af7285-9ec4-4dee-a267-313b4fe144f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:45.414886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14af7285-9ec4-4dee-a267-313b4fe144f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:45.415577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14af7285-9ec4-4dee-a267-313b4fe144f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:45.416033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14af7285-9ec4-4dee-a267-313b4fe144f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:45.416462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-14af7285-9ec4-4dee-a267-313b4fe144f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:45.545710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-14af7285-9ec4-4dee-a267-313b4fe144f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:45.554150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-14af7285-9ec4-4dee-a267-313b4fe144f2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.150612 Aug 18 22:15:45.554722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1746/3497] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:45 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:45.590275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fb64ac9f-fc18-4987-a9f5-f97f85c4b11f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:45.590890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fb64ac9f-fc18-4987-a9f5-f97f85c4b11f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:45.597273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb64ac9f-fc18-4987-a9f5-f97f85c4b11f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:45.597797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb64ac9f-fc18-4987-a9f5-f97f85c4b11f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:45.598234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb64ac9f-fc18-4987-a9f5-f97f85c4b11f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:45.598923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb64ac9f-fc18-4987-a9f5-f97f85c4b11f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:45.599378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb64ac9f-fc18-4987-a9f5-f97f85c4b11f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:45.599805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fb64ac9f-fc18-4987-a9f5-f97f85c4b11f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:45.727141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fb64ac9f-fc18-4987-a9f5-f97f85c4b11f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:45.735821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fb64ac9f-fc18-4987-a9f5-f97f85c4b11f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149349 Aug 18 22:15:45.736389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1752/3498] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:45 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:45.928539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-430d88bc-7891-46f7-907d-4effc7533d45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:45.929162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-430d88bc-7891-46f7-907d-4effc7533d45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:45.931179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:45.936416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-430d88bc-7891-46f7-907d-4effc7533d45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:45.936896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-430d88bc-7891-46f7-907d-4effc7533d45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:45.937342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-430d88bc-7891-46f7-907d-4effc7533d45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:45.938062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-430d88bc-7891-46f7-907d-4effc7533d45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:45.938522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-430d88bc-7891-46f7-907d-4effc7533d45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:45.938952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-430d88bc-7891-46f7-907d-4effc7533d45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:46.064745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-430d88bc-7891-46f7-907d-4effc7533d45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:46.073313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-430d88bc-7891-46f7-907d-4effc7533d45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:46.074844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-430d88bc-7891-46f7-907d-4effc7533d45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:46.075982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-430d88bc-7891-46f7-907d-4effc7533d45 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151626 Aug 18 22:15:46.076546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1747/3499] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:45 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:46.377279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a9cc3fa4-fd12-4941-a064-8b7c3234c4d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:46.377929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a9cc3fa4-fd12-4941-a064-8b7c3234c4d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:46.384373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9cc3fa4-fd12-4941-a064-8b7c3234c4d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:46.384859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9cc3fa4-fd12-4941-a064-8b7c3234c4d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:46.385303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9cc3fa4-fd12-4941-a064-8b7c3234c4d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:46.386021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9cc3fa4-fd12-4941-a064-8b7c3234c4d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:46.386540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9cc3fa4-fd12-4941-a064-8b7c3234c4d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:46.386917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a9cc3fa4-fd12-4941-a064-8b7c3234c4d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:46.416975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fac0b615-8cae-4573-b338-65355a86d14c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:46.417588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fac0b615-8cae-4573-b338-65355a86d14c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:46.424086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fac0b615-8cae-4573-b338-65355a86d14c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:46.424565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fac0b615-8cae-4573-b338-65355a86d14c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:46.424996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fac0b615-8cae-4573-b338-65355a86d14c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:46.425713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fac0b615-8cae-4573-b338-65355a86d14c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:46.426164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fac0b615-8cae-4573-b338-65355a86d14c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:46.426839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fac0b615-8cae-4573-b338-65355a86d14c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:46.518800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a9cc3fa4-fd12-4941-a064-8b7c3234c4d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:46.521041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:46.528456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a9cc3fa4-fd12-4941-a064-8b7c3234c4d6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155011 Aug 18 22:15:46.529137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1753/3500] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:46.560237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fac0b615-8cae-4573-b338-65355a86d14c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:46.568945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fac0b615-8cae-4573-b338-65355a86d14c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155942 Aug 18 22:15:46.569520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1748/3501] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:46 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:46.575777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26951a6b-052b-4ae5-ac83-e4566e629765 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:46.577030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26951a6b-052b-4ae5-ac83-e4566e629765 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:46.583005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26951a6b-052b-4ae5-ac83-e4566e629765 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:46.583488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26951a6b-052b-4ae5-ac83-e4566e629765 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:46.583928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26951a6b-052b-4ae5-ac83-e4566e629765 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:46.584626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26951a6b-052b-4ae5-ac83-e4566e629765 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:46.585081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26951a6b-052b-4ae5-ac83-e4566e629765 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:46.585512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26951a6b-052b-4ae5-ac83-e4566e629765 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:46.711003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26951a6b-052b-4ae5-ac83-e4566e629765 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:46.719493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26951a6b-052b-4ae5-ac83-e4566e629765 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.147741 Aug 18 22:15:46.720087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1754/3502] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:46 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:46.758566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cb34408b-6414-47d2-92a1-f38818bd4bb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:46.759194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cb34408b-6414-47d2-92a1-f38818bd4bb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:46.765751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb34408b-6414-47d2-92a1-f38818bd4bb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:46.766235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb34408b-6414-47d2-92a1-f38818bd4bb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:46.766664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb34408b-6414-47d2-92a1-f38818bd4bb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:46.767348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb34408b-6414-47d2-92a1-f38818bd4bb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:46.767797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb34408b-6414-47d2-92a1-f38818bd4bb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:46.768217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb34408b-6414-47d2-92a1-f38818bd4bb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:46.894175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cb34408b-6414-47d2-92a1-f38818bd4bb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:46.902698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cb34408b-6414-47d2-92a1-f38818bd4bb1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148131 Aug 18 22:15:46.902924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1749/3503] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:46 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:47.098569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-43577803-243e-415f-8838-7c5ff2a73ecf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:47.099175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-43577803-243e-415f-8838-7c5ff2a73ecf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:47.105138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43577803-243e-415f-8838-7c5ff2a73ecf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:47.105637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43577803-243e-415f-8838-7c5ff2a73ecf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:47.106076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43577803-243e-415f-8838-7c5ff2a73ecf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:47.106755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43577803-243e-415f-8838-7c5ff2a73ecf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:47.107203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43577803-243e-415f-8838-7c5ff2a73ecf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:47.107624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-43577803-243e-415f-8838-7c5ff2a73ecf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:47.231601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-43577803-243e-415f-8838-7c5ff2a73ecf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:47.240064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-43577803-243e-415f-8838-7c5ff2a73ecf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:47.241541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-43577803-243e-415f-8838-7c5ff2a73ecf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:47.242697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-43577803-243e-415f-8838-7c5ff2a73ecf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.147975 Aug 18 22:15:47.243619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1755/3504] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:47 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:15:47.550305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f2520ec4-9f4c-4287-9d5b-f71b3164d2d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:47.550919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f2520ec4-9f4c-4287-9d5b-f71b3164d2d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:47.557660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2520ec4-9f4c-4287-9d5b-f71b3164d2d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:47.558144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2520ec4-9f4c-4287-9d5b-f71b3164d2d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:47.558620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2520ec4-9f4c-4287-9d5b-f71b3164d2d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:47.559268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2520ec4-9f4c-4287-9d5b-f71b3164d2d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:47.559723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2520ec4-9f4c-4287-9d5b-f71b3164d2d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:47.560148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2520ec4-9f4c-4287-9d5b-f71b3164d2d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:47.590542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-529fe4dd-1293-4386-8ca4-1a20f7c20740 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:47.591165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-529fe4dd-1293-4386-8ca4-1a20f7c20740 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:47.597657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-529fe4dd-1293-4386-8ca4-1a20f7c20740 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:47.598150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-529fe4dd-1293-4386-8ca4-1a20f7c20740 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:47.598592 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-529fe4dd-1293-4386-8ca4-1a20f7c20740 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:47.599294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-529fe4dd-1293-4386-8ca4-1a20f7c20740 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:47.599753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-529fe4dd-1293-4386-8ca4-1a20f7c20740 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:47.600184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-529fe4dd-1293-4386-8ca4-1a20f7c20740 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:47.690894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f2520ec4-9f4c-4287-9d5b-f71b3164d2d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:47.699499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f2520ec4-9f4c-4287-9d5b-f71b3164d2d9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153149 Aug 18 22:15:47.700417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1750/3505] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:47.735284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-529fe4dd-1293-4386-8ca4-1a20f7c20740 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:47.740464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c3142d20-2d1c-4e14-8cd4-2b013a91717d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:47.741343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c3142d20-2d1c-4e14-8cd4-2b013a91717d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:47.747040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-529fe4dd-1293-4386-8ca4-1a20f7c20740 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.160096 Aug 18 22:15:47.747953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1756/3506] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:47 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:47.752620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3142d20-2d1c-4e14-8cd4-2b013a91717d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:47.753139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3142d20-2d1c-4e14-8cd4-2b013a91717d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:47.753579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3142d20-2d1c-4e14-8cd4-2b013a91717d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:47.754312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3142d20-2d1c-4e14-8cd4-2b013a91717d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:47.754759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3142d20-2d1c-4e14-8cd4-2b013a91717d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:47.755180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3142d20-2d1c-4e14-8cd4-2b013a91717d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:47.889145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c3142d20-2d1c-4e14-8cd4-2b013a91717d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:47.897368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c3142d20-2d1c-4e14-8cd4-2b013a91717d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.160781 Aug 18 22:15:47.897970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1751/3507] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:47 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:47.923339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d304d339-b264-4937-b4d7-a2b7bd58b085 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:47.923961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d304d339-b264-4937-b4d7-a2b7bd58b085 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:47.930251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d304d339-b264-4937-b4d7-a2b7bd58b085 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:47.930739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d304d339-b264-4937-b4d7-a2b7bd58b085 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:47.931183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d304d339-b264-4937-b4d7-a2b7bd58b085 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:47.931872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d304d339-b264-4937-b4d7-a2b7bd58b085 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:47.932358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d304d339-b264-4937-b4d7-a2b7bd58b085 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:47.932788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d304d339-b264-4937-b4d7-a2b7bd58b085 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:48.057169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d304d339-b264-4937-b4d7-a2b7bd58b085 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:48.065457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d304d339-b264-4937-b4d7-a2b7bd58b085 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.146492 Aug 18 22:15:48.066069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1757/3508] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:47 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:48.265936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-feb6b287-8273-44b3-99bb-8e2be4d1bbf3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:48.266555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-feb6b287-8273-44b3-99bb-8e2be4d1bbf3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:48.272453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feb6b287-8273-44b3-99bb-8e2be4d1bbf3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:48.272932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feb6b287-8273-44b3-99bb-8e2be4d1bbf3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:48.273366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feb6b287-8273-44b3-99bb-8e2be4d1bbf3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:48.274081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feb6b287-8273-44b3-99bb-8e2be4d1bbf3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:48.274536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feb6b287-8273-44b3-99bb-8e2be4d1bbf3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:48.274963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-feb6b287-8273-44b3-99bb-8e2be4d1bbf3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:48.289864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:48.405393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-feb6b287-8273-44b3-99bb-8e2be4d1bbf3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:48.414022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-feb6b287-8273-44b3-99bb-8e2be4d1bbf3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:48.415560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-feb6b287-8273-44b3-99bb-8e2be4d1bbf3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:48.416719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-feb6b287-8273-44b3-99bb-8e2be4d1bbf3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154802 Aug 18 22:15:48.417276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1752/3509] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:48.721784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3b25c4b5-bd80-4bbf-afa7-38a73b8d6cda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:48.722410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3b25c4b5-bd80-4bbf-afa7-38a73b8d6cda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:48.728806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b25c4b5-bd80-4bbf-afa7-38a73b8d6cda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:48.729294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b25c4b5-bd80-4bbf-afa7-38a73b8d6cda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:48.729780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b25c4b5-bd80-4bbf-afa7-38a73b8d6cda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:48.730481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b25c4b5-bd80-4bbf-afa7-38a73b8d6cda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:48.730939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b25c4b5-bd80-4bbf-afa7-38a73b8d6cda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:48.731372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3b25c4b5-bd80-4bbf-afa7-38a73b8d6cda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:48.768696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-09eb58c8-83e7-44dc-abc8-b9a562676159 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:48.769317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-09eb58c8-83e7-44dc-abc8-b9a562676159 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:48.775442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09eb58c8-83e7-44dc-abc8-b9a562676159 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:48.775935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09eb58c8-83e7-44dc-abc8-b9a562676159 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:48.776381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09eb58c8-83e7-44dc-abc8-b9a562676159 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:48.777088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09eb58c8-83e7-44dc-abc8-b9a562676159 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:48.777551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09eb58c8-83e7-44dc-abc8-b9a562676159 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:48.778013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09eb58c8-83e7-44dc-abc8-b9a562676159 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:48.925894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-09eb58c8-83e7-44dc-abc8-b9a562676159 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:48.936090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-09eb58c8-83e7-44dc-abc8-b9a562676159 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.170847 Aug 18 22:15:48.936675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1753/3510] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:48 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:48.941287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7522cc57-2ef0-4ef5-a4c0-2b1adbe717ee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:48.941982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7522cc57-2ef0-4ef5-a4c0-2b1adbe717ee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:48.948405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7522cc57-2ef0-4ef5-a4c0-2b1adbe717ee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:48.948903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7522cc57-2ef0-4ef5-a4c0-2b1adbe717ee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:48.949339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7522cc57-2ef0-4ef5-a4c0-2b1adbe717ee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:48.950212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7522cc57-2ef0-4ef5-a4c0-2b1adbe717ee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:48.950986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7522cc57-2ef0-4ef5-a4c0-2b1adbe717ee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:48.951751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7522cc57-2ef0-4ef5-a4c0-2b1adbe717ee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:49.089475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7522cc57-2ef0-4ef5-a4c0-2b1adbe717ee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:49.098132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7522cc57-2ef0-4ef5-a4c0-2b1adbe717ee tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.160465 Aug 18 22:15:49.098578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3b25c4b5-bd80-4bbf-afa7-38a73b8d6cda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:49.098709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1754/3511] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:48 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:49.103070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5fc5a276-c1ae-48a1-b08a-fd02db31555c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:49.103674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5fc5a276-c1ae-48a1-b08a-fd02db31555c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:49.108216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3b25c4b5-bd80-4bbf-afa7-38a73b8d6cda tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.390313 Aug 18 22:15:49.108974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1758/3512] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:48 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:49.110433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc5a276-c1ae-48a1-b08a-fd02db31555c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:49.110918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc5a276-c1ae-48a1-b08a-fd02db31555c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:49.111359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc5a276-c1ae-48a1-b08a-fd02db31555c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:49.112050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc5a276-c1ae-48a1-b08a-fd02db31555c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:49.112499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc5a276-c1ae-48a1-b08a-fd02db31555c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:49.112924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc5a276-c1ae-48a1-b08a-fd02db31555c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:49.243399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5fc5a276-c1ae-48a1-b08a-fd02db31555c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:49.251851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5fc5a276-c1ae-48a1-b08a-fd02db31555c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152188 Aug 18 22:15:49.252438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1755/3513] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:49 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:49.440063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-867f0084-61cb-428a-9893-c781ecc2d1f7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:49.440671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-867f0084-61cb-428a-9893-c781ecc2d1f7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:49.446670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867f0084-61cb-428a-9893-c781ecc2d1f7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:49.447146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867f0084-61cb-428a-9893-c781ecc2d1f7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:49.447575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867f0084-61cb-428a-9893-c781ecc2d1f7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:49.448253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867f0084-61cb-428a-9893-c781ecc2d1f7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:49.448704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867f0084-61cb-428a-9893-c781ecc2d1f7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:49.449136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-867f0084-61cb-428a-9893-c781ecc2d1f7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:49.574479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-867f0084-61cb-428a-9893-c781ecc2d1f7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:49.583808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-867f0084-61cb-428a-9893-c781ecc2d1f7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:49.585310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-867f0084-61cb-428a-9893-c781ecc2d1f7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:49.586497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-867f0084-61cb-428a-9893-c781ecc2d1f7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150320 Aug 18 22:15:49.587065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1759/3514] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:49.958690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8005f718-69c1-4c17-9071-41d8d11d762e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:49.959345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8005f718-69c1-4c17-9071-41d8d11d762e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:49.966283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8005f718-69c1-4c17-9071-41d8d11d762e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:49.967425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8005f718-69c1-4c17-9071-41d8d11d762e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:49.967873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8005f718-69c1-4c17-9071-41d8d11d762e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:49.968579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8005f718-69c1-4c17-9071-41d8d11d762e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:49.969039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8005f718-69c1-4c17-9071-41d8d11d762e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:49.969472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8005f718-69c1-4c17-9071-41d8d11d762e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:50.095787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8005f718-69c1-4c17-9071-41d8d11d762e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:50.103890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8005f718-69c1-4c17-9071-41d8d11d762e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149282 Aug 18 22:15:50.104463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1756/3515] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:49 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:50.120115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5c0230f4-5e35-4ada-a3e9-9d38a29cf412 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:50.120669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5c0230f4-5e35-4ada-a3e9-9d38a29cf412 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:50.127116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c0230f4-5e35-4ada-a3e9-9d38a29cf412 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:50.127607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c0230f4-5e35-4ada-a3e9-9d38a29cf412 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:50.127994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-74751219-0c2a-471a-9ca7-3ef958459bc5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:50.128112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c0230f4-5e35-4ada-a3e9-9d38a29cf412 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:50.128611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-74751219-0c2a-471a-9ca7-3ef958459bc5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:50.128747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c0230f4-5e35-4ada-a3e9-9d38a29cf412 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:50.129193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c0230f4-5e35-4ada-a3e9-9d38a29cf412 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:50.129647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c0230f4-5e35-4ada-a3e9-9d38a29cf412 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:50.134467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74751219-0c2a-471a-9ca7-3ef958459bc5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:50.134949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74751219-0c2a-471a-9ca7-3ef958459bc5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:50.135387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74751219-0c2a-471a-9ca7-3ef958459bc5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:50.136075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74751219-0c2a-471a-9ca7-3ef958459bc5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:50.136537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74751219-0c2a-471a-9ca7-3ef958459bc5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:50.137763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-74751219-0c2a-471a-9ca7-3ef958459bc5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:50.260969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5c0230f4-5e35-4ada-a3e9-9d38a29cf412 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:50.266386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-74751219-0c2a-471a-9ca7-3ef958459bc5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:50.270350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5c0230f4-5e35-4ada-a3e9-9d38a29cf412 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154026 Aug 18 22:15:50.270937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1760/3516] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:50 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:50.275211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-74751219-0c2a-471a-9ca7-3ef958459bc5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150897 Aug 18 22:15:50.275660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-96a3d904-e5ec-4ff0-8ff9-fd6e5571901f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:50.276277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-96a3d904-e5ec-4ff0-8ff9-fd6e5571901f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:50.280984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1757/3517] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:50 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:50.282359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96a3d904-e5ec-4ff0-8ff9-fd6e5571901f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:50.282850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96a3d904-e5ec-4ff0-8ff9-fd6e5571901f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:50.283294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96a3d904-e5ec-4ff0-8ff9-fd6e5571901f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:50.283992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96a3d904-e5ec-4ff0-8ff9-fd6e5571901f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:50.284448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96a3d904-e5ec-4ff0-8ff9-fd6e5571901f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:50.284884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96a3d904-e5ec-4ff0-8ff9-fd6e5571901f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:50.409151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-96a3d904-e5ec-4ff0-8ff9-fd6e5571901f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:50.417303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-96a3d904-e5ec-4ff0-8ff9-fd6e5571901f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.145210 Aug 18 22:15:50.417967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1761/3518] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:50.610103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-26906f87-2816-4142-8549-b83bde88b0cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:50.610715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-26906f87-2816-4142-8549-b83bde88b0cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:50.616688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26906f87-2816-4142-8549-b83bde88b0cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:50.617162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26906f87-2816-4142-8549-b83bde88b0cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:50.617620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26906f87-2816-4142-8549-b83bde88b0cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:50.618309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26906f87-2816-4142-8549-b83bde88b0cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:50.618758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26906f87-2816-4142-8549-b83bde88b0cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:50.619182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26906f87-2816-4142-8549-b83bde88b0cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:50.751426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-26906f87-2816-4142-8549-b83bde88b0cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:50.760111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-26906f87-2816-4142-8549-b83bde88b0cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:50.761615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-26906f87-2816-4142-8549-b83bde88b0cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:50.762772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-26906f87-2816-4142-8549-b83bde88b0cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157216 Aug 18 22:15:50.763335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1758/3519] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:51.124980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-71f62e55-2c04-4a17-9355-91ad524ed698 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:51.125650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-71f62e55-2c04-4a17-9355-91ad524ed698 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:51.132100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71f62e55-2c04-4a17-9355-91ad524ed698 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:51.132589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71f62e55-2c04-4a17-9355-91ad524ed698 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:51.133030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71f62e55-2c04-4a17-9355-91ad524ed698 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:51.133778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71f62e55-2c04-4a17-9355-91ad524ed698 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:51.134239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71f62e55-2c04-4a17-9355-91ad524ed698 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:51.134671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71f62e55-2c04-4a17-9355-91ad524ed698 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:51.262063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-71f62e55-2c04-4a17-9355-91ad524ed698 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:51.270300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-71f62e55-2c04-4a17-9355-91ad524ed698 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149362 Aug 18 22:15:51.270877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1762/3520] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:51 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:51.291144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eb8b49bb-200a-4d17-b754-17e73aed0220 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:51.291774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eb8b49bb-200a-4d17-b754-17e73aed0220 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:51.296320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64a91c0c-f386-4bad-a400-fd0865819ff3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:51.296936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64a91c0c-f386-4bad-a400-fd0865819ff3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:51.298836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb8b49bb-200a-4d17-b754-17e73aed0220 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:51.299329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb8b49bb-200a-4d17-b754-17e73aed0220 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:51.299772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb8b49bb-200a-4d17-b754-17e73aed0220 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:51.300475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb8b49bb-200a-4d17-b754-17e73aed0220 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:51.300938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb8b49bb-200a-4d17-b754-17e73aed0220 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:51.301639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb8b49bb-200a-4d17-b754-17e73aed0220 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:51.303095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a91c0c-f386-4bad-a400-fd0865819ff3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:51.303588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a91c0c-f386-4bad-a400-fd0865819ff3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:51.304137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a91c0c-f386-4bad-a400-fd0865819ff3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:51.304837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a91c0c-f386-4bad-a400-fd0865819ff3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:51.305295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a91c0c-f386-4bad-a400-fd0865819ff3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:51.305755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64a91c0c-f386-4bad-a400-fd0865819ff3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:51.430507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-eb8b49bb-200a-4d17-b754-17e73aed0220 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:51.436201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-64a91c0c-f386-4bad-a400-fd0865819ff3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:51.439253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eb8b49bb-200a-4d17-b754-17e73aed0220 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152012 Aug 18 22:15:51.439921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1759/3521] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:51 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:51.444274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f8531fca-21d5-411b-bcd4-502bf936c350 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:51.444878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f8531fca-21d5-411b-bcd4-502bf936c350 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:51.445537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64a91c0c-f386-4bad-a400-fd0865819ff3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153430 Aug 18 22:15:51.449659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1763/3522] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:51 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:51.455054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8531fca-21d5-411b-bcd4-502bf936c350 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:51.455548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8531fca-21d5-411b-bcd4-502bf936c350 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:51.455989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8531fca-21d5-411b-bcd4-502bf936c350 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:51.456724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8531fca-21d5-411b-bcd4-502bf936c350 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:51.457208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8531fca-21d5-411b-bcd4-502bf936c350 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:51.457658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8531fca-21d5-411b-bcd4-502bf936c350 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:51.585028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8531fca-21d5-411b-bcd4-502bf936c350 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:51.593907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f8531fca-21d5-411b-bcd4-502bf936c350 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153017 Aug 18 22:15:51.594473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1760/3523] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:51.784462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8e6e3c5a-4ed0-4b49-ab65-a041d1874f81 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:51.785006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8e6e3c5a-4ed0-4b49-ab65-a041d1874f81 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:51.786880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:51.792296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e6e3c5a-4ed0-4b49-ab65-a041d1874f81 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:51.792786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e6e3c5a-4ed0-4b49-ab65-a041d1874f81 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:51.793225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e6e3c5a-4ed0-4b49-ab65-a041d1874f81 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:51.793963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e6e3c5a-4ed0-4b49-ab65-a041d1874f81 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:51.794425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e6e3c5a-4ed0-4b49-ab65-a041d1874f81 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:51.794851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e6e3c5a-4ed0-4b49-ab65-a041d1874f81 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:51.922641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8e6e3c5a-4ed0-4b49-ab65-a041d1874f81 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:51.931806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8e6e3c5a-4ed0-4b49-ab65-a041d1874f81 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:51.933310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8e6e3c5a-4ed0-4b49-ab65-a041d1874f81 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:51.934803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8e6e3c5a-4ed0-4b49-ab65-a041d1874f81 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154239 Aug 18 22:15:51.935384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1764/3524] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:51 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:52.292160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c7f0455c-9193-4cf5-84a4-1d1440cc3443 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:52.292785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c7f0455c-9193-4cf5-84a4-1d1440cc3443 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:52.299941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7f0455c-9193-4cf5-84a4-1d1440cc3443 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:52.300432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7f0455c-9193-4cf5-84a4-1d1440cc3443 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:52.300873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7f0455c-9193-4cf5-84a4-1d1440cc3443 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:52.301859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7f0455c-9193-4cf5-84a4-1d1440cc3443 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:52.302321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7f0455c-9193-4cf5-84a4-1d1440cc3443 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:52.302754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7f0455c-9193-4cf5-84a4-1d1440cc3443 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:52.431357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c7f0455c-9193-4cf5-84a4-1d1440cc3443 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:52.440124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c7f0455c-9193-4cf5-84a4-1d1440cc3443 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151931 Aug 18 22:15:52.440699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1761/3525] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:52 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:52.460472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c627854-1b17-4f2a-ac2f-a1475561f39b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:52.461090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c627854-1b17-4f2a-ac2f-a1475561f39b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:52.467598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7ff62285-38b4-45c9-8464-07fd5d0e9a99 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:52.467763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c627854-1b17-4f2a-ac2f-a1475561f39b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:52.468214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7ff62285-38b4-45c9-8464-07fd5d0e9a99 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:52.468330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c627854-1b17-4f2a-ac2f-a1475561f39b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:52.468657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c627854-1b17-4f2a-ac2f-a1475561f39b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:52.469356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c627854-1b17-4f2a-ac2f-a1475561f39b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:52.469912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c627854-1b17-4f2a-ac2f-a1475561f39b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:52.470346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c627854-1b17-4f2a-ac2f-a1475561f39b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:52.474054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ff62285-38b4-45c9-8464-07fd5d0e9a99 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:52.474533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ff62285-38b4-45c9-8464-07fd5d0e9a99 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:52.474964 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ff62285-38b4-45c9-8464-07fd5d0e9a99 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:52.475643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ff62285-38b4-45c9-8464-07fd5d0e9a99 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:52.476090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ff62285-38b4-45c9-8464-07fd5d0e9a99 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:52.476509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7ff62285-38b4-45c9-8464-07fd5d0e9a99 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:52.606669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7ff62285-38b4-45c9-8464-07fd5d0e9a99 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:52.607193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4c627854-1b17-4f2a-ac2f-a1475561f39b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:52.615760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7ff62285-38b4-45c9-8464-07fd5d0e9a99 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152055 Aug 18 22:15:52.616343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1762/3526] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:52.616724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c627854-1b17-4f2a-ac2f-a1475561f39b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.159972 Aug 18 22:15:52.617393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1765/3527] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:52 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:52.620745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6ce5bd5f-12e3-48d3-b262-95a5742e9e8c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:52.621364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6ce5bd5f-12e3-48d3-b262-95a5742e9e8c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:52.627234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ce5bd5f-12e3-48d3-b262-95a5742e9e8c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:52.627723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ce5bd5f-12e3-48d3-b262-95a5742e9e8c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:52.628166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ce5bd5f-12e3-48d3-b262-95a5742e9e8c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:52.628861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ce5bd5f-12e3-48d3-b262-95a5742e9e8c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:52.629343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ce5bd5f-12e3-48d3-b262-95a5742e9e8c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:52.629863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ce5bd5f-12e3-48d3-b262-95a5742e9e8c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:52.759972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6ce5bd5f-12e3-48d3-b262-95a5742e9e8c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:52.768091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6ce5bd5f-12e3-48d3-b262-95a5742e9e8c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150809 Aug 18 22:15:52.768656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1763/3528] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:52.958391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e38f6a06-1f2d-4e36-8c4f-3787121dafda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:52.958918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e38f6a06-1f2d-4e36-8c4f-3787121dafda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:52.964840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e38f6a06-1f2d-4e36-8c4f-3787121dafda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:52.965316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e38f6a06-1f2d-4e36-8c4f-3787121dafda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:52.965770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e38f6a06-1f2d-4e36-8c4f-3787121dafda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:52.966447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e38f6a06-1f2d-4e36-8c4f-3787121dafda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:52.967461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e38f6a06-1f2d-4e36-8c4f-3787121dafda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:52.967878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e38f6a06-1f2d-4e36-8c4f-3787121dafda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:53.093306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e38f6a06-1f2d-4e36-8c4f-3787121dafda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:53.101913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e38f6a06-1f2d-4e36-8c4f-3787121dafda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:53.103408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e38f6a06-1f2d-4e36-8c4f-3787121dafda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:53.104552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e38f6a06-1f2d-4e36-8c4f-3787121dafda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150155 Aug 18 22:15:53.105108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1766/3529] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:52 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:53.461893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7b1f9cfd-6fcf-4e04-bc48-40f5b3a6dd1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:53.462518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7b1f9cfd-6fcf-4e04-bc48-40f5b3a6dd1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:53.469168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b1f9cfd-6fcf-4e04-bc48-40f5b3a6dd1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:53.469676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b1f9cfd-6fcf-4e04-bc48-40f5b3a6dd1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:53.470114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b1f9cfd-6fcf-4e04-bc48-40f5b3a6dd1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:53.470794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b1f9cfd-6fcf-4e04-bc48-40f5b3a6dd1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:53.471244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b1f9cfd-6fcf-4e04-bc48-40f5b3a6dd1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:53.471666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b1f9cfd-6fcf-4e04-bc48-40f5b3a6dd1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:53.605412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7b1f9cfd-6fcf-4e04-bc48-40f5b3a6dd1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:53.614119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7b1f9cfd-6fcf-4e04-bc48-40f5b3a6dd1c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156012 Aug 18 22:15:53.614697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1764/3530] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:53 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:53.636106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9fc9fbff-808e-4023-8f1d-695857caf1cb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:53.636729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9fc9fbff-808e-4023-8f1d-695857caf1cb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:53.639006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aaa84df2-b59b-4b29-955c-c61b6a9baf7d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:53.639620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-aaa84df2-b59b-4b29-955c-c61b6a9baf7d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:53.643315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fc9fbff-808e-4023-8f1d-695857caf1cb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:53.643801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fc9fbff-808e-4023-8f1d-695857caf1cb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:53.644241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fc9fbff-808e-4023-8f1d-695857caf1cb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:53.644940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fc9fbff-808e-4023-8f1d-695857caf1cb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:53.645394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fc9fbff-808e-4023-8f1d-695857caf1cb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:53.645531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aaa84df2-b59b-4b29-955c-c61b6a9baf7d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:53.645850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9fc9fbff-808e-4023-8f1d-695857caf1cb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:53.646040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aaa84df2-b59b-4b29-955c-c61b6a9baf7d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:53.646475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aaa84df2-b59b-4b29-955c-c61b6a9baf7d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:53.647158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aaa84df2-b59b-4b29-955c-c61b6a9baf7d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:53.647608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aaa84df2-b59b-4b29-955c-c61b6a9baf7d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:53.648031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aaa84df2-b59b-4b29-955c-c61b6a9baf7d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:53.779196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9fc9fbff-808e-4023-8f1d-695857caf1cb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:53.781299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aaa84df2-b59b-4b29-955c-c61b6a9baf7d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:53.788001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9fc9fbff-808e-4023-8f1d-695857caf1cb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155688 Aug 18 22:15:53.788686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1767/3531] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:53.790125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aaa84df2-b59b-4b29-955c-c61b6a9baf7d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154949 Aug 18 22:15:53.790690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1765/3532] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:53 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:53.793454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-806b6ff7-4636-4b9b-9385-6ffc41115186 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:53.794073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-806b6ff7-4636-4b9b-9385-6ffc41115186 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:53.800508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-806b6ff7-4636-4b9b-9385-6ffc41115186 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:53.801052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-806b6ff7-4636-4b9b-9385-6ffc41115186 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:53.801846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-806b6ff7-4636-4b9b-9385-6ffc41115186 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:53.802594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-806b6ff7-4636-4b9b-9385-6ffc41115186 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:53.803117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-806b6ff7-4636-4b9b-9385-6ffc41115186 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:53.803625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-806b6ff7-4636-4b9b-9385-6ffc41115186 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:53.934961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-806b6ff7-4636-4b9b-9385-6ffc41115186 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:53.944832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-806b6ff7-4636-4b9b-9385-6ffc41115186 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155100 Aug 18 22:15:53.945402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1768/3533] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:53 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:54.127333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f451b2fa-0d90-47fc-8d1f-c6465f195cb2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:54.127952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f451b2fa-0d90-47fc-8d1f-c6465f195cb2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:54.134190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f451b2fa-0d90-47fc-8d1f-c6465f195cb2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:54.134716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f451b2fa-0d90-47fc-8d1f-c6465f195cb2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:54.135159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f451b2fa-0d90-47fc-8d1f-c6465f195cb2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:54.135889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f451b2fa-0d90-47fc-8d1f-c6465f195cb2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:54.136358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f451b2fa-0d90-47fc-8d1f-c6465f195cb2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:54.136816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f451b2fa-0d90-47fc-8d1f-c6465f195cb2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:54.268776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f451b2fa-0d90-47fc-8d1f-c6465f195cb2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:54.277388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f451b2fa-0d90-47fc-8d1f-c6465f195cb2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:54.278932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f451b2fa-0d90-47fc-8d1f-c6465f195cb2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:54.280583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f451b2fa-0d90-47fc-8d1f-c6465f195cb2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157191 Aug 18 22:15:54.281139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1766/3534] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:54 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:54.636234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a25b57bb-82a4-4093-b840-e9daec630473 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:54.636860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a25b57bb-82a4-4093-b840-e9daec630473 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:54.643482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a25b57bb-82a4-4093-b840-e9daec630473 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:54.643964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a25b57bb-82a4-4093-b840-e9daec630473 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:54.644403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a25b57bb-82a4-4093-b840-e9daec630473 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:54.645096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a25b57bb-82a4-4093-b840-e9daec630473 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:54.645551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a25b57bb-82a4-4093-b840-e9daec630473 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:54.646061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a25b57bb-82a4-4093-b840-e9daec630473 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:54.773917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a25b57bb-82a4-4093-b840-e9daec630473 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:54.782049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a25b57bb-82a4-4093-b840-e9daec630473 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149675 Aug 18 22:15:54.782624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1769/3535] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:54 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:54.810142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-99c3b1b8-dbdb-4f81-a9d1-d73d7960caef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:54.811418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-99c3b1b8-dbdb-4f81-a9d1-d73d7960caef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:54.818782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99c3b1b8-dbdb-4f81-a9d1-d73d7960caef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:54.818913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99c3b1b8-dbdb-4f81-a9d1-d73d7960caef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:54.819372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99c3b1b8-dbdb-4f81-a9d1-d73d7960caef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:54.820001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b9126e6f-8045-4aeb-b81d-56156b0b739b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:54.820159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99c3b1b8-dbdb-4f81-a9d1-d73d7960caef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:54.820532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99c3b1b8-dbdb-4f81-a9d1-d73d7960caef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:54.820661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b9126e6f-8045-4aeb-b81d-56156b0b739b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:54.820987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99c3b1b8-dbdb-4f81-a9d1-d73d7960caef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:54.827218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9126e6f-8045-4aeb-b81d-56156b0b739b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:54.827701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9126e6f-8045-4aeb-b81d-56156b0b739b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:54.828153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9126e6f-8045-4aeb-b81d-56156b0b739b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:54.828850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9126e6f-8045-4aeb-b81d-56156b0b739b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:54.829303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9126e6f-8045-4aeb-b81d-56156b0b739b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:54.829754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b9126e6f-8045-4aeb-b81d-56156b0b739b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:54.844537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:54.957459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-99c3b1b8-dbdb-4f81-a9d1-d73d7960caef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:54.966436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-99c3b1b8-dbdb-4f81-a9d1-d73d7960caef tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.160058 Aug 18 22:15:54.967065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1767/3536] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:54 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:54.971608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8eeedbf0-4635-4a6c-a975-5a9fc95ca29c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:54.972223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8eeedbf0-4635-4a6c-a975-5a9fc95ca29c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:54.977579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b9126e6f-8045-4aeb-b81d-56156b0b739b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:54.978089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8eeedbf0-4635-4a6c-a975-5a9fc95ca29c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:54.978583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8eeedbf0-4635-4a6c-a975-5a9fc95ca29c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:54.979021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8eeedbf0-4635-4a6c-a975-5a9fc95ca29c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:54.979717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8eeedbf0-4635-4a6c-a975-5a9fc95ca29c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:54.980170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8eeedbf0-4635-4a6c-a975-5a9fc95ca29c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:54.980601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8eeedbf0-4635-4a6c-a975-5a9fc95ca29c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:54.988341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b9126e6f-8045-4aeb-b81d-56156b0b739b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.172307 Aug 18 22:15:54.988910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1770/3537] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:54 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:55.106665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8eeedbf0-4635-4a6c-a975-5a9fc95ca29c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:55.115201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8eeedbf0-4635-4a6c-a975-5a9fc95ca29c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147212 Aug 18 22:15:55.115770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1768/3538] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:54 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:55.304062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-38076c8f-fa94-40d7-b48f-4f8493612115 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:55.304711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-38076c8f-fa94-40d7-b48f-4f8493612115 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:55.311304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38076c8f-fa94-40d7-b48f-4f8493612115 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:55.311784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38076c8f-fa94-40d7-b48f-4f8493612115 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:55.312226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38076c8f-fa94-40d7-b48f-4f8493612115 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:55.312915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38076c8f-fa94-40d7-b48f-4f8493612115 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:55.313532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38076c8f-fa94-40d7-b48f-4f8493612115 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:55.313990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38076c8f-fa94-40d7-b48f-4f8493612115 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:55.438996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-38076c8f-fa94-40d7-b48f-4f8493612115 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:55.447480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-38076c8f-fa94-40d7-b48f-4f8493612115 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:55.448984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-38076c8f-fa94-40d7-b48f-4f8493612115 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:55.450186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-38076c8f-fa94-40d7-b48f-4f8493612115 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150227 Aug 18 22:15:55.450751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1771/3539] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:55.803453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4c110293-5455-4438-bd4d-e3a00e0a9b9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:55.804062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4c110293-5455-4438-bd4d-e3a00e0a9b9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:55.810029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4c110293-5455-4438-bd4d-e3a00e0a9b9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:55.810514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4c110293-5455-4438-bd4d-e3a00e0a9b9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:55.811104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4c110293-5455-4438-bd4d-e3a00e0a9b9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:55.811615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4c110293-5455-4438-bd4d-e3a00e0a9b9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:55.812066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4c110293-5455-4438-bd4d-e3a00e0a9b9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:55.812487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4c110293-5455-4438-bd4d-e3a00e0a9b9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:55.816772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:15:55.944323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4c110293-5455-4438-bd4d-e3a00e0a9b9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:55.953252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4c110293-5455-4438-bd4d-e3a00e0a9b9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153873 Aug 18 22:15:55.953868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1769/3540] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:55 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:55.988241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ba507f4c-fecc-497f-88f0-306325f4f82b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:55.988783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ba507f4c-fecc-497f-88f0-306325f4f82b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:55.995325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba507f4c-fecc-497f-88f0-306325f4f82b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:55.995830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba507f4c-fecc-497f-88f0-306325f4f82b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:55.996290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba507f4c-fecc-497f-88f0-306325f4f82b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:55.996974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba507f4c-fecc-497f-88f0-306325f4f82b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:55.997425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba507f4c-fecc-497f-88f0-306325f4f82b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:55.997902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba507f4c-fecc-497f-88f0-306325f4f82b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:56.009273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6f3dfc4c-d4c1-4280-b65f-b4993f22fd63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:56.009910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6f3dfc4c-d4c1-4280-b65f-b4993f22fd63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:56.016526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f3dfc4c-d4c1-4280-b65f-b4993f22fd63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:56.017015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f3dfc4c-d4c1-4280-b65f-b4993f22fd63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:56.017455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f3dfc4c-d4c1-4280-b65f-b4993f22fd63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:56.018180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f3dfc4c-d4c1-4280-b65f-b4993f22fd63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:56.018640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f3dfc4c-d4c1-4280-b65f-b4993f22fd63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:56.019068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f3dfc4c-d4c1-4280-b65f-b4993f22fd63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:56.131674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ba507f4c-fecc-497f-88f0-306325f4f82b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:56.140841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ba507f4c-fecc-497f-88f0-306325f4f82b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156502 Aug 18 22:15:56.141670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1772/3541] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:55 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:56.146080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e0346eb4-20fc-4ccf-9183-c1e737466ef6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:56.146688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e0346eb4-20fc-4ccf-9183-c1e737466ef6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:56.152335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6f3dfc4c-d4c1-4280-b65f-b4993f22fd63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:56.152534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0346eb4-20fc-4ccf-9183-c1e737466ef6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:56.153027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0346eb4-20fc-4ccf-9183-c1e737466ef6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:56.153468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0346eb4-20fc-4ccf-9183-c1e737466ef6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:56.155264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0346eb4-20fc-4ccf-9183-c1e737466ef6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:56.155829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0346eb4-20fc-4ccf-9183-c1e737466ef6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:56.156369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0346eb4-20fc-4ccf-9183-c1e737466ef6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:56.161328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6f3dfc4c-d4c1-4280-b65f-b4993f22fd63 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155707 Aug 18 22:15:56.161937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1770/3542] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:56 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:56.285052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e0346eb4-20fc-4ccf-9183-c1e737466ef6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:56.293175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e0346eb4-20fc-4ccf-9183-c1e737466ef6 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150561 Aug 18 22:15:56.293777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1773/3543] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:56 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:56.472715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2594ea0-f707-4e3b-b167-e55350abffae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:56.473359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e2594ea0-f707-4e3b-b167-e55350abffae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:56.479318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2594ea0-f707-4e3b-b167-e55350abffae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:56.479796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2594ea0-f707-4e3b-b167-e55350abffae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:56.480232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2594ea0-f707-4e3b-b167-e55350abffae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:56.480910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2594ea0-f707-4e3b-b167-e55350abffae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:56.481359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2594ea0-f707-4e3b-b167-e55350abffae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:56.481832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2594ea0-f707-4e3b-b167-e55350abffae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:56.607085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e2594ea0-f707-4e3b-b167-e55350abffae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:56.616481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e2594ea0-f707-4e3b-b167-e55350abffae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:56.617993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e2594ea0-f707-4e3b-b167-e55350abffae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:56.619137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e2594ea0-f707-4e3b-b167-e55350abffae tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150343 Aug 18 22:15:56.619698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1771/3544] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:56.975182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e76ca062-d27e-4775-9f9b-c8627ec37b8c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:56.975740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e76ca062-d27e-4775-9f9b-c8627ec37b8c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:56.981830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e76ca062-d27e-4775-9f9b-c8627ec37b8c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:56.982801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e76ca062-d27e-4775-9f9b-c8627ec37b8c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:56.983230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e76ca062-d27e-4775-9f9b-c8627ec37b8c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:56.983911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e76ca062-d27e-4775-9f9b-c8627ec37b8c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:56.984355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e76ca062-d27e-4775-9f9b-c8627ec37b8c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:56.984774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e76ca062-d27e-4775-9f9b-c8627ec37b8c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:57.110574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e76ca062-d27e-4775-9f9b-c8627ec37b8c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:57.118876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e76ca062-d27e-4775-9f9b-c8627ec37b8c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.147584 Aug 18 22:15:57.119448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1774/3545] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:56 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:57.163614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aeb830e6-42c5-40fb-990f-a36e8bb7309e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:57.164237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-aeb830e6-42c5-40fb-990f-a36e8bb7309e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:57.171532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aeb830e6-42c5-40fb-990f-a36e8bb7309e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:57.172055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aeb830e6-42c5-40fb-990f-a36e8bb7309e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:57.172503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aeb830e6-42c5-40fb-990f-a36e8bb7309e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:57.173205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aeb830e6-42c5-40fb-990f-a36e8bb7309e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:57.173703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aeb830e6-42c5-40fb-990f-a36e8bb7309e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:57.174141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aeb830e6-42c5-40fb-990f-a36e8bb7309e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:57.182402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9bd7d5cd-43dc-4de1-a032-935a6b4df771 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:57.183045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9bd7d5cd-43dc-4de1-a032-935a6b4df771 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:57.188974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd7d5cd-43dc-4de1-a032-935a6b4df771 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:57.189467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd7d5cd-43dc-4de1-a032-935a6b4df771 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:57.189941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd7d5cd-43dc-4de1-a032-935a6b4df771 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:57.190641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd7d5cd-43dc-4de1-a032-935a6b4df771 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:57.191094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd7d5cd-43dc-4de1-a032-935a6b4df771 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:57.191528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd7d5cd-43dc-4de1-a032-935a6b4df771 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:57.309030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aeb830e6-42c5-40fb-990f-a36e8bb7309e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:57.317810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aeb830e6-42c5-40fb-990f-a36e8bb7309e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.158003 Aug 18 22:15:57.318393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1772/3546] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:57 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:57.323235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-213ca394-b138-4019-8e24-cdfe0d4523b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:57.323852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-213ca394-b138-4019-8e24-cdfe0d4523b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:57.329749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-213ca394-b138-4019-8e24-cdfe0d4523b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:57.330235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-213ca394-b138-4019-8e24-cdfe0d4523b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:57.330672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-213ca394-b138-4019-8e24-cdfe0d4523b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:57.331388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-213ca394-b138-4019-8e24-cdfe0d4523b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:57.331813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-213ca394-b138-4019-8e24-cdfe0d4523b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:57.332380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-213ca394-b138-4019-8e24-cdfe0d4523b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:57.336900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9bd7d5cd-43dc-4de1-a032-935a6b4df771 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:57.346138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9bd7d5cd-43dc-4de1-a032-935a6b4df771 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.167417 Aug 18 22:15:57.349636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1775/3547] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:57 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:57.463950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-213ca394-b138-4019-8e24-cdfe0d4523b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:57.472695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-213ca394-b138-4019-8e24-cdfe0d4523b5 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153374 Aug 18 22:15:57.473276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1773/3548] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:57.643009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d6c3e7a4-bb30-46ff-88a3-c9d1257da723 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:57.643780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d6c3e7a4-bb30-46ff-88a3-c9d1257da723 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:57.650631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6c3e7a4-bb30-46ff-88a3-c9d1257da723 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:57.651115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6c3e7a4-bb30-46ff-88a3-c9d1257da723 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:57.651552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6c3e7a4-bb30-46ff-88a3-c9d1257da723 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:57.652255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6c3e7a4-bb30-46ff-88a3-c9d1257da723 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:57.652717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6c3e7a4-bb30-46ff-88a3-c9d1257da723 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:57.653125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6c3e7a4-bb30-46ff-88a3-c9d1257da723 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:57.782106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d6c3e7a4-bb30-46ff-88a3-c9d1257da723 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:57.790856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d6c3e7a4-bb30-46ff-88a3-c9d1257da723 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:57.792378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d6c3e7a4-bb30-46ff-88a3-c9d1257da723 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:57.793545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d6c3e7a4-bb30-46ff-88a3-c9d1257da723 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154945 Aug 18 22:15:57.794146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1776/3549] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:58.139385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f18d4aae-c4ba-4521-870e-de668614e99a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:58.140032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f18d4aae-c4ba-4521-870e-de668614e99a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:58.146353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f18d4aae-c4ba-4521-870e-de668614e99a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:58.146854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f18d4aae-c4ba-4521-870e-de668614e99a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:58.147295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f18d4aae-c4ba-4521-870e-de668614e99a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:58.147998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f18d4aae-c4ba-4521-870e-de668614e99a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:58.148459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f18d4aae-c4ba-4521-870e-de668614e99a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:58.148892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f18d4aae-c4ba-4521-870e-de668614e99a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:58.278775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f18d4aae-c4ba-4521-870e-de668614e99a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:58.287740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f18d4aae-c4ba-4521-870e-de668614e99a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152432 Aug 18 22:15:58.288309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1774/3550] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:58 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:58.338037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e88beb1b-aed0-4dfb-a5cb-a3ad768629bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:58.338666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e88beb1b-aed0-4dfb-a5cb-a3ad768629bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:58.345335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e88beb1b-aed0-4dfb-a5cb-a3ad768629bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:58.345849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e88beb1b-aed0-4dfb-a5cb-a3ad768629bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:58.346280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e88beb1b-aed0-4dfb-a5cb-a3ad768629bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:58.346973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e88beb1b-aed0-4dfb-a5cb-a3ad768629bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:58.347430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e88beb1b-aed0-4dfb-a5cb-a3ad768629bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:58.347853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e88beb1b-aed0-4dfb-a5cb-a3ad768629bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:58.368145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-33fa2e93-e3d2-41c9-9b21-ee953510034e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:58.368758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-33fa2e93-e3d2-41c9-9b21-ee953510034e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:58.375284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33fa2e93-e3d2-41c9-9b21-ee953510034e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:58.375775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33fa2e93-e3d2-41c9-9b21-ee953510034e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:58.376220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33fa2e93-e3d2-41c9-9b21-ee953510034e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:58.376920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33fa2e93-e3d2-41c9-9b21-ee953510034e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:58.377379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33fa2e93-e3d2-41c9-9b21-ee953510034e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:58.377833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33fa2e93-e3d2-41c9-9b21-ee953510034e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:58.486749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e88beb1b-aed0-4dfb-a5cb-a3ad768629bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:58.495215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e88beb1b-aed0-4dfb-a5cb-a3ad768629bc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.160957 Aug 18 22:15:58.495801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1777/3551] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:58.500868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1b68b20e-6c1f-420e-8146-e7a1416bdd5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:58.501486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1b68b20e-6c1f-420e-8146-e7a1416bdd5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:58.507412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b68b20e-6c1f-420e-8146-e7a1416bdd5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:58.507900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b68b20e-6c1f-420e-8146-e7a1416bdd5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:58.508334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b68b20e-6c1f-420e-8146-e7a1416bdd5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:58.509030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b68b20e-6c1f-420e-8146-e7a1416bdd5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:58.509480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b68b20e-6c1f-420e-8146-e7a1416bdd5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:58.509942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b68b20e-6c1f-420e-8146-e7a1416bdd5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:58.517194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-33fa2e93-e3d2-41c9-9b21-ee953510034e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:58.525443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-33fa2e93-e3d2-41c9-9b21-ee953510034e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.161061 Aug 18 22:15:58.526069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1775/3552] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:58 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:58.638267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1b68b20e-6c1f-420e-8146-e7a1416bdd5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:58.646589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1b68b20e-6c1f-420e-8146-e7a1416bdd5c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149762 Aug 18 22:15:58.647122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1778/3553] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:58 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:58.816462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1f94e969-e65b-4841-bff9-4df296166c7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:58.817084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1f94e969-e65b-4841-bff9-4df296166c7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:58.823087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f94e969-e65b-4841-bff9-4df296166c7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:58.823581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f94e969-e65b-4841-bff9-4df296166c7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:58.824087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f94e969-e65b-4841-bff9-4df296166c7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:58.824812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f94e969-e65b-4841-bff9-4df296166c7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:58.825276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f94e969-e65b-4841-bff9-4df296166c7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:58.825729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1f94e969-e65b-4841-bff9-4df296166c7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:58.958624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1f94e969-e65b-4841-bff9-4df296166c7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:58.969334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1f94e969-e65b-4841-bff9-4df296166c7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:58.970908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1f94e969-e65b-4841-bff9-4df296166c7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:58.972072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1f94e969-e65b-4841-bff9-4df296166c7f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159564 Aug 18 22:15:58.972683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1776/3554] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:15:59.309832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f6ae7ed0-9344-4a7e-9ce5-1da040bd63cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:59.310937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f6ae7ed0-9344-4a7e-9ce5-1da040bd63cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:59.317228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6ae7ed0-9344-4a7e-9ce5-1da040bd63cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:59.317815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6ae7ed0-9344-4a7e-9ce5-1da040bd63cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:59.318253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6ae7ed0-9344-4a7e-9ce5-1da040bd63cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:59.318938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6ae7ed0-9344-4a7e-9ce5-1da040bd63cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:59.319390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6ae7ed0-9344-4a7e-9ce5-1da040bd63cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:59.319813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6ae7ed0-9344-4a7e-9ce5-1da040bd63cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:59.455525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f6ae7ed0-9344-4a7e-9ce5-1da040bd63cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:59.463993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f6ae7ed0-9344-4a7e-9ce5-1da040bd63cc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.158097 Aug 18 22:15:59.464620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1779/3555] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:59 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:59.516991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f0c93d3b-fdb6-4361-9e33-22b34d7258dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:59.517623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f0c93d3b-fdb6-4361-9e33-22b34d7258dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:59.524372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0c93d3b-fdb6-4361-9e33-22b34d7258dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:59.524853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0c93d3b-fdb6-4361-9e33-22b34d7258dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:59.525287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0c93d3b-fdb6-4361-9e33-22b34d7258dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:59.525999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0c93d3b-fdb6-4361-9e33-22b34d7258dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:59.526451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0c93d3b-fdb6-4361-9e33-22b34d7258dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:59.526873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0c93d3b-fdb6-4361-9e33-22b34d7258dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:59.547338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ec87d64b-5397-469b-bf63-b3311caeefc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:59.548006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ec87d64b-5397-469b-bf63-b3311caeefc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:59.554216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec87d64b-5397-469b-bf63-b3311caeefc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:59.554706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec87d64b-5397-469b-bf63-b3311caeefc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:59.555149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec87d64b-5397-469b-bf63-b3311caeefc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:59.555843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec87d64b-5397-469b-bf63-b3311caeefc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:59.556303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec87d64b-5397-469b-bf63-b3311caeefc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:59.556732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec87d64b-5397-469b-bf63-b3311caeefc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:59.660405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f0c93d3b-fdb6-4361-9e33-22b34d7258dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:59.668994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f0c93d3b-fdb6-4361-9e33-22b34d7258dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156609 Aug 18 22:15:59.669566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1777/3556] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:59 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:59.674518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-33b6fd04-7dcd-44bc-bc5a-f4b3f1dbf265 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:59.675238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-33b6fd04-7dcd-44bc-bc5a-f4b3f1dbf265 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:15:59.681205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33b6fd04-7dcd-44bc-bc5a-f4b3f1dbf265 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:59.681731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33b6fd04-7dcd-44bc-bc5a-f4b3f1dbf265 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:59.682277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33b6fd04-7dcd-44bc-bc5a-f4b3f1dbf265 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:59.682942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33b6fd04-7dcd-44bc-bc5a-f4b3f1dbf265 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:15:59.683396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33b6fd04-7dcd-44bc-bc5a-f4b3f1dbf265 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:15:59.683817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33b6fd04-7dcd-44bc-bc5a-f4b3f1dbf265 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:15:59.689309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ec87d64b-5397-469b-bf63-b3311caeefc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:59.698045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ec87d64b-5397-469b-bf63-b3311caeefc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154548 Aug 18 22:15:59.698653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1780/3557] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:59 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:15:59.813534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-33b6fd04-7dcd-44bc-bc5a-f4b3f1dbf265 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:15:59.821778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-33b6fd04-7dcd-44bc-bc5a-f4b3f1dbf265 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150745 Aug 18 22:15:59.822352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1778/3558] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:15:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:15:59.994829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-761ae312-0996-4cea-9f0d-a1c0e9e13d7c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:15:59.995403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-761ae312-0996-4cea-9f0d-a1c0e9e13d7c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:00.002240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761ae312-0996-4cea-9f0d-a1c0e9e13d7c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:00.002776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761ae312-0996-4cea-9f0d-a1c0e9e13d7c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:00.003222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761ae312-0996-4cea-9f0d-a1c0e9e13d7c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:00.003931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761ae312-0996-4cea-9f0d-a1c0e9e13d7c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:00.004389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761ae312-0996-4cea-9f0d-a1c0e9e13d7c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:00.004859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761ae312-0996-4cea-9f0d-a1c0e9e13d7c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:00.131988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-761ae312-0996-4cea-9f0d-a1c0e9e13d7c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:00.140788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-761ae312-0996-4cea-9f0d-a1c0e9e13d7c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:00.142350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-761ae312-0996-4cea-9f0d-a1c0e9e13d7c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:00.143527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-761ae312-0996-4cea-9f0d-a1c0e9e13d7c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152743 Aug 18 22:16:00.144094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1781/3559] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:15:59 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:16:00.484327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ff226c46-8eee-49a6-a154-7f0379dd40d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:00.484948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ff226c46-8eee-49a6-a154-7f0379dd40d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:00.491018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff226c46-8eee-49a6-a154-7f0379dd40d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:00.491502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff226c46-8eee-49a6-a154-7f0379dd40d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:00.491946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff226c46-8eee-49a6-a154-7f0379dd40d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:00.492640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff226c46-8eee-49a6-a154-7f0379dd40d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:00.493097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff226c46-8eee-49a6-a154-7f0379dd40d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:00.493528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff226c46-8eee-49a6-a154-7f0379dd40d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:00.631195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ff226c46-8eee-49a6-a154-7f0379dd40d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:00.639973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ff226c46-8eee-49a6-a154-7f0379dd40d8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.159546 Aug 18 22:16:00.640574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1779/3560] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:00 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:00.690858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-de894781-a0c2-4b68-a409-e4b3a2f54ccd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:00.691496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-de894781-a0c2-4b68-a409-e4b3a2f54ccd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:00.698018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de894781-a0c2-4b68-a409-e4b3a2f54ccd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:00.698507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de894781-a0c2-4b68-a409-e4b3a2f54ccd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:00.698955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de894781-a0c2-4b68-a409-e4b3a2f54ccd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:00.699665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de894781-a0c2-4b68-a409-e4b3a2f54ccd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:00.700146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de894781-a0c2-4b68-a409-e4b3a2f54ccd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:00.700577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-de894781-a0c2-4b68-a409-e4b3a2f54ccd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:00.722093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5ba9a2b0-fddd-4192-bd02-93dda11cb1d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:00.722710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5ba9a2b0-fddd-4192-bd02-93dda11cb1d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:00.728729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ba9a2b0-fddd-4192-bd02-93dda11cb1d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:00.729220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ba9a2b0-fddd-4192-bd02-93dda11cb1d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:00.729695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ba9a2b0-fddd-4192-bd02-93dda11cb1d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:00.730402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ba9a2b0-fddd-4192-bd02-93dda11cb1d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:00.730852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ba9a2b0-fddd-4192-bd02-93dda11cb1d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:00.731270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5ba9a2b0-fddd-4192-bd02-93dda11cb1d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:00.836145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-de894781-a0c2-4b68-a409-e4b3a2f54ccd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:00.844907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-de894781-a0c2-4b68-a409-e4b3a2f54ccd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.157824 Aug 18 22:16:00.845499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1782/3561] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:00 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:00.850369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c8efca82-fb26-422b-8c49-984a9816aec2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:00.851271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c8efca82-fb26-422b-8c49-984a9816aec2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:00.857315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8efca82-fb26-422b-8c49-984a9816aec2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:00.857634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8efca82-fb26-422b-8c49-984a9816aec2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:00.858042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8efca82-fb26-422b-8c49-984a9816aec2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:00.858750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8efca82-fb26-422b-8c49-984a9816aec2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:00.859194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8efca82-fb26-422b-8c49-984a9816aec2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:00.859620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8efca82-fb26-422b-8c49-984a9816aec2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:00.864540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5ba9a2b0-fddd-4192-bd02-93dda11cb1d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:00.873699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5ba9a2b0-fddd-4192-bd02-93dda11cb1d8 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154774 Aug 18 22:16:00.885887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1780/3562] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:00 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:00.990547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c8efca82-fb26-422b-8c49-984a9816aec2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:00.999456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c8efca82-fb26-422b-8c49-984a9816aec2 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152990 Aug 18 22:16:01.000037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1783/3563] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:00 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:01.166843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-57ad9b40-04da-4adc-b96c-bb0c458c8887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:01.167411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-57ad9b40-04da-4adc-b96c-bb0c458c8887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:01.174012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57ad9b40-04da-4adc-b96c-bb0c458c8887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:01.174504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57ad9b40-04da-4adc-b96c-bb0c458c8887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:01.174950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57ad9b40-04da-4adc-b96c-bb0c458c8887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:01.175652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57ad9b40-04da-4adc-b96c-bb0c458c8887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:01.176106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57ad9b40-04da-4adc-b96c-bb0c458c8887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:01.176823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57ad9b40-04da-4adc-b96c-bb0c458c8887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:01.311556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-57ad9b40-04da-4adc-b96c-bb0c458c8887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:01.320427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-57ad9b40-04da-4adc-b96c-bb0c458c8887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:01.321961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-57ad9b40-04da-4adc-b96c-bb0c458c8887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:01.323136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-57ad9b40-04da-4adc-b96c-bb0c458c8887 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.160304 Aug 18 22:16:01.323696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1781/3564] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:01.660921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5eac778f-d6f4-4b0c-82ca-1049084ef2f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:01.661531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5eac778f-d6f4-4b0c-82ca-1049084ef2f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:01.667629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5eac778f-d6f4-4b0c-82ca-1049084ef2f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:01.668109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5eac778f-d6f4-4b0c-82ca-1049084ef2f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:01.668539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5eac778f-d6f4-4b0c-82ca-1049084ef2f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:01.669221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5eac778f-d6f4-4b0c-82ca-1049084ef2f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:01.670316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5eac778f-d6f4-4b0c-82ca-1049084ef2f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:01.670743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5eac778f-d6f4-4b0c-82ca-1049084ef2f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:01.801711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5eac778f-d6f4-4b0c-82ca-1049084ef2f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:01.809876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5eac778f-d6f4-4b0c-82ca-1049084ef2f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152763 Aug 18 22:16:01.810448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1784/3565] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:01 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:01.867935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2ffd34c9-563d-462a-9f27-68a2564ef4c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:01.868599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2ffd34c9-563d-462a-9f27-68a2564ef4c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:01.875032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ffd34c9-563d-462a-9f27-68a2564ef4c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:01.875518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ffd34c9-563d-462a-9f27-68a2564ef4c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:01.875959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ffd34c9-563d-462a-9f27-68a2564ef4c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:01.876650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ffd34c9-563d-462a-9f27-68a2564ef4c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:01.877109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ffd34c9-563d-462a-9f27-68a2564ef4c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:01.877536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ffd34c9-563d-462a-9f27-68a2564ef4c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:01.895358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a10eb23b-a7a5-4a63-bdca-54b3181f9069 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:01.895969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a10eb23b-a7a5-4a63-bdca-54b3181f9069 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:01.901966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a10eb23b-a7a5-4a63-bdca-54b3181f9069 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:01.902564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a10eb23b-a7a5-4a63-bdca-54b3181f9069 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:01.902877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a10eb23b-a7a5-4a63-bdca-54b3181f9069 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:01.903566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a10eb23b-a7a5-4a63-bdca-54b3181f9069 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:01.904098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a10eb23b-a7a5-4a63-bdca-54b3181f9069 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:01.905292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a10eb23b-a7a5-4a63-bdca-54b3181f9069 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:02.013315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2ffd34c9-563d-462a-9f27-68a2564ef4c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:02.022675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2ffd34c9-563d-462a-9f27-68a2564ef4c6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.158649 Aug 18 22:16:02.023252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1782/3566] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:01 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:02.027902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cc455e9d-e24b-4217-89f3-9513893e9e90 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:02.028512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cc455e9d-e24b-4217-89f3-9513893e9e90 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:02.035084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc455e9d-e24b-4217-89f3-9513893e9e90 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:02.035777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc455e9d-e24b-4217-89f3-9513893e9e90 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:02.036319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc455e9d-e24b-4217-89f3-9513893e9e90 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:02.037857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc455e9d-e24b-4217-89f3-9513893e9e90 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:02.038322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc455e9d-e24b-4217-89f3-9513893e9e90 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:02.038754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cc455e9d-e24b-4217-89f3-9513893e9e90 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:02.039227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a10eb23b-a7a5-4a63-bdca-54b3181f9069 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:02.048087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a10eb23b-a7a5-4a63-bdca-54b3181f9069 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156439 Aug 18 22:16:02.048671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1785/3567] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:01 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:02.165881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cc455e9d-e24b-4217-89f3-9513893e9e90 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:02.174131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cc455e9d-e24b-4217-89f3-9513893e9e90 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149927 Aug 18 22:16:02.174709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1783/3568] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:02 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:02.346376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-84f89d4e-2ab4-4f36-afe3-bcb8e47e3e21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:02.347111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-84f89d4e-2ab4-4f36-afe3-bcb8e47e3e21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:02.353025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84f89d4e-2ab4-4f36-afe3-bcb8e47e3e21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:02.353506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84f89d4e-2ab4-4f36-afe3-bcb8e47e3e21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:02.353986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84f89d4e-2ab4-4f36-afe3-bcb8e47e3e21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:02.354675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84f89d4e-2ab4-4f36-afe3-bcb8e47e3e21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:02.355134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84f89d4e-2ab4-4f36-afe3-bcb8e47e3e21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:02.355560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84f89d4e-2ab4-4f36-afe3-bcb8e47e3e21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:02.488498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-84f89d4e-2ab4-4f36-afe3-bcb8e47e3e21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:02.497052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-84f89d4e-2ab4-4f36-afe3-bcb8e47e3e21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:02.499112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-84f89d4e-2ab4-4f36-afe3-bcb8e47e3e21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:02.500291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-84f89d4e-2ab4-4f36-afe3-bcb8e47e3e21 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157869 Aug 18 22:16:02.500859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1786/3569] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:02.831093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d81a5ac0-69cf-4363-9ac5-73ea73f12ea9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:02.831712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d81a5ac0-69cf-4363-9ac5-73ea73f12ea9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:02.838008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d81a5ac0-69cf-4363-9ac5-73ea73f12ea9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:02.838538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d81a5ac0-69cf-4363-9ac5-73ea73f12ea9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:02.838983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d81a5ac0-69cf-4363-9ac5-73ea73f12ea9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:02.839693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d81a5ac0-69cf-4363-9ac5-73ea73f12ea9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:02.840149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d81a5ac0-69cf-4363-9ac5-73ea73f12ea9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:02.840578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d81a5ac0-69cf-4363-9ac5-73ea73f12ea9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:02.971365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d81a5ac0-69cf-4363-9ac5-73ea73f12ea9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:02.979587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d81a5ac0-69cf-4363-9ac5-73ea73f12ea9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152353 Aug 18 22:16:02.980157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1784/3570] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:02 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:03.044230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-290c219e-2c1a-4669-a27a-b2d9083e692e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:03.045479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-290c219e-2c1a-4669-a27a-b2d9083e692e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:03.052242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-290c219e-2c1a-4669-a27a-b2d9083e692e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:03.052758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-290c219e-2c1a-4669-a27a-b2d9083e692e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:03.053196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-290c219e-2c1a-4669-a27a-b2d9083e692e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:03.053922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-290c219e-2c1a-4669-a27a-b2d9083e692e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:03.054381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-290c219e-2c1a-4669-a27a-b2d9083e692e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:03.054809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-290c219e-2c1a-4669-a27a-b2d9083e692e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:03.057331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:03.068415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eab11224-e618-41da-a835-202982d1b646 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:03.069150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eab11224-e618-41da-a835-202982d1b646 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:03.074984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab11224-e618-41da-a835-202982d1b646 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:03.075463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab11224-e618-41da-a835-202982d1b646 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:03.075897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab11224-e618-41da-a835-202982d1b646 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:03.076583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab11224-e618-41da-a835-202982d1b646 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:03.077034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab11224-e618-41da-a835-202982d1b646 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:03.077457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eab11224-e618-41da-a835-202982d1b646 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:03.191032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-290c219e-2c1a-4669-a27a-b2d9083e692e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:03.199616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-290c219e-2c1a-4669-a27a-b2d9083e692e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159162 Aug 18 22:16:03.200319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1787/3571] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:03 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:03.204919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae4c1572-fe3b-465c-b820-8584781c8e3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:03.205662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ae4c1572-fe3b-465c-b820-8584781c8e3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:03.210048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-eab11224-e618-41da-a835-202982d1b646 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:03.211892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae4c1572-fe3b-465c-b820-8584781c8e3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:03.212262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:03.212670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae4c1572-fe3b-465c-b820-8584781c8e3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:03.213419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae4c1572-fe3b-465c-b820-8584781c8e3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:03.214477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae4c1572-fe3b-465c-b820-8584781c8e3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:03.214959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae4c1572-fe3b-465c-b820-8584781c8e3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:03.215384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae4c1572-fe3b-465c-b820-8584781c8e3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:03.220440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eab11224-e618-41da-a835-202982d1b646 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.155829 Aug 18 22:16:03.221033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1785/3572] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:03 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:03.342550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ae4c1572-fe3b-465c-b820-8584781c8e3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:03.350664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ae4c1572-fe3b-465c-b820-8584781c8e3b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149285 Aug 18 22:16:03.351239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1788/3573] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:03 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:03.522626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3d6c153a-ae61-4a88-9b39-1470809ea560 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:03.523234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3d6c153a-ae61-4a88-9b39-1470809ea560 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:03.530046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d6c153a-ae61-4a88-9b39-1470809ea560 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:03.530528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d6c153a-ae61-4a88-9b39-1470809ea560 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:03.530959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d6c153a-ae61-4a88-9b39-1470809ea560 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:03.531649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d6c153a-ae61-4a88-9b39-1470809ea560 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:03.532100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d6c153a-ae61-4a88-9b39-1470809ea560 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:03.532524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d6c153a-ae61-4a88-9b39-1470809ea560 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:03.663426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3d6c153a-ae61-4a88-9b39-1470809ea560 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:03.672172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3d6c153a-ae61-4a88-9b39-1470809ea560 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:03.674268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3d6c153a-ae61-4a88-9b39-1470809ea560 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:03.675594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3d6c153a-ae61-4a88-9b39-1470809ea560 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156778 Aug 18 22:16:03.676227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1786/3574] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:04.003001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0eb4b56c-aac3-4c2c-be0c-dcfd94339a76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:04.003531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0eb4b56c-aac3-4c2c-be0c-dcfd94339a76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:04.009527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0eb4b56c-aac3-4c2c-be0c-dcfd94339a76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:04.010039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0eb4b56c-aac3-4c2c-be0c-dcfd94339a76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:04.010469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0eb4b56c-aac3-4c2c-be0c-dcfd94339a76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:04.011162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0eb4b56c-aac3-4c2c-be0c-dcfd94339a76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:04.011607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0eb4b56c-aac3-4c2c-be0c-dcfd94339a76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:04.012032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0eb4b56c-aac3-4c2c-be0c-dcfd94339a76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:04.143633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0eb4b56c-aac3-4c2c-be0c-dcfd94339a76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:04.151832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0eb4b56c-aac3-4c2c-be0c-dcfd94339a76 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152788 Aug 18 22:16:04.152404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1789/3575] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:03 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:04.219906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-26d58c3d-b93a-4f12-a5fa-8f0d174f6b23 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:04.220527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-26d58c3d-b93a-4f12-a5fa-8f0d174f6b23 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:04.227018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26d58c3d-b93a-4f12-a5fa-8f0d174f6b23 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:04.227510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26d58c3d-b93a-4f12-a5fa-8f0d174f6b23 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:04.227950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26d58c3d-b93a-4f12-a5fa-8f0d174f6b23 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:04.228649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26d58c3d-b93a-4f12-a5fa-8f0d174f6b23 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:04.229113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26d58c3d-b93a-4f12-a5fa-8f0d174f6b23 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:04.229553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26d58c3d-b93a-4f12-a5fa-8f0d174f6b23 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:04.242183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1a293964-1fc1-4be9-a8fc-ff5e33c3b1d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:04.242796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1a293964-1fc1-4be9-a8fc-ff5e33c3b1d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:04.249840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a293964-1fc1-4be9-a8fc-ff5e33c3b1d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:04.250503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a293964-1fc1-4be9-a8fc-ff5e33c3b1d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:04.250964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a293964-1fc1-4be9-a8fc-ff5e33c3b1d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:04.251654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a293964-1fc1-4be9-a8fc-ff5e33c3b1d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:04.252112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a293964-1fc1-4be9-a8fc-ff5e33c3b1d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:04.252535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a293964-1fc1-4be9-a8fc-ff5e33c3b1d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:04.375448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-26d58c3d-b93a-4f12-a5fa-8f0d174f6b23 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:04.383700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-26d58c3d-b93a-4f12-a5fa-8f0d174f6b23 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.167605 Aug 18 22:16:04.384297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1787/3576] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:04 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:04.385845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1a293964-1fc1-4be9-a8fc-ff5e33c3b1d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:04.388987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7080cafd-2afe-4498-a5c9-16433d3f44a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:04.389848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7080cafd-2afe-4498-a5c9-16433d3f44a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:04.394615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1a293964-1fc1-4be9-a8fc-ff5e33c3b1d0 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156250 Aug 18 22:16:04.395297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1790/3577] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:04 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:04.395924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7080cafd-2afe-4498-a5c9-16433d3f44a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:04.396423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7080cafd-2afe-4498-a5c9-16433d3f44a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:04.396867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7080cafd-2afe-4498-a5c9-16433d3f44a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:04.397572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7080cafd-2afe-4498-a5c9-16433d3f44a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:04.398060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7080cafd-2afe-4498-a5c9-16433d3f44a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:04.398495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7080cafd-2afe-4498-a5c9-16433d3f44a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:04.523859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7080cafd-2afe-4498-a5c9-16433d3f44a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:04.532383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7080cafd-2afe-4498-a5c9-16433d3f44a3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147145 Aug 18 22:16:04.532963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1788/3578] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:04.698639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-28a49837-9bfb-4fc0-80fb-8928d2af07f4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:04.699172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-28a49837-9bfb-4fc0-80fb-8928d2af07f4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:04.705642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28a49837-9bfb-4fc0-80fb-8928d2af07f4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:04.706124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28a49837-9bfb-4fc0-80fb-8928d2af07f4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:04.706555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28a49837-9bfb-4fc0-80fb-8928d2af07f4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:04.707239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28a49837-9bfb-4fc0-80fb-8928d2af07f4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:04.707688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28a49837-9bfb-4fc0-80fb-8928d2af07f4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:04.708108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28a49837-9bfb-4fc0-80fb-8928d2af07f4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:04.842538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-28a49837-9bfb-4fc0-80fb-8928d2af07f4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:04.851158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-28a49837-9bfb-4fc0-80fb-8928d2af07f4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:04.852657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-28a49837-9bfb-4fc0-80fb-8928d2af07f4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:04.853841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-28a49837-9bfb-4fc0-80fb-8928d2af07f4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159222 Aug 18 22:16:04.854417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1791/3579] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:05.173253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c3ee2c22-b7ae-46df-9fe8-475b7cdcd7c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:05.173908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c3ee2c22-b7ae-46df-9fe8-475b7cdcd7c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:05.180248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3ee2c22-b7ae-46df-9fe8-475b7cdcd7c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:05.180733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3ee2c22-b7ae-46df-9fe8-475b7cdcd7c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:05.181173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3ee2c22-b7ae-46df-9fe8-475b7cdcd7c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:05.181887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3ee2c22-b7ae-46df-9fe8-475b7cdcd7c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:05.182344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3ee2c22-b7ae-46df-9fe8-475b7cdcd7c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:05.182769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3ee2c22-b7ae-46df-9fe8-475b7cdcd7c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:05.313420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c3ee2c22-b7ae-46df-9fe8-475b7cdcd7c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:05.321687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c3ee2c22-b7ae-46df-9fe8-475b7cdcd7c4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152591 Aug 18 22:16:05.322268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1789/3580] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:05 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:05.404974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-48a73e08-7cc4-425d-91ab-7042350220ac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:05.405709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-48a73e08-7cc4-425d-91ab-7042350220ac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:05.412497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48a73e08-7cc4-425d-91ab-7042350220ac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:05.412986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48a73e08-7cc4-425d-91ab-7042350220ac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:05.413431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48a73e08-7cc4-425d-91ab-7042350220ac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:05.414162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48a73e08-7cc4-425d-91ab-7042350220ac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:05.414658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48a73e08-7cc4-425d-91ab-7042350220ac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:05.415571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-48a73e08-7cc4-425d-91ab-7042350220ac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:05.416538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f0bf474b-5194-4227-94f9-bec824e67d44 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:05.417669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f0bf474b-5194-4227-94f9-bec824e67d44 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:05.424686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0bf474b-5194-4227-94f9-bec824e67d44 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:05.425107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0bf474b-5194-4227-94f9-bec824e67d44 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:05.425543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0bf474b-5194-4227-94f9-bec824e67d44 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:05.426266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0bf474b-5194-4227-94f9-bec824e67d44 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:05.426970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0bf474b-5194-4227-94f9-bec824e67d44 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:05.427395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f0bf474b-5194-4227-94f9-bec824e67d44 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:05.545524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-48a73e08-7cc4-425d-91ab-7042350220ac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:05.554184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-48a73e08-7cc4-425d-91ab-7042350220ac tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152962 Aug 18 22:16:05.554769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1792/3581] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:05 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:05.555401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f0bf474b-5194-4227-94f9-bec824e67d44 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:05.559737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0ff0aaf8-d405-46c7-a15e-3ca133df41c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:05.560850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0ff0aaf8-d405-46c7-a15e-3ca133df41c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:05.565035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f0bf474b-5194-4227-94f9-bec824e67d44 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153234 Aug 18 22:16:05.565724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1790/3582] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:05 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:05.569870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ff0aaf8-d405-46c7-a15e-3ca133df41c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:05.570370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ff0aaf8-d405-46c7-a15e-3ca133df41c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:05.570815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ff0aaf8-d405-46c7-a15e-3ca133df41c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:05.571526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ff0aaf8-d405-46c7-a15e-3ca133df41c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:05.571982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ff0aaf8-d405-46c7-a15e-3ca133df41c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:05.572411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ff0aaf8-d405-46c7-a15e-3ca133df41c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:05.701917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0ff0aaf8-d405-46c7-a15e-3ca133df41c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:05.710031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0ff0aaf8-d405-46c7-a15e-3ca133df41c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154245 Aug 18 22:16:05.710597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1793/3583] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:05 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:05.878237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5fc69176-96cd-45c7-bb91-eb4fb1086073 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:05.878237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5fc69176-96cd-45c7-bb91-eb4fb1086073 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:05.884303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc69176-96cd-45c7-bb91-eb4fb1086073 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:05.884793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc69176-96cd-45c7-bb91-eb4fb1086073 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:05.885237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc69176-96cd-45c7-bb91-eb4fb1086073 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:05.885968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc69176-96cd-45c7-bb91-eb4fb1086073 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:05.886431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc69176-96cd-45c7-bb91-eb4fb1086073 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:05.886863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5fc69176-96cd-45c7-bb91-eb4fb1086073 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:06.023854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5fc69176-96cd-45c7-bb91-eb4fb1086073 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:06.033747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5fc69176-96cd-45c7-bb91-eb4fb1086073 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:06.035444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5fc69176-96cd-45c7-bb91-eb4fb1086073 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:06.036753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5fc69176-96cd-45c7-bb91-eb4fb1086073 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.163656 Aug 18 22:16:06.037319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1791/3584] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:05 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:06.344013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bdd99a57-3c19-4e8c-92cc-25f38e61b03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:06.344623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bdd99a57-3c19-4e8c-92cc-25f38e61b03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:06.350617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdd99a57-3c19-4e8c-92cc-25f38e61b03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:06.351091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdd99a57-3c19-4e8c-92cc-25f38e61b03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:06.351522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdd99a57-3c19-4e8c-92cc-25f38e61b03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:06.352198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdd99a57-3c19-4e8c-92cc-25f38e61b03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:06.352648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdd99a57-3c19-4e8c-92cc-25f38e61b03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:06.353068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdd99a57-3c19-4e8c-92cc-25f38e61b03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:06.484623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bdd99a57-3c19-4e8c-92cc-25f38e61b03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:06.492780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bdd99a57-3c19-4e8c-92cc-25f38e61b03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153080 Aug 18 22:16:06.493361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1794/3585] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:06 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:06.576772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-402354fc-5d1c-4da0-af7c-4179a179f554 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:06.577371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-402354fc-5d1c-4da0-af7c-4179a179f554 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:06.584009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-402354fc-5d1c-4da0-af7c-4179a179f554 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:06.584498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-402354fc-5d1c-4da0-af7c-4179a179f554 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:06.584955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-402354fc-5d1c-4da0-af7c-4179a179f554 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:06.585662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-402354fc-5d1c-4da0-af7c-4179a179f554 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:06.586122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-402354fc-5d1c-4da0-af7c-4179a179f554 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:06.586519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-04c118d4-8a12-4fad-b676-bfe9a56f5e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:06.586636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-402354fc-5d1c-4da0-af7c-4179a179f554 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:06.587138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-04c118d4-8a12-4fad-b676-bfe9a56f5e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:06.594180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04c118d4-8a12-4fad-b676-bfe9a56f5e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:06.594609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04c118d4-8a12-4fad-b676-bfe9a56f5e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:06.595086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04c118d4-8a12-4fad-b676-bfe9a56f5e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:06.595790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04c118d4-8a12-4fad-b676-bfe9a56f5e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:06.596250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04c118d4-8a12-4fad-b676-bfe9a56f5e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:06.596681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04c118d4-8a12-4fad-b676-bfe9a56f5e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:06.719943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-402354fc-5d1c-4da0-af7c-4179a179f554 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:06.726952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-04c118d4-8a12-4fad-b676-bfe9a56f5e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:06.727729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-402354fc-5d1c-4da0-af7c-4179a179f554 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155359 Aug 18 22:16:06.728317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1792/3586] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:06 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:06.732876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a68591f0-0cc7-4041-b4cb-63c3598e7b70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:06.733487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a68591f0-0cc7-4041-b4cb-63c3598e7b70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:06.735160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-04c118d4-8a12-4fad-b676-bfe9a56f5e4b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152548 Aug 18 22:16:06.735892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1795/3587] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:06 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:06.739332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a68591f0-0cc7-4041-b4cb-63c3598e7b70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:06.739828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a68591f0-0cc7-4041-b4cb-63c3598e7b70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:06.740268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a68591f0-0cc7-4041-b4cb-63c3598e7b70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:06.740960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a68591f0-0cc7-4041-b4cb-63c3598e7b70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:06.741417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a68591f0-0cc7-4041-b4cb-63c3598e7b70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:06.741868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a68591f0-0cc7-4041-b4cb-63c3598e7b70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:06.874012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a68591f0-0cc7-4041-b4cb-63c3598e7b70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:06.882804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a68591f0-0cc7-4041-b4cb-63c3598e7b70 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153548 Aug 18 22:16:06.883377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1793/3588] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:06 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:07.060868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0760a8fd-884c-4f54-b93c-a0953e9f79e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:07.061480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0760a8fd-884c-4f54-b93c-a0953e9f79e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:07.067488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0760a8fd-884c-4f54-b93c-a0953e9f79e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:07.067952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0760a8fd-884c-4f54-b93c-a0953e9f79e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:07.068392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0760a8fd-884c-4f54-b93c-a0953e9f79e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:07.069077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0760a8fd-884c-4f54-b93c-a0953e9f79e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:07.069531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0760a8fd-884c-4f54-b93c-a0953e9f79e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:07.069982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0760a8fd-884c-4f54-b93c-a0953e9f79e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:07.200156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0760a8fd-884c-4f54-b93c-a0953e9f79e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:07.208760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0760a8fd-884c-4f54-b93c-a0953e9f79e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:07.210262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0760a8fd-884c-4f54-b93c-a0953e9f79e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:07.211409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0760a8fd-884c-4f54-b93c-a0953e9f79e9 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155030 Aug 18 22:16:07.211972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1796/3589] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:07 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:07.514077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8e16fa19-8857-432b-b038-e5d5b444cbb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:07.514603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8e16fa19-8857-432b-b038-e5d5b444cbb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:07.520497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e16fa19-8857-432b-b038-e5d5b444cbb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:07.520971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e16fa19-8857-432b-b038-e5d5b444cbb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:07.521406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e16fa19-8857-432b-b038-e5d5b444cbb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:07.522117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e16fa19-8857-432b-b038-e5d5b444cbb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:07.522572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e16fa19-8857-432b-b038-e5d5b444cbb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:07.522992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e16fa19-8857-432b-b038-e5d5b444cbb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:07.654990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8e16fa19-8857-432b-b038-e5d5b444cbb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:07.663765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8e16fa19-8857-432b-b038-e5d5b444cbb3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153579 Aug 18 22:16:07.664344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1794/3590] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:07 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:07.751039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bdb1da15-e853-44a9-bda9-984f14a9e961 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:07.751703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bdb1da15-e853-44a9-bda9-984f14a9e961 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:07.756731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-865b90d9-d2a4-44f9-8d8e-046abe01dfb7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:07.757359 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-865b90d9-d2a4-44f9-8d8e-046abe01dfb7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:07.759233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb1da15-e853-44a9-bda9-984f14a9e961 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:07.759715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb1da15-e853-44a9-bda9-984f14a9e961 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:07.760145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb1da15-e853-44a9-bda9-984f14a9e961 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:07.760847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb1da15-e853-44a9-bda9-984f14a9e961 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:07.761300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb1da15-e853-44a9-bda9-984f14a9e961 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:07.761749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bdb1da15-e853-44a9-bda9-984f14a9e961 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:07.763477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-865b90d9-d2a4-44f9-8d8e-046abe01dfb7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:07.763961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-865b90d9-d2a4-44f9-8d8e-046abe01dfb7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:07.764459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-865b90d9-d2a4-44f9-8d8e-046abe01dfb7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:07.765084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-865b90d9-d2a4-44f9-8d8e-046abe01dfb7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:07.765538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-865b90d9-d2a4-44f9-8d8e-046abe01dfb7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:07.766071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-865b90d9-d2a4-44f9-8d8e-046abe01dfb7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:07.896031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bdb1da15-e853-44a9-bda9-984f14a9e961 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:07.896511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-865b90d9-d2a4-44f9-8d8e-046abe01dfb7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:07.905170 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bdb1da15-e853-44a9-bda9-984f14a9e961 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159748 Aug 18 22:16:07.907014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-865b90d9-d2a4-44f9-8d8e-046abe01dfb7 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153014 Aug 18 22:16:07.907227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1797/3591] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:07 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:07.907393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1795/3592] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:07 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:07.910892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b329ed9b-a8ef-475c-8134-bb107915162d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:07.911518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b329ed9b-a8ef-475c-8134-bb107915162d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:07.918527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b329ed9b-a8ef-475c-8134-bb107915162d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:07.919320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b329ed9b-a8ef-475c-8134-bb107915162d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:07.920659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b329ed9b-a8ef-475c-8134-bb107915162d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:07.921590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b329ed9b-a8ef-475c-8134-bb107915162d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:07.922288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b329ed9b-a8ef-475c-8134-bb107915162d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:07.922881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b329ed9b-a8ef-475c-8134-bb107915162d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:08.051203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b329ed9b-a8ef-475c-8134-bb107915162d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:08.059755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b329ed9b-a8ef-475c-8134-bb107915162d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152633 Aug 18 22:16:08.060332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1798/3593] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:08.234904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-da76ff06-2582-4200-a73c-9bd616b7281d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:08.235542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-da76ff06-2582-4200-a73c-9bd616b7281d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:08.241411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-da76ff06-2582-4200-a73c-9bd616b7281d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:08.241924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-da76ff06-2582-4200-a73c-9bd616b7281d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:08.242360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-da76ff06-2582-4200-a73c-9bd616b7281d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:08.243041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-da76ff06-2582-4200-a73c-9bd616b7281d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:08.243492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-da76ff06-2582-4200-a73c-9bd616b7281d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:08.243916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-da76ff06-2582-4200-a73c-9bd616b7281d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:08.374443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-da76ff06-2582-4200-a73c-9bd616b7281d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:08.382855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-da76ff06-2582-4200-a73c-9bd616b7281d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:08.384342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-da76ff06-2582-4200-a73c-9bd616b7281d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:08.385488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-da76ff06-2582-4200-a73c-9bd616b7281d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154471 Aug 18 22:16:08.386106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1796/3594] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:08 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:08.687907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5f53d9c9-50fd-47f8-a13c-e6f86784137a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:08.688442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5f53d9c9-50fd-47f8-a13c-e6f86784137a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:08.694501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f53d9c9-50fd-47f8-a13c-e6f86784137a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:08.694978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f53d9c9-50fd-47f8-a13c-e6f86784137a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:08.695413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f53d9c9-50fd-47f8-a13c-e6f86784137a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:08.696096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f53d9c9-50fd-47f8-a13c-e6f86784137a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:08.696545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f53d9c9-50fd-47f8-a13c-e6f86784137a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:08.696965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f53d9c9-50fd-47f8-a13c-e6f86784137a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:08.829426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5f53d9c9-50fd-47f8-a13c-e6f86784137a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:08.837753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5f53d9c9-50fd-47f8-a13c-e6f86784137a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154315 Aug 18 22:16:08.838323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1799/3595] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:08 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:08.927059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ea27b692-d0e6-47c4-bcc6-b766d628940d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:08.927686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ea27b692-d0e6-47c4-bcc6-b766d628940d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:08.929765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-40a6fec7-0db3-4040-b246-f0427a84856d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:08.930095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:08.930382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-40a6fec7-0db3-4040-b246-f0427a84856d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:08.937116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea27b692-d0e6-47c4-bcc6-b766d628940d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:08.937580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40a6fec7-0db3-4040-b246-f0427a84856d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:08.937722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea27b692-d0e6-47c4-bcc6-b766d628940d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:08.938129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea27b692-d0e6-47c4-bcc6-b766d628940d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:08.938268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40a6fec7-0db3-4040-b246-f0427a84856d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:08.938511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40a6fec7-0db3-4040-b246-f0427a84856d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:08.938799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea27b692-d0e6-47c4-bcc6-b766d628940d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:08.939228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40a6fec7-0db3-4040-b246-f0427a84856d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:08.939353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea27b692-d0e6-47c4-bcc6-b766d628940d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:08.939677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40a6fec7-0db3-4040-b246-f0427a84856d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:08.939795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea27b692-d0e6-47c4-bcc6-b766d628940d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:08.940095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40a6fec7-0db3-4040-b246-f0427a84856d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:09.079395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ea27b692-d0e6-47c4-bcc6-b766d628940d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:09.080450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-40a6fec7-0db3-4040-b246-f0427a84856d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:09.087697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ea27b692-d0e6-47c4-bcc6-b766d628940d tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.164745 Aug 18 22:16:09.088276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1797/3596] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:08 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:09.088452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-40a6fec7-0db3-4040-b246-f0427a84856d tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.162733 Aug 18 22:16:09.089183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1800/3597] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:08 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:09.094242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d3275863-ff42-4257-9628-9db73a12bf43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:09.094865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d3275863-ff42-4257-9628-9db73a12bf43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:09.101051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3275863-ff42-4257-9628-9db73a12bf43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:09.101544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3275863-ff42-4257-9628-9db73a12bf43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:09.102093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3275863-ff42-4257-9628-9db73a12bf43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:09.102802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3275863-ff42-4257-9628-9db73a12bf43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:09.103259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3275863-ff42-4257-9628-9db73a12bf43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:09.103693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3275863-ff42-4257-9628-9db73a12bf43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:09.230093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d3275863-ff42-4257-9628-9db73a12bf43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:09.239027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d3275863-ff42-4257-9628-9db73a12bf43 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149207 Aug 18 22:16:09.239616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1798/3598] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:09 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:09.408808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b83d7743-3e77-4568-b548-d44d09fe194f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:09.410074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b83d7743-3e77-4568-b548-d44d09fe194f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:09.416074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b83d7743-3e77-4568-b548-d44d09fe194f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:09.416568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b83d7743-3e77-4568-b548-d44d09fe194f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:09.416978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b83d7743-3e77-4568-b548-d44d09fe194f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:09.417807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b83d7743-3e77-4568-b548-d44d09fe194f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:09.418255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b83d7743-3e77-4568-b548-d44d09fe194f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:09.418673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b83d7743-3e77-4568-b548-d44d09fe194f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:09.549028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b83d7743-3e77-4568-b548-d44d09fe194f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:09.558483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b83d7743-3e77-4568-b548-d44d09fe194f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:09.559627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b83d7743-3e77-4568-b548-d44d09fe194f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:09.560783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b83d7743-3e77-4568-b548-d44d09fe194f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155943 Aug 18 22:16:09.561341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1801/3599] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:09 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:09.859257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-737d8bd4-77d6-438b-83f2-e8879e8f45cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:09.859883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-737d8bd4-77d6-438b-83f2-e8879e8f45cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:09.865959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-737d8bd4-77d6-438b-83f2-e8879e8f45cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:09.866450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-737d8bd4-77d6-438b-83f2-e8879e8f45cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:09.866895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-737d8bd4-77d6-438b-83f2-e8879e8f45cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:09.867584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-737d8bd4-77d6-438b-83f2-e8879e8f45cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:09.868047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-737d8bd4-77d6-438b-83f2-e8879e8f45cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:09.868477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-737d8bd4-77d6-438b-83f2-e8879e8f45cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:09.998673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-737d8bd4-77d6-438b-83f2-e8879e8f45cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:10.006965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-737d8bd4-77d6-438b-83f2-e8879e8f45cb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151541 Aug 18 22:16:10.007546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1799/3600] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:09 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:10.109810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ba144f4a-6b58-44e0-8ac0-e5ee69d4ee97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:10.110342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b579264c-3718-42a0-ad97-0ef7ae524dd5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:10.110678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ba144f4a-6b58-44e0-8ac0-e5ee69d4ee97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:10.110900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b579264c-3718-42a0-ad97-0ef7ae524dd5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:10.116800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b579264c-3718-42a0-ad97-0ef7ae524dd5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:10.117123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba144f4a-6b58-44e0-8ac0-e5ee69d4ee97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:10.117298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b579264c-3718-42a0-ad97-0ef7ae524dd5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:10.117620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba144f4a-6b58-44e0-8ac0-e5ee69d4ee97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:10.117754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b579264c-3718-42a0-ad97-0ef7ae524dd5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:10.118057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba144f4a-6b58-44e0-8ac0-e5ee69d4ee97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:10.118455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b579264c-3718-42a0-ad97-0ef7ae524dd5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:10.118744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba144f4a-6b58-44e0-8ac0-e5ee69d4ee97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:10.118910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b579264c-3718-42a0-ad97-0ef7ae524dd5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:10.119192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba144f4a-6b58-44e0-8ac0-e5ee69d4ee97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:10.119326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b579264c-3718-42a0-ad97-0ef7ae524dd5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:10.119613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ba144f4a-6b58-44e0-8ac0-e5ee69d4ee97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:10.249244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b579264c-3718-42a0-ad97-0ef7ae524dd5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:10.250030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ba144f4a-6b58-44e0-8ac0-e5ee69d4ee97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:10.258139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b579264c-3718-42a0-ad97-0ef7ae524dd5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152174 Aug 18 22:16:10.258314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ba144f4a-6b58-44e0-8ac0-e5ee69d4ee97 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152907 Aug 18 22:16:10.258727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1800/3601] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:10 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:10.263745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ab1e7c66-d298-4ba8-9de1-f30dcaf64a87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:10.264045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1802/3602] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:10 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:10.264685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ab1e7c66-d298-4ba8-9de1-f30dcaf64a87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:10.270664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab1e7c66-d298-4ba8-9de1-f30dcaf64a87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:10.271155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab1e7c66-d298-4ba8-9de1-f30dcaf64a87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:10.271598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab1e7c66-d298-4ba8-9de1-f30dcaf64a87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:10.272288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab1e7c66-d298-4ba8-9de1-f30dcaf64a87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:10.272747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab1e7c66-d298-4ba8-9de1-f30dcaf64a87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:10.273183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab1e7c66-d298-4ba8-9de1-f30dcaf64a87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:10.400998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ab1e7c66-d298-4ba8-9de1-f30dcaf64a87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:10.409302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ab1e7c66-d298-4ba8-9de1-f30dcaf64a87 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149625 Aug 18 22:16:10.410046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1801/3603] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:10 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:10.584283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dc22023b-9ffd-4747-81c6-14667a9f2351 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:10.584895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dc22023b-9ffd-4747-81c6-14667a9f2351 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:10.590926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc22023b-9ffd-4747-81c6-14667a9f2351 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:10.591936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc22023b-9ffd-4747-81c6-14667a9f2351 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:10.592372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc22023b-9ffd-4747-81c6-14667a9f2351 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:10.593056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc22023b-9ffd-4747-81c6-14667a9f2351 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:10.593506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc22023b-9ffd-4747-81c6-14667a9f2351 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:10.593957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dc22023b-9ffd-4747-81c6-14667a9f2351 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:10.725416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc22023b-9ffd-4747-81c6-14667a9f2351 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:10.727622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:10.735867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc22023b-9ffd-4747-81c6-14667a9f2351 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:10.737662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dc22023b-9ffd-4747-81c6-14667a9f2351 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:10.738831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dc22023b-9ffd-4747-81c6-14667a9f2351 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.158501 Aug 18 22:16:10.739390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1803/3604] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:10 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:11.030267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9b8d842a-896f-4517-a0bf-d3dd3f99a0c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:11.030904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9b8d842a-896f-4517-a0bf-d3dd3f99a0c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:11.038176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b8d842a-896f-4517-a0bf-d3dd3f99a0c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:11.038680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b8d842a-896f-4517-a0bf-d3dd3f99a0c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:11.039116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b8d842a-896f-4517-a0bf-d3dd3f99a0c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:11.039816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b8d842a-896f-4517-a0bf-d3dd3f99a0c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:11.040276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b8d842a-896f-4517-a0bf-d3dd3f99a0c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:11.040707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9b8d842a-896f-4517-a0bf-d3dd3f99a0c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:11.057129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:11.180430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9b8d842a-896f-4517-a0bf-d3dd3f99a0c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:11.188784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9b8d842a-896f-4517-a0bf-d3dd3f99a0c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.164322 Aug 18 22:16:11.189367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1802/3605] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:11 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:11.279379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-036ccccc-4a13-4dc4-b9f1-d0a2cfb05d8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:11.279974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-26124cca-a476-469f-8821-77e96ace1681 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:11.280107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-036ccccc-4a13-4dc4-b9f1-d0a2cfb05d8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:11.280262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-26124cca-a476-469f-8821-77e96ace1681 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:11.286331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26124cca-a476-469f-8821-77e96ace1681 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:11.286760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26124cca-a476-469f-8821-77e96ace1681 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:11.286896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-036ccccc-4a13-4dc4-b9f1-d0a2cfb05d8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:11.287210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26124cca-a476-469f-8821-77e96ace1681 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:11.287388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-036ccccc-4a13-4dc4-b9f1-d0a2cfb05d8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:11.287879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-036ccccc-4a13-4dc4-b9f1-d0a2cfb05d8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:11.288009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26124cca-a476-469f-8821-77e96ace1681 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:11.288363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26124cca-a476-469f-8821-77e96ace1681 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:11.288591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-036ccccc-4a13-4dc4-b9f1-d0a2cfb05d8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:11.288794 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26124cca-a476-469f-8821-77e96ace1681 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:11.289050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-036ccccc-4a13-4dc4-b9f1-d0a2cfb05d8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:11.289476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-036ccccc-4a13-4dc4-b9f1-d0a2cfb05d8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:11.425845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-26124cca-a476-469f-8821-77e96ace1681 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:11.426195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-036ccccc-4a13-4dc4-b9f1-d0a2cfb05d8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:11.434373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-036ccccc-4a13-4dc4-b9f1-d0a2cfb05d8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.159219 Aug 18 22:16:11.434546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-26124cca-a476-469f-8821-77e96ace1681 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159005 Aug 18 22:16:11.435672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1804/3607] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:11 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:11.435822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1803/3607] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:11.439857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0cd3a614-f727-480c-9e0f-7ee35e2bac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:11.440464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0cd3a614-f727-480c-9e0f-7ee35e2bac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:11.446125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cd3a614-f727-480c-9e0f-7ee35e2bac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:11.446607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cd3a614-f727-480c-9e0f-7ee35e2bac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:11.447048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cd3a614-f727-480c-9e0f-7ee35e2bac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:11.447733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cd3a614-f727-480c-9e0f-7ee35e2bac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:11.448185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cd3a614-f727-480c-9e0f-7ee35e2bac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:11.448689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0cd3a614-f727-480c-9e0f-7ee35e2bac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:11.576813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0cd3a614-f727-480c-9e0f-7ee35e2bac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:11.584848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0cd3a614-f727-480c-9e0f-7ee35e2bac76 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148474 Aug 18 22:16:11.585422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1805/3608] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:11.761508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7b9db246-1f66-4297-8539-01188e647654 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:11.762157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7b9db246-1f66-4297-8539-01188e647654 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:11.768104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b9db246-1f66-4297-8539-01188e647654 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:11.768596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b9db246-1f66-4297-8539-01188e647654 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:11.769042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b9db246-1f66-4297-8539-01188e647654 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:11.769770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b9db246-1f66-4297-8539-01188e647654 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:11.770231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b9db246-1f66-4297-8539-01188e647654 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:11.770663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7b9db246-1f66-4297-8539-01188e647654 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:11.898607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7b9db246-1f66-4297-8539-01188e647654 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:11.911431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7b9db246-1f66-4297-8539-01188e647654 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:11.912950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7b9db246-1f66-4297-8539-01188e647654 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:11.914158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7b9db246-1f66-4297-8539-01188e647654 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156607 Aug 18 22:16:11.914726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1804/3609] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:11 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:12.210270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eb654b58-2f4c-4ced-8d3f-aae0735d244b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:12.210889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eb654b58-2f4c-4ced-8d3f-aae0735d244b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:12.217469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb654b58-2f4c-4ced-8d3f-aae0735d244b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:12.217985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb654b58-2f4c-4ced-8d3f-aae0735d244b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:12.218427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb654b58-2f4c-4ced-8d3f-aae0735d244b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:12.219113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb654b58-2f4c-4ced-8d3f-aae0735d244b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:12.219565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb654b58-2f4c-4ced-8d3f-aae0735d244b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:12.219993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb654b58-2f4c-4ced-8d3f-aae0735d244b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:12.350436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eb654b58-2f4c-4ced-8d3f-aae0735d244b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:12.359192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eb654b58-2f4c-4ced-8d3f-aae0735d244b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152697 Aug 18 22:16:12.359766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1806/3610] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:12 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:12.456216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2488d167-c8e4-4ea5-802d-7c5641232372 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:12.456773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-df7c273d-dba1-497b-8957-094331c6cec9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:12.456912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2488d167-c8e4-4ea5-802d-7c5641232372 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:12.457024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-df7c273d-dba1-497b-8957-094331c6cec9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:12.463048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df7c273d-dba1-497b-8957-094331c6cec9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:12.463197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2488d167-c8e4-4ea5-802d-7c5641232372 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:12.463535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df7c273d-dba1-497b-8957-094331c6cec9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:12.463721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2488d167-c8e4-4ea5-802d-7c5641232372 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:12.463969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df7c273d-dba1-497b-8957-094331c6cec9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:12.464111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2488d167-c8e4-4ea5-802d-7c5641232372 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:12.464664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df7c273d-dba1-497b-8957-094331c6cec9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:12.464784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2488d167-c8e4-4ea5-802d-7c5641232372 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:12.465118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df7c273d-dba1-497b-8957-094331c6cec9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:12.465254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2488d167-c8e4-4ea5-802d-7c5641232372 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:12.465552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df7c273d-dba1-497b-8957-094331c6cec9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:12.465699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2488d167-c8e4-4ea5-802d-7c5641232372 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:12.596135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-df7c273d-dba1-497b-8957-094331c6cec9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:12.596480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2488d167-c8e4-4ea5-802d-7c5641232372 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:12.604929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2488d167-c8e4-4ea5-802d-7c5641232372 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152594 Aug 18 22:16:12.605155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-df7c273d-dba1-497b-8957-094331c6cec9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152829 Aug 18 22:16:12.605512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1805/3611] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:12 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:12.612393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1807/3612] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:12 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:12.612588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dee533c8-d446-4cd6-843e-f5fbeefd3d5d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:12.612588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dee533c8-d446-4cd6-843e-f5fbeefd3d5d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:12.617274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dee533c8-d446-4cd6-843e-f5fbeefd3d5d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:12.617792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dee533c8-d446-4cd6-843e-f5fbeefd3d5d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:12.618233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dee533c8-d446-4cd6-843e-f5fbeefd3d5d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:12.618919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dee533c8-d446-4cd6-843e-f5fbeefd3d5d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:12.619377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dee533c8-d446-4cd6-843e-f5fbeefd3d5d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:12.619799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dee533c8-d446-4cd6-843e-f5fbeefd3d5d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:12.757412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dee533c8-d446-4cd6-843e-f5fbeefd3d5d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:12.766595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dee533c8-d446-4cd6-843e-f5fbeefd3d5d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.160097 Aug 18 22:16:12.767175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1806/3613] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:12 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:12.939386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-42a9b52d-1a8f-4de2-8967-9da44d5668e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:12.940005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-42a9b52d-1a8f-4de2-8967-9da44d5668e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:12.945990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42a9b52d-1a8f-4de2-8967-9da44d5668e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:12.946475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42a9b52d-1a8f-4de2-8967-9da44d5668e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:12.946914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42a9b52d-1a8f-4de2-8967-9da44d5668e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:12.947609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42a9b52d-1a8f-4de2-8967-9da44d5668e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:12.948068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42a9b52d-1a8f-4de2-8967-9da44d5668e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:12.948494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42a9b52d-1a8f-4de2-8967-9da44d5668e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:13.083832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-42a9b52d-1a8f-4de2-8967-9da44d5668e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:13.092306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-42a9b52d-1a8f-4de2-8967-9da44d5668e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:13.093864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-42a9b52d-1a8f-4de2-8967-9da44d5668e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:13.095007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-42a9b52d-1a8f-4de2-8967-9da44d5668e3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.160091 Aug 18 22:16:13.095570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1808/3614] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:12 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:13.437227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-29e9c805-66ba-4c4c-a8e4-b221628dcd0f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:13.437810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-29e9c805-66ba-4c4c-a8e4-b221628dcd0f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:13.443685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29e9c805-66ba-4c4c-a8e4-b221628dcd0f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:13.444162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29e9c805-66ba-4c4c-a8e4-b221628dcd0f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:13.444590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29e9c805-66ba-4c4c-a8e4-b221628dcd0f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:13.445272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29e9c805-66ba-4c4c-a8e4-b221628dcd0f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:13.445750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29e9c805-66ba-4c4c-a8e4-b221628dcd0f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:13.446174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29e9c805-66ba-4c4c-a8e4-b221628dcd0f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:13.576289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-29e9c805-66ba-4c4c-a8e4-b221628dcd0f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:13.584572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-29e9c805-66ba-4c4c-a8e4-b221628dcd0f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152030 Aug 18 22:16:13.585149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1807/3615] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:13 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:13.625858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-222f4ad6-0c85-4406-bf1c-d2a629b37f8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:13.626448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c7262674-58ad-4030-800a-43015da3f5d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:13.626566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-222f4ad6-0c85-4406-bf1c-d2a629b37f8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:13.626671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c7262674-58ad-4030-800a-43015da3f5d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:13.632639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7262674-58ad-4030-800a-43015da3f5d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:13.632846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-222f4ad6-0c85-4406-bf1c-d2a629b37f8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:13.633176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7262674-58ad-4030-800a-43015da3f5d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:13.633328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-222f4ad6-0c85-4406-bf1c-d2a629b37f8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:13.633639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7262674-58ad-4030-800a-43015da3f5d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:13.633821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-222f4ad6-0c85-4406-bf1c-d2a629b37f8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:13.634332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7262674-58ad-4030-800a-43015da3f5d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:13.634480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-222f4ad6-0c85-4406-bf1c-d2a629b37f8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:13.634779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7262674-58ad-4030-800a-43015da3f5d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:13.634941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-222f4ad6-0c85-4406-bf1c-d2a629b37f8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:13.635206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c7262674-58ad-4030-800a-43015da3f5d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:13.635350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-222f4ad6-0c85-4406-bf1c-d2a629b37f8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:13.766854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-222f4ad6-0c85-4406-bf1c-d2a629b37f8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:13.772837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c7262674-58ad-4030-800a-43015da3f5d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:13.775330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-222f4ad6-0c85-4406-bf1c-d2a629b37f8e tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.153336 Aug 18 22:16:13.775910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1809/3616] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:13 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:13.782321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c7262674-58ad-4030-800a-43015da3f5d2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159297 Aug 18 22:16:13.782321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1808/3617] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:13.787715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-017e3717-9df4-4fc5-b95a-3f3d20f69a69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:13.788333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-017e3717-9df4-4fc5-b95a-3f3d20f69a69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:13.794270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-017e3717-9df4-4fc5-b95a-3f3d20f69a69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:13.795446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-017e3717-9df4-4fc5-b95a-3f3d20f69a69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:13.795757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-017e3717-9df4-4fc5-b95a-3f3d20f69a69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:13.796448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-017e3717-9df4-4fc5-b95a-3f3d20f69a69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:13.796904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-017e3717-9df4-4fc5-b95a-3f3d20f69a69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:13.797324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-017e3717-9df4-4fc5-b95a-3f3d20f69a69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:13.923741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-017e3717-9df4-4fc5-b95a-3f3d20f69a69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:13.932568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-017e3717-9df4-4fc5-b95a-3f3d20f69a69 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148507 Aug 18 22:16:13.933218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1810/3618] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:13 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:14.118294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1713ac1d-90bc-44a8-af49-94fc4c550acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:14.118910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1713ac1d-90bc-44a8-af49-94fc4c550acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:14.125065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1713ac1d-90bc-44a8-af49-94fc4c550acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:14.125547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1713ac1d-90bc-44a8-af49-94fc4c550acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:14.126020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1713ac1d-90bc-44a8-af49-94fc4c550acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:14.126714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1713ac1d-90bc-44a8-af49-94fc4c550acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:14.127171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1713ac1d-90bc-44a8-af49-94fc4c550acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:14.127597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1713ac1d-90bc-44a8-af49-94fc4c550acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:14.254899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1713ac1d-90bc-44a8-af49-94fc4c550acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:14.264281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1713ac1d-90bc-44a8-af49-94fc4c550acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:14.265816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1713ac1d-90bc-44a8-af49-94fc4c550acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:14.267084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1713ac1d-90bc-44a8-af49-94fc4c550acd tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152589 Aug 18 22:16:14.267550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1809/3619] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:14 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:14.606236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-20e88e3c-c965-4339-b6ed-9921173f0e9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:14.607399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-20e88e3c-c965-4339-b6ed-9921173f0e9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:14.613429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20e88e3c-c965-4339-b6ed-9921173f0e9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:14.613946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20e88e3c-c965-4339-b6ed-9921173f0e9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:14.614382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20e88e3c-c965-4339-b6ed-9921173f0e9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:14.615081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20e88e3c-c965-4339-b6ed-9921173f0e9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:14.615529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20e88e3c-c965-4339-b6ed-9921173f0e9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:14.615955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20e88e3c-c965-4339-b6ed-9921173f0e9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:14.748362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-20e88e3c-c965-4339-b6ed-9921173f0e9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:14.756545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-20e88e3c-c965-4339-b6ed-9921173f0e9e tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154160 Aug 18 22:16:14.757118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1811/3620] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:14 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:14.797175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4b20484d-8f5f-4711-918a-d1c02d6b9dbe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:14.797924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4b20484d-8f5f-4711-918a-d1c02d6b9dbe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:14.803554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f2a4aff-396d-4ba2-a7be-ad49433c2c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:14.804278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f2a4aff-396d-4ba2-a7be-ad49433c2c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:14.805056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b20484d-8f5f-4711-918a-d1c02d6b9dbe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:14.805548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b20484d-8f5f-4711-918a-d1c02d6b9dbe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:14.806140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b20484d-8f5f-4711-918a-d1c02d6b9dbe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:14.806850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b20484d-8f5f-4711-918a-d1c02d6b9dbe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:14.807309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b20484d-8f5f-4711-918a-d1c02d6b9dbe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:14.807761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b20484d-8f5f-4711-918a-d1c02d6b9dbe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:14.810919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f2a4aff-396d-4ba2-a7be-ad49433c2c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:14.811398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f2a4aff-396d-4ba2-a7be-ad49433c2c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:14.811829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f2a4aff-396d-4ba2-a7be-ad49433c2c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:14.812630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f2a4aff-396d-4ba2-a7be-ad49433c2c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:14.813082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f2a4aff-396d-4ba2-a7be-ad49433c2c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:14.813506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f2a4aff-396d-4ba2-a7be-ad49433c2c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:14.939472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4b20484d-8f5f-4711-918a-d1c02d6b9dbe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:14.945052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4f2a4aff-396d-4ba2-a7be-ad49433c2c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:14.951326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4b20484d-8f5f-4711-918a-d1c02d6b9dbe tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.158457 Aug 18 22:16:14.951915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1810/3621] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:14 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:14.954544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f2a4aff-396d-4ba2-a7be-ad49433c2c5b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155006 Aug 18 22:16:14.956779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a25eac2f-dea8-43c1-9f02-b1f3a0c7dd5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:14.957394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a25eac2f-dea8-43c1-9f02-b1f3a0c7dd5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:14.963617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a25eac2f-dea8-43c1-9f02-b1f3a0c7dd5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:14.964099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a25eac2f-dea8-43c1-9f02-b1f3a0c7dd5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:14.964540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a25eac2f-dea8-43c1-9f02-b1f3a0c7dd5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:14.965226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a25eac2f-dea8-43c1-9f02-b1f3a0c7dd5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:14.965712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a25eac2f-dea8-43c1-9f02-b1f3a0c7dd5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:14.966142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a25eac2f-dea8-43c1-9f02-b1f3a0c7dd5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:14.968866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1812/3622] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:15.096995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a25eac2f-dea8-43c1-9f02-b1f3a0c7dd5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:15.105158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a25eac2f-dea8-43c1-9f02-b1f3a0c7dd5b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152109 Aug 18 22:16:15.105753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1811/3623] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:15.289907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3dbf6549-159c-46dc-94a0-d65b5a1da9f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:15.290530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3dbf6549-159c-46dc-94a0-d65b5a1da9f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:15.297140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dbf6549-159c-46dc-94a0-d65b5a1da9f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:15.297649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dbf6549-159c-46dc-94a0-d65b5a1da9f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:15.298093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dbf6549-159c-46dc-94a0-d65b5a1da9f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:15.298787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dbf6549-159c-46dc-94a0-d65b5a1da9f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:15.299246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dbf6549-159c-46dc-94a0-d65b5a1da9f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:15.299679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dbf6549-159c-46dc-94a0-d65b5a1da9f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:15.430379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3dbf6549-159c-46dc-94a0-d65b5a1da9f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:15.439120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3dbf6549-159c-46dc-94a0-d65b5a1da9f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:15.440612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3dbf6549-159c-46dc-94a0-d65b5a1da9f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:15.441798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3dbf6549-159c-46dc-94a0-d65b5a1da9f8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156034 Aug 18 22:16:15.442356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1813/3624] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:15 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:15.777885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2efe309b-c1f4-428e-af4b-f184f9eeb897 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:15.778539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2efe309b-c1f4-428e-af4b-f184f9eeb897 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:15.784746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2efe309b-c1f4-428e-af4b-f184f9eeb897 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:15.785230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2efe309b-c1f4-428e-af4b-f184f9eeb897 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:15.785692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2efe309b-c1f4-428e-af4b-f184f9eeb897 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:15.786383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2efe309b-c1f4-428e-af4b-f184f9eeb897 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:15.786839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2efe309b-c1f4-428e-af4b-f184f9eeb897 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:15.787266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2efe309b-c1f4-428e-af4b-f184f9eeb897 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:15.915789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2efe309b-c1f4-428e-af4b-f184f9eeb897 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:15.925142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2efe309b-c1f4-428e-af4b-f184f9eeb897 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151101 Aug 18 22:16:15.925748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1812/3625] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:15 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:15.972475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1db244ef-d923-468f-9319-764a1366ebc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:15.973035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1db244ef-d923-468f-9319-764a1366ebc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:15.974938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:15.976206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-76c66ad0-0d43-4876-a185-eff8cc2f7885 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:15.976838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-76c66ad0-0d43-4876-a185-eff8cc2f7885 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:15.980545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1db244ef-d923-468f-9319-764a1366ebc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:15.981023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1db244ef-d923-468f-9319-764a1366ebc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:15.981529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1db244ef-d923-468f-9319-764a1366ebc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:15.982247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1db244ef-d923-468f-9319-764a1366ebc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:15.982696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1db244ef-d923-468f-9319-764a1366ebc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:15.983117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1db244ef-d923-468f-9319-764a1366ebc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:15.983303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76c66ad0-0d43-4876-a185-eff8cc2f7885 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:15.983795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76c66ad0-0d43-4876-a185-eff8cc2f7885 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:15.984263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76c66ad0-0d43-4876-a185-eff8cc2f7885 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:15.984957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76c66ad0-0d43-4876-a185-eff8cc2f7885 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:15.985413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76c66ad0-0d43-4876-a185-eff8cc2f7885 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:15.985868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-76c66ad0-0d43-4876-a185-eff8cc2f7885 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:16.116048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1db244ef-d923-468f-9319-764a1366ebc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:16.119275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-76c66ad0-0d43-4876-a185-eff8cc2f7885 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:16.126248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1db244ef-d923-468f-9319-764a1366ebc2 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157588 Aug 18 22:16:16.126833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1814/3626] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:15 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:16.129111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-76c66ad0-0d43-4876-a185-eff8cc2f7885 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156835 Aug 18 22:16:16.129959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1813/3627] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:15 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:16.131401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1177d1c2-b443-49d9-b3d7-f5b5ab0c8624 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:16.132010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1177d1c2-b443-49d9-b3d7-f5b5ab0c8624 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:16.138443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1177d1c2-b443-49d9-b3d7-f5b5ab0c8624 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:16.139126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1177d1c2-b443-49d9-b3d7-f5b5ab0c8624 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:16.139751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1177d1c2-b443-49d9-b3d7-f5b5ab0c8624 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:16.140476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1177d1c2-b443-49d9-b3d7-f5b5ab0c8624 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:16.140957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1177d1c2-b443-49d9-b3d7-f5b5ab0c8624 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:16.141376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1177d1c2-b443-49d9-b3d7-f5b5ab0c8624 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:16.270564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1177d1c2-b443-49d9-b3d7-f5b5ab0c8624 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:16.278630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1177d1c2-b443-49d9-b3d7-f5b5ab0c8624 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150857 Aug 18 22:16:16.279219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1815/3628] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:16.464479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-26632649-bcbb-4c8e-9d4c-1766e4bc322e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:16.465106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-26632649-bcbb-4c8e-9d4c-1766e4bc322e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:16.471087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26632649-bcbb-4c8e-9d4c-1766e4bc322e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:16.471576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26632649-bcbb-4c8e-9d4c-1766e4bc322e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:16.472018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26632649-bcbb-4c8e-9d4c-1766e4bc322e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:16.472706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26632649-bcbb-4c8e-9d4c-1766e4bc322e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:16.473165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26632649-bcbb-4c8e-9d4c-1766e4bc322e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:16.473619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-26632649-bcbb-4c8e-9d4c-1766e4bc322e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:16.599791 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-26632649-bcbb-4c8e-9d4c-1766e4bc322e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:16.609043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-26632649-bcbb-4c8e-9d4c-1766e4bc322e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:16.610603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-26632649-bcbb-4c8e-9d4c-1766e4bc322e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:16.611759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-26632649-bcbb-4c8e-9d4c-1766e4bc322e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151163 Aug 18 22:16:16.612347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1814/3629] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:16 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:16.947250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0f1efda1-d898-4a9f-acf8-e974f5af54fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:16.947863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0f1efda1-d898-4a9f-acf8-e974f5af54fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:16.954981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f1efda1-d898-4a9f-acf8-e974f5af54fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:16.955461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f1efda1-d898-4a9f-acf8-e974f5af54fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:16.955893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f1efda1-d898-4a9f-acf8-e974f5af54fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:16.956594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f1efda1-d898-4a9f-acf8-e974f5af54fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:16.957047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f1efda1-d898-4a9f-acf8-e974f5af54fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:16.957474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f1efda1-d898-4a9f-acf8-e974f5af54fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:17.089782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0f1efda1-d898-4a9f-acf8-e974f5af54fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:17.099224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0f1efda1-d898-4a9f-acf8-e974f5af54fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155668 Aug 18 22:16:17.099813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1816/3630] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:16 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:17.147441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-de3a513f-f831-413f-b554-6375505462d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:17.148119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-de3a513f-f831-413f-b554-6375505462d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:17.151091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b34efe36-2302-4396-956c-e7e07d09929e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:17.151806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b34efe36-2302-4396-956c-e7e07d09929e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:17.155946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de3a513f-f831-413f-b554-6375505462d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:17.156522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de3a513f-f831-413f-b554-6375505462d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:17.157037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de3a513f-f831-413f-b554-6375505462d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:17.157862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de3a513f-f831-413f-b554-6375505462d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:17.158395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de3a513f-f831-413f-b554-6375505462d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:17.158926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de3a513f-f831-413f-b554-6375505462d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:17.159254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b34efe36-2302-4396-956c-e7e07d09929e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:17.159818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b34efe36-2302-4396-956c-e7e07d09929e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:17.160331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b34efe36-2302-4396-956c-e7e07d09929e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:17.161108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b34efe36-2302-4396-956c-e7e07d09929e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:17.161663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b34efe36-2302-4396-956c-e7e07d09929e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:17.162337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b34efe36-2302-4396-956c-e7e07d09929e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:17.296271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b34efe36-2302-4396-956c-e7e07d09929e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:17.305171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b34efe36-2302-4396-956c-e7e07d09929e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.158772 Aug 18 22:16:17.305983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1817/3631] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:17 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:17.311848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5c7483eb-debd-44ed-91e6-abdde1e9235b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:17.312456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5c7483eb-debd-44ed-91e6-abdde1e9235b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:17.318395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c7483eb-debd-44ed-91e6-abdde1e9235b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:17.318874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c7483eb-debd-44ed-91e6-abdde1e9235b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:17.319308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c7483eb-debd-44ed-91e6-abdde1e9235b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:17.319998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c7483eb-debd-44ed-91e6-abdde1e9235b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:17.320640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c7483eb-debd-44ed-91e6-abdde1e9235b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:17.321066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c7483eb-debd-44ed-91e6-abdde1e9235b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:17.370952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-de3a513f-f831-413f-b554-6375505462d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:17.379931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-de3a513f-f831-413f-b554-6375505462d9 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.236558 Aug 18 22:16:17.380524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1815/3632] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:17 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:17.458704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5c7483eb-debd-44ed-91e6-abdde1e9235b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:17.467123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5c7483eb-debd-44ed-91e6-abdde1e9235b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.160173 Aug 18 22:16:17.467710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1818/3633] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:17.634824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f6f66745-c39b-4d6d-b32f-44bf536d22ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:17.635364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f6f66745-c39b-4d6d-b32f-44bf536d22ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:17.641460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6f66745-c39b-4d6d-b32f-44bf536d22ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:17.641971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6f66745-c39b-4d6d-b32f-44bf536d22ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:17.642407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6f66745-c39b-4d6d-b32f-44bf536d22ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:17.643092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6f66745-c39b-4d6d-b32f-44bf536d22ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:17.643546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6f66745-c39b-4d6d-b32f-44bf536d22ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:17.643973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6f66745-c39b-4d6d-b32f-44bf536d22ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:17.776357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f6f66745-c39b-4d6d-b32f-44bf536d22ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:17.785232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f6f66745-c39b-4d6d-b32f-44bf536d22ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:17.786772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f6f66745-c39b-4d6d-b32f-44bf536d22ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:17.787931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f6f66745-c39b-4d6d-b32f-44bf536d22ff tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157236 Aug 18 22:16:17.788503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1816/3634] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:17 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:18.187655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d63150bb-d0ad-4c11-9205-e3f75c1d1219 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:18.188283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d63150bb-d0ad-4c11-9205-e3f75c1d1219 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:18.194226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d63150bb-d0ad-4c11-9205-e3f75c1d1219 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:18.194716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d63150bb-d0ad-4c11-9205-e3f75c1d1219 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:18.195158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d63150bb-d0ad-4c11-9205-e3f75c1d1219 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:18.195850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d63150bb-d0ad-4c11-9205-e3f75c1d1219 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:18.196307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d63150bb-d0ad-4c11-9205-e3f75c1d1219 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:18.196733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d63150bb-d0ad-4c11-9205-e3f75c1d1219 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:18.327079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eed27eae-9006-40a2-861f-5d10052ad0b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:18.327729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eed27eae-9006-40a2-861f-5d10052ad0b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:18.331657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d63150bb-d0ad-4c11-9205-e3f75c1d1219 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:18.334325 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eed27eae-9006-40a2-861f-5d10052ad0b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:18.334816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eed27eae-9006-40a2-861f-5d10052ad0b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:18.335254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eed27eae-9006-40a2-861f-5d10052ad0b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:18.335954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eed27eae-9006-40a2-861f-5d10052ad0b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:18.336503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eed27eae-9006-40a2-861f-5d10052ad0b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:18.336940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eed27eae-9006-40a2-861f-5d10052ad0b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:18.340005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d63150bb-d0ad-4c11-9205-e3f75c1d1219 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.223482 Aug 18 22:16:18.340808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1819/3635] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:18 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:18.402614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ffc37f8a-ea2d-4fd3-ad66-01e50311c738 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:18.403179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ffc37f8a-ea2d-4fd3-ad66-01e50311c738 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:18.410429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffc37f8a-ea2d-4fd3-ad66-01e50311c738 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:18.411187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffc37f8a-ea2d-4fd3-ad66-01e50311c738 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:18.411952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffc37f8a-ea2d-4fd3-ad66-01e50311c738 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:18.413077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffc37f8a-ea2d-4fd3-ad66-01e50311c738 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:18.413913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffc37f8a-ea2d-4fd3-ad66-01e50311c738 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:18.414644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ffc37f8a-ea2d-4fd3-ad66-01e50311c738 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:18.436674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:18.486403 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-eed27eae-9006-40a2-861f-5d10052ad0b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:18.495377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eed27eae-9006-40a2-861f-5d10052ad0b6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.172266 Aug 18 22:16:18.496176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1817/3636] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:18 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:18.500943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-33b9eeae-29b3-40d0-b9e7-c7206c6aa7ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:18.501405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-33b9eeae-29b3-40d0-b9e7-c7206c6aa7ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:18.510175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33b9eeae-29b3-40d0-b9e7-c7206c6aa7ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:18.510175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33b9eeae-29b3-40d0-b9e7-c7206c6aa7ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:18.510175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33b9eeae-29b3-40d0-b9e7-c7206c6aa7ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:18.511350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33b9eeae-29b3-40d0-b9e7-c7206c6aa7ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:18.511350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33b9eeae-29b3-40d0-b9e7-c7206c6aa7ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:18.511350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33b9eeae-29b3-40d0-b9e7-c7206c6aa7ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:18.567282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ffc37f8a-ea2d-4fd3-ad66-01e50311c738 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:18.577724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ffc37f8a-ea2d-4fd3-ad66-01e50311c738 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.179712 Aug 18 22:16:18.578430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1820/3637] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:18 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:18.644487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-33b9eeae-29b3-40d0-b9e7-c7206c6aa7ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:18.652693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-33b9eeae-29b3-40d0-b9e7-c7206c6aa7ea tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155662 Aug 18 22:16:18.653200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1818/3638] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:18 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:18.811884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-287dbaea-d946-4534-9ba6-b58f8216e5bb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:18.812516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-287dbaea-d946-4534-9ba6-b58f8216e5bb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:18.818515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-287dbaea-d946-4534-9ba6-b58f8216e5bb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:18.818993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-287dbaea-d946-4534-9ba6-b58f8216e5bb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:18.819425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-287dbaea-d946-4534-9ba6-b58f8216e5bb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:18.820108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-287dbaea-d946-4534-9ba6-b58f8216e5bb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:18.820558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-287dbaea-d946-4534-9ba6-b58f8216e5bb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:18.820980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-287dbaea-d946-4534-9ba6-b58f8216e5bb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:18.950489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-287dbaea-d946-4534-9ba6-b58f8216e5bb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:18.959950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-287dbaea-d946-4534-9ba6-b58f8216e5bb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:18.961484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-287dbaea-d946-4534-9ba6-b58f8216e5bb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:18.962684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-287dbaea-d946-4534-9ba6-b58f8216e5bb tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155227 Aug 18 22:16:18.963250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1821/3639] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:18 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:19.362291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4a96095c-a938-4bfc-bc04-5eacb6863675 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:19.363013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4a96095c-a938-4bfc-bc04-5eacb6863675 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:19.369512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a96095c-a938-4bfc-bc04-5eacb6863675 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:19.370030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a96095c-a938-4bfc-bc04-5eacb6863675 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:19.370471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a96095c-a938-4bfc-bc04-5eacb6863675 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:19.371172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a96095c-a938-4bfc-bc04-5eacb6863675 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:19.371630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a96095c-a938-4bfc-bc04-5eacb6863675 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:19.372054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a96095c-a938-4bfc-bc04-5eacb6863675 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:19.374623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:19.504704 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4a96095c-a938-4bfc-bc04-5eacb6863675 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:19.514188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4a96095c-a938-4bfc-bc04-5eacb6863675 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155127 Aug 18 22:16:19.514775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1819/3640] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:19 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:19.516995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1fdb7efb-bed5-4533-81a3-b78b73b99821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:19.517633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1fdb7efb-bed5-4533-81a3-b78b73b99821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:19.524657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fdb7efb-bed5-4533-81a3-b78b73b99821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:19.525158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fdb7efb-bed5-4533-81a3-b78b73b99821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:19.525620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fdb7efb-bed5-4533-81a3-b78b73b99821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:19.526349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fdb7efb-bed5-4533-81a3-b78b73b99821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:19.526968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fdb7efb-bed5-4533-81a3-b78b73b99821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:19.527410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1fdb7efb-bed5-4533-81a3-b78b73b99821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:19.599418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-130b5c9e-0f44-4218-b820-c5c246efbdf4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:19.599730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-130b5c9e-0f44-4218-b820-c5c246efbdf4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:19.606151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-130b5c9e-0f44-4218-b820-c5c246efbdf4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:19.606896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-130b5c9e-0f44-4218-b820-c5c246efbdf4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:19.607259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-130b5c9e-0f44-4218-b820-c5c246efbdf4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:19.608337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-130b5c9e-0f44-4218-b820-c5c246efbdf4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:19.608944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-130b5c9e-0f44-4218-b820-c5c246efbdf4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:19.608944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-130b5c9e-0f44-4218-b820-c5c246efbdf4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:19.668865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1fdb7efb-bed5-4533-81a3-b78b73b99821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:19.677818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1fdb7efb-bed5-4533-81a3-b78b73b99821 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.165125 Aug 18 22:16:19.678423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1822/3641] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:19 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:19.683095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7af6d2a5-fe1c-42e1-99f9-d7004016edfd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:19.683703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7af6d2a5-fe1c-42e1-99f9-d7004016edfd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:19.691423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7af6d2a5-fe1c-42e1-99f9-d7004016edfd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:19.691682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7af6d2a5-fe1c-42e1-99f9-d7004016edfd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:19.692035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7af6d2a5-fe1c-42e1-99f9-d7004016edfd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:19.694995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7af6d2a5-fe1c-42e1-99f9-d7004016edfd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:19.695480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7af6d2a5-fe1c-42e1-99f9-d7004016edfd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:19.695974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7af6d2a5-fe1c-42e1-99f9-d7004016edfd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:19.762884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-130b5c9e-0f44-4218-b820-c5c246efbdf4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:19.772115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-130b5c9e-0f44-4218-b820-c5c246efbdf4 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.176763 Aug 18 22:16:19.772853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1820/3642] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:19 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:19.839509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7af6d2a5-fe1c-42e1-99f9-d7004016edfd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:19.853576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7af6d2a5-fe1c-42e1-99f9-d7004016edfd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.173832 Aug 18 22:16:19.854542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1823/3643] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:19 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:19.990222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7bb779b8-4991-42dd-9ea1-c07eea7daf25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:19.991255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7bb779b8-4991-42dd-9ea1-c07eea7daf25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:20.002083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7bb779b8-4991-42dd-9ea1-c07eea7daf25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:20.003009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7bb779b8-4991-42dd-9ea1-c07eea7daf25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:20.003809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7bb779b8-4991-42dd-9ea1-c07eea7daf25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:20.005079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7bb779b8-4991-42dd-9ea1-c07eea7daf25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:20.005948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7bb779b8-4991-42dd-9ea1-c07eea7daf25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:20.006729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7bb779b8-4991-42dd-9ea1-c07eea7daf25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:20.157721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7bb779b8-4991-42dd-9ea1-c07eea7daf25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:20.166372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7bb779b8-4991-42dd-9ea1-c07eea7daf25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:20.167861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7bb779b8-4991-42dd-9ea1-c07eea7daf25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:20.169009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7bb779b8-4991-42dd-9ea1-c07eea7daf25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.186299 Aug 18 22:16:20.169567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1821/3644] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:19 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:20.535840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7295c42e-b394-4da3-a10e-805c7c998176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:20.536446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7295c42e-b394-4da3-a10e-805c7c998176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:20.542997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7295c42e-b394-4da3-a10e-805c7c998176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:20.543471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7295c42e-b394-4da3-a10e-805c7c998176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:20.543901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7295c42e-b394-4da3-a10e-805c7c998176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:20.544586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7295c42e-b394-4da3-a10e-805c7c998176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:20.545033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7295c42e-b394-4da3-a10e-805c7c998176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:20.545447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7295c42e-b394-4da3-a10e-805c7c998176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:20.673589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7295c42e-b394-4da3-a10e-805c7c998176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:20.682235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7295c42e-b394-4da3-a10e-805c7c998176 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150216 Aug 18 22:16:20.682884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1824/3645] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:20 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:20.700202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a4e54dd6-627e-4971-acc8-98a179b372a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:20.700849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a4e54dd6-627e-4971-acc8-98a179b372a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:20.707221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4e54dd6-627e-4971-acc8-98a179b372a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:20.707695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4e54dd6-627e-4971-acc8-98a179b372a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:20.708125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4e54dd6-627e-4971-acc8-98a179b372a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:20.708808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4e54dd6-627e-4971-acc8-98a179b372a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:20.709256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4e54dd6-627e-4971-acc8-98a179b372a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:20.709705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4e54dd6-627e-4971-acc8-98a179b372a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:20.796318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2ba08c97-871c-4375-97cd-729f80c44b42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:20.797018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2ba08c97-871c-4375-97cd-729f80c44b42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:20.803601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ba08c97-871c-4375-97cd-729f80c44b42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:20.804083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ba08c97-871c-4375-97cd-729f80c44b42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:20.804526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ba08c97-871c-4375-97cd-729f80c44b42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:20.805213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ba08c97-871c-4375-97cd-729f80c44b42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:20.805694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ba08c97-871c-4375-97cd-729f80c44b42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:20.806118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2ba08c97-871c-4375-97cd-729f80c44b42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:20.844947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a4e54dd6-627e-4971-acc8-98a179b372a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:20.853690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a4e54dd6-627e-4971-acc8-98a179b372a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.157076 Aug 18 22:16:20.854253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1822/3646] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:20.882175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07a55b13-66f6-45b6-b3f4-929a54d95ab4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:20.882740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07a55b13-66f6-45b6-b3f4-929a54d95ab4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:20.888999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07a55b13-66f6-45b6-b3f4-929a54d95ab4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:20.889491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07a55b13-66f6-45b6-b3f4-929a54d95ab4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:20.889963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07a55b13-66f6-45b6-b3f4-929a54d95ab4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:20.890669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07a55b13-66f6-45b6-b3f4-929a54d95ab4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:20.891116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07a55b13-66f6-45b6-b3f4-929a54d95ab4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:20.891542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07a55b13-66f6-45b6-b3f4-929a54d95ab4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:20.950816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2ba08c97-871c-4375-97cd-729f80c44b42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:20.959382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2ba08c97-871c-4375-97cd-729f80c44b42 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.167994 Aug 18 22:16:20.959977 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1825/3647] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:20 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:21.043619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-07a55b13-66f6-45b6-b3f4-929a54d95ab4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:21.049414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07a55b13-66f6-45b6-b3f4-929a54d95ab4 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.171340 Aug 18 22:16:21.050035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1823/3648] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:20 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:21.192125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-df81a6ca-f147-4370-8e6b-5902bf148262 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:21.192741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-df81a6ca-f147-4370-8e6b-5902bf148262 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:21.198780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df81a6ca-f147-4370-8e6b-5902bf148262 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:21.199238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df81a6ca-f147-4370-8e6b-5902bf148262 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:21.199678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df81a6ca-f147-4370-8e6b-5902bf148262 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:21.200376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df81a6ca-f147-4370-8e6b-5902bf148262 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:21.200831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df81a6ca-f147-4370-8e6b-5902bf148262 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:21.201275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df81a6ca-f147-4370-8e6b-5902bf148262 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:21.325915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-df81a6ca-f147-4370-8e6b-5902bf148262 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:21.334477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-df81a6ca-f147-4370-8e6b-5902bf148262 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:21.335979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-df81a6ca-f147-4370-8e6b-5902bf148262 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:21.337126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-df81a6ca-f147-4370-8e6b-5902bf148262 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.149180 Aug 18 22:16:21.337703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1826/3649] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:21 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:21.704769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d5c57d0d-c4b4-41f1-a99b-b7a5bf1d5e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:21.705321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d5c57d0d-c4b4-41f1-a99b-b7a5bf1d5e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:21.711957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5c57d0d-c4b4-41f1-a99b-b7a5bf1d5e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:21.712448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5c57d0d-c4b4-41f1-a99b-b7a5bf1d5e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:21.712897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5c57d0d-c4b4-41f1-a99b-b7a5bf1d5e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:21.713641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5c57d0d-c4b4-41f1-a99b-b7a5bf1d5e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:21.714150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5c57d0d-c4b4-41f1-a99b-b7a5bf1d5e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:21.714585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5c57d0d-c4b4-41f1-a99b-b7a5bf1d5e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:21.855787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d5c57d0d-c4b4-41f1-a99b-b7a5bf1d5e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:21.864130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d5c57d0d-c4b4-41f1-a99b-b7a5bf1d5e74 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.163767 Aug 18 22:16:21.864909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1824/3650] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:21 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:21.876924 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b2f250bc-73e7-4c0a-b5ce-819c18a806b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:21.877542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b2f250bc-73e7-4c0a-b5ce-819c18a806b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:21.884066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2f250bc-73e7-4c0a-b5ce-819c18a806b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:21.884550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2f250bc-73e7-4c0a-b5ce-819c18a806b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:21.884988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2f250bc-73e7-4c0a-b5ce-819c18a806b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:21.885704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2f250bc-73e7-4c0a-b5ce-819c18a806b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:21.886157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2f250bc-73e7-4c0a-b5ce-819c18a806b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:21.886581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2f250bc-73e7-4c0a-b5ce-819c18a806b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:21.980031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-41342cb8-1c46-4caf-be2a-050c08fb1915 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:21.980881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-41342cb8-1c46-4caf-be2a-050c08fb1915 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:21.989407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41342cb8-1c46-4caf-be2a-050c08fb1915 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:21.989895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41342cb8-1c46-4caf-be2a-050c08fb1915 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:21.990343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41342cb8-1c46-4caf-be2a-050c08fb1915 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:21.991830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41342cb8-1c46-4caf-be2a-050c08fb1915 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:21.991830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41342cb8-1c46-4caf-be2a-050c08fb1915 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:21.992114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-41342cb8-1c46-4caf-be2a-050c08fb1915 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:22.021388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b2f250bc-73e7-4c0a-b5ce-819c18a806b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:22.029637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b2f250bc-73e7-4c0a-b5ce-819c18a806b3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.158088 Aug 18 22:16:22.030223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1827/3651] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:22.070885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-632b898a-c0bc-469e-a14c-b25aa48d9d92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:22.071513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-632b898a-c0bc-469e-a14c-b25aa48d9d92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:22.078118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-632b898a-c0bc-469e-a14c-b25aa48d9d92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:22.078610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-632b898a-c0bc-469e-a14c-b25aa48d9d92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:22.079053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-632b898a-c0bc-469e-a14c-b25aa48d9d92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:22.079757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-632b898a-c0bc-469e-a14c-b25aa48d9d92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:22.080216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-632b898a-c0bc-469e-a14c-b25aa48d9d92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:22.080643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-632b898a-c0bc-469e-a14c-b25aa48d9d92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:22.121619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-41342cb8-1c46-4caf-be2a-050c08fb1915 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:22.130788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-41342cb8-1c46-4caf-be2a-050c08fb1915 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154582 Aug 18 22:16:22.131454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1825/3652] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:21 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:22.211488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-632b898a-c0bc-469e-a14c-b25aa48d9d92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:22.220088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-632b898a-c0bc-469e-a14c-b25aa48d9d92 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153004 Aug 18 22:16:22.220683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1828/3653] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:22 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:22.360748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-48160c11-6d4b-4d65-a83b-ab170269ee73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:22.361356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-48160c11-6d4b-4d65-a83b-ab170269ee73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:22.367287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48160c11-6d4b-4d65-a83b-ab170269ee73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:22.367765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48160c11-6d4b-4d65-a83b-ab170269ee73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:22.368196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48160c11-6d4b-4d65-a83b-ab170269ee73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:22.368876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48160c11-6d4b-4d65-a83b-ab170269ee73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:22.369326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48160c11-6d4b-4d65-a83b-ab170269ee73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:22.369773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48160c11-6d4b-4d65-a83b-ab170269ee73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:22.498309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-48160c11-6d4b-4d65-a83b-ab170269ee73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:22.507287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-48160c11-6d4b-4d65-a83b-ab170269ee73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:22.508984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-48160c11-6d4b-4d65-a83b-ab170269ee73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:22.510372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-48160c11-6d4b-4d65-a83b-ab170269ee73 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154379 Aug 18 22:16:22.510951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1826/3654] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:22 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:22.886138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da9eb1a2-0309-4afc-8d16-3825fd75ef23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:22.886810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-da9eb1a2-0309-4afc-8d16-3825fd75ef23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:22.893664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9eb1a2-0309-4afc-8d16-3825fd75ef23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:22.894140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9eb1a2-0309-4afc-8d16-3825fd75ef23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:22.894571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9eb1a2-0309-4afc-8d16-3825fd75ef23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:22.895254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9eb1a2-0309-4afc-8d16-3825fd75ef23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:22.895703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9eb1a2-0309-4afc-8d16-3825fd75ef23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:22.896123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da9eb1a2-0309-4afc-8d16-3825fd75ef23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:23.033110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-da9eb1a2-0309-4afc-8d16-3825fd75ef23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:23.041242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da9eb1a2-0309-4afc-8d16-3825fd75ef23 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.158916 Aug 18 22:16:23.041839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1829/3655] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:22 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:23.050956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8323e15d-4582-4417-b20e-36837dfd2f96 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:23.052182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8323e15d-4582-4417-b20e-36837dfd2f96 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:23.058658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8323e15d-4582-4417-b20e-36837dfd2f96 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:23.059163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8323e15d-4582-4417-b20e-36837dfd2f96 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:23.059584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8323e15d-4582-4417-b20e-36837dfd2f96 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:23.060282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8323e15d-4582-4417-b20e-36837dfd2f96 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:23.060735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8323e15d-4582-4417-b20e-36837dfd2f96 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:23.061165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8323e15d-4582-4417-b20e-36837dfd2f96 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:23.152536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7fb90637-87b5-4af1-838a-6138711455df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:23.153461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7fb90637-87b5-4af1-838a-6138711455df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:23.160014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fb90637-87b5-4af1-838a-6138711455df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:23.160530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fb90637-87b5-4af1-838a-6138711455df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:23.160972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fb90637-87b5-4af1-838a-6138711455df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:23.161706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fb90637-87b5-4af1-838a-6138711455df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:23.162155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fb90637-87b5-4af1-838a-6138711455df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:23.162844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fb90637-87b5-4af1-838a-6138711455df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:23.196128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8323e15d-4582-4417-b20e-36837dfd2f96 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:23.206288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8323e15d-4582-4417-b20e-36837dfd2f96 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159040 Aug 18 22:16:23.207091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1827/3656] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:23 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:23.241279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a91c55c6-d438-483a-b914-0e32e009605b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:23.241940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a91c55c6-d438-483a-b914-0e32e009605b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:23.248512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a91c55c6-d438-483a-b914-0e32e009605b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:23.249010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a91c55c6-d438-483a-b914-0e32e009605b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:23.249455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a91c55c6-d438-483a-b914-0e32e009605b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:23.250265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a91c55c6-d438-483a-b914-0e32e009605b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:23.250728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a91c55c6-d438-483a-b914-0e32e009605b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:23.251162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a91c55c6-d438-483a-b914-0e32e009605b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:23.297708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7fb90637-87b5-4af1-838a-6138711455df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:23.306078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7fb90637-87b5-4af1-838a-6138711455df tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.157730 Aug 18 22:16:23.306656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1830/3657] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:23 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:23.379326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a91c55c6-d438-483a-b914-0e32e009605b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:23.387615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a91c55c6-d438-483a-b914-0e32e009605b tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150283 Aug 18 22:16:23.388849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1828/3658] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:23 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:23.533265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6fab3c40-0d3b-44fb-9526-afe5b29aa499 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:23.533942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6fab3c40-0d3b-44fb-9526-afe5b29aa499 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:23.540020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fab3c40-0d3b-44fb-9526-afe5b29aa499 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:23.540447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fab3c40-0d3b-44fb-9526-afe5b29aa499 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:23.540885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fab3c40-0d3b-44fb-9526-afe5b29aa499 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:23.541577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fab3c40-0d3b-44fb-9526-afe5b29aa499 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:23.542056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fab3c40-0d3b-44fb-9526-afe5b29aa499 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:23.542486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6fab3c40-0d3b-44fb-9526-afe5b29aa499 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:23.667410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6fab3c40-0d3b-44fb-9526-afe5b29aa499 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:23.676363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6fab3c40-0d3b-44fb-9526-afe5b29aa499 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:23.678216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6fab3c40-0d3b-44fb-9526-afe5b29aa499 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:23.679403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6fab3c40-0d3b-44fb-9526-afe5b29aa499 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.149994 Aug 18 22:16:23.679963 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1831/3659] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:23 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:24.063026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9f383cab-276f-4225-9e2b-a64e16bd080c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:24.063655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9f383cab-276f-4225-9e2b-a64e16bd080c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:24.070167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f383cab-276f-4225-9e2b-a64e16bd080c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:24.070658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f383cab-276f-4225-9e2b-a64e16bd080c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:24.071109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f383cab-276f-4225-9e2b-a64e16bd080c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:24.071805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f383cab-276f-4225-9e2b-a64e16bd080c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:24.072267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f383cab-276f-4225-9e2b-a64e16bd080c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:24.072698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f383cab-276f-4225-9e2b-a64e16bd080c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:24.204806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9f383cab-276f-4225-9e2b-a64e16bd080c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:24.212942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9f383cab-276f-4225-9e2b-a64e16bd080c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153918 Aug 18 22:16:24.213514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1829/3660] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:24 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:24.228270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-82c12387-4cca-4e02-91ff-19a0bca07dde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:24.228900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-82c12387-4cca-4e02-91ff-19a0bca07dde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:24.236119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82c12387-4cca-4e02-91ff-19a0bca07dde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:24.236605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82c12387-4cca-4e02-91ff-19a0bca07dde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:24.237047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82c12387-4cca-4e02-91ff-19a0bca07dde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:24.237893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82c12387-4cca-4e02-91ff-19a0bca07dde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:24.238356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82c12387-4cca-4e02-91ff-19a0bca07dde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:24.238792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82c12387-4cca-4e02-91ff-19a0bca07dde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:24.328002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-35cf4750-2cbb-4173-987d-ddfbaac5ca92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:24.328713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-35cf4750-2cbb-4173-987d-ddfbaac5ca92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:24.334849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35cf4750-2cbb-4173-987d-ddfbaac5ca92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:24.335424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35cf4750-2cbb-4173-987d-ddfbaac5ca92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:24.335924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35cf4750-2cbb-4173-987d-ddfbaac5ca92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:24.336631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35cf4750-2cbb-4173-987d-ddfbaac5ca92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:24.337085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35cf4750-2cbb-4173-987d-ddfbaac5ca92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:24.337516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-35cf4750-2cbb-4173-987d-ddfbaac5ca92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:24.369416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-82c12387-4cca-4e02-91ff-19a0bca07dde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:24.378241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-82c12387-4cca-4e02-91ff-19a0bca07dde tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153845 Aug 18 22:16:24.378830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1832/3661] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:24 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:24.409105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9c4b453c-3be0-4edf-9672-9d8acf607d3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:24.409666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9c4b453c-3be0-4edf-9672-9d8acf607d3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:24.415800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c4b453c-3be0-4edf-9672-9d8acf607d3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:24.416290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c4b453c-3be0-4edf-9672-9d8acf607d3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:24.416728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c4b453c-3be0-4edf-9672-9d8acf607d3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:24.417433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c4b453c-3be0-4edf-9672-9d8acf607d3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:24.417923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c4b453c-3be0-4edf-9672-9d8acf607d3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:24.418357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c4b453c-3be0-4edf-9672-9d8acf607d3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:24.467212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-35cf4750-2cbb-4173-987d-ddfbaac5ca92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:24.476035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-35cf4750-2cbb-4173-987d-ddfbaac5ca92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.152494 Aug 18 22:16:24.476617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1830/3662] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:24 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:24.555883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9c4b453c-3be0-4edf-9672-9d8acf607d3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:24.563955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9c4b453c-3be0-4edf-9672-9d8acf607d3d tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.158868 Aug 18 22:16:24.564527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1833/3663] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:24 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:24.702858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9f42398e-09aa-40e7-9eae-2c33a74b33e4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:24.703435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9f42398e-09aa-40e7-9eae-2c33a74b33e4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:24.709406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f42398e-09aa-40e7-9eae-2c33a74b33e4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:24.709928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f42398e-09aa-40e7-9eae-2c33a74b33e4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:24.710376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f42398e-09aa-40e7-9eae-2c33a74b33e4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:24.711070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f42398e-09aa-40e7-9eae-2c33a74b33e4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:24.711531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f42398e-09aa-40e7-9eae-2c33a74b33e4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:24.711968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9f42398e-09aa-40e7-9eae-2c33a74b33e4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:24.841566 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9f42398e-09aa-40e7-9eae-2c33a74b33e4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:24.850826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9f42398e-09aa-40e7-9eae-2c33a74b33e4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:24.852378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9f42398e-09aa-40e7-9eae-2c33a74b33e4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:24.853555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9f42398e-09aa-40e7-9eae-2c33a74b33e4 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.155206 Aug 18 22:16:24.854178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1831/3664] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:24 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:25.235517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c1286ea4-3982-47cc-a480-30dd0b958da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:25.236135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c1286ea4-3982-47cc-a480-30dd0b958da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:25.242632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1286ea4-3982-47cc-a480-30dd0b958da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:25.243112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1286ea4-3982-47cc-a480-30dd0b958da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:25.243555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1286ea4-3982-47cc-a480-30dd0b958da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:25.244243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1286ea4-3982-47cc-a480-30dd0b958da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:25.244698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1286ea4-3982-47cc-a480-30dd0b958da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:25.245131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1286ea4-3982-47cc-a480-30dd0b958da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:25.372194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c1286ea4-3982-47cc-a480-30dd0b958da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:25.380912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c1286ea4-3982-47cc-a480-30dd0b958da0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149766 Aug 18 22:16:25.381483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1834/3665] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:25 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:25.399832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9bd15106-c88d-4518-bcde-21f3830a3d20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:25.400449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9bd15106-c88d-4518-bcde-21f3830a3d20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:25.407827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd15106-c88d-4518-bcde-21f3830a3d20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:25.408308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd15106-c88d-4518-bcde-21f3830a3d20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:25.408742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd15106-c88d-4518-bcde-21f3830a3d20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:25.409428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd15106-c88d-4518-bcde-21f3830a3d20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:25.409905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd15106-c88d-4518-bcde-21f3830a3d20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:25.410329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd15106-c88d-4518-bcde-21f3830a3d20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:25.496258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c9820b0c-926c-4c54-a717-a05cfc6123fc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:25.496872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c9820b0c-926c-4c54-a717-a05cfc6123fc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:25.503562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9820b0c-926c-4c54-a717-a05cfc6123fc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:25.504050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9820b0c-926c-4c54-a717-a05cfc6123fc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:25.504491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9820b0c-926c-4c54-a717-a05cfc6123fc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:25.505189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9820b0c-926c-4c54-a717-a05cfc6123fc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:25.505667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9820b0c-926c-4c54-a717-a05cfc6123fc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:25.506098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c9820b0c-926c-4c54-a717-a05cfc6123fc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:25.543285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9bd15106-c88d-4518-bcde-21f3830a3d20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:25.552419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9bd15106-c88d-4518-bcde-21f3830a3d20 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156351 Aug 18 22:16:25.553004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1832/3666] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:25 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:25.585430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bd7a0ba8-96ee-4fd0-b844-969316328ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:25.586085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bd7a0ba8-96ee-4fd0-b844-969316328ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:25.592793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd7a0ba8-96ee-4fd0-b844-969316328ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:25.593316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd7a0ba8-96ee-4fd0-b844-969316328ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:25.593763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd7a0ba8-96ee-4fd0-b844-969316328ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:25.594466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd7a0ba8-96ee-4fd0-b844-969316328ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:25.594923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd7a0ba8-96ee-4fd0-b844-969316328ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:25.595351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bd7a0ba8-96ee-4fd0-b844-969316328ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:25.640308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c9820b0c-926c-4c54-a717-a05cfc6123fc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:25.648503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c9820b0c-926c-4c54-a717-a05cfc6123fc tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156126 Aug 18 22:16:25.649158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1835/3667] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:25 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:25.725369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bd7a0ba8-96ee-4fd0-b844-969316328ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:25.734146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bd7a0ba8-96ee-4fd0-b844-969316328ad1 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152562 Aug 18 22:16:25.734717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1833/3668] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:25 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:25.875788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5db2c42e-ff50-4bb3-99b1-fd2b7c2a39c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:25.876395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5db2c42e-ff50-4bb3-99b1-fd2b7c2a39c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:25.882293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5db2c42e-ff50-4bb3-99b1-fd2b7c2a39c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:25.882767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5db2c42e-ff50-4bb3-99b1-fd2b7c2a39c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:25.883197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5db2c42e-ff50-4bb3-99b1-fd2b7c2a39c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:25.883873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5db2c42e-ff50-4bb3-99b1-fd2b7c2a39c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:25.884324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5db2c42e-ff50-4bb3-99b1-fd2b7c2a39c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:25.884746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5db2c42e-ff50-4bb3-99b1-fd2b7c2a39c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:26.013556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5db2c42e-ff50-4bb3-99b1-fd2b7c2a39c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:26.022544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5db2c42e-ff50-4bb3-99b1-fd2b7c2a39c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:26.024047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5db2c42e-ff50-4bb3-99b1-fd2b7c2a39c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:26.025241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5db2c42e-ff50-4bb3-99b1-fd2b7c2a39c5 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153402 Aug 18 22:16:26.025825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1836/3669] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:25 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:16:26.402212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-01d97544-8793-44a9-b1a5-132dfc7859bb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:26.402822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-01d97544-8793-44a9-b1a5-132dfc7859bb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:26.409627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01d97544-8793-44a9-b1a5-132dfc7859bb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:26.410119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01d97544-8793-44a9-b1a5-132dfc7859bb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:26.410588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01d97544-8793-44a9-b1a5-132dfc7859bb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:26.411281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01d97544-8793-44a9-b1a5-132dfc7859bb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:26.411731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01d97544-8793-44a9-b1a5-132dfc7859bb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:26.412180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01d97544-8793-44a9-b1a5-132dfc7859bb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:26.573802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64e80f33-cca3-45f1-8b7a-391ef2ead8eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:26.574587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64e80f33-cca3-45f1-8b7a-391ef2ead8eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:26.582928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64e80f33-cca3-45f1-8b7a-391ef2ead8eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:26.583427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64e80f33-cca3-45f1-8b7a-391ef2ead8eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:26.583902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64e80f33-cca3-45f1-8b7a-391ef2ead8eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:26.584657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64e80f33-cca3-45f1-8b7a-391ef2ead8eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:26.585117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64e80f33-cca3-45f1-8b7a-391ef2ead8eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:26.585551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64e80f33-cca3-45f1-8b7a-391ef2ead8eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:26.588555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:26.727614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-64e80f33-cca3-45f1-8b7a-391ef2ead8eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:26.736681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64e80f33-cca3-45f1-8b7a-391ef2ead8eb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.166703 Aug 18 22:16:26.737268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1837/3670] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:26 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:26.742139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-36f6f87e-2772-404d-9520-09f1d05ba59f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:26.742758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-36f6f87e-2772-404d-9520-09f1d05ba59f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:26.750103 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36f6f87e-2772-404d-9520-09f1d05ba59f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:26.750602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36f6f87e-2772-404d-9520-09f1d05ba59f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:26.751288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36f6f87e-2772-404d-9520-09f1d05ba59f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:26.751999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36f6f87e-2772-404d-9520-09f1d05ba59f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:26.752458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36f6f87e-2772-404d-9520-09f1d05ba59f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:26.752890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36f6f87e-2772-404d-9520-09f1d05ba59f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:26.786926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-01d97544-8793-44a9-b1a5-132dfc7859bb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:26.795753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-01d97544-8793-44a9-b1a5-132dfc7859bb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.397421 Aug 18 22:16:26.796347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1834/3671] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:26 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:26.801071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4a864fb2-4996-4038-8c3a-b2d54c3275c3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:26.801984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4a864fb2-4996-4038-8c3a-b2d54c3275c3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:26.808431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a864fb2-4996-4038-8c3a-b2d54c3275c3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:26.808930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a864fb2-4996-4038-8c3a-b2d54c3275c3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:26.809382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a864fb2-4996-4038-8c3a-b2d54c3275c3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:26.810651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a864fb2-4996-4038-8c3a-b2d54c3275c3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:26.811114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a864fb2-4996-4038-8c3a-b2d54c3275c3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:26.811546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a864fb2-4996-4038-8c3a-b2d54c3275c3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:26.894752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-36f6f87e-2772-404d-9520-09f1d05ba59f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:26.903058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-36f6f87e-2772-404d-9520-09f1d05ba59f tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.164595 Aug 18 22:16:26.903691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1838/3672] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:26 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:26.941912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4a864fb2-4996-4038-8c3a-b2d54c3275c3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:26.944081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:26.951588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4a864fb2-4996-4038-8c3a-b2d54c3275c3 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.154269 Aug 18 22:16:26.952168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1835/3673] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:26 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:27.050328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0926bd42-87c7-4e34-92c2-01d2bf713d8e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:27.050947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0926bd42-87c7-4e34-92c2-01d2bf713d8e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:27.057166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0926bd42-87c7-4e34-92c2-01d2bf713d8e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:27.057688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0926bd42-87c7-4e34-92c2-01d2bf713d8e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:27.058133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0926bd42-87c7-4e34-92c2-01d2bf713d8e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:27.058833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0926bd42-87c7-4e34-92c2-01d2bf713d8e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:27.059635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0926bd42-87c7-4e34-92c2-01d2bf713d8e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:27.059891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0926bd42-87c7-4e34-92c2-01d2bf713d8e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:27.195218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0926bd42-87c7-4e34-92c2-01d2bf713d8e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:27.204326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0926bd42-87c7-4e34-92c2-01d2bf713d8e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:27.205946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0926bd42-87c7-4e34-92c2-01d2bf713d8e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:27.207110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0926bd42-87c7-4e34-92c2-01d2bf713d8e tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.160634 Aug 18 22:16:27.207687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1839/3674] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:27 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:27.759680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-202c9ca4-08a4-499b-92e3-c1d153199ac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:27.760354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-202c9ca4-08a4-499b-92e3-c1d153199ac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:27.767059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-202c9ca4-08a4-499b-92e3-c1d153199ac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:27.767545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-202c9ca4-08a4-499b-92e3-c1d153199ac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:27.767988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-202c9ca4-08a4-499b-92e3-c1d153199ac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:27.768690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-202c9ca4-08a4-499b-92e3-c1d153199ac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:27.769139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-202c9ca4-08a4-499b-92e3-c1d153199ac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:27.769738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-202c9ca4-08a4-499b-92e3-c1d153199ac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:27.824046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-975ba369-5309-4b10-b3af-68a46a8195aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:27.824652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-975ba369-5309-4b10-b3af-68a46a8195aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:27.832509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-975ba369-5309-4b10-b3af-68a46a8195aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:27.833211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-975ba369-5309-4b10-b3af-68a46a8195aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:27.833931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-975ba369-5309-4b10-b3af-68a46a8195aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:27.834743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-975ba369-5309-4b10-b3af-68a46a8195aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:27.835295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-975ba369-5309-4b10-b3af-68a46a8195aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:27.835826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-975ba369-5309-4b10-b3af-68a46a8195aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:27.902819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-202c9ca4-08a4-499b-92e3-c1d153199ac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:27.910937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-202c9ca4-08a4-499b-92e3-c1d153199ac0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155135 Aug 18 22:16:27.911517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1836/3675] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:27 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:27.966656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-975ba369-5309-4b10-b3af-68a46a8195aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:27.971967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6dc51f5e-f465-4c11-87ae-518335086077 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:27.972527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6dc51f5e-f465-4c11-87ae-518335086077 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:27.975224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-975ba369-5309-4b10-b3af-68a46a8195aa tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155207 Aug 18 22:16:27.975808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1840/3676] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:27.978770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dc51f5e-f465-4c11-87ae-518335086077 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:27.979364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dc51f5e-f465-4c11-87ae-518335086077 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:27.979900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dc51f5e-f465-4c11-87ae-518335086077 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:27.980554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-13946afd-d88c-43bf-839f-e0c0b8da89b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:27.980878 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dc51f5e-f465-4c11-87ae-518335086077 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:27.981436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dc51f5e-f465-4c11-87ae-518335086077 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:27.982067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dc51f5e-f465-4c11-87ae-518335086077 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:27.982191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-13946afd-d88c-43bf-839f-e0c0b8da89b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:27.988001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13946afd-d88c-43bf-839f-e0c0b8da89b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:27.988479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13946afd-d88c-43bf-839f-e0c0b8da89b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:27.988905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13946afd-d88c-43bf-839f-e0c0b8da89b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:27.989650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13946afd-d88c-43bf-839f-e0c0b8da89b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:27.990095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13946afd-d88c-43bf-839f-e0c0b8da89b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:27.990515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13946afd-d88c-43bf-839f-e0c0b8da89b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:28.120505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6dc51f5e-f465-4c11-87ae-518335086077 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:28.125512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-13946afd-d88c-43bf-839f-e0c0b8da89b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:28.129514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6dc51f5e-f465-4c11-87ae-518335086077 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.209003 Aug 18 22:16:28.130133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1837/3677] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:27 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:28.133785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-13946afd-d88c-43bf-839f-e0c0b8da89b7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.156983 Aug 18 22:16:28.134348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1841/3678] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:27 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:28.230868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-70ffcf9e-fb29-4066-9360-1509226e3a39 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:28.231406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-70ffcf9e-fb29-4066-9360-1509226e3a39 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:28.237870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70ffcf9e-fb29-4066-9360-1509226e3a39 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:28.238356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70ffcf9e-fb29-4066-9360-1509226e3a39 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:28.238826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70ffcf9e-fb29-4066-9360-1509226e3a39 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:28.239526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70ffcf9e-fb29-4066-9360-1509226e3a39 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:28.239985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70ffcf9e-fb29-4066-9360-1509226e3a39 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:28.240418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70ffcf9e-fb29-4066-9360-1509226e3a39 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:28.366915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-70ffcf9e-fb29-4066-9360-1509226e3a39 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:28.376168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-70ffcf9e-fb29-4066-9360-1509226e3a39 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:28.377689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-70ffcf9e-fb29-4066-9360-1509226e3a39 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:28.378840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-70ffcf9e-fb29-4066-9360-1509226e3a39 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151948 Aug 18 22:16:28.379404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1838/3679] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:28 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:28.931722 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d8978378-2747-4c0e-8261-8ea7c0446b11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:28.932334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d8978378-2747-4c0e-8261-8ea7c0446b11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:28.938843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8978378-2747-4c0e-8261-8ea7c0446b11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:28.939324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8978378-2747-4c0e-8261-8ea7c0446b11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:28.939762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8978378-2747-4c0e-8261-8ea7c0446b11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:28.940447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8978378-2747-4c0e-8261-8ea7c0446b11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:28.940900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8978378-2747-4c0e-8261-8ea7c0446b11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:28.941346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d8978378-2747-4c0e-8261-8ea7c0446b11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:28.996290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bfaad322-23d6-4d4e-b735-995bfd75725a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:28.996849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bfaad322-23d6-4d4e-b735-995bfd75725a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:29.003322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfaad322-23d6-4d4e-b735-995bfd75725a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:29.003812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfaad322-23d6-4d4e-b735-995bfd75725a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:29.004258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfaad322-23d6-4d4e-b735-995bfd75725a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:29.004968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfaad322-23d6-4d4e-b735-995bfd75725a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:29.005434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfaad322-23d6-4d4e-b735-995bfd75725a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:29.005956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bfaad322-23d6-4d4e-b735-995bfd75725a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:29.074904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d8978378-2747-4c0e-8261-8ea7c0446b11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:29.083659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d8978378-2747-4c0e-8261-8ea7c0446b11 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155743 Aug 18 22:16:29.084249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1842/3680] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:28 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:29.150326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-87ecf3eb-5cd3-45d8-8ff6-e2f3bbf7183c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:29.151615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-87ecf3eb-5cd3-45d8-8ff6-e2f3bbf7183c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:29.152546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bfaad322-23d6-4d4e-b735-995bfd75725a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:29.161112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87ecf3eb-5cd3-45d8-8ff6-e2f3bbf7183c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:29.161646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87ecf3eb-5cd3-45d8-8ff6-e2f3bbf7183c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:29.162133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87ecf3eb-5cd3-45d8-8ff6-e2f3bbf7183c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:29.162653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bfaad322-23d6-4d4e-b735-995bfd75725a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.170115 Aug 18 22:16:29.162854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87ecf3eb-5cd3-45d8-8ff6-e2f3bbf7183c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:29.163600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87ecf3eb-5cd3-45d8-8ff6-e2f3bbf7183c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:29.163809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1839/3681] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:28 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:29.164175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-87ecf3eb-5cd3-45d8-8ff6-e2f3bbf7183c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:29.168625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9755b939-3216-4c42-ac9b-d091c95fd79f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:29.169617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9755b939-3216-4c42-ac9b-d091c95fd79f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:29.175719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9755b939-3216-4c42-ac9b-d091c95fd79f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:29.176300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9755b939-3216-4c42-ac9b-d091c95fd79f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:29.177114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9755b939-3216-4c42-ac9b-d091c95fd79f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:29.177941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9755b939-3216-4c42-ac9b-d091c95fd79f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:29.178489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9755b939-3216-4c42-ac9b-d091c95fd79f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:29.179022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9755b939-3216-4c42-ac9b-d091c95fd79f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:29.308903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9755b939-3216-4c42-ac9b-d091c95fd79f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:29.310263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-87ecf3eb-5cd3-45d8-8ff6-e2f3bbf7183c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:29.317717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9755b939-3216-4c42-ac9b-d091c95fd79f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152578 Aug 18 22:16:29.318283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1840/3682] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:29 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:29.318538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-87ecf3eb-5cd3-45d8-8ff6-e2f3bbf7183c tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.172493 Aug 18 22:16:29.319373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1843/3683] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:29 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:29.402222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-15653251-013f-43e1-906a-a1ed003f254b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:29.402840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-15653251-013f-43e1-906a-a1ed003f254b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:29.408798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15653251-013f-43e1-906a-a1ed003f254b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:29.409287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15653251-013f-43e1-906a-a1ed003f254b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:29.409764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15653251-013f-43e1-906a-a1ed003f254b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:29.410463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15653251-013f-43e1-906a-a1ed003f254b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:29.410927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15653251-013f-43e1-906a-a1ed003f254b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:29.411361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-15653251-013f-43e1-906a-a1ed003f254b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:29.541313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-15653251-013f-43e1-906a-a1ed003f254b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:29.550222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-15653251-013f-43e1-906a-a1ed003f254b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:29.551986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-15653251-013f-43e1-906a-a1ed003f254b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:29.553137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-15653251-013f-43e1-906a-a1ed003f254b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154842 Aug 18 22:16:29.553721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1841/3684] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:29 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:30.165408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1252d9cd-026e-4757-9f03-ad9bbc182663 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:30.166064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1252d9cd-026e-4757-9f03-ad9bbc182663 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:30.173167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1252d9cd-026e-4757-9f03-ad9bbc182663 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:30.173690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1252d9cd-026e-4757-9f03-ad9bbc182663 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:30.174139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1252d9cd-026e-4757-9f03-ad9bbc182663 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:30.174842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1252d9cd-026e-4757-9f03-ad9bbc182663 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:30.175305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1252d9cd-026e-4757-9f03-ad9bbc182663 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:30.175738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1252d9cd-026e-4757-9f03-ad9bbc182663 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:30.184165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4f632975-f5f1-4b47-bc9f-a2558c3cf410 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:30.184866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4f632975-f5f1-4b47-bc9f-a2558c3cf410 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:30.192974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f632975-f5f1-4b47-bc9f-a2558c3cf410 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:30.193493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f632975-f5f1-4b47-bc9f-a2558c3cf410 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:30.194296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f632975-f5f1-4b47-bc9f-a2558c3cf410 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:30.194658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f632975-f5f1-4b47-bc9f-a2558c3cf410 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:30.195111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f632975-f5f1-4b47-bc9f-a2558c3cf410 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:30.195547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4f632975-f5f1-4b47-bc9f-a2558c3cf410 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:30.313161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1252d9cd-026e-4757-9f03-ad9bbc182663 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:30.321431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1252d9cd-026e-4757-9f03-ad9bbc182663 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159986 Aug 18 22:16:30.322045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1844/3685] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:30 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:30.327884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4f632975-f5f1-4b47-bc9f-a2558c3cf410 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:30.328153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6d648a54-a6a9-4c50-9619-1a52a90574cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:30.328861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6d648a54-a6a9-4c50-9619-1a52a90574cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:30.335618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d648a54-a6a9-4c50-9619-1a52a90574cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:30.336112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d648a54-a6a9-4c50-9619-1a52a90574cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:30.336553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d648a54-a6a9-4c50-9619-1a52a90574cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:30.337260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d648a54-a6a9-4c50-9619-1a52a90574cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:30.337752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d648a54-a6a9-4c50-9619-1a52a90574cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:30.338188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d648a54-a6a9-4c50-9619-1a52a90574cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:30.339012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4f632975-f5f1-4b47-bc9f-a2558c3cf410 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.158255 Aug 18 22:16:30.339264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1842/3686] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:30 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:30.344477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1bdc1bf0-d79b-482d-81ec-fc7725795496 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:30.345090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1bdc1bf0-d79b-482d-81ec-fc7725795496 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:30.350807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bdc1bf0-d79b-482d-81ec-fc7725795496 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:30.351290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bdc1bf0-d79b-482d-81ec-fc7725795496 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:30.351729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bdc1bf0-d79b-482d-81ec-fc7725795496 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:30.352423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bdc1bf0-d79b-482d-81ec-fc7725795496 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:30.352881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bdc1bf0-d79b-482d-81ec-fc7725795496 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:30.353312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1bdc1bf0-d79b-482d-81ec-fc7725795496 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:30.364783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6d648a54-a6a9-4c50-9619-1a52a90574cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:16:30.425888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6d648a54-a6a9-4c50-9619-1a52a90574cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [f4618efa-9011-4c4d-86c1-3d593c4ef3c9] AMQP server on 10.222.0.82:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 22:16:30.491305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1bdc1bf0-d79b-482d-81ec-fc7725795496 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:30.499518 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1bdc1bf0-d79b-482d-81ec-fc7725795496 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.159210 Aug 18 22:16:30.500105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1843/3687] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:30 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:30.504587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5d057415-6b35-4349-ac02-85548196a429 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:30.505192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5d057415-6b35-4349-ac02-85548196a429 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:30.510825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d057415-6b35-4349-ac02-85548196a429 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:30.511303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d057415-6b35-4349-ac02-85548196a429 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:30.511735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d057415-6b35-4349-ac02-85548196a429 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:30.512417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d057415-6b35-4349-ac02-85548196a429 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:30.513410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d057415-6b35-4349-ac02-85548196a429 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:30.514302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d057415-6b35-4349-ac02-85548196a429 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:30.642592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5d057415-6b35-4349-ac02-85548196a429 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:30.650782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5d057415-6b35-4349-ac02-85548196a429 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.149754 Aug 18 22:16:30.651377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1844/3688] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:30 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:30.656477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8b18247d-18e6-42e5-8dcc-0439f2234874 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:30.657089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8b18247d-18e6-42e5-8dcc-0439f2234874 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:30.662810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b18247d-18e6-42e5-8dcc-0439f2234874 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:30.663295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b18247d-18e6-42e5-8dcc-0439f2234874 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:30.663735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b18247d-18e6-42e5-8dcc-0439f2234874 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:30.664419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b18247d-18e6-42e5-8dcc-0439f2234874 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:30.664880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b18247d-18e6-42e5-8dcc-0439f2234874 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:30.665303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8b18247d-18e6-42e5-8dcc-0439f2234874 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:30.792510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8b18247d-18e6-42e5-8dcc-0439f2234874 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:30.801230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8b18247d-18e6-42e5-8dcc-0439f2234874 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:30.803037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8b18247d-18e6-42e5-8dcc-0439f2234874 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:30.804202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8b18247d-18e6-42e5-8dcc-0439f2234874 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151928 Aug 18 22:16:30.804770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1845/3689] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:30 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:31.342710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5bfeecb8-2224-4906-aa9c-b92922e178f5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:31.343387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5bfeecb8-2224-4906-aa9c-b92922e178f5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:31.349722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bfeecb8-2224-4906-aa9c-b92922e178f5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:31.350200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bfeecb8-2224-4906-aa9c-b92922e178f5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:31.350637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bfeecb8-2224-4906-aa9c-b92922e178f5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:31.351321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bfeecb8-2224-4906-aa9c-b92922e178f5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:31.351776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bfeecb8-2224-4906-aa9c-b92922e178f5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:31.352198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5bfeecb8-2224-4906-aa9c-b92922e178f5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:31.433125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [None req-6d648a54-a6a9-4c50-9619-1a52a90574cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [f4618efa-9011-4c4d-86c1-3d593c4ef3c9] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 57698. Aug 18 22:16:31.459744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6d648a54-a6a9-4c50-9619-1a52a90574cf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "DELETE /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 204 len: 0 microversion: 2.1 time: 1.136585 Aug 18 22:16:31.460612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1845/3690] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:16:30 2022] DELETE /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 0 bytes in 1138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:16:31.466265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5a5bba5e-7004-4482-a0fb-d105ed8f0a93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:31.466968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5a5bba5e-7004-4482-a0fb-d105ed8f0a93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:31.473125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a5bba5e-7004-4482-a0fb-d105ed8f0a93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:31.473622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a5bba5e-7004-4482-a0fb-d105ed8f0a93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:31.474065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a5bba5e-7004-4482-a0fb-d105ed8f0a93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:31.474743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a5bba5e-7004-4482-a0fb-d105ed8f0a93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:31.475203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a5bba5e-7004-4482-a0fb-d105ed8f0a93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:31.475616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5a5bba5e-7004-4482-a0fb-d105ed8f0a93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:31.490986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5bfeecb8-2224-4906-aa9c-b92922e178f5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:31.500218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5bfeecb8-2224-4906-aa9c-b92922e178f5 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.161338 Aug 18 22:16:31.500805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1846/3691] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:31.514203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-48e9b0c4-3f21-4fce-875a-b199374a3053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:31.514203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-48e9b0c4-3f21-4fce-875a-b199374a3053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:31.514203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:31.514203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48e9b0c4-3f21-4fce-875a-b199374a3053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:31.514678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48e9b0c4-3f21-4fce-875a-b199374a3053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:31.514795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48e9b0c4-3f21-4fce-875a-b199374a3053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:31.515533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48e9b0c4-3f21-4fce-875a-b199374a3053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:31.516121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48e9b0c4-3f21-4fce-875a-b199374a3053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:31.516545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48e9b0c4-3f21-4fce-875a-b199374a3053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:31.609190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5a5bba5e-7004-4482-a0fb-d105ed8f0a93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:31.617451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5a5bba5e-7004-4482-a0fb-d105ed8f0a93 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155716 Aug 18 22:16:31.618066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1846/3692] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:31 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:31.647431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-48e9b0c4-3f21-4fce-875a-b199374a3053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:31.656667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-48e9b0c4-3f21-4fce-875a-b199374a3053 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1720 microversion: 2.1 time: 0.154906 Aug 18 22:16:31.657433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1847/3693] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:31.672731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a1741121-001e-4efa-a5ff-8cbfa800557b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:31.673351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a1741121-001e-4efa-a5ff-8cbfa800557b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:31.679683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1741121-001e-4efa-a5ff-8cbfa800557b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:31.680167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1741121-001e-4efa-a5ff-8cbfa800557b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:31.680606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1741121-001e-4efa-a5ff-8cbfa800557b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:31.681297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1741121-001e-4efa-a5ff-8cbfa800557b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:31.681781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1741121-001e-4efa-a5ff-8cbfa800557b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:31.682218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a1741121-001e-4efa-a5ff-8cbfa800557b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:31.746972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-14f8ef2a-f077-431e-8927-bbd74d088270 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:31.747736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-14f8ef2a-f077-431e-8927-bbd74d088270 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:31.753858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14f8ef2a-f077-431e-8927-bbd74d088270 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:31.754351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14f8ef2a-f077-431e-8927-bbd74d088270 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:31.754794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14f8ef2a-f077-431e-8927-bbd74d088270 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:31.755504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14f8ef2a-f077-431e-8927-bbd74d088270 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:31.755962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14f8ef2a-f077-431e-8927-bbd74d088270 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:31.756393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14f8ef2a-f077-431e-8927-bbd74d088270 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:31.822735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a1741121-001e-4efa-a5ff-8cbfa800557b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:31.831965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a1741121-001e-4efa-a5ff-8cbfa800557b tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.163510 Aug 18 22:16:31.832568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1848/3694] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:31 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:31.837800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-56cb63f8-e5e2-4321-8088-1cdb645a4374 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:31.838418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-56cb63f8-e5e2-4321-8088-1cdb645a4374 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:31.850972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56cb63f8-e5e2-4321-8088-1cdb645a4374 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:31.851459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56cb63f8-e5e2-4321-8088-1cdb645a4374 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:31.851895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56cb63f8-e5e2-4321-8088-1cdb645a4374 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:31.852630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56cb63f8-e5e2-4321-8088-1cdb645a4374 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:31.853033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56cb63f8-e5e2-4321-8088-1cdb645a4374 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:31.854115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-56cb63f8-e5e2-4321-8088-1cdb645a4374 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:31.893477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-14f8ef2a-f077-431e-8927-bbd74d088270 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:31.902093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-14f8ef2a-f077-431e-8927-bbd74d088270 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.282959 Aug 18 22:16:31.902771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1847/3695] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:31 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:31.983632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-56cb63f8-e5e2-4321-8088-1cdb645a4374 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:31.992161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-56cb63f8-e5e2-4321-8088-1cdb645a4374 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:31.993671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-56cb63f8-e5e2-4321-8088-1cdb645a4374 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:31.994814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-56cb63f8-e5e2-4321-8088-1cdb645a4374 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.160589 Aug 18 22:16:31.995385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1849/3696] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:31 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:32.521537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c73ed5dd-6184-44ca-9fc5-08b866c869b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:32.522406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c73ed5dd-6184-44ca-9fc5-08b866c869b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:32.529279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c73ed5dd-6184-44ca-9fc5-08b866c869b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:32.529722 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c73ed5dd-6184-44ca-9fc5-08b866c869b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:32.530166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c73ed5dd-6184-44ca-9fc5-08b866c869b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:32.530901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c73ed5dd-6184-44ca-9fc5-08b866c869b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:32.531322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c73ed5dd-6184-44ca-9fc5-08b866c869b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:32.531764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c73ed5dd-6184-44ca-9fc5-08b866c869b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:32.643670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bc26e0e4-ed56-49e0-9deb-707a13e1b7e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:32.645312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bc26e0e4-ed56-49e0-9deb-707a13e1b7e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:32.652123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc26e0e4-ed56-49e0-9deb-707a13e1b7e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:32.652856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc26e0e4-ed56-49e0-9deb-707a13e1b7e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:32.653314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc26e0e4-ed56-49e0-9deb-707a13e1b7e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:32.654038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc26e0e4-ed56-49e0-9deb-707a13e1b7e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:32.654507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc26e0e4-ed56-49e0-9deb-707a13e1b7e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:32.654929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc26e0e4-ed56-49e0-9deb-707a13e1b7e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:32.675088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c73ed5dd-6184-44ca-9fc5-08b866c869b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:32.687212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c73ed5dd-6184-44ca-9fc5-08b866c869b1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.169636 Aug 18 22:16:32.702770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1848/3697] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:32 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:32.708091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-47b9c91e-40c6-44e3-9273-c2492a1876ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:32.708726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-47b9c91e-40c6-44e3-9273-c2492a1876ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:32.716271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47b9c91e-40c6-44e3-9273-c2492a1876ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:32.716767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47b9c91e-40c6-44e3-9273-c2492a1876ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:32.717209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47b9c91e-40c6-44e3-9273-c2492a1876ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:32.717945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47b9c91e-40c6-44e3-9273-c2492a1876ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:32.718398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47b9c91e-40c6-44e3-9273-c2492a1876ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:32.718818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-47b9c91e-40c6-44e3-9273-c2492a1876ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:32.782994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-47b9c91e-40c6-44e3-9273-c2492a1876ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:32.791286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-47b9c91e-40c6-44e3-9273-c2492a1876ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1652 microversion: 2.1 time: 0.087097 Aug 18 22:16:32.791865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1849/3698] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1652 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:32.862372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-55860f79-47b4-4c86-8cd7-cc1879740442 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:32.862982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-55860f79-47b4-4c86-8cd7-cc1879740442 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:32.869031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55860f79-47b4-4c86-8cd7-cc1879740442 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:32.869389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55860f79-47b4-4c86-8cd7-cc1879740442 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:32.869868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55860f79-47b4-4c86-8cd7-cc1879740442 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:32.870570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55860f79-47b4-4c86-8cd7-cc1879740442 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:32.871010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55860f79-47b4-4c86-8cd7-cc1879740442 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:32.871436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55860f79-47b4-4c86-8cd7-cc1879740442 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:32.873072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bc26e0e4-ed56-49e0-9deb-707a13e1b7e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:32.881575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bc26e0e4-ed56-49e0-9deb-707a13e1b7e9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.244789 Aug 18 22:16:32.893687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1850/3699] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:32 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:32.924628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dfa34a0d-eb9f-4cd6-8561-89d5d26febb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:32.925251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dfa34a0d-eb9f-4cd6-8561-89d5d26febb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:32.932479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfa34a0d-eb9f-4cd6-8561-89d5d26febb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:32.932479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfa34a0d-eb9f-4cd6-8561-89d5d26febb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:32.932686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfa34a0d-eb9f-4cd6-8561-89d5d26febb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:32.933394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfa34a0d-eb9f-4cd6-8561-89d5d26febb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:32.933885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfa34a0d-eb9f-4cd6-8561-89d5d26febb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:32.934306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfa34a0d-eb9f-4cd6-8561-89d5d26febb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:33.030915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-55860f79-47b4-4c86-8cd7-cc1879740442 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:33.041569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-55860f79-47b4-4c86-8cd7-cc1879740442 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.182765 Aug 18 22:16:33.047079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1850/3700] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:32 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:33.141517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-bdab16fe-0b9d-4579-9044-f97c6624b2ca req-12cf6fb3-7987-4175-b7e5-79a01ca0e5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3851c11-f4ba-40cd-946e-d113ddb6e3b3", "name": "network-vif-deleted", "tag": "09c93341-0714-48fb-b589-3f3fe222c0a8"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:16:33.148178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dfa34a0d-eb9f-4cd6-8561-89d5d26febb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:33.154435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-bdab16fe-0b9d-4579-9044-f97c6624b2ca req-12cf6fb3-7987-4175-b7e5-79a01ca0e5dc service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:33.154930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-bdab16fe-0b9d-4579-9044-f97c6624b2ca req-12cf6fb3-7987-4175-b7e5-79a01ca0e5dc service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:33.155364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-bdab16fe-0b9d-4579-9044-f97c6624b2ca req-12cf6fb3-7987-4175-b7e5-79a01ca0e5dc service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:33.158864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dfa34a0d-eb9f-4cd6-8561-89d5d26febb0 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.238443 Aug 18 22:16:33.173917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1851/3701] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:32 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:33.173917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b35c3546-22bd-4c17-b600-104d10293e51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:33.173917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b35c3546-22bd-4c17-b600-104d10293e51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:33.174357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-bdab16fe-0b9d-4579-9044-f97c6624b2ca req-12cf6fb3-7987-4175-b7e5-79a01ca0e5dc service nova] Creating event network-vif-deleted:09c93341-0714-48fb-b589-3f3fe222c0a8 for instance b3851c11-f4ba-40cd-946e-d113ddb6e3b3 on hv-cinder-85367 Aug 18 22:16:33.174480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b35c3546-22bd-4c17-b600-104d10293e51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:33.174480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b35c3546-22bd-4c17-b600-104d10293e51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:33.174480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b35c3546-22bd-4c17-b600-104d10293e51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:33.176260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b35c3546-22bd-4c17-b600-104d10293e51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:33.177070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b35c3546-22bd-4c17-b600-104d10293e51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:33.177312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-bdab16fe-0b9d-4579-9044-f97c6624b2ca req-12cf6fb3-7987-4175-b7e5-79a01ca0e5dc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128427 Aug 18 22:16:33.177677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b35c3546-22bd-4c17-b600-104d10293e51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:33.178337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1851/3702] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:16:33.198273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:33.316018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b35c3546-22bd-4c17-b600-104d10293e51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:33.325075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b35c3546-22bd-4c17-b600-104d10293e51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:33.326615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b35c3546-22bd-4c17-b600-104d10293e51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:33.327773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b35c3546-22bd-4c17-b600-104d10293e51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.167122 Aug 18 22:16:33.328595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1852/3703] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:33 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:33.713484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dbec0cc0-e3ed-41e3-a8c5-f111b8e04982 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:33.714237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dbec0cc0-e3ed-41e3-a8c5-f111b8e04982 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:33.721516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbec0cc0-e3ed-41e3-a8c5-f111b8e04982 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:33.722053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbec0cc0-e3ed-41e3-a8c5-f111b8e04982 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:33.722494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbec0cc0-e3ed-41e3-a8c5-f111b8e04982 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:33.723307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbec0cc0-e3ed-41e3-a8c5-f111b8e04982 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:33.723896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbec0cc0-e3ed-41e3-a8c5-f111b8e04982 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:33.724335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dbec0cc0-e3ed-41e3-a8c5-f111b8e04982 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:33.814763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ffe9ad31-8ba8-412c-b749-174ddb14b2f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:33.816011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ffe9ad31-8ba8-412c-b749-174ddb14b2f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:33.822634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe9ad31-8ba8-412c-b749-174ddb14b2f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:33.823122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe9ad31-8ba8-412c-b749-174ddb14b2f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:33.823557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe9ad31-8ba8-412c-b749-174ddb14b2f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:33.824702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe9ad31-8ba8-412c-b749-174ddb14b2f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:33.825219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe9ad31-8ba8-412c-b749-174ddb14b2f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:33.826575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffe9ad31-8ba8-412c-b749-174ddb14b2f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:33.863381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dbec0cc0-e3ed-41e3-a8c5-f111b8e04982 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:33.865855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:33.876016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dbec0cc0-e3ed-41e3-a8c5-f111b8e04982 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.167281 Aug 18 22:16:33.876646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1852/3704] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:33.894487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ffe9ad31-8ba8-412c-b749-174ddb14b2f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:33.903178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f75774e7-588a-4073-b158-ccf45a7d78e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:33.903372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ffe9ad31-8ba8-412c-b749-174ddb14b2f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.092660 Aug 18 22:16:33.903804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f75774e7-588a-4073-b158-ccf45a7d78e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:33.904054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1853/3705] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:33.917932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f75774e7-588a-4073-b158-ccf45a7d78e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:33.918725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f75774e7-588a-4073-b158-ccf45a7d78e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:33.919190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f75774e7-588a-4073-b158-ccf45a7d78e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:33.919899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f75774e7-588a-4073-b158-ccf45a7d78e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:33.920504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f75774e7-588a-4073-b158-ccf45a7d78e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:33.920934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f75774e7-588a-4073-b158-ccf45a7d78e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:34.053301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f75774e7-588a-4073-b158-ccf45a7d78e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:34.062373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f75774e7-588a-4073-b158-ccf45a7d78e8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.163001 Aug 18 22:16:34.063217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1853/3706] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:33 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:34.066115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-853b86be-12db-42bd-a757-271f6ab0d297 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:34.066762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-853b86be-12db-42bd-a757-271f6ab0d297 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:34.073439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-853b86be-12db-42bd-a757-271f6ab0d297 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:34.074060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-853b86be-12db-42bd-a757-271f6ab0d297 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:34.074421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-853b86be-12db-42bd-a757-271f6ab0d297 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:34.075124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-853b86be-12db-42bd-a757-271f6ab0d297 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:34.076214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-853b86be-12db-42bd-a757-271f6ab0d297 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:34.076856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-853b86be-12db-42bd-a757-271f6ab0d297 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:34.181706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e52a8e58-da2c-448a-b1d8-de0565eb68ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:34.182445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e52a8e58-da2c-448a-b1d8-de0565eb68ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:34.189047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e52a8e58-da2c-448a-b1d8-de0565eb68ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:34.189533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e52a8e58-da2c-448a-b1d8-de0565eb68ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:34.190001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e52a8e58-da2c-448a-b1d8-de0565eb68ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:34.190708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e52a8e58-da2c-448a-b1d8-de0565eb68ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:34.191161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e52a8e58-da2c-448a-b1d8-de0565eb68ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:34.191584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e52a8e58-da2c-448a-b1d8-de0565eb68ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:34.210671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-853b86be-12db-42bd-a757-271f6ab0d297 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:34.219118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-853b86be-12db-42bd-a757-271f6ab0d297 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.156698 Aug 18 22:16:34.219626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1854/3707] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:34 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:34.323368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e52a8e58-da2c-448a-b1d8-de0565eb68ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:34.331642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e52a8e58-da2c-448a-b1d8-de0565eb68ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153758 Aug 18 22:16:34.332215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1854/3708] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:34 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:34.350874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6052ae1b-fc6b-42a9-b2db-a761d39291e1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:34.351496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6052ae1b-fc6b-42a9-b2db-a761d39291e1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:34.358286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6052ae1b-fc6b-42a9-b2db-a761d39291e1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:34.358776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6052ae1b-fc6b-42a9-b2db-a761d39291e1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:34.359250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6052ae1b-fc6b-42a9-b2db-a761d39291e1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:34.359944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6052ae1b-fc6b-42a9-b2db-a761d39291e1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:34.360404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6052ae1b-fc6b-42a9-b2db-a761d39291e1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:34.360836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6052ae1b-fc6b-42a9-b2db-a761d39291e1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:34.485943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6052ae1b-fc6b-42a9-b2db-a761d39291e1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:34.494480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6052ae1b-fc6b-42a9-b2db-a761d39291e1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:34.496102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6052ae1b-fc6b-42a9-b2db-a761d39291e1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:34.497423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6052ae1b-fc6b-42a9-b2db-a761d39291e1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150335 Aug 18 22:16:34.498502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1855/3709] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:34 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:34.898499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ddea0b9b-f45f-4b0b-99fb-e8a24b229021 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:34.899384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ddea0b9b-f45f-4b0b-99fb-e8a24b229021 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:34.907102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ddea0b9b-f45f-4b0b-99fb-e8a24b229021 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:34.907593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ddea0b9b-f45f-4b0b-99fb-e8a24b229021 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:34.908069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ddea0b9b-f45f-4b0b-99fb-e8a24b229021 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:34.908772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ddea0b9b-f45f-4b0b-99fb-e8a24b229021 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:34.909230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ddea0b9b-f45f-4b0b-99fb-e8a24b229021 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:34.909688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ddea0b9b-f45f-4b0b-99fb-e8a24b229021 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:34.924565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-321a5d64-a23b-4b0d-9c05-bc9e91c1eecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:34.925342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-321a5d64-a23b-4b0d-9c05-bc9e91c1eecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:34.933509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-321a5d64-a23b-4b0d-9c05-bc9e91c1eecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:34.934145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-321a5d64-a23b-4b0d-9c05-bc9e91c1eecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:34.934576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-321a5d64-a23b-4b0d-9c05-bc9e91c1eecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:34.935388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-321a5d64-a23b-4b0d-9c05-bc9e91c1eecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:34.935856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-321a5d64-a23b-4b0d-9c05-bc9e91c1eecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:34.936658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-321a5d64-a23b-4b0d-9c05-bc9e91c1eecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:34.998686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-321a5d64-a23b-4b0d-9c05-bc9e91c1eecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:35.006993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-321a5d64-a23b-4b0d-9c05-bc9e91c1eecb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086423 Aug 18 22:16:35.007838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1856/3710] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:35.051235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ddea0b9b-f45f-4b0b-99fb-e8a24b229021 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:35.059715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ddea0b9b-f45f-4b0b-99fb-e8a24b229021 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.165383 Aug 18 22:16:35.060292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1855/3711] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:34 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:35.086014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-db5c4f57-3ad1-4f22-bce8-4c100ca67980 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:35.086634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-db5c4f57-3ad1-4f22-bce8-4c100ca67980 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:35.093271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db5c4f57-3ad1-4f22-bce8-4c100ca67980 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:35.093790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db5c4f57-3ad1-4f22-bce8-4c100ca67980 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:35.094236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db5c4f57-3ad1-4f22-bce8-4c100ca67980 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:35.094932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db5c4f57-3ad1-4f22-bce8-4c100ca67980 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:35.095395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db5c4f57-3ad1-4f22-bce8-4c100ca67980 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:35.095826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db5c4f57-3ad1-4f22-bce8-4c100ca67980 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:35.231616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-db5c4f57-3ad1-4f22-bce8-4c100ca67980 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:35.239936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-db5c4f57-3ad1-4f22-bce8-4c100ca67980 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.157715 Aug 18 22:16:35.240172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d4312154-6426-4cb8-a5b1-d726530cff92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:35.240513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1857/3712] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:35 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:35.240722 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d4312154-6426-4cb8-a5b1-d726530cff92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:35.246801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4312154-6426-4cb8-a5b1-d726530cff92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:35.247771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4312154-6426-4cb8-a5b1-d726530cff92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:35.248203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4312154-6426-4cb8-a5b1-d726530cff92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:35.248891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4312154-6426-4cb8-a5b1-d726530cff92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:35.249338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4312154-6426-4cb8-a5b1-d726530cff92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:35.249787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d4312154-6426-4cb8-a5b1-d726530cff92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:35.352175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8915c2c1-0d33-4c4b-a5fd-b488adfa7fcf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:35.352854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8915c2c1-0d33-4c4b-a5fd-b488adfa7fcf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:35.358865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8915c2c1-0d33-4c4b-a5fd-b488adfa7fcf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:35.359350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8915c2c1-0d33-4c4b-a5fd-b488adfa7fcf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:35.359782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8915c2c1-0d33-4c4b-a5fd-b488adfa7fcf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:35.360466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8915c2c1-0d33-4c4b-a5fd-b488adfa7fcf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:35.360918 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8915c2c1-0d33-4c4b-a5fd-b488adfa7fcf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:35.361339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8915c2c1-0d33-4c4b-a5fd-b488adfa7fcf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:35.382210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d4312154-6426-4cb8-a5b1-d726530cff92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:35.391161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d4312154-6426-4cb8-a5b1-d726530cff92 tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.154805 Aug 18 22:16:35.391755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1856/3713] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:35 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:35.488982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8915c2c1-0d33-4c4b-a5fd-b488adfa7fcf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:35.497680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8915c2c1-0d33-4c4b-a5fd-b488adfa7fcf tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.148776 Aug 18 22:16:35.498259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1858/3714] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:35 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:35.520158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dce5dac4-6fe6-47ac-a354-ebe5acc8ec70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:35.520773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dce5dac4-6fe6-47ac-a354-ebe5acc8ec70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:35.526778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dce5dac4-6fe6-47ac-a354-ebe5acc8ec70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:35.527294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dce5dac4-6fe6-47ac-a354-ebe5acc8ec70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:35.527730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dce5dac4-6fe6-47ac-a354-ebe5acc8ec70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:35.528533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dce5dac4-6fe6-47ac-a354-ebe5acc8ec70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:35.529054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dce5dac4-6fe6-47ac-a354-ebe5acc8ec70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:35.529713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dce5dac4-6fe6-47ac-a354-ebe5acc8ec70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:35.657803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dce5dac4-6fe6-47ac-a354-ebe5acc8ec70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:35.666436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dce5dac4-6fe6-47ac-a354-ebe5acc8ec70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:35.667952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dce5dac4-6fe6-47ac-a354-ebe5acc8ec70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:35.669615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dce5dac4-6fe6-47ac-a354-ebe5acc8ec70 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152840 Aug 18 22:16:35.670178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1857/3715] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:35 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:36.028804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9d18726c-4cba-438e-ac72-1dc92ca22f5c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:36.029411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9d18726c-4cba-438e-ac72-1dc92ca22f5c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:36.036105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d18726c-4cba-438e-ac72-1dc92ca22f5c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:36.036678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d18726c-4cba-438e-ac72-1dc92ca22f5c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:36.037121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d18726c-4cba-438e-ac72-1dc92ca22f5c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:36.037849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d18726c-4cba-438e-ac72-1dc92ca22f5c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:36.038339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d18726c-4cba-438e-ac72-1dc92ca22f5c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:36.038765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9d18726c-4cba-438e-ac72-1dc92ca22f5c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:36.080525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f8caff14-d6d6-4928-b0fe-c9bc1b8c7d0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:36.081138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f8caff14-d6d6-4928-b0fe-c9bc1b8c7d0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:36.087699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8caff14-d6d6-4928-b0fe-c9bc1b8c7d0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:36.088186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8caff14-d6d6-4928-b0fe-c9bc1b8c7d0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:36.088712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8caff14-d6d6-4928-b0fe-c9bc1b8c7d0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:36.089421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8caff14-d6d6-4928-b0fe-c9bc1b8c7d0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:36.089907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8caff14-d6d6-4928-b0fe-c9bc1b8c7d0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:36.090342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f8caff14-d6d6-4928-b0fe-c9bc1b8c7d0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:36.104368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9d18726c-4cba-438e-ac72-1dc92ca22f5c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:36.113036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9d18726c-4cba-438e-ac72-1dc92ca22f5c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088598 Aug 18 22:16:36.113621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1859/3716] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:36.216893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f8caff14-d6d6-4928-b0fe-c9bc1b8c7d0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:36.225145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f8caff14-d6d6-4928-b0fe-c9bc1b8c7d0b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.148765 Aug 18 22:16:36.225742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1858/3717] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:36 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:36.261469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5a699cd7-3f9b-4b43-abf5-0e69a7ee0cfe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:36.262122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5a699cd7-3f9b-4b43-abf5-0e69a7ee0cfe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:36.268128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a699cd7-3f9b-4b43-abf5-0e69a7ee0cfe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:36.268603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a699cd7-3f9b-4b43-abf5-0e69a7ee0cfe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:36.269038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a699cd7-3f9b-4b43-abf5-0e69a7ee0cfe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:36.269748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a699cd7-3f9b-4b43-abf5-0e69a7ee0cfe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:36.270200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a699cd7-3f9b-4b43-abf5-0e69a7ee0cfe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:36.270620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a699cd7-3f9b-4b43-abf5-0e69a7ee0cfe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:36.395151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5a699cd7-3f9b-4b43-abf5-0e69a7ee0cfe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:36.403388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5a699cd7-3f9b-4b43-abf5-0e69a7ee0cfe tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.145744 Aug 18 22:16:36.404446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1860/3718] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:36 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:36.412041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d2d84e5a-85b4-4da7-b095-a0ed753596ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:36.412654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d2d84e5a-85b4-4da7-b095-a0ed753596ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:36.418552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2d84e5a-85b4-4da7-b095-a0ed753596ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:36.419060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2d84e5a-85b4-4da7-b095-a0ed753596ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:36.419491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2d84e5a-85b4-4da7-b095-a0ed753596ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:36.420171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2d84e5a-85b4-4da7-b095-a0ed753596ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:36.420625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2d84e5a-85b4-4da7-b095-a0ed753596ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:36.421046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2d84e5a-85b4-4da7-b095-a0ed753596ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:36.519703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0ea585e5-e3b7-44ec-996e-c108ae35bbd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:36.520323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0ea585e5-e3b7-44ec-996e-c108ae35bbd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:36.526364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ea585e5-e3b7-44ec-996e-c108ae35bbd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:36.526863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ea585e5-e3b7-44ec-996e-c108ae35bbd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:36.527290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ea585e5-e3b7-44ec-996e-c108ae35bbd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:36.527985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ea585e5-e3b7-44ec-996e-c108ae35bbd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:36.529120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ea585e5-e3b7-44ec-996e-c108ae35bbd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:36.529498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0ea585e5-e3b7-44ec-996e-c108ae35bbd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:36.551086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d2d84e5a-85b4-4da7-b095-a0ed753596ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:36.559548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d2d84e5a-85b4-4da7-b095-a0ed753596ab tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.151314 Aug 18 22:16:36.560135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1859/3719] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:36 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:36.654224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0ea585e5-e3b7-44ec-996e-c108ae35bbd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:36.662250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0ea585e5-e3b7-44ec-996e-c108ae35bbd8 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147053 Aug 18 22:16:36.662823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1861/3720] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:36 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:36.693441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7e8861e5-681a-45be-a507-4383ee0ba9f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:36.694134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7e8861e5-681a-45be-a507-4383ee0ba9f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:36.700677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e8861e5-681a-45be-a507-4383ee0ba9f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:36.701164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e8861e5-681a-45be-a507-4383ee0ba9f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:36.701619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e8861e5-681a-45be-a507-4383ee0ba9f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:36.702320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e8861e5-681a-45be-a507-4383ee0ba9f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:36.702776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e8861e5-681a-45be-a507-4383ee0ba9f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:36.703202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e8861e5-681a-45be-a507-4383ee0ba9f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:36.831623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7e8861e5-681a-45be-a507-4383ee0ba9f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:36.840281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7e8861e5-681a-45be-a507-4383ee0ba9f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:36.841848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7e8861e5-681a-45be-a507-4383ee0ba9f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:36.842998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7e8861e5-681a-45be-a507-4383ee0ba9f3 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153469 Aug 18 22:16:36.843555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1860/3721] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:36 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:37.053265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:16:37.053865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:16:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:16:37.136074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c5ce0768-afa4-400f-9b15-1c77faba64c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:37.136682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c5ce0768-afa4-400f-9b15-1c77faba64c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:37.145212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5ce0768-afa4-400f-9b15-1c77faba64c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:37.145740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5ce0768-afa4-400f-9b15-1c77faba64c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:37.146218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5ce0768-afa4-400f-9b15-1c77faba64c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:37.146921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5ce0768-afa4-400f-9b15-1c77faba64c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:37.147407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5ce0768-afa4-400f-9b15-1c77faba64c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:37.147837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c5ce0768-afa4-400f-9b15-1c77faba64c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:37.213344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c5ce0768-afa4-400f-9b15-1c77faba64c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:37.222890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c5ce0768-afa4-400f-9b15-1c77faba64c2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.090488 Aug 18 22:16:37.223474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1862/3722] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:37 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:37.245791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5137da3d-ebfe-43c1-86d9-0170893c0b71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:37.246403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5137da3d-ebfe-43c1-86d9-0170893c0b71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:37.248762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:37.255766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5137da3d-ebfe-43c1-86d9-0170893c0b71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:37.256460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5137da3d-ebfe-43c1-86d9-0170893c0b71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:37.257052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5137da3d-ebfe-43c1-86d9-0170893c0b71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:37.257914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5137da3d-ebfe-43c1-86d9-0170893c0b71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:37.258402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5137da3d-ebfe-43c1-86d9-0170893c0b71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:37.258829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5137da3d-ebfe-43c1-86d9-0170893c0b71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:37.389948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5137da3d-ebfe-43c1-86d9-0170893c0b71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:37.398167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5137da3d-ebfe-43c1-86d9-0170893c0b71 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156239 Aug 18 22:16:37.398755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1861/3723] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:37 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:37.425295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-409b00f2-1cc6-42ed-b2d7-1fcc77948fbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:37.425979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-409b00f2-1cc6-42ed-b2d7-1fcc77948fbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:37.432159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-409b00f2-1cc6-42ed-b2d7-1fcc77948fbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:37.432642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-409b00f2-1cc6-42ed-b2d7-1fcc77948fbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:37.433082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-409b00f2-1cc6-42ed-b2d7-1fcc77948fbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:37.433800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-409b00f2-1cc6-42ed-b2d7-1fcc77948fbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:37.434255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-409b00f2-1cc6-42ed-b2d7-1fcc77948fbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:37.434758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-409b00f2-1cc6-42ed-b2d7-1fcc77948fbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:37.478800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:16:37.479025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:16:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e (ip 10.222.0.82) !!! Aug 18 22:16:37.564594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-409b00f2-1cc6-42ed-b2d7-1fcc77948fbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:37.572756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-409b00f2-1cc6-42ed-b2d7-1fcc77948fbd tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151241 Aug 18 22:16:37.573317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1863/3724] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:37 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:37.580691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c308830f-c65c-4d13-88c5-823569bc80ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:37.581413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c308830f-c65c-4d13-88c5-823569bc80ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] [instance: 3f0b7a98-3ba3-4739-8b60-3c7946107c6e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:37.587298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c308830f-c65c-4d13-88c5-823569bc80ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:37.587778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c308830f-c65c-4d13-88c5-823569bc80ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:37.588207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c308830f-c65c-4d13-88c5-823569bc80ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:37.588885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c308830f-c65c-4d13-88c5-823569bc80ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:37.589332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c308830f-c65c-4d13-88c5-823569bc80ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:37.589850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c308830f-c65c-4d13-88c5-823569bc80ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:37.683034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4804bfc8-ca02-4709-b082-e7b70140a122 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:37.683658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4804bfc8-ca02-4709-b082-e7b70140a122 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:37.694795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4804bfc8-ca02-4709-b082-e7b70140a122 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:37.695289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4804bfc8-ca02-4709-b082-e7b70140a122 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:37.695729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4804bfc8-ca02-4709-b082-e7b70140a122 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:37.696441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4804bfc8-ca02-4709-b082-e7b70140a122 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:37.696901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4804bfc8-ca02-4709-b082-e7b70140a122 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:37.697333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4804bfc8-ca02-4709-b082-e7b70140a122 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:37.716336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c308830f-c65c-4d13-88c5-823569bc80ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a40fd568da34b26bd93b8ff0ea92812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b157ed00f1548f1af769106e03cf9b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:37.724759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c308830f-c65c-4d13-88c5-823569bc80ed tempest-VolumesSnapshotTestJSON-273656140 tempest-VolumesSnapshotTestJSON-273656140-project] 10.222.0.82 "GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e" status: 200 len: 1560 microversion: 2.1 time: 0.147807 Aug 18 22:16:37.725342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1862/3725] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:37 2022] GET /compute/v2.1/servers/3f0b7a98-3ba3-4739-8b60-3c7946107c6e => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:37.834580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4804bfc8-ca02-4709-b082-e7b70140a122 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:37.843172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4804bfc8-ca02-4709-b082-e7b70140a122 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.163909 Aug 18 22:16:37.843807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1864/3726] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:37 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:37.865619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4af42ac0-7177-4095-807e-485c1d2c8207 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:37.866270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4af42ac0-7177-4095-807e-485c1d2c8207 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:37.873025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4af42ac0-7177-4095-807e-485c1d2c8207 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:37.873522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4af42ac0-7177-4095-807e-485c1d2c8207 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:37.873986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4af42ac0-7177-4095-807e-485c1d2c8207 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:37.874680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4af42ac0-7177-4095-807e-485c1d2c8207 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:37.875139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4af42ac0-7177-4095-807e-485c1d2c8207 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:37.875573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4af42ac0-7177-4095-807e-485c1d2c8207 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:38.009583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4af42ac0-7177-4095-807e-485c1d2c8207 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:38.018618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4af42ac0-7177-4095-807e-485c1d2c8207 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:38.020141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4af42ac0-7177-4095-807e-485c1d2c8207 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:38.021292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4af42ac0-7177-4095-807e-485c1d2c8207 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159581 Aug 18 22:16:38.021886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1863/3727] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:37 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:38.244140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c2f88c90-09d2-460f-9f9d-26613de8d1e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:38.244732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c2f88c90-09d2-460f-9f9d-26613de8d1e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:38.251829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2f88c90-09d2-460f-9f9d-26613de8d1e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:38.252317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2f88c90-09d2-460f-9f9d-26613de8d1e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:38.252756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2f88c90-09d2-460f-9f9d-26613de8d1e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:38.253447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2f88c90-09d2-460f-9f9d-26613de8d1e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:38.253956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2f88c90-09d2-460f-9f9d-26613de8d1e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:38.254385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2f88c90-09d2-460f-9f9d-26613de8d1e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:38.317588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c2f88c90-09d2-460f-9f9d-26613de8d1e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:38.325850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c2f88c90-09d2-460f-9f9d-26613de8d1e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085930 Aug 18 22:16:38.326414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1865/3728] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:38 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:38.420333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dfecc963-2016-47ff-8989-f0bdd0565442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:38.420949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dfecc963-2016-47ff-8989-f0bdd0565442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:38.427698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfecc963-2016-47ff-8989-f0bdd0565442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:38.428183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfecc963-2016-47ff-8989-f0bdd0565442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:38.428622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfecc963-2016-47ff-8989-f0bdd0565442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:38.429313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfecc963-2016-47ff-8989-f0bdd0565442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:38.429809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfecc963-2016-47ff-8989-f0bdd0565442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:38.430244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dfecc963-2016-47ff-8989-f0bdd0565442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:38.555343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dfecc963-2016-47ff-8989-f0bdd0565442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:38.563500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dfecc963-2016-47ff-8989-f0bdd0565442 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.147625 Aug 18 22:16:38.564074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1864/3729] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:38 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:38.594983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d077de09-f3d7-4817-b843-5b482b6bb917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:38.595603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d077de09-f3d7-4817-b843-5b482b6bb917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:38.601568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d077de09-f3d7-4817-b843-5b482b6bb917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:38.602082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d077de09-f3d7-4817-b843-5b482b6bb917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:38.602529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d077de09-f3d7-4817-b843-5b482b6bb917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:38.603217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d077de09-f3d7-4817-b843-5b482b6bb917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:38.603677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d077de09-f3d7-4817-b843-5b482b6bb917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:38.604111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d077de09-f3d7-4817-b843-5b482b6bb917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:38.729550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d077de09-f3d7-4817-b843-5b482b6bb917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:38.737671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d077de09-f3d7-4817-b843-5b482b6bb917 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.146962 Aug 18 22:16:38.738245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1866/3730] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:38 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:38.864588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c69e4d99-31b6-4138-8d53-92aad463620e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:38.865206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c69e4d99-31b6-4138-8d53-92aad463620e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:38.871066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c69e4d99-31b6-4138-8d53-92aad463620e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:38.871546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c69e4d99-31b6-4138-8d53-92aad463620e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:38.871985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c69e4d99-31b6-4138-8d53-92aad463620e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:38.872666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c69e4d99-31b6-4138-8d53-92aad463620e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:38.873123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c69e4d99-31b6-4138-8d53-92aad463620e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:38.873547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c69e4d99-31b6-4138-8d53-92aad463620e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:38.999214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c69e4d99-31b6-4138-8d53-92aad463620e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:39.007357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c69e4d99-31b6-4138-8d53-92aad463620e tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.146639 Aug 18 22:16:39.007933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1865/3731] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:38 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:39.043553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-36d538ee-5b98-43f5-bb64-e1647361c2d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:39.044202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-36d538ee-5b98-43f5-bb64-e1647361c2d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:39.050317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36d538ee-5b98-43f5-bb64-e1647361c2d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:39.050803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36d538ee-5b98-43f5-bb64-e1647361c2d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:39.051245 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36d538ee-5b98-43f5-bb64-e1647361c2d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:39.052199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36d538ee-5b98-43f5-bb64-e1647361c2d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:39.052654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36d538ee-5b98-43f5-bb64-e1647361c2d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:39.053084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-36d538ee-5b98-43f5-bb64-e1647361c2d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:39.178492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-36d538ee-5b98-43f5-bb64-e1647361c2d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:39.187750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-36d538ee-5b98-43f5-bb64-e1647361c2d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:39.189249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-36d538ee-5b98-43f5-bb64-e1647361c2d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:39.190439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-36d538ee-5b98-43f5-bb64-e1647361c2d0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150796 Aug 18 22:16:39.191000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1867/3732] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:39 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:39.346206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fe08c753-e03e-4068-82ee-014169ef535b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:39.346846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fe08c753-e03e-4068-82ee-014169ef535b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:39.352824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe08c753-e03e-4068-82ee-014169ef535b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:39.353309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe08c753-e03e-4068-82ee-014169ef535b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:39.353786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe08c753-e03e-4068-82ee-014169ef535b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:39.354481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe08c753-e03e-4068-82ee-014169ef535b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:39.354933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe08c753-e03e-4068-82ee-014169ef535b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:39.355360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fe08c753-e03e-4068-82ee-014169ef535b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:39.417516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fe08c753-e03e-4068-82ee-014169ef535b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:39.427067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fe08c753-e03e-4068-82ee-014169ef535b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084463 Aug 18 22:16:39.427673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1866/3733] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:39 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:39.584140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f8bec22c-3425-4797-bbee-7146f72d72c2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:39.584765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f8bec22c-3425-4797-bbee-7146f72d72c2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:39.591287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8bec22c-3425-4797-bbee-7146f72d72c2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:39.591777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8bec22c-3425-4797-bbee-7146f72d72c2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:39.592226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8bec22c-3425-4797-bbee-7146f72d72c2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:39.592915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8bec22c-3425-4797-bbee-7146f72d72c2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:39.593377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8bec22c-3425-4797-bbee-7146f72d72c2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:39.593853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f8bec22c-3425-4797-bbee-7146f72d72c2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:39.725104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f8bec22c-3425-4797-bbee-7146f72d72c2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:39.733858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f8bec22c-3425-4797-bbee-7146f72d72c2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153578 Aug 18 22:16:39.734429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1868/3734] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:39 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:39.758778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-90462bc6-02c3-4405-ba4b-56356d1be2c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:39.759394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-90462bc6-02c3-4405-ba4b-56356d1be2c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:39.765539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90462bc6-02c3-4405-ba4b-56356d1be2c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:39.766041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90462bc6-02c3-4405-ba4b-56356d1be2c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:39.766476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90462bc6-02c3-4405-ba4b-56356d1be2c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:39.767188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90462bc6-02c3-4405-ba4b-56356d1be2c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:39.767635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90462bc6-02c3-4405-ba4b-56356d1be2c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:39.768084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-90462bc6-02c3-4405-ba4b-56356d1be2c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:39.905875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-90462bc6-02c3-4405-ba4b-56356d1be2c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:39.914018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-90462bc6-02c3-4405-ba4b-56356d1be2c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.158954 Aug 18 22:16:39.914601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1867/3735] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:39 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:40.028784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8f135e46-a3ff-437e-91bd-cc240aa2a9fe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:40.029394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8f135e46-a3ff-437e-91bd-cc240aa2a9fe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:40.035342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f135e46-a3ff-437e-91bd-cc240aa2a9fe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:40.035822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f135e46-a3ff-437e-91bd-cc240aa2a9fe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:40.036256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f135e46-a3ff-437e-91bd-cc240aa2a9fe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:40.036931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f135e46-a3ff-437e-91bd-cc240aa2a9fe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:40.037382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f135e46-a3ff-437e-91bd-cc240aa2a9fe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:40.037824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f135e46-a3ff-437e-91bd-cc240aa2a9fe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:40.040294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:40.165327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8f135e46-a3ff-437e-91bd-cc240aa2a9fe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:40.173490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8f135e46-a3ff-437e-91bd-cc240aa2a9fe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149124 Aug 18 22:16:40.174085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1869/3736] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:40 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:40.213850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-799caf46-add5-480a-bba1-932eda669d25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:40.214782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-799caf46-add5-480a-bba1-932eda669d25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:40.221667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-799caf46-add5-480a-bba1-932eda669d25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:40.222158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-799caf46-add5-480a-bba1-932eda669d25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:40.222603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-799caf46-add5-480a-bba1-932eda669d25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:40.223321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-799caf46-add5-480a-bba1-932eda669d25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:40.223779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-799caf46-add5-480a-bba1-932eda669d25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:40.224238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-799caf46-add5-480a-bba1-932eda669d25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:40.352532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-799caf46-add5-480a-bba1-932eda669d25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:40.361311 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-799caf46-add5-480a-bba1-932eda669d25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:40.362845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-799caf46-add5-480a-bba1-932eda669d25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:40.363980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-799caf46-add5-480a-bba1-932eda669d25 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154125 Aug 18 22:16:40.364536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1868/3737] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:40 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:40.448677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f2fedb9f-48ec-4431-813e-c05e483a3944 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:40.449296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f2fedb9f-48ec-4431-813e-c05e483a3944 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:40.455751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2fedb9f-48ec-4431-813e-c05e483a3944 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:40.456232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2fedb9f-48ec-4431-813e-c05e483a3944 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:40.456670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2fedb9f-48ec-4431-813e-c05e483a3944 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:40.457352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2fedb9f-48ec-4431-813e-c05e483a3944 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:40.457834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2fedb9f-48ec-4431-813e-c05e483a3944 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:40.458260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f2fedb9f-48ec-4431-813e-c05e483a3944 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:40.518474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f2fedb9f-48ec-4431-813e-c05e483a3944 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:40.526526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f2fedb9f-48ec-4431-813e-c05e483a3944 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081673 Aug 18 22:16:40.527086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1870/3738] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:40 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:40.754594 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-042efdc8-b8e4-4c31-9e76-1cf84eaff1df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:40.755245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-042efdc8-b8e4-4c31-9e76-1cf84eaff1df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:40.761748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-042efdc8-b8e4-4c31-9e76-1cf84eaff1df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:40.762234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-042efdc8-b8e4-4c31-9e76-1cf84eaff1df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:40.763348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-042efdc8-b8e4-4c31-9e76-1cf84eaff1df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:40.764030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-042efdc8-b8e4-4c31-9e76-1cf84eaff1df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:40.764481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-042efdc8-b8e4-4c31-9e76-1cf84eaff1df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:40.764908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-042efdc8-b8e4-4c31-9e76-1cf84eaff1df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:40.780642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:40.896704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-042efdc8-b8e4-4c31-9e76-1cf84eaff1df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:40.904745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-042efdc8-b8e4-4c31-9e76-1cf84eaff1df tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154050 Aug 18 22:16:40.905321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1869/3739] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:40 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:40.936692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3a7073db-9d10-4b35-a520-74c44b4adddb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:40.937314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3a7073db-9d10-4b35-a520-74c44b4adddb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:40.944189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a7073db-9d10-4b35-a520-74c44b4adddb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:40.944678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a7073db-9d10-4b35-a520-74c44b4adddb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:40.945120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a7073db-9d10-4b35-a520-74c44b4adddb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:40.945839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a7073db-9d10-4b35-a520-74c44b4adddb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:40.946300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a7073db-9d10-4b35-a520-74c44b4adddb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:40.946733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3a7073db-9d10-4b35-a520-74c44b4adddb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:41.076385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3a7073db-9d10-4b35-a520-74c44b4adddb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:41.084585 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3a7073db-9d10-4b35-a520-74c44b4adddb tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152255 Aug 18 22:16:41.085159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1871/3740] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:40 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:41.194863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1a427aa2-80e0-487e-bea2-e011345a9202 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:41.195512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1a427aa2-80e0-487e-bea2-e011345a9202 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:41.201504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a427aa2-80e0-487e-bea2-e011345a9202 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:41.202027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a427aa2-80e0-487e-bea2-e011345a9202 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:41.202465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a427aa2-80e0-487e-bea2-e011345a9202 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:41.203150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a427aa2-80e0-487e-bea2-e011345a9202 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:41.203604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a427aa2-80e0-487e-bea2-e011345a9202 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:41.204029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a427aa2-80e0-487e-bea2-e011345a9202 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:41.328667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1a427aa2-80e0-487e-bea2-e011345a9202 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:41.336720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1a427aa2-80e0-487e-bea2-e011345a9202 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.145738 Aug 18 22:16:41.337288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1870/3741] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:41 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:41.386565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e52fbb18-b6f8-43a1-be05-98949679a977 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:41.387183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e52fbb18-b6f8-43a1-be05-98949679a977 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:41.393256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e52fbb18-b6f8-43a1-be05-98949679a977 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:41.393785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e52fbb18-b6f8-43a1-be05-98949679a977 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:41.394230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e52fbb18-b6f8-43a1-be05-98949679a977 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:41.394921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e52fbb18-b6f8-43a1-be05-98949679a977 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:41.395413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e52fbb18-b6f8-43a1-be05-98949679a977 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:41.395844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e52fbb18-b6f8-43a1-be05-98949679a977 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:41.521166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e52fbb18-b6f8-43a1-be05-98949679a977 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:41.530584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e52fbb18-b6f8-43a1-be05-98949679a977 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:41.532031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e52fbb18-b6f8-43a1-be05-98949679a977 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:41.533196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e52fbb18-b6f8-43a1-be05-98949679a977 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150519 Aug 18 22:16:41.533789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1872/3742] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:41 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:41.547297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cc55e992-775a-4fa0-ac40-e1180da955fe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:41.547921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cc55e992-775a-4fa0-ac40-e1180da955fe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:41.554199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc55e992-775a-4fa0-ac40-e1180da955fe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:41.554690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc55e992-775a-4fa0-ac40-e1180da955fe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:41.555134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc55e992-775a-4fa0-ac40-e1180da955fe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:41.555832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc55e992-775a-4fa0-ac40-e1180da955fe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:41.556307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc55e992-775a-4fa0-ac40-e1180da955fe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:41.556729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc55e992-775a-4fa0-ac40-e1180da955fe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:41.616355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cc55e992-775a-4fa0-ac40-e1180da955fe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:41.624627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cc55e992-775a-4fa0-ac40-e1180da955fe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081764 Aug 18 22:16:41.625186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1871/3743] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:41 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:41.925833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5b1f91d2-49fb-4a12-a874-f61e459c5276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:41.926358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5b1f91d2-49fb-4a12-a874-f61e459c5276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:41.932559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b1f91d2-49fb-4a12-a874-f61e459c5276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:41.933034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b1f91d2-49fb-4a12-a874-f61e459c5276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:41.933467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b1f91d2-49fb-4a12-a874-f61e459c5276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:41.934177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b1f91d2-49fb-4a12-a874-f61e459c5276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:41.934636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b1f91d2-49fb-4a12-a874-f61e459c5276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:41.935100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5b1f91d2-49fb-4a12-a874-f61e459c5276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:42.067241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5b1f91d2-49fb-4a12-a874-f61e459c5276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:42.076620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5b1f91d2-49fb-4a12-a874-f61e459c5276 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154780 Aug 18 22:16:42.077195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1873/3744] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:41 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:42.105777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-28e99988-f4b0-4eb1-9b71-6c2f5cb41db7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:42.106450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-28e99988-f4b0-4eb1-9b71-6c2f5cb41db7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:42.112799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28e99988-f4b0-4eb1-9b71-6c2f5cb41db7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:42.113276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28e99988-f4b0-4eb1-9b71-6c2f5cb41db7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:42.113758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28e99988-f4b0-4eb1-9b71-6c2f5cb41db7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:42.114442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28e99988-f4b0-4eb1-9b71-6c2f5cb41db7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:42.114889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28e99988-f4b0-4eb1-9b71-6c2f5cb41db7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:42.115305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-28e99988-f4b0-4eb1-9b71-6c2f5cb41db7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:42.246519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-28e99988-f4b0-4eb1-9b71-6c2f5cb41db7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:42.255234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-28e99988-f4b0-4eb1-9b71-6c2f5cb41db7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153427 Aug 18 22:16:42.255810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1872/3745] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:42 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:42.358470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f94d228d-abb2-4ce7-9bb9-14f0aa9bcefd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:42.359111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f94d228d-abb2-4ce7-9bb9-14f0aa9bcefd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:42.364934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f94d228d-abb2-4ce7-9bb9-14f0aa9bcefd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:42.365452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f94d228d-abb2-4ce7-9bb9-14f0aa9bcefd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:42.365919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f94d228d-abb2-4ce7-9bb9-14f0aa9bcefd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:42.366604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f94d228d-abb2-4ce7-9bb9-14f0aa9bcefd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:42.367082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f94d228d-abb2-4ce7-9bb9-14f0aa9bcefd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:42.367514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f94d228d-abb2-4ce7-9bb9-14f0aa9bcefd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:42.499298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f94d228d-abb2-4ce7-9bb9-14f0aa9bcefd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:42.507476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f94d228d-abb2-4ce7-9bb9-14f0aa9bcefd tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153477 Aug 18 22:16:42.508045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1874/3746] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:42 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:42.556592 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8320660c-1195-4a6c-b0f6-7f4628896d51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:42.557191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8320660c-1195-4a6c-b0f6-7f4628896d51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:42.564164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8320660c-1195-4a6c-b0f6-7f4628896d51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:42.564647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8320660c-1195-4a6c-b0f6-7f4628896d51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:42.565085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8320660c-1195-4a6c-b0f6-7f4628896d51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:42.565821 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8320660c-1195-4a6c-b0f6-7f4628896d51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:42.566268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8320660c-1195-4a6c-b0f6-7f4628896d51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:42.566681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8320660c-1195-4a6c-b0f6-7f4628896d51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:42.645917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0e616ea8-4e1b-4a44-b005-4715b85a9fe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:42.646532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0e616ea8-4e1b-4a44-b005-4715b85a9fe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:42.652798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e616ea8-4e1b-4a44-b005-4715b85a9fe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:42.653392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e616ea8-4e1b-4a44-b005-4715b85a9fe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:42.653858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e616ea8-4e1b-4a44-b005-4715b85a9fe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:42.654546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e616ea8-4e1b-4a44-b005-4715b85a9fe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:42.654995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e616ea8-4e1b-4a44-b005-4715b85a9fe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:42.655417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e616ea8-4e1b-4a44-b005-4715b85a9fe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:42.700158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8320660c-1195-4a6c-b0f6-7f4628896d51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:42.708972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8320660c-1195-4a6c-b0f6-7f4628896d51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:42.710509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8320660c-1195-4a6c-b0f6-7f4628896d51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:42.711676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8320660c-1195-4a6c-b0f6-7f4628896d51 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159119 Aug 18 22:16:42.712642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1873/3747] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:42 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:42.716931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:16:42.717265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:16:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:16:42.730805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0e616ea8-4e1b-4a44-b005-4715b85a9fe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:42.739528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0e616ea8-4e1b-4a44-b005-4715b85a9fe2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.097430 Aug 18 22:16:42.740140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1875/3748] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:43.097967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1431ccd3-6ef2-4761-86e9-3405e67a66db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:43.098587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1431ccd3-6ef2-4761-86e9-3405e67a66db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:43.104739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1431ccd3-6ef2-4761-86e9-3405e67a66db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:43.105223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1431ccd3-6ef2-4761-86e9-3405e67a66db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:43.105687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1431ccd3-6ef2-4761-86e9-3405e67a66db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:43.106986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1431ccd3-6ef2-4761-86e9-3405e67a66db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:43.107532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1431ccd3-6ef2-4761-86e9-3405e67a66db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:43.107868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1431ccd3-6ef2-4761-86e9-3405e67a66db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:43.240010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1431ccd3-6ef2-4761-86e9-3405e67a66db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:43.248646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1431ccd3-6ef2-4761-86e9-3405e67a66db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154739 Aug 18 22:16:43.249208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1874/3749] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:43 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:43.276957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bf512d69-d9af-45f7-b29d-887797c5fe38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:43.277689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bf512d69-d9af-45f7-b29d-887797c5fe38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:43.284956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf512d69-d9af-45f7-b29d-887797c5fe38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:43.285494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf512d69-d9af-45f7-b29d-887797c5fe38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:43.285959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf512d69-d9af-45f7-b29d-887797c5fe38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:43.286650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf512d69-d9af-45f7-b29d-887797c5fe38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:43.287103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf512d69-d9af-45f7-b29d-887797c5fe38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:43.287526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf512d69-d9af-45f7-b29d-887797c5fe38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:43.417018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bf512d69-d9af-45f7-b29d-887797c5fe38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:43.425208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bf512d69-d9af-45f7-b29d-887797c5fe38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152084 Aug 18 22:16:43.425817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1876/3750] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:43 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:43.528209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-18ed566a-17bf-4f72-94e9-66556c015216 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:43.528848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-18ed566a-17bf-4f72-94e9-66556c015216 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:43.534707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18ed566a-17bf-4f72-94e9-66556c015216 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:43.535185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18ed566a-17bf-4f72-94e9-66556c015216 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:43.535616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18ed566a-17bf-4f72-94e9-66556c015216 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:43.536294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18ed566a-17bf-4f72-94e9-66556c015216 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:43.536742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18ed566a-17bf-4f72-94e9-66556c015216 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:43.537162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18ed566a-17bf-4f72-94e9-66556c015216 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:43.660960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-18ed566a-17bf-4f72-94e9-66556c015216 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:43.669132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-18ed566a-17bf-4f72-94e9-66556c015216 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.144765 Aug 18 22:16:43.669885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1875/3751] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:43 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:43.734863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-25095386-065f-42d1-b520-598991fa421d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:43.735487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-25095386-065f-42d1-b520-598991fa421d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:43.741528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25095386-065f-42d1-b520-598991fa421d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:43.742050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25095386-065f-42d1-b520-598991fa421d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:43.742495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25095386-065f-42d1-b520-598991fa421d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:43.743185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25095386-065f-42d1-b520-598991fa421d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:43.743643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25095386-065f-42d1-b520-598991fa421d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:43.744083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-25095386-065f-42d1-b520-598991fa421d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:43.760064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-239a79af-08da-4d3a-9123-c3dba8b2d834 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:43.760710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-239a79af-08da-4d3a-9123-c3dba8b2d834 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:43.767130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-239a79af-08da-4d3a-9123-c3dba8b2d834 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:43.767614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-239a79af-08da-4d3a-9123-c3dba8b2d834 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:43.768055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-239a79af-08da-4d3a-9123-c3dba8b2d834 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:43.768748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-239a79af-08da-4d3a-9123-c3dba8b2d834 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:43.769200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-239a79af-08da-4d3a-9123-c3dba8b2d834 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:43.769644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-239a79af-08da-4d3a-9123-c3dba8b2d834 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:43.831351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-239a79af-08da-4d3a-9123-c3dba8b2d834 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:43.839716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-239a79af-08da-4d3a-9123-c3dba8b2d834 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083411 Aug 18 22:16:43.840287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1876/3752] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:43 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:43.876690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-25095386-065f-42d1-b520-598991fa421d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:43.885401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-25095386-065f-42d1-b520-598991fa421d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:43.887054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-25095386-065f-42d1-b520-598991fa421d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:43.888196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-25095386-065f-42d1-b520-598991fa421d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157308 Aug 18 22:16:43.888753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1877/3753] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:43 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:44.270842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a282fbfb-ad62-4809-b576-abaf8d679469 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:44.271463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a282fbfb-ad62-4809-b576-abaf8d679469 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:44.277938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a282fbfb-ad62-4809-b576-abaf8d679469 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:44.278914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a282fbfb-ad62-4809-b576-abaf8d679469 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:44.279353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a282fbfb-ad62-4809-b576-abaf8d679469 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:44.280048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a282fbfb-ad62-4809-b576-abaf8d679469 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:44.280511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a282fbfb-ad62-4809-b576-abaf8d679469 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:44.280936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a282fbfb-ad62-4809-b576-abaf8d679469 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:44.409176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a282fbfb-ad62-4809-b576-abaf8d679469 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:44.417305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a282fbfb-ad62-4809-b576-abaf8d679469 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150328 Aug 18 22:16:44.417914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1877/3754] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:44 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:44.446477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fdc3a042-0c7a-46f5-b658-faddedc2172d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:44.447102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fdc3a042-0c7a-46f5-b658-faddedc2172d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:44.453503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdc3a042-0c7a-46f5-b658-faddedc2172d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:44.454033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdc3a042-0c7a-46f5-b658-faddedc2172d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:44.454476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdc3a042-0c7a-46f5-b658-faddedc2172d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:44.455170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdc3a042-0c7a-46f5-b658-faddedc2172d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:44.455629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdc3a042-0c7a-46f5-b658-faddedc2172d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:44.456058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdc3a042-0c7a-46f5-b658-faddedc2172d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:44.585526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fdc3a042-0c7a-46f5-b658-faddedc2172d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:44.594149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fdc3a042-0c7a-46f5-b658-faddedc2172d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151524 Aug 18 22:16:44.594724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1878/3755] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:44 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:44.692177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a880991f-ebfb-4075-9081-d5ba8335d7ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:44.692803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a880991f-ebfb-4075-9081-d5ba8335d7ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:44.698766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a880991f-ebfb-4075-9081-d5ba8335d7ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:44.699249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a880991f-ebfb-4075-9081-d5ba8335d7ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:44.699689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a880991f-ebfb-4075-9081-d5ba8335d7ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:44.700888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a880991f-ebfb-4075-9081-d5ba8335d7ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:44.701348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a880991f-ebfb-4075-9081-d5ba8335d7ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:44.701812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a880991f-ebfb-4075-9081-d5ba8335d7ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:44.824837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a880991f-ebfb-4075-9081-d5ba8335d7ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:44.833428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a880991f-ebfb-4075-9081-d5ba8335d7ef tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.145093 Aug 18 22:16:44.834035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1878/3756] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:44 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:44.860346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-083caabc-b251-4392-983c-ac6e4b16f974 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:44.860971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-083caabc-b251-4392-983c-ac6e4b16f974 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:44.866858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-083caabc-b251-4392-983c-ac6e4b16f974 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:44.867345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-083caabc-b251-4392-983c-ac6e4b16f974 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:44.867793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-083caabc-b251-4392-983c-ac6e4b16f974 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:44.868484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-083caabc-b251-4392-983c-ac6e4b16f974 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:44.868935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-083caabc-b251-4392-983c-ac6e4b16f974 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:44.869367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-083caabc-b251-4392-983c-ac6e4b16f974 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:44.910790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-79cffa1b-0d7e-457e-a2fc-01bca7c5a9d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:44.911519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-79cffa1b-0d7e-457e-a2fc-01bca7c5a9d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:44.917384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-79cffa1b-0d7e-457e-a2fc-01bca7c5a9d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:44.917918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-79cffa1b-0d7e-457e-a2fc-01bca7c5a9d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:44.918362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-79cffa1b-0d7e-457e-a2fc-01bca7c5a9d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:44.919061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-79cffa1b-0d7e-457e-a2fc-01bca7c5a9d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:44.919518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-79cffa1b-0d7e-457e-a2fc-01bca7c5a9d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:44.919949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-79cffa1b-0d7e-457e-a2fc-01bca7c5a9d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:44.929141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-083caabc-b251-4392-983c-ac6e4b16f974 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:44.945820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-083caabc-b251-4392-983c-ac6e4b16f974 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.089147 Aug 18 22:16:44.946642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1879/3757] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:44 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:45.052475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-79cffa1b-0d7e-457e-a2fc-01bca7c5a9d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:45.061530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-79cffa1b-0d7e-457e-a2fc-01bca7c5a9d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:45.063045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-79cffa1b-0d7e-457e-a2fc-01bca7c5a9d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:45.064196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-79cffa1b-0d7e-457e-a2fc-01bca7c5a9d8 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157367 Aug 18 22:16:45.064745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1879/3758] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:44 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:16:45.439971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ef695054-3130-4deb-b63f-9e9be2e422a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:45.440593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ef695054-3130-4deb-b63f-9e9be2e422a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:45.446661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef695054-3130-4deb-b63f-9e9be2e422a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:45.447234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef695054-3130-4deb-b63f-9e9be2e422a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:45.447583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef695054-3130-4deb-b63f-9e9be2e422a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:45.448277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef695054-3130-4deb-b63f-9e9be2e422a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:45.448739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef695054-3130-4deb-b63f-9e9be2e422a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:45.449170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef695054-3130-4deb-b63f-9e9be2e422a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:45.574527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ef695054-3130-4deb-b63f-9e9be2e422a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:45.582722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ef695054-3130-4deb-b63f-9e9be2e422a0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.146602 Aug 18 22:16:45.583299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1880/3759] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:45 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:45.615718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-570a115c-202e-494f-87fb-a2941e5ad67c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:45.616334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-570a115c-202e-494f-87fb-a2941e5ad67c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:45.623046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-570a115c-202e-494f-87fb-a2941e5ad67c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:45.623526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-570a115c-202e-494f-87fb-a2941e5ad67c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:45.623964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-570a115c-202e-494f-87fb-a2941e5ad67c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:45.624646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-570a115c-202e-494f-87fb-a2941e5ad67c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:45.625101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-570a115c-202e-494f-87fb-a2941e5ad67c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:45.625534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-570a115c-202e-494f-87fb-a2941e5ad67c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:45.751833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-570a115c-202e-494f-87fb-a2941e5ad67c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:45.759888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-570a115c-202e-494f-87fb-a2941e5ad67c tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148193 Aug 18 22:16:45.760455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1880/3760] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:45 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:45.857486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b4d7e4d0-8168-4fbf-860a-8edb17a127e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:45.858044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b4d7e4d0-8168-4fbf-860a-8edb17a127e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:45.863957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4d7e4d0-8168-4fbf-860a-8edb17a127e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:45.864444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4d7e4d0-8168-4fbf-860a-8edb17a127e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:45.864886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4d7e4d0-8168-4fbf-860a-8edb17a127e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:45.865605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4d7e4d0-8168-4fbf-860a-8edb17a127e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:45.866065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4d7e4d0-8168-4fbf-860a-8edb17a127e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:45.866494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4d7e4d0-8168-4fbf-860a-8edb17a127e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:45.967853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b204f6b1-1b80-4d93-adfe-ad006a2cfed8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:45.968609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b204f6b1-1b80-4d93-adfe-ad006a2cfed8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:45.974564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b204f6b1-1b80-4d93-adfe-ad006a2cfed8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:45.975058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b204f6b1-1b80-4d93-adfe-ad006a2cfed8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:45.975499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b204f6b1-1b80-4d93-adfe-ad006a2cfed8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:45.976202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b204f6b1-1b80-4d93-adfe-ad006a2cfed8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:45.976663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b204f6b1-1b80-4d93-adfe-ad006a2cfed8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:45.977093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b204f6b1-1b80-4d93-adfe-ad006a2cfed8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:45.997689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b4d7e4d0-8168-4fbf-860a-8edb17a127e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:46.005921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b4d7e4d0-8168-4fbf-860a-8edb17a127e7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152885 Aug 18 22:16:46.006564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1881/3761] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:45 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:46.037767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b204f6b1-1b80-4d93-adfe-ad006a2cfed8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:46.046395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b204f6b1-1b80-4d93-adfe-ad006a2cfed8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082917 Aug 18 22:16:46.046954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1881/3762] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:46.086982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-13109580-7d31-4a47-b4fe-cbb12646072c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:46.087605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-13109580-7d31-4a47-b4fe-cbb12646072c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:46.094178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13109580-7d31-4a47-b4fe-cbb12646072c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:46.094668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13109580-7d31-4a47-b4fe-cbb12646072c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:46.095110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13109580-7d31-4a47-b4fe-cbb12646072c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:46.095802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13109580-7d31-4a47-b4fe-cbb12646072c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:46.096260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13109580-7d31-4a47-b4fe-cbb12646072c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:46.096691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13109580-7d31-4a47-b4fe-cbb12646072c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:46.225444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-13109580-7d31-4a47-b4fe-cbb12646072c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:46.234157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-13109580-7d31-4a47-b4fe-cbb12646072c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:46.235662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-13109580-7d31-4a47-b4fe-cbb12646072c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:46.236814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-13109580-7d31-4a47-b4fe-cbb12646072c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.153733 Aug 18 22:16:46.237369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1882/3763] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:46 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:46.603955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cbd105d2-5654-4b5b-8eee-214aa2a4a2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:46.604573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cbd105d2-5654-4b5b-8eee-214aa2a4a2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:46.610700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbd105d2-5654-4b5b-8eee-214aa2a4a2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:46.611184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbd105d2-5654-4b5b-8eee-214aa2a4a2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:46.611622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbd105d2-5654-4b5b-8eee-214aa2a4a2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:46.612310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbd105d2-5654-4b5b-8eee-214aa2a4a2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:46.612764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbd105d2-5654-4b5b-8eee-214aa2a4a2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:46.613196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbd105d2-5654-4b5b-8eee-214aa2a4a2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:46.781580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2f763c6b-734f-4933-8210-20b09eb875d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:46.782268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2f763c6b-734f-4933-8210-20b09eb875d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:46.789149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f763c6b-734f-4933-8210-20b09eb875d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:46.789674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f763c6b-734f-4933-8210-20b09eb875d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:46.790119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f763c6b-734f-4933-8210-20b09eb875d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:46.790832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f763c6b-734f-4933-8210-20b09eb875d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:46.791293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f763c6b-734f-4933-8210-20b09eb875d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:46.792206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2f763c6b-734f-4933-8210-20b09eb875d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:46.928444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2f763c6b-734f-4933-8210-20b09eb875d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:46.937879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2f763c6b-734f-4933-8210-20b09eb875d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.160145 Aug 18 22:16:46.938477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1883/3764] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:46 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:46.972465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cbd105d2-5654-4b5b-8eee-214aa2a4a2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:46.980544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cbd105d2-5654-4b5b-8eee-214aa2a4a2e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.380413 Aug 18 22:16:46.981590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1882/3765] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:46 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:47.027026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aae7f34a-dec6-462f-9c86-7bf83370e802 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:47.027654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-aae7f34a-dec6-462f-9c86-7bf83370e802 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:47.033653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aae7f34a-dec6-462f-9c86-7bf83370e802 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:47.034142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aae7f34a-dec6-462f-9c86-7bf83370e802 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:47.034586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aae7f34a-dec6-462f-9c86-7bf83370e802 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:47.035277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aae7f34a-dec6-462f-9c86-7bf83370e802 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:47.035738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aae7f34a-dec6-462f-9c86-7bf83370e802 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:47.036167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aae7f34a-dec6-462f-9c86-7bf83370e802 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:47.066984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-139c5bb1-4f45-43f3-844e-632d1a86ea14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:47.067597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-139c5bb1-4f45-43f3-844e-632d1a86ea14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:47.073548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-139c5bb1-4f45-43f3-844e-632d1a86ea14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:47.074052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-139c5bb1-4f45-43f3-844e-632d1a86ea14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:47.074484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-139c5bb1-4f45-43f3-844e-632d1a86ea14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:47.075203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-139c5bb1-4f45-43f3-844e-632d1a86ea14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:47.075654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-139c5bb1-4f45-43f3-844e-632d1a86ea14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:47.076072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-139c5bb1-4f45-43f3-844e-632d1a86ea14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:47.136712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-139c5bb1-4f45-43f3-844e-632d1a86ea14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:47.145094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-139c5bb1-4f45-43f3-844e-632d1a86ea14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081906 Aug 18 22:16:47.157788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1883/3766] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:47 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:47.165442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aae7f34a-dec6-462f-9c86-7bf83370e802 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:47.174106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aae7f34a-dec6-462f-9c86-7bf83370e802 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150957 Aug 18 22:16:47.174675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1884/3767] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:47 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:47.259685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1276def8-e800-46f5-a52c-4721b4812bf1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:47.260330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1276def8-e800-46f5-a52c-4721b4812bf1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:47.266397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1276def8-e800-46f5-a52c-4721b4812bf1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:47.266878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1276def8-e800-46f5-a52c-4721b4812bf1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:47.267316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1276def8-e800-46f5-a52c-4721b4812bf1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:47.268000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1276def8-e800-46f5-a52c-4721b4812bf1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:47.268452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1276def8-e800-46f5-a52c-4721b4812bf1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:47.268874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1276def8-e800-46f5-a52c-4721b4812bf1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:47.391931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1276def8-e800-46f5-a52c-4721b4812bf1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:47.400512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1276def8-e800-46f5-a52c-4721b4812bf1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:47.402090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1276def8-e800-46f5-a52c-4721b4812bf1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:47.403773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1276def8-e800-46f5-a52c-4721b4812bf1 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.147510 Aug 18 22:16:47.404332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1884/3768] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:47 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:47.959923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-592cf853-c242-4483-b31d-b3b23eb906c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:47.960538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-592cf853-c242-4483-b31d-b3b23eb906c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:47.967824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-592cf853-c242-4483-b31d-b3b23eb906c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:47.968313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-592cf853-c242-4483-b31d-b3b23eb906c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:47.968741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-592cf853-c242-4483-b31d-b3b23eb906c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:47.969509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-592cf853-c242-4483-b31d-b3b23eb906c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:47.969949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-592cf853-c242-4483-b31d-b3b23eb906c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:47.970377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-592cf853-c242-4483-b31d-b3b23eb906c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:48.002690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d65ea4ff-4aa0-4316-b7e6-fd9ff2583ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:48.003313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d65ea4ff-4aa0-4316-b7e6-fd9ff2583ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:48.009828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d65ea4ff-4aa0-4316-b7e6-fd9ff2583ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:48.010458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d65ea4ff-4aa0-4316-b7e6-fd9ff2583ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:48.010900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d65ea4ff-4aa0-4316-b7e6-fd9ff2583ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:48.011608 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d65ea4ff-4aa0-4316-b7e6-fd9ff2583ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:48.012065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d65ea4ff-4aa0-4316-b7e6-fd9ff2583ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:48.013283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d65ea4ff-4aa0-4316-b7e6-fd9ff2583ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:48.099963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-592cf853-c242-4483-b31d-b3b23eb906c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:48.102137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:48.110311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-592cf853-c242-4483-b31d-b3b23eb906c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.153486 Aug 18 22:16:48.110901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1885/3769] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:47 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:48.145234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d65ea4ff-4aa0-4316-b7e6-fd9ff2583ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:48.153527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d65ea4ff-4aa0-4316-b7e6-fd9ff2583ed3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154570 Aug 18 22:16:48.154129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1885/3770] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:47 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:48.167233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-02f36ce2-fc3d-4405-a2df-f6d8c9306301 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:48.167851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-02f36ce2-fc3d-4405-a2df-f6d8c9306301 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:48.173900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02f36ce2-fc3d-4405-a2df-f6d8c9306301 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:48.174382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02f36ce2-fc3d-4405-a2df-f6d8c9306301 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:48.174816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02f36ce2-fc3d-4405-a2df-f6d8c9306301 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:48.175501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02f36ce2-fc3d-4405-a2df-f6d8c9306301 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:48.175956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02f36ce2-fc3d-4405-a2df-f6d8c9306301 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:48.176396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-02f36ce2-fc3d-4405-a2df-f6d8c9306301 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:48.195494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-137b418d-1b2e-4d5b-84bf-1537b33551db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:48.196150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-137b418d-1b2e-4d5b-84bf-1537b33551db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:48.203726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-137b418d-1b2e-4d5b-84bf-1537b33551db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:48.204191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-137b418d-1b2e-4d5b-84bf-1537b33551db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:48.205070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-137b418d-1b2e-4d5b-84bf-1537b33551db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:48.205336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-137b418d-1b2e-4d5b-84bf-1537b33551db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:48.205823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-137b418d-1b2e-4d5b-84bf-1537b33551db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:48.206257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-137b418d-1b2e-4d5b-84bf-1537b33551db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:48.209001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:48.240890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-02f36ce2-fc3d-4405-a2df-f6d8c9306301 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:48.249764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-02f36ce2-fc3d-4405-a2df-f6d8c9306301 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086418 Aug 18 22:16:48.250356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1886/3771] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:48 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:48.331539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-137b418d-1b2e-4d5b-84bf-1537b33551db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:48.339661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-137b418d-1b2e-4d5b-84bf-1537b33551db tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147980 Aug 18 22:16:48.340232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1886/3772] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:48 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:48.426615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-99e64d01-a3cb-492f-90bb-4f24052d940d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:48.427486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-99e64d01-a3cb-492f-90bb-4f24052d940d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:48.433488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99e64d01-a3cb-492f-90bb-4f24052d940d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:48.434007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99e64d01-a3cb-492f-90bb-4f24052d940d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:48.435090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99e64d01-a3cb-492f-90bb-4f24052d940d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:48.435784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99e64d01-a3cb-492f-90bb-4f24052d940d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:48.436243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99e64d01-a3cb-492f-90bb-4f24052d940d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:48.436672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-99e64d01-a3cb-492f-90bb-4f24052d940d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:48.562622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-99e64d01-a3cb-492f-90bb-4f24052d940d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:48.571119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-99e64d01-a3cb-492f-90bb-4f24052d940d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:48.572649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-99e64d01-a3cb-492f-90bb-4f24052d940d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:48.573832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-99e64d01-a3cb-492f-90bb-4f24052d940d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151131 Aug 18 22:16:48.574395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1887/3773] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:48 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:49.132266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a68b710c-ae1e-4493-9c53-f721a6f629d0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:49.132907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a68b710c-ae1e-4493-9c53-f721a6f629d0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:49.139840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a68b710c-ae1e-4493-9c53-f721a6f629d0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:49.140318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a68b710c-ae1e-4493-9c53-f721a6f629d0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:49.140755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a68b710c-ae1e-4493-9c53-f721a6f629d0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:49.141438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a68b710c-ae1e-4493-9c53-f721a6f629d0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:49.141915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a68b710c-ae1e-4493-9c53-f721a6f629d0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:49.142337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a68b710c-ae1e-4493-9c53-f721a6f629d0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:49.174527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-530756d8-e89f-429c-85c1-2f10693dd6db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:49.175164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-530756d8-e89f-429c-85c1-2f10693dd6db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:49.182072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-530756d8-e89f-429c-85c1-2f10693dd6db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:49.182646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-530756d8-e89f-429c-85c1-2f10693dd6db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:49.183104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-530756d8-e89f-429c-85c1-2f10693dd6db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:49.183810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-530756d8-e89f-429c-85c1-2f10693dd6db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:49.184276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-530756d8-e89f-429c-85c1-2f10693dd6db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:49.184711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-530756d8-e89f-429c-85c1-2f10693dd6db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:49.274947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a68b710c-ae1e-4493-9c53-f721a6f629d0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:49.285315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a68b710c-ae1e-4493-9c53-f721a6f629d0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156800 Aug 18 22:16:49.285978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1887/3774] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:49 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:49.290645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3cef3d65-0640-4c03-ae0a-b60aeeb39fd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:49.291336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3cef3d65-0640-4c03-ae0a-b60aeeb39fd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:49.297348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3cef3d65-0640-4c03-ae0a-b60aeeb39fd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:49.297871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3cef3d65-0640-4c03-ae0a-b60aeeb39fd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:49.298319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3cef3d65-0640-4c03-ae0a-b60aeeb39fd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:49.299025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3cef3d65-0640-4c03-ae0a-b60aeeb39fd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:49.299482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3cef3d65-0640-4c03-ae0a-b60aeeb39fd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:49.299915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3cef3d65-0640-4c03-ae0a-b60aeeb39fd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:49.320242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-530756d8-e89f-429c-85c1-2f10693dd6db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:49.328851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-530756d8-e89f-429c-85c1-2f10693dd6db tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.158149 Aug 18 22:16:49.329417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1888/3775] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:49 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:49.360471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ad483b6a-491d-48ae-8d79-59dafc7fde08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:49.361089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ad483b6a-491d-48ae-8d79-59dafc7fde08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:49.362128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3cef3d65-0640-4c03-ae0a-b60aeeb39fd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:49.367048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad483b6a-491d-48ae-8d79-59dafc7fde08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:49.367526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad483b6a-491d-48ae-8d79-59dafc7fde08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:49.367961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad483b6a-491d-48ae-8d79-59dafc7fde08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:49.368642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad483b6a-491d-48ae-8d79-59dafc7fde08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:49.369096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad483b6a-491d-48ae-8d79-59dafc7fde08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:49.369641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad483b6a-491d-48ae-8d79-59dafc7fde08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:49.370614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3cef3d65-0640-4c03-ae0a-b60aeeb39fd1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083659 Aug 18 22:16:49.371194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1888/3776] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:49 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:49.498973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ad483b6a-491d-48ae-8d79-59dafc7fde08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:49.507125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ad483b6a-491d-48ae-8d79-59dafc7fde08 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150430 Aug 18 22:16:49.507705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1889/3777] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:49 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:49.596007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6484e9f4-b67d-43cf-b6d2-044da42c049d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:49.596664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6484e9f4-b67d-43cf-b6d2-044da42c049d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:49.602653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6484e9f4-b67d-43cf-b6d2-044da42c049d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:49.603137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6484e9f4-b67d-43cf-b6d2-044da42c049d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:49.603577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6484e9f4-b67d-43cf-b6d2-044da42c049d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:49.604278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6484e9f4-b67d-43cf-b6d2-044da42c049d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:49.604727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6484e9f4-b67d-43cf-b6d2-044da42c049d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:49.605158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6484e9f4-b67d-43cf-b6d2-044da42c049d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:49.731628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6484e9f4-b67d-43cf-b6d2-044da42c049d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:49.740283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6484e9f4-b67d-43cf-b6d2-044da42c049d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:49.741825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6484e9f4-b67d-43cf-b6d2-044da42c049d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:49.742973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6484e9f4-b67d-43cf-b6d2-044da42c049d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151072 Aug 18 22:16:49.743533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1889/3778] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:49 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:50.307661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-03e11b04-50d3-46b1-aa5b-9d17a439b9be tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:50.308315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-03e11b04-50d3-46b1-aa5b-9d17a439b9be tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:50.314889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03e11b04-50d3-46b1-aa5b-9d17a439b9be tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:50.315395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03e11b04-50d3-46b1-aa5b-9d17a439b9be tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:50.315821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03e11b04-50d3-46b1-aa5b-9d17a439b9be tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:50.316513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03e11b04-50d3-46b1-aa5b-9d17a439b9be tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:50.316973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03e11b04-50d3-46b1-aa5b-9d17a439b9be tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:50.317404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03e11b04-50d3-46b1-aa5b-9d17a439b9be tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:50.352392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fcae9e32-3c4c-42cf-b958-f507c96511bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:50.353102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fcae9e32-3c4c-42cf-b958-f507c96511bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:50.361996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcae9e32-3c4c-42cf-b958-f507c96511bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:50.362510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcae9e32-3c4c-42cf-b958-f507c96511bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:50.362948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcae9e32-3c4c-42cf-b958-f507c96511bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:50.363650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcae9e32-3c4c-42cf-b958-f507c96511bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:50.364102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcae9e32-3c4c-42cf-b958-f507c96511bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:50.364529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fcae9e32-3c4c-42cf-b958-f507c96511bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:50.446783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-03e11b04-50d3-46b1-aa5b-9d17a439b9be tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:50.455212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-03e11b04-50d3-46b1-aa5b-9d17a439b9be tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151502 Aug 18 22:16:50.455808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1890/3779] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:50 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:50.460264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-88693ddb-b5d3-40b0-9241-842b09c29ede tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:50.460907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-88693ddb-b5d3-40b0-9241-842b09c29ede tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:50.467333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88693ddb-b5d3-40b0-9241-842b09c29ede tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:50.467732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88693ddb-b5d3-40b0-9241-842b09c29ede tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:50.468178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88693ddb-b5d3-40b0-9241-842b09c29ede tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:50.468892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88693ddb-b5d3-40b0-9241-842b09c29ede tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:50.469341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88693ddb-b5d3-40b0-9241-842b09c29ede tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:50.469888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-88693ddb-b5d3-40b0-9241-842b09c29ede tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:50.497723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fcae9e32-3c4c-42cf-b958-f507c96511bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:50.506192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fcae9e32-3c4c-42cf-b958-f507c96511bb tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.159414 Aug 18 22:16:50.506776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1890/3780] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:50 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:50.528897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5e72abe4-ff08-4db7-b42a-82e2d3a57359 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:50.529519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5e72abe4-ff08-4db7-b42a-82e2d3a57359 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:50.529802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-88693ddb-b5d3-40b0-9241-842b09c29ede tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:50.535583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e72abe4-ff08-4db7-b42a-82e2d3a57359 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:50.536055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e72abe4-ff08-4db7-b42a-82e2d3a57359 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:50.536490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e72abe4-ff08-4db7-b42a-82e2d3a57359 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:50.537183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e72abe4-ff08-4db7-b42a-82e2d3a57359 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:50.537659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e72abe4-ff08-4db7-b42a-82e2d3a57359 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:50.538078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5e72abe4-ff08-4db7-b42a-82e2d3a57359 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:50.538238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-88693ddb-b5d3-40b0-9241-842b09c29ede tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081473 Aug 18 22:16:50.538808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1891/3781] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:50 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:50.666208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5e72abe4-ff08-4db7-b42a-82e2d3a57359 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:50.674393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5e72abe4-ff08-4db7-b42a-82e2d3a57359 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150131 Aug 18 22:16:50.674965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1891/3782] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:50 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:50.766676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d4931262-7fbc-48c7-ac99-04864b7d738f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:50.767298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d4931262-7fbc-48c7-ac99-04864b7d738f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:50.773276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4931262-7fbc-48c7-ac99-04864b7d738f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:50.773815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4931262-7fbc-48c7-ac99-04864b7d738f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:50.774258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4931262-7fbc-48c7-ac99-04864b7d738f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:50.774949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4931262-7fbc-48c7-ac99-04864b7d738f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:50.775406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4931262-7fbc-48c7-ac99-04864b7d738f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:50.775840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4931262-7fbc-48c7-ac99-04864b7d738f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:50.907444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d4931262-7fbc-48c7-ac99-04864b7d738f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:50.916290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d4931262-7fbc-48c7-ac99-04864b7d738f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:50.917825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d4931262-7fbc-48c7-ac99-04864b7d738f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:50.919033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d4931262-7fbc-48c7-ac99-04864b7d738f tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156851 Aug 18 22:16:50.919594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1892/3783] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:50 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:51.477132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d6293364-0eb2-4cc9-9b33-ef5f91638d94 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:51.477733 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d6293364-0eb2-4cc9-9b33-ef5f91638d94 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:51.484687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6293364-0eb2-4cc9-9b33-ef5f91638d94 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:51.485172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6293364-0eb2-4cc9-9b33-ef5f91638d94 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:51.485640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6293364-0eb2-4cc9-9b33-ef5f91638d94 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:51.486365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6293364-0eb2-4cc9-9b33-ef5f91638d94 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:51.486823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6293364-0eb2-4cc9-9b33-ef5f91638d94 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:51.487253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d6293364-0eb2-4cc9-9b33-ef5f91638d94 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:51.527128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-366d74f3-5d33-4824-8e28-ce8679616309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:51.527861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-366d74f3-5d33-4824-8e28-ce8679616309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:51.534523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-366d74f3-5d33-4824-8e28-ce8679616309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:51.535087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-366d74f3-5d33-4824-8e28-ce8679616309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:51.535620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-366d74f3-5d33-4824-8e28-ce8679616309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:51.536391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-366d74f3-5d33-4824-8e28-ce8679616309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:51.536933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-366d74f3-5d33-4824-8e28-ce8679616309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:51.537436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-366d74f3-5d33-4824-8e28-ce8679616309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:51.619037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d6293364-0eb2-4cc9-9b33-ef5f91638d94 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:51.628075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d6293364-0eb2-4cc9-9b33-ef5f91638d94 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.154838 Aug 18 22:16:51.628657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1892/3784] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:51 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:51.633036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4d79e889-1659-493c-9806-277642a28b7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:51.633885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4d79e889-1659-493c-9806-277642a28b7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:51.639492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d79e889-1659-493c-9806-277642a28b7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:51.639978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d79e889-1659-493c-9806-277642a28b7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:51.640614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d79e889-1659-493c-9806-277642a28b7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:51.641957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d79e889-1659-493c-9806-277642a28b7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:51.642432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d79e889-1659-493c-9806-277642a28b7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:51.642864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4d79e889-1659-493c-9806-277642a28b7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:51.665550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-366d74f3-5d33-4824-8e28-ce8679616309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:51.674443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-366d74f3-5d33-4824-8e28-ce8679616309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151189 Aug 18 22:16:51.675034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1893/3785] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:51 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:51.696020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-60a8c021-88a0-4b3b-bd11-9107ce656611 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:51.696737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-60a8c021-88a0-4b3b-bd11-9107ce656611 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:51.703198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60a8c021-88a0-4b3b-bd11-9107ce656611 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:51.703765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60a8c021-88a0-4b3b-bd11-9107ce656611 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:51.704277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60a8c021-88a0-4b3b-bd11-9107ce656611 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:51.704987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60a8c021-88a0-4b3b-bd11-9107ce656611 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:51.705108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4d79e889-1659-493c-9806-277642a28b7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:51.705448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60a8c021-88a0-4b3b-bd11-9107ce656611 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:51.705906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60a8c021-88a0-4b3b-bd11-9107ce656611 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:51.713315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4d79e889-1659-493c-9806-277642a28b7e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083694 Aug 18 22:16:51.714378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1893/3786] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:51 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:51.836731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-60a8c021-88a0-4b3b-bd11-9107ce656611 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:51.845485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-60a8c021-88a0-4b3b-bd11-9107ce656611 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153339 Aug 18 22:16:51.846092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1894/3787] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:51 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:51.941881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b227b2c8-0323-4335-862e-89c756e96687 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:51.942526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b227b2c8-0323-4335-862e-89c756e96687 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:51.948905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b227b2c8-0323-4335-862e-89c756e96687 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:51.949396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b227b2c8-0323-4335-862e-89c756e96687 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:51.949901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b227b2c8-0323-4335-862e-89c756e96687 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:51.950601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b227b2c8-0323-4335-862e-89c756e96687 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:51.951056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b227b2c8-0323-4335-862e-89c756e96687 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:51.951508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b227b2c8-0323-4335-862e-89c756e96687 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:52.079183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b227b2c8-0323-4335-862e-89c756e96687 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:52.087945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b227b2c8-0323-4335-862e-89c756e96687 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:52.089460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b227b2c8-0323-4335-862e-89c756e96687 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:52.091202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b227b2c8-0323-4335-862e-89c756e96687 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152785 Aug 18 22:16:52.091876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1894/3788] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:51 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:52.649616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-399051a4-7be8-426a-9224-b6f0e7c4ae42 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:52.650242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-399051a4-7be8-426a-9224-b6f0e7c4ae42 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:52.656716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-399051a4-7be8-426a-9224-b6f0e7c4ae42 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:52.657199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-399051a4-7be8-426a-9224-b6f0e7c4ae42 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:52.657665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-399051a4-7be8-426a-9224-b6f0e7c4ae42 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:52.658351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-399051a4-7be8-426a-9224-b6f0e7c4ae42 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:52.658804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-399051a4-7be8-426a-9224-b6f0e7c4ae42 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:52.659231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-399051a4-7be8-426a-9224-b6f0e7c4ae42 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:52.696232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-970ee3ec-1502-479e-b038-50a91ca5e551 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:52.696844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-970ee3ec-1502-479e-b038-50a91ca5e551 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:52.704278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-970ee3ec-1502-479e-b038-50a91ca5e551 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:52.704760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-970ee3ec-1502-479e-b038-50a91ca5e551 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:52.705196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-970ee3ec-1502-479e-b038-50a91ca5e551 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:52.705934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-970ee3ec-1502-479e-b038-50a91ca5e551 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:52.706387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-970ee3ec-1502-479e-b038-50a91ca5e551 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:52.706817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-970ee3ec-1502-479e-b038-50a91ca5e551 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:52.787612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-399051a4-7be8-426a-9224-b6f0e7c4ae42 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:52.795944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-399051a4-7be8-426a-9224-b6f0e7c4ae42 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150208 Aug 18 22:16:52.796527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1895/3789] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:52 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:52.801125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-daec69b2-4d08-4230-886b-6993895b344f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:52.801774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-daec69b2-4d08-4230-886b-6993895b344f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:52.808010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daec69b2-4d08-4230-886b-6993895b344f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:52.808499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daec69b2-4d08-4230-886b-6993895b344f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:52.809767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daec69b2-4d08-4230-886b-6993895b344f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:52.810289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daec69b2-4d08-4230-886b-6993895b344f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:52.810782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daec69b2-4d08-4230-886b-6993895b344f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:52.811220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-daec69b2-4d08-4230-886b-6993895b344f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:52.839477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-970ee3ec-1502-479e-b038-50a91ca5e551 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:52.847832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-970ee3ec-1502-479e-b038-50a91ca5e551 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155446 Aug 18 22:16:52.848410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1895/3790] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:52 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:52.867012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-91d3cec6-c62c-42d5-a23a-8ec19ade1b48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:52.867659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-91d3cec6-c62c-42d5-a23a-8ec19ade1b48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:52.871261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-daec69b2-4d08-4230-886b-6993895b344f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:52.874610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91d3cec6-c62c-42d5-a23a-8ec19ade1b48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:52.875101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91d3cec6-c62c-42d5-a23a-8ec19ade1b48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:52.875544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91d3cec6-c62c-42d5-a23a-8ec19ade1b48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:52.876248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91d3cec6-c62c-42d5-a23a-8ec19ade1b48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:52.876706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91d3cec6-c62c-42d5-a23a-8ec19ade1b48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:52.877136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91d3cec6-c62c-42d5-a23a-8ec19ade1b48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:52.880191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-daec69b2-4d08-4230-886b-6993895b344f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082658 Aug 18 22:16:52.881022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1896/3791] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:52 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:53.004540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-91d3cec6-c62c-42d5-a23a-8ec19ade1b48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:53.012730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-91d3cec6-c62c-42d5-a23a-8ec19ade1b48 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149552 Aug 18 22:16:53.013301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1896/3792] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:52 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:53.114506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bf8c1e51-3c30-4091-89bb-f43ec84ddf64 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:53.115124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bf8c1e51-3c30-4091-89bb-f43ec84ddf64 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:53.116998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:53.122806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf8c1e51-3c30-4091-89bb-f43ec84ddf64 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:53.123306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf8c1e51-3c30-4091-89bb-f43ec84ddf64 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:53.123725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf8c1e51-3c30-4091-89bb-f43ec84ddf64 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:53.124427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf8c1e51-3c30-4091-89bb-f43ec84ddf64 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:53.124882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf8c1e51-3c30-4091-89bb-f43ec84ddf64 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:53.125307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf8c1e51-3c30-4091-89bb-f43ec84ddf64 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:53.256208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bf8c1e51-3c30-4091-89bb-f43ec84ddf64 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:53.265640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bf8c1e51-3c30-4091-89bb-f43ec84ddf64 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:53.267137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bf8c1e51-3c30-4091-89bb-f43ec84ddf64 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:53.268283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bf8c1e51-3c30-4091-89bb-f43ec84ddf64 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157725 Aug 18 22:16:53.268848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1897/3793] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:53 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:53.817261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-46483916-c82c-403e-b9ff-4bfb2b9920c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:53.817896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-46483916-c82c-403e-b9ff-4bfb2b9920c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:53.824365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46483916-c82c-403e-b9ff-4bfb2b9920c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:53.825327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46483916-c82c-403e-b9ff-4bfb2b9920c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:53.825802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46483916-c82c-403e-b9ff-4bfb2b9920c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:53.826479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46483916-c82c-403e-b9ff-4bfb2b9920c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:53.826926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46483916-c82c-403e-b9ff-4bfb2b9920c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:53.827343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-46483916-c82c-403e-b9ff-4bfb2b9920c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:53.869493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e3e80044-bbf7-4446-8ffb-c997a1b610fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:53.870166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e3e80044-bbf7-4446-8ffb-c997a1b610fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:53.876814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3e80044-bbf7-4446-8ffb-c997a1b610fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:53.877303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3e80044-bbf7-4446-8ffb-c997a1b610fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:53.877773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3e80044-bbf7-4446-8ffb-c997a1b610fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:53.878474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3e80044-bbf7-4446-8ffb-c997a1b610fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:53.878936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3e80044-bbf7-4446-8ffb-c997a1b610fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:53.879366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3e80044-bbf7-4446-8ffb-c997a1b610fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:53.953875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-46483916-c82c-403e-b9ff-4bfb2b9920c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:53.962376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-46483916-c82c-403e-b9ff-4bfb2b9920c2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.148909 Aug 18 22:16:53.963071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1897/3794] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:53 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:53.968396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6db08aef-839d-4f59-88b5-2213b2b82004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:53.969143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6db08aef-839d-4f59-88b5-2213b2b82004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:53.975331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6db08aef-839d-4f59-88b5-2213b2b82004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:53.975830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6db08aef-839d-4f59-88b5-2213b2b82004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:53.976302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6db08aef-839d-4f59-88b5-2213b2b82004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:53.977066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6db08aef-839d-4f59-88b5-2213b2b82004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:53.977531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6db08aef-839d-4f59-88b5-2213b2b82004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:53.978032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6db08aef-839d-4f59-88b5-2213b2b82004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:54.009943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e3e80044-bbf7-4446-8ffb-c997a1b610fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:54.018847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e3e80044-bbf7-4446-8ffb-c997a1b610fd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153190 Aug 18 22:16:54.019441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1898/3795] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:53 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:54.033769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bcab466a-98a3-4b63-b480-da75ec71b791 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:54.034377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bcab466a-98a3-4b63-b480-da75ec71b791 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:54.043468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcab466a-98a3-4b63-b480-da75ec71b791 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:54.043883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6db08aef-839d-4f59-88b5-2213b2b82004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:54.044212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcab466a-98a3-4b63-b480-da75ec71b791 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:54.044781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcab466a-98a3-4b63-b480-da75ec71b791 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:54.045897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcab466a-98a3-4b63-b480-da75ec71b791 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:54.046492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcab466a-98a3-4b63-b480-da75ec71b791 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:54.047044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcab466a-98a3-4b63-b480-da75ec71b791 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:54.052522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6db08aef-839d-4f59-88b5-2213b2b82004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088161 Aug 18 22:16:54.053109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1898/3796] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:53 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:54.177193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bcab466a-98a3-4b63-b480-da75ec71b791 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:54.185904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bcab466a-98a3-4b63-b480-da75ec71b791 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155876 Aug 18 22:16:54.186480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1899/3797] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:54 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:54.291604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-44e6c4ee-185a-4866-94a7-c594166250a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:54.292079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-44e6c4ee-185a-4866-94a7-c594166250a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:54.298490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44e6c4ee-185a-4866-94a7-c594166250a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:54.298976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44e6c4ee-185a-4866-94a7-c594166250a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:54.299416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44e6c4ee-185a-4866-94a7-c594166250a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:54.300105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44e6c4ee-185a-4866-94a7-c594166250a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:54.300562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44e6c4ee-185a-4866-94a7-c594166250a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:54.300989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44e6c4ee-185a-4866-94a7-c594166250a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:54.426175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-44e6c4ee-185a-4866-94a7-c594166250a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:54.435627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-44e6c4ee-185a-4866-94a7-c594166250a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:54.437126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-44e6c4ee-185a-4866-94a7-c594166250a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:54.438314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-44e6c4ee-185a-4866-94a7-c594166250a0 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.150826 Aug 18 22:16:54.438876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1899/3798] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:54 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:54.984829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dbc00ac1-5d10-47bc-beb9-f39f540efd09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:54.985409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dbc00ac1-5d10-47bc-beb9-f39f540efd09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:54.991908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbc00ac1-5d10-47bc-beb9-f39f540efd09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:54.992388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbc00ac1-5d10-47bc-beb9-f39f540efd09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:54.992824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbc00ac1-5d10-47bc-beb9-f39f540efd09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:54.993524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbc00ac1-5d10-47bc-beb9-f39f540efd09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:54.994006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbc00ac1-5d10-47bc-beb9-f39f540efd09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:54.994435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbc00ac1-5d10-47bc-beb9-f39f540efd09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:55.039930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8f161604-d4d7-4947-8126-31f9626e7a9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:55.040617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8f161604-d4d7-4947-8126-31f9626e7a9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:55.047704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f161604-d4d7-4947-8126-31f9626e7a9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:55.048184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f161604-d4d7-4947-8126-31f9626e7a9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:55.048642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f161604-d4d7-4947-8126-31f9626e7a9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:55.049336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f161604-d4d7-4947-8126-31f9626e7a9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:55.049822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f161604-d4d7-4947-8126-31f9626e7a9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:55.050246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8f161604-d4d7-4947-8126-31f9626e7a9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:55.123638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dbc00ac1-5d10-47bc-beb9-f39f540efd09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:55.131915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dbc00ac1-5d10-47bc-beb9-f39f540efd09 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151603 Aug 18 22:16:55.139207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1900/3799] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:54 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:55.139207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3f3d8261-f267-4a69-bbe9-5e353f3a46be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:55.139207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3f3d8261-f267-4a69-bbe9-5e353f3a46be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:55.144052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f3d8261-f267-4a69-bbe9-5e353f3a46be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:55.144540 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f3d8261-f267-4a69-bbe9-5e353f3a46be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:55.145167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f3d8261-f267-4a69-bbe9-5e353f3a46be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:55.145917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f3d8261-f267-4a69-bbe9-5e353f3a46be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:55.146398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f3d8261-f267-4a69-bbe9-5e353f3a46be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:55.146829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f3d8261-f267-4a69-bbe9-5e353f3a46be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:55.179840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8f161604-d4d7-4947-8126-31f9626e7a9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:55.188373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8f161604-d4d7-4947-8126-31f9626e7a9c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152246 Aug 18 22:16:55.188960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1900/3800] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:55 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:55.207432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ec4b35dd-6fa5-47ab-b91c-6716df967aca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:55.207578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3f3d8261-f267-4a69-bbe9-5e353f3a46be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:55.208113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ec4b35dd-6fa5-47ab-b91c-6716df967aca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:55.214138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec4b35dd-6fa5-47ab-b91c-6716df967aca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:55.215002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec4b35dd-6fa5-47ab-b91c-6716df967aca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:55.215126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec4b35dd-6fa5-47ab-b91c-6716df967aca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:55.215753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec4b35dd-6fa5-47ab-b91c-6716df967aca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:55.216257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3f3d8261-f267-4a69-bbe9-5e353f3a46be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082797 Aug 18 22:16:55.216392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec4b35dd-6fa5-47ab-b91c-6716df967aca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:55.217632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec4b35dd-6fa5-47ab-b91c-6716df967aca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:55.217757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1901/3801] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:55 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:55.347058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ec4b35dd-6fa5-47ab-b91c-6716df967aca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:55.355136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ec4b35dd-6fa5-47ab-b91c-6716df967aca tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151480 Aug 18 22:16:55.355698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1901/3802] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:55 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:55.460985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-85dcfc02-44b4-462f-96cc-cb1eb8825622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:55.461620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-85dcfc02-44b4-462f-96cc-cb1eb8825622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:55.468472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85dcfc02-44b4-462f-96cc-cb1eb8825622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:55.468968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85dcfc02-44b4-462f-96cc-cb1eb8825622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:55.469409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85dcfc02-44b4-462f-96cc-cb1eb8825622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:55.470131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85dcfc02-44b4-462f-96cc-cb1eb8825622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:55.470618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85dcfc02-44b4-462f-96cc-cb1eb8825622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:55.471046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85dcfc02-44b4-462f-96cc-cb1eb8825622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:55.485961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:55.603309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-85dcfc02-44b4-462f-96cc-cb1eb8825622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:55.612044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-85dcfc02-44b4-462f-96cc-cb1eb8825622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:55.613555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-85dcfc02-44b4-462f-96cc-cb1eb8825622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:55.614740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-85dcfc02-44b4-462f-96cc-cb1eb8825622 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.157578 Aug 18 22:16:55.615308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1902/3803] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:55 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:56.154366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8ed7aa29-30e0-414e-9b6d-c637021e7538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:56.154941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8ed7aa29-30e0-414e-9b6d-c637021e7538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:56.161524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ed7aa29-30e0-414e-9b6d-c637021e7538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:56.162040 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ed7aa29-30e0-414e-9b6d-c637021e7538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:56.162481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ed7aa29-30e0-414e-9b6d-c637021e7538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:56.163174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ed7aa29-30e0-414e-9b6d-c637021e7538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:56.163632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ed7aa29-30e0-414e-9b6d-c637021e7538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:56.164065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8ed7aa29-30e0-414e-9b6d-c637021e7538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:56.210833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b0385629-5679-40ce-8fde-e790b9a56521 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:56.211666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b0385629-5679-40ce-8fde-e790b9a56521 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:56.219383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0385629-5679-40ce-8fde-e790b9a56521 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:56.220131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0385629-5679-40ce-8fde-e790b9a56521 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:56.220636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0385629-5679-40ce-8fde-e790b9a56521 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:56.221402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0385629-5679-40ce-8fde-e790b9a56521 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:56.221978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0385629-5679-40ce-8fde-e790b9a56521 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:56.222478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b0385629-5679-40ce-8fde-e790b9a56521 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:56.294611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8ed7aa29-30e0-414e-9b6d-c637021e7538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:56.297268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:56.305254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8ed7aa29-30e0-414e-9b6d-c637021e7538 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155133 Aug 18 22:16:56.305871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1902/3804] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:56 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:56.312214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9d636b17-e6fb-4036-a71a-3b0aafd754fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:56.313092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9d636b17-e6fb-4036-a71a-3b0aafd754fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:56.319188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d636b17-e6fb-4036-a71a-3b0aafd754fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:56.319668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d636b17-e6fb-4036-a71a-3b0aafd754fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:56.320104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d636b17-e6fb-4036-a71a-3b0aafd754fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:56.320824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d636b17-e6fb-4036-a71a-3b0aafd754fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:56.321277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d636b17-e6fb-4036-a71a-3b0aafd754fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:56.321725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9d636b17-e6fb-4036-a71a-3b0aafd754fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:56.351940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b0385629-5679-40ce-8fde-e790b9a56521 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:56.360982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b0385629-5679-40ce-8fde-e790b9a56521 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.153928 Aug 18 22:16:56.361739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1903/3805] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:56 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:56.375873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-af0893c9-2330-4e3e-99ff-f02972fe9644 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:56.376487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-af0893c9-2330-4e3e-99ff-f02972fe9644 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:56.382430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af0893c9-2330-4e3e-99ff-f02972fe9644 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:56.382919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af0893c9-2330-4e3e-99ff-f02972fe9644 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:56.383357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af0893c9-2330-4e3e-99ff-f02972fe9644 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:56.384133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af0893c9-2330-4e3e-99ff-f02972fe9644 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:56.384501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af0893c9-2330-4e3e-99ff-f02972fe9644 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:56.385007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-af0893c9-2330-4e3e-99ff-f02972fe9644 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:56.386629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9d636b17-e6fb-4036-a71a-3b0aafd754fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:56.394854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9d636b17-e6fb-4036-a71a-3b0aafd754fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088054 Aug 18 22:16:56.395421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1903/3806] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:56 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:56.513934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-af0893c9-2330-4e3e-99ff-f02972fe9644 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:56.521961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-af0893c9-2330-4e3e-99ff-f02972fe9644 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.149927 Aug 18 22:16:56.522532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1904/3807] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:56 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:56.639248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d1a72e2b-0d8d-43ad-a22e-efe9dfd7a4da tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:56.639856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d1a72e2b-0d8d-43ad-a22e-efe9dfd7a4da tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:56.645757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1a72e2b-0d8d-43ad-a22e-efe9dfd7a4da tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:56.646238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1a72e2b-0d8d-43ad-a22e-efe9dfd7a4da tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:56.646667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1a72e2b-0d8d-43ad-a22e-efe9dfd7a4da tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:56.647342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1a72e2b-0d8d-43ad-a22e-efe9dfd7a4da tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:56.647788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1a72e2b-0d8d-43ad-a22e-efe9dfd7a4da tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:56.648206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1a72e2b-0d8d-43ad-a22e-efe9dfd7a4da tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:56.775041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d1a72e2b-0d8d-43ad-a22e-efe9dfd7a4da tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:56.784441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d1a72e2b-0d8d-43ad-a22e-efe9dfd7a4da tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:56.785974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d1a72e2b-0d8d-43ad-a22e-efe9dfd7a4da tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:56.787124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d1a72e2b-0d8d-43ad-a22e-efe9dfd7a4da tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152239 Aug 18 22:16:56.787678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1904/3808] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:56 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:57.328154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e08d3fce-08c5-485f-8340-0bc47908f76f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:57.328761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e08d3fce-08c5-485f-8340-0bc47908f76f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:57.334714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e08d3fce-08c5-485f-8340-0bc47908f76f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:57.335190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e08d3fce-08c5-485f-8340-0bc47908f76f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:57.335620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e08d3fce-08c5-485f-8340-0bc47908f76f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:57.336303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e08d3fce-08c5-485f-8340-0bc47908f76f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:57.336750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e08d3fce-08c5-485f-8340-0bc47908f76f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:57.337171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e08d3fce-08c5-485f-8340-0bc47908f76f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:57.381877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9c28998d-77bf-422c-8b97-94f1a390fd6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:57.382476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9c28998d-77bf-422c-8b97-94f1a390fd6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:57.388671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c28998d-77bf-422c-8b97-94f1a390fd6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:57.389152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c28998d-77bf-422c-8b97-94f1a390fd6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:57.389588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c28998d-77bf-422c-8b97-94f1a390fd6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:57.390310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c28998d-77bf-422c-8b97-94f1a390fd6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:57.390763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c28998d-77bf-422c-8b97-94f1a390fd6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:57.391190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9c28998d-77bf-422c-8b97-94f1a390fd6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:57.464402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e08d3fce-08c5-485f-8340-0bc47908f76f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:57.472775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e08d3fce-08c5-485f-8340-0bc47908f76f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150054 Aug 18 22:16:57.473357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1905/3809] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:57 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:57.477833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-08f6cc6b-c328-489b-bfc0-5a168cca3955 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:57.478591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-08f6cc6b-c328-489b-bfc0-5a168cca3955 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:57.485161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08f6cc6b-c328-489b-bfc0-5a168cca3955 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:57.485684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08f6cc6b-c328-489b-bfc0-5a168cca3955 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:57.486133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08f6cc6b-c328-489b-bfc0-5a168cca3955 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:57.486839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08f6cc6b-c328-489b-bfc0-5a168cca3955 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:57.487303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08f6cc6b-c328-489b-bfc0-5a168cca3955 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:57.487735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08f6cc6b-c328-489b-bfc0-5a168cca3955 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:57.521198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9c28998d-77bf-422c-8b97-94f1a390fd6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:57.529870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9c28998d-77bf-422c-8b97-94f1a390fd6f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151609 Aug 18 22:16:57.530550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1905/3810] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:57 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:57.542990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-772487f4-2cc1-48c8-9710-382ba6a9c1c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:57.543607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-772487f4-2cc1-48c8-9710-382ba6a9c1c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:57.548017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-08f6cc6b-c328-489b-bfc0-5a168cca3955 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:57.550179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-772487f4-2cc1-48c8-9710-382ba6a9c1c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:57.550665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-772487f4-2cc1-48c8-9710-382ba6a9c1c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:57.551104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-772487f4-2cc1-48c8-9710-382ba6a9c1c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:57.551803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-772487f4-2cc1-48c8-9710-382ba6a9c1c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:57.552529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-772487f4-2cc1-48c8-9710-382ba6a9c1c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:57.552958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-772487f4-2cc1-48c8-9710-382ba6a9c1c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:57.557096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-08f6cc6b-c328-489b-bfc0-5a168cca3955 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082755 Aug 18 22:16:57.558401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1906/3811] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:57 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:57.696355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-772487f4-2cc1-48c8-9710-382ba6a9c1c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:57.704657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-772487f4-2cc1-48c8-9710-382ba6a9c1c9 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.165409 Aug 18 22:16:57.705227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1906/3812] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:57 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:57.810040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e0390827-4b64-4230-bdce-f66aad29d437 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:57.811856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e0390827-4b64-4230-bdce-f66aad29d437 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:57.821182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0390827-4b64-4230-bdce-f66aad29d437 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:57.821760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0390827-4b64-4230-bdce-f66aad29d437 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:57.822233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0390827-4b64-4230-bdce-f66aad29d437 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:57.822968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0390827-4b64-4230-bdce-f66aad29d437 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:57.823460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0390827-4b64-4230-bdce-f66aad29d437 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:57.823924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e0390827-4b64-4230-bdce-f66aad29d437 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:57.954896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e0390827-4b64-4230-bdce-f66aad29d437 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:57.964470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e0390827-4b64-4230-bdce-f66aad29d437 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:57.966076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e0390827-4b64-4230-bdce-f66aad29d437 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:57.968184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e0390827-4b64-4230-bdce-f66aad29d437 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.161959 Aug 18 22:16:57.968756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1907/3813] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:57 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:58.494898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2c933c63-8ff9-424b-a6b0-70cc4d6723c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:58.495583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2c933c63-8ff9-424b-a6b0-70cc4d6723c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:58.502427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c933c63-8ff9-424b-a6b0-70cc4d6723c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:58.502902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c933c63-8ff9-424b-a6b0-70cc4d6723c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:58.503332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c933c63-8ff9-424b-a6b0-70cc4d6723c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:58.504014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c933c63-8ff9-424b-a6b0-70cc4d6723c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:58.504459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c933c63-8ff9-424b-a6b0-70cc4d6723c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:58.504877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c933c63-8ff9-424b-a6b0-70cc4d6723c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:58.551644 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6a7eb008-08c1-4f86-81ad-bb0ef891e6d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:58.552509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6a7eb008-08c1-4f86-81ad-bb0ef891e6d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:58.558535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a7eb008-08c1-4f86-81ad-bb0ef891e6d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:58.559023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a7eb008-08c1-4f86-81ad-bb0ef891e6d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:58.559461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a7eb008-08c1-4f86-81ad-bb0ef891e6d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:58.560645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a7eb008-08c1-4f86-81ad-bb0ef891e6d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:58.561102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a7eb008-08c1-4f86-81ad-bb0ef891e6d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:58.561530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a7eb008-08c1-4f86-81ad-bb0ef891e6d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:58.632887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2c933c63-8ff9-424b-a6b0-70cc4d6723c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:58.641769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2c933c63-8ff9-424b-a6b0-70cc4d6723c8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.150702 Aug 18 22:16:58.642346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1907/3814] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:58 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:58.646766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-db79eec1-a4ac-4cae-a035-90c6b17e3265 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:58.647371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-db79eec1-a4ac-4cae-a035-90c6b17e3265 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:58.653506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-db79eec1-a4ac-4cae-a035-90c6b17e3265 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:58.654067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-db79eec1-a4ac-4cae-a035-90c6b17e3265 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:58.654507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-db79eec1-a4ac-4cae-a035-90c6b17e3265 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:58.655213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-db79eec1-a4ac-4cae-a035-90c6b17e3265 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:58.655675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-db79eec1-a4ac-4cae-a035-90c6b17e3265 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:58.656101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-db79eec1-a4ac-4cae-a035-90c6b17e3265 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:58.691524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6a7eb008-08c1-4f86-81ad-bb0ef891e6d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:58.700394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6a7eb008-08c1-4f86-81ad-bb0ef891e6d4 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152594 Aug 18 22:16:58.701572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1908/3815] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:58 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:58.719689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-db79eec1-a4ac-4cae-a035-90c6b17e3265 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:58.726248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c3ad2631-2de7-4c05-943c-75ed47eac877 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:58.726872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c3ad2631-2de7-4c05-943c-75ed47eac877 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:58.727977 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-db79eec1-a4ac-4cae-a035-90c6b17e3265 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084674 Aug 18 22:16:58.728550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1908/3816] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:58 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:58.732903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3ad2631-2de7-4c05-943c-75ed47eac877 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:58.733388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3ad2631-2de7-4c05-943c-75ed47eac877 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:58.733854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3ad2631-2de7-4c05-943c-75ed47eac877 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:58.734549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3ad2631-2de7-4c05-943c-75ed47eac877 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:58.735006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3ad2631-2de7-4c05-943c-75ed47eac877 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:58.735438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c3ad2631-2de7-4c05-943c-75ed47eac877 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:58.861064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c3ad2631-2de7-4c05-943c-75ed47eac877 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:58.869207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c3ad2631-2de7-4c05-943c-75ed47eac877 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.146785 Aug 18 22:16:58.869811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1909/3817] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:58 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:58.992755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-058c1e86-8087-41d6-be71-407aeb78345a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:58.993374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-058c1e86-8087-41d6-be71-407aeb78345a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:59.000035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-058c1e86-8087-41d6-be71-407aeb78345a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:59.000690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-058c1e86-8087-41d6-be71-407aeb78345a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:59.001137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-058c1e86-8087-41d6-be71-407aeb78345a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:59.001858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-058c1e86-8087-41d6-be71-407aeb78345a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:59.002318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-058c1e86-8087-41d6-be71-407aeb78345a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:59.002752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-058c1e86-8087-41d6-be71-407aeb78345a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:59.134404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-058c1e86-8087-41d6-be71-407aeb78345a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:59.142892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-058c1e86-8087-41d6-be71-407aeb78345a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:59.144381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-058c1e86-8087-41d6-be71-407aeb78345a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:59.145524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-058c1e86-8087-41d6-be71-407aeb78345a tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156739 Aug 18 22:16:59.146130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1909/3818] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:16:58 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:16:59.663502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4e24e6be-d2b9-4068-bad3-295334ac0f38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:59.664132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4e24e6be-d2b9-4068-bad3-295334ac0f38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:59.670188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e24e6be-d2b9-4068-bad3-295334ac0f38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:59.670678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e24e6be-d2b9-4068-bad3-295334ac0f38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:59.671120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e24e6be-d2b9-4068-bad3-295334ac0f38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:59.671814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e24e6be-d2b9-4068-bad3-295334ac0f38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:59.672279 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e24e6be-d2b9-4068-bad3-295334ac0f38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:59.672709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e24e6be-d2b9-4068-bad3-295334ac0f38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:59.722972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8456deb3-f8bd-4184-9cb6-1e5f555095c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:59.723596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8456deb3-f8bd-4184-9cb6-1e5f555095c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:59.730116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8456deb3-f8bd-4184-9cb6-1e5f555095c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:59.730602 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8456deb3-f8bd-4184-9cb6-1e5f555095c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:59.731044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8456deb3-f8bd-4184-9cb6-1e5f555095c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:59.731739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8456deb3-f8bd-4184-9cb6-1e5f555095c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:59.732237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8456deb3-f8bd-4184-9cb6-1e5f555095c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:59.732666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8456deb3-f8bd-4184-9cb6-1e5f555095c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:59.807240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4e24e6be-d2b9-4068-bad3-295334ac0f38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:59.816072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4e24e6be-d2b9-4068-bad3-295334ac0f38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156388 Aug 18 22:16:59.816943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1910/3819] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:59 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:16:59.821408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ffdef144-1160-4e0b-8a5e-2b15d1e097a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:59.822158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ffdef144-1160-4e0b-8a5e-2b15d1e097a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:59.829305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffdef144-1160-4e0b-8a5e-2b15d1e097a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:59.829899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffdef144-1160-4e0b-8a5e-2b15d1e097a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:59.830445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffdef144-1160-4e0b-8a5e-2b15d1e097a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:59.831273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffdef144-1160-4e0b-8a5e-2b15d1e097a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:59.831837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffdef144-1160-4e0b-8a5e-2b15d1e097a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:59.832372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ffdef144-1160-4e0b-8a5e-2b15d1e097a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:59.866202 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8456deb3-f8bd-4184-9cb6-1e5f555095c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:59.874897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8456deb3-f8bd-4184-9cb6-1e5f555095c0 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155555 Aug 18 22:16:59.889294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1910/3820] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:59 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:16:59.894152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ea8d647a-6c6e-4352-b259-732f114ab892 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:16:59.894877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ea8d647a-6c6e-4352-b259-732f114ab892 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:16:59.896605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:16:59.897369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ffdef144-1160-4e0b-8a5e-2b15d1e097a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:16:59.902690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea8d647a-6c6e-4352-b259-732f114ab892 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:59.903180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea8d647a-6c6e-4352-b259-732f114ab892 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:59.903625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea8d647a-6c6e-4352-b259-732f114ab892 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:59.904867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea8d647a-6c6e-4352-b259-732f114ab892 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:16:59.905323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea8d647a-6c6e-4352-b259-732f114ab892 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:16:59.905780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea8d647a-6c6e-4352-b259-732f114ab892 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:16:59.907079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ffdef144-1160-4e0b-8a5e-2b15d1e097a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.089234 Aug 18 22:16:59.907951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1911/3821] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:59 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:00.037236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ea8d647a-6c6e-4352-b259-732f114ab892 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:00.045360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea8d647a-6c6e-4352-b259-732f114ab892 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.155052 Aug 18 22:17:00.045956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1911/3822] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:16:59 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:00.168376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-32839a83-7071-41c2-af02-beb1fcc5e25d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:00.169145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-32839a83-7071-41c2-af02-beb1fcc5e25d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:00.175171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32839a83-7071-41c2-af02-beb1fcc5e25d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:00.175662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32839a83-7071-41c2-af02-beb1fcc5e25d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:00.176105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32839a83-7071-41c2-af02-beb1fcc5e25d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:00.176802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32839a83-7071-41c2-af02-beb1fcc5e25d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:00.177516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32839a83-7071-41c2-af02-beb1fcc5e25d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:00.177972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-32839a83-7071-41c2-af02-beb1fcc5e25d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:00.306220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-32839a83-7071-41c2-af02-beb1fcc5e25d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:00.316195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-32839a83-7071-41c2-af02-beb1fcc5e25d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:00.317773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-32839a83-7071-41c2-af02-beb1fcc5e25d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:00.318946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-32839a83-7071-41c2-af02-beb1fcc5e25d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154770 Aug 18 22:17:00.319534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1912/3823] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:00 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:00.838514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52bbb596-4a44-46d3-8432-f7b1532f1b7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:00.839134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-52bbb596-4a44-46d3-8432-f7b1532f1b7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:00.846404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52bbb596-4a44-46d3-8432-f7b1532f1b7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:00.846891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52bbb596-4a44-46d3-8432-f7b1532f1b7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:00.847334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52bbb596-4a44-46d3-8432-f7b1532f1b7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:00.848025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52bbb596-4a44-46d3-8432-f7b1532f1b7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:00.848485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52bbb596-4a44-46d3-8432-f7b1532f1b7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:00.848916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52bbb596-4a44-46d3-8432-f7b1532f1b7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:00.897019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ca420ae2-ace1-4969-ba0a-0a7a366b6b80 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:00.897725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ca420ae2-ace1-4969-ba0a-0a7a366b6b80 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:00.905006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca420ae2-ace1-4969-ba0a-0a7a366b6b80 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:00.905499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca420ae2-ace1-4969-ba0a-0a7a366b6b80 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:00.905969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca420ae2-ace1-4969-ba0a-0a7a366b6b80 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:00.906674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca420ae2-ace1-4969-ba0a-0a7a366b6b80 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:00.907140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca420ae2-ace1-4969-ba0a-0a7a366b6b80 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:00.907576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ca420ae2-ace1-4969-ba0a-0a7a366b6b80 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:00.990931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-52bbb596-4a44-46d3-8432-f7b1532f1b7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:00.999284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-52bbb596-4a44-46d3-8432-f7b1532f1b7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.164551 Aug 18 22:17:00.999872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1912/3824] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:00 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:01.004302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5d85380a-7a7d-4043-b328-1861a0c623d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:01.005084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5d85380a-7a7d-4043-b328-1861a0c623d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:01.010786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d85380a-7a7d-4043-b328-1861a0c623d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:01.011279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d85380a-7a7d-4043-b328-1861a0c623d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:01.011719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d85380a-7a7d-4043-b328-1861a0c623d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:01.012421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d85380a-7a7d-4043-b328-1861a0c623d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:01.012878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d85380a-7a7d-4043-b328-1861a0c623d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:01.013337 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5d85380a-7a7d-4043-b328-1861a0c623d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:01.037575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ca420ae2-ace1-4969-ba0a-0a7a366b6b80 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:01.047713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ca420ae2-ace1-4969-ba0a-0a7a366b6b80 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154661 Aug 18 22:17:01.048434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1913/3825] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:00 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:01.066427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1c6a1090-0d86-4478-8cc7-62e08599f7ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:01.067135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1c6a1090-0d86-4478-8cc7-62e08599f7ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:01.073307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c6a1090-0d86-4478-8cc7-62e08599f7ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:01.073957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c6a1090-0d86-4478-8cc7-62e08599f7ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:01.074394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c6a1090-0d86-4478-8cc7-62e08599f7ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:01.074680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5d85380a-7a7d-4043-b328-1861a0c623d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:01.075117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c6a1090-0d86-4478-8cc7-62e08599f7ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:01.075575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c6a1090-0d86-4478-8cc7-62e08599f7ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:01.076000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c6a1090-0d86-4478-8cc7-62e08599f7ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:01.089138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5d85380a-7a7d-4043-b328-1861a0c623d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088199 Aug 18 22:17:01.089917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1913/3826] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:00 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:01.202119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1c6a1090-0d86-4478-8cc7-62e08599f7ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:01.210165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1c6a1090-0d86-4478-8cc7-62e08599f7ff tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.147605 Aug 18 22:17:01.210734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1914/3827] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:01 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:01.342570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-14cfcfd6-11d6-4449-a867-83e9c7c99bda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:01.344913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-14cfcfd6-11d6-4449-a867-83e9c7c99bda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:01.349537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14cfcfd6-11d6-4449-a867-83e9c7c99bda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:01.349846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14cfcfd6-11d6-4449-a867-83e9c7c99bda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:01.350282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14cfcfd6-11d6-4449-a867-83e9c7c99bda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:01.350965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14cfcfd6-11d6-4449-a867-83e9c7c99bda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:01.351413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14cfcfd6-11d6-4449-a867-83e9c7c99bda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:01.351835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-14cfcfd6-11d6-4449-a867-83e9c7c99bda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:01.480550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-14cfcfd6-11d6-4449-a867-83e9c7c99bda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:01.489486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-14cfcfd6-11d6-4449-a867-83e9c7c99bda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:01.491003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-14cfcfd6-11d6-4449-a867-83e9c7c99bda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:01.492151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-14cfcfd6-11d6-4449-a867-83e9c7c99bda tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.154071 Aug 18 22:17:01.492707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1914/3828] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:01 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:02.022659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-061416ee-4b6b-4cd5-918b-921699c1f459 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:02.023284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-061416ee-4b6b-4cd5-918b-921699c1f459 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:02.029898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-061416ee-4b6b-4cd5-918b-921699c1f459 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:02.030387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-061416ee-4b6b-4cd5-918b-921699c1f459 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:02.030848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-061416ee-4b6b-4cd5-918b-921699c1f459 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:02.031644 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-061416ee-4b6b-4cd5-918b-921699c1f459 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:02.032122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-061416ee-4b6b-4cd5-918b-921699c1f459 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:02.032550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-061416ee-4b6b-4cd5-918b-921699c1f459 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:02.068186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-132762ae-14a8-49fb-a87c-0d1f955f89c3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:02.068827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-132762ae-14a8-49fb-a87c-0d1f955f89c3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:02.075420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-132762ae-14a8-49fb-a87c-0d1f955f89c3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:02.075898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-132762ae-14a8-49fb-a87c-0d1f955f89c3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:02.076333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-132762ae-14a8-49fb-a87c-0d1f955f89c3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:02.077019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-132762ae-14a8-49fb-a87c-0d1f955f89c3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:02.077467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-132762ae-14a8-49fb-a87c-0d1f955f89c3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:02.077912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-132762ae-14a8-49fb-a87c-0d1f955f89c3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:02.237104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-132762ae-14a8-49fb-a87c-0d1f955f89c3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:02.245726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-132762ae-14a8-49fb-a87c-0d1f955f89c3 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.181211 Aug 18 22:17:02.246322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1915/3829] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:02 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:02.251184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fa5171db-86a4-4876-964b-9f75bd18e7f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:02.251852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fa5171db-86a4-4876-964b-9f75bd18e7f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:02.258018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa5171db-86a4-4876-964b-9f75bd18e7f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:02.258508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa5171db-86a4-4876-964b-9f75bd18e7f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:02.258947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa5171db-86a4-4876-964b-9f75bd18e7f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:02.259665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa5171db-86a4-4876-964b-9f75bd18e7f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:02.260111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa5171db-86a4-4876-964b-9f75bd18e7f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:02.260627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa5171db-86a4-4876-964b-9f75bd18e7f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:02.324074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fa5171db-86a4-4876-964b-9f75bd18e7f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:02.333129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fa5171db-86a4-4876-964b-9f75bd18e7f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085787 Aug 18 22:17:02.333748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1916/3830] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:02.341172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-eb438ae7-f82e-4230-a66c-f2fbc63e273c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:02.342347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-eb438ae7-f82e-4230-a66c-f2fbc63e273c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:02.348387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb438ae7-f82e-4230-a66c-f2fbc63e273c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:02.348872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb438ae7-f82e-4230-a66c-f2fbc63e273c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:02.349311 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb438ae7-f82e-4230-a66c-f2fbc63e273c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:02.350031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb438ae7-f82e-4230-a66c-f2fbc63e273c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:02.350489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb438ae7-f82e-4230-a66c-f2fbc63e273c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:02.350919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-eb438ae7-f82e-4230-a66c-f2fbc63e273c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:02.390639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-061416ee-4b6b-4cd5-918b-921699c1f459 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:02.399027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-061416ee-4b6b-4cd5-918b-921699c1f459 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.381841 Aug 18 22:17:02.399612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1915/3831] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:02 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:02.481562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-eb438ae7-f82e-4230-a66c-f2fbc63e273c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:02.490334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-eb438ae7-f82e-4230-a66c-f2fbc63e273c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152804 Aug 18 22:17:02.490899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1917/3832] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:02 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:02.514965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d77417ec-5fdf-42ea-9003-7bea00891882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:02.515586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d77417ec-5fdf-42ea-9003-7bea00891882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:02.521568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d77417ec-5fdf-42ea-9003-7bea00891882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:02.522078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d77417ec-5fdf-42ea-9003-7bea00891882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:02.522515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d77417ec-5fdf-42ea-9003-7bea00891882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:02.523197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d77417ec-5fdf-42ea-9003-7bea00891882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:02.523654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d77417ec-5fdf-42ea-9003-7bea00891882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:02.524081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d77417ec-5fdf-42ea-9003-7bea00891882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:02.656115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d77417ec-5fdf-42ea-9003-7bea00891882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:02.664737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d77417ec-5fdf-42ea-9003-7bea00891882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:02.666282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d77417ec-5fdf-42ea-9003-7bea00891882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:02.667437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d77417ec-5fdf-42ea-9003-7bea00891882 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.156394 Aug 18 22:17:02.668003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1916/3833] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:02 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:02.739748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:17:02.739940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:17:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:17:03.268326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-35fee9fa-0229-4da0-a4c9-0a19eb95d0cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:03.268951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-35fee9fa-0229-4da0-a4c9-0a19eb95d0cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:03.275565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35fee9fa-0229-4da0-a4c9-0a19eb95d0cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:03.276053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35fee9fa-0229-4da0-a4c9-0a19eb95d0cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:03.276498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35fee9fa-0229-4da0-a4c9-0a19eb95d0cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:03.277194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35fee9fa-0229-4da0-a4c9-0a19eb95d0cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:03.277681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35fee9fa-0229-4da0-a4c9-0a19eb95d0cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:03.278117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35fee9fa-0229-4da0-a4c9-0a19eb95d0cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:03.357890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-81a1fcf9-8e45-403b-810e-ac2cdb286bd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:03.358912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-81a1fcf9-8e45-403b-810e-ac2cdb286bd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:03.365613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81a1fcf9-8e45-403b-810e-ac2cdb286bd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:03.366134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81a1fcf9-8e45-403b-810e-ac2cdb286bd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:03.366578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81a1fcf9-8e45-403b-810e-ac2cdb286bd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:03.367287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81a1fcf9-8e45-403b-810e-ac2cdb286bd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:03.367743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81a1fcf9-8e45-403b-810e-ac2cdb286bd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:03.368171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81a1fcf9-8e45-403b-810e-ac2cdb286bd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:03.407429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-35fee9fa-0229-4da0-a4c9-0a19eb95d0cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:03.415915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-35fee9fa-0229-4da0-a4c9-0a19eb95d0cc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151424 Aug 18 22:17:03.416499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1918/3834] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:03 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:03.421530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f99d6c7-b022-49bb-883c-846e9a351950 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:03.422160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f99d6c7-b022-49bb-883c-846e9a351950 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:03.428381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f99d6c7-b022-49bb-883c-846e9a351950 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:03.428899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f99d6c7-b022-49bb-883c-846e9a351950 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:03.429284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f99d6c7-b022-49bb-883c-846e9a351950 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:03.430002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f99d6c7-b022-49bb-883c-846e9a351950 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:03.430452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f99d6c7-b022-49bb-883c-846e9a351950 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:03.430873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f99d6c7-b022-49bb-883c-846e9a351950 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:03.434118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-81a1fcf9-8e45-403b-810e-ac2cdb286bd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:03.443601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-81a1fcf9-8e45-403b-810e-ac2cdb286bd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.091889 Aug 18 22:17:03.444179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1917/3835] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:03.447182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:03.511456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-954457c6-12d9-409e-af0d-bb46510bfd22 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:03.511990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-954457c6-12d9-409e-af0d-bb46510bfd22 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:03.518234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-954457c6-12d9-409e-af0d-bb46510bfd22 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:03.518725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-954457c6-12d9-409e-af0d-bb46510bfd22 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:03.519164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-954457c6-12d9-409e-af0d-bb46510bfd22 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:03.519856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-954457c6-12d9-409e-af0d-bb46510bfd22 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:03.520311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-954457c6-12d9-409e-af0d-bb46510bfd22 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:03.520743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-954457c6-12d9-409e-af0d-bb46510bfd22 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:03.565053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4f99d6c7-b022-49bb-883c-846e9a351950 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:03.573165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f99d6c7-b022-49bb-883c-846e9a351950 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.155719 Aug 18 22:17:03.573900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1919/3836] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:03 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:03.650039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-954457c6-12d9-409e-af0d-bb46510bfd22 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:03.658355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-954457c6-12d9-409e-af0d-bb46510bfd22 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.150971 Aug 18 22:17:03.658952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1918/3837] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:03 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:03.690899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-439168e8-f5d4-45a6-b5d1-c292a00d6261 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:03.691513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-439168e8-f5d4-45a6-b5d1-c292a00d6261 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:03.697625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-439168e8-f5d4-45a6-b5d1-c292a00d6261 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:03.698119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-439168e8-f5d4-45a6-b5d1-c292a00d6261 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:03.698557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-439168e8-f5d4-45a6-b5d1-c292a00d6261 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:03.699249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-439168e8-f5d4-45a6-b5d1-c292a00d6261 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:03.699701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-439168e8-f5d4-45a6-b5d1-c292a00d6261 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:03.700130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-439168e8-f5d4-45a6-b5d1-c292a00d6261 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:03.827642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-439168e8-f5d4-45a6-b5d1-c292a00d6261 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:03.836162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-439168e8-f5d4-45a6-b5d1-c292a00d6261 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:03.837728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-439168e8-f5d4-45a6-b5d1-c292a00d6261 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:03.838973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-439168e8-f5d4-45a6-b5d1-c292a00d6261 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.152130 Aug 18 22:17:03.839530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1920/3838] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:03 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:04.437925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a25c0352-dbf3-45b4-bb83-35c4f623b9ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:04.438526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a25c0352-dbf3-45b4-bb83-35c4f623b9ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:04.444938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a25c0352-dbf3-45b4-bb83-35c4f623b9ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:04.445420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a25c0352-dbf3-45b4-bb83-35c4f623b9ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:04.445886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a25c0352-dbf3-45b4-bb83-35c4f623b9ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:04.446570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a25c0352-dbf3-45b4-bb83-35c4f623b9ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:04.447019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a25c0352-dbf3-45b4-bb83-35c4f623b9ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:04.447455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a25c0352-dbf3-45b4-bb83-35c4f623b9ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:04.451768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:04.464380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8605e630-6646-486f-830b-91648311fb0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:04.464999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8605e630-6646-486f-830b-91648311fb0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:04.472106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8605e630-6646-486f-830b-91648311fb0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:04.472588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8605e630-6646-486f-830b-91648311fb0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:04.473022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8605e630-6646-486f-830b-91648311fb0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:04.473739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8605e630-6646-486f-830b-91648311fb0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:04.474190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8605e630-6646-486f-830b-91648311fb0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:04.474613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8605e630-6646-486f-830b-91648311fb0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:04.534763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8605e630-6646-486f-830b-91648311fb0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:04.543295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8605e630-6646-486f-830b-91648311fb0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082734 Aug 18 22:17:04.543885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1921/3839] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:04.576777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a25c0352-dbf3-45b4-bb83-35c4f623b9ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:04.584975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a25c0352-dbf3-45b4-bb83-35c4f623b9ea tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150944 Aug 18 22:17:04.585544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1919/3840] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:04 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:04.594794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-10825e77-baed-4127-84dc-44635be17a44 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:04.595846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-10825e77-baed-4127-84dc-44635be17a44 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:04.601767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10825e77-baed-4127-84dc-44635be17a44 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:04.602248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10825e77-baed-4127-84dc-44635be17a44 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:04.602684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10825e77-baed-4127-84dc-44635be17a44 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:04.603373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10825e77-baed-4127-84dc-44635be17a44 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:04.603837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10825e77-baed-4127-84dc-44635be17a44 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:04.604267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10825e77-baed-4127-84dc-44635be17a44 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:04.680626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-40528bc4-f763-40b4-b3fa-643d19203708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:04.681253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-40528bc4-f763-40b4-b3fa-643d19203708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:04.687270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40528bc4-f763-40b4-b3fa-643d19203708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:04.687761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40528bc4-f763-40b4-b3fa-643d19203708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:04.688254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40528bc4-f763-40b4-b3fa-643d19203708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:04.688905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40528bc4-f763-40b4-b3fa-643d19203708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:04.689362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40528bc4-f763-40b4-b3fa-643d19203708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:04.689814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40528bc4-f763-40b4-b3fa-643d19203708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:04.740088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-10825e77-baed-4127-84dc-44635be17a44 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:04.748346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-10825e77-baed-4127-84dc-44635be17a44 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.157831 Aug 18 22:17:04.749114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1922/3841] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:04 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:04.821653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-40528bc4-f763-40b4-b3fa-643d19203708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:04.829967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-40528bc4-f763-40b4-b3fa-643d19203708 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153537 Aug 18 22:17:04.830521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1920/3842] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:04 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:04.863275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ec94467b-68c0-4c05-b348-8dd40587fab2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:04.863895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ec94467b-68c0-4c05-b348-8dd40587fab2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:04.869813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec94467b-68c0-4c05-b348-8dd40587fab2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:04.870301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec94467b-68c0-4c05-b348-8dd40587fab2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:04.870743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec94467b-68c0-4c05-b348-8dd40587fab2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:04.871433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec94467b-68c0-4c05-b348-8dd40587fab2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:04.871892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec94467b-68c0-4c05-b348-8dd40587fab2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:04.872321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec94467b-68c0-4c05-b348-8dd40587fab2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:04.999582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ec94467b-68c0-4c05-b348-8dd40587fab2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:05.008343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ec94467b-68c0-4c05-b348-8dd40587fab2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:05.009915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ec94467b-68c0-4c05-b348-8dd40587fab2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:05.011072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ec94467b-68c0-4c05-b348-8dd40587fab2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.151723 Aug 18 22:17:05.011641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1923/3843] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:04 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:05.564977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c17d66c4-83ac-4674-90c2-65fadafeb646 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:05.565622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c17d66c4-83ac-4674-90c2-65fadafeb646 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:05.572029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c17d66c4-83ac-4674-90c2-65fadafeb646 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:05.572517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c17d66c4-83ac-4674-90c2-65fadafeb646 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:05.572955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c17d66c4-83ac-4674-90c2-65fadafeb646 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:05.573670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c17d66c4-83ac-4674-90c2-65fadafeb646 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:05.574128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c17d66c4-83ac-4674-90c2-65fadafeb646 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:05.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c17d66c4-83ac-4674-90c2-65fadafeb646 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:05.606805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-65f5fdf4-ce59-49f9-a2ae-1dba16bc1654 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:05.608120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-65f5fdf4-ce59-49f9-a2ae-1dba16bc1654 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:05.614613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65f5fdf4-ce59-49f9-a2ae-1dba16bc1654 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:05.615172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65f5fdf4-ce59-49f9-a2ae-1dba16bc1654 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:05.615640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65f5fdf4-ce59-49f9-a2ae-1dba16bc1654 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:05.616336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65f5fdf4-ce59-49f9-a2ae-1dba16bc1654 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:05.616791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65f5fdf4-ce59-49f9-a2ae-1dba16bc1654 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:05.617220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65f5fdf4-ce59-49f9-a2ae-1dba16bc1654 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:05.638101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c17d66c4-83ac-4674-90c2-65fadafeb646 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:05.647170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c17d66c4-83ac-4674-90c2-65fadafeb646 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086056 Aug 18 22:17:05.647741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1921/3844] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:05.755287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-65f5fdf4-ce59-49f9-a2ae-1dba16bc1654 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:05.763484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-65f5fdf4-ce59-49f9-a2ae-1dba16bc1654 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.160683 Aug 18 22:17:05.764056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1924/3845] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:05 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:05.769397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-63815845-2b9a-451e-b095-2e9e0389adda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:05.770114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-63815845-2b9a-451e-b095-2e9e0389adda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:05.776282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63815845-2b9a-451e-b095-2e9e0389adda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:05.776924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63815845-2b9a-451e-b095-2e9e0389adda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:05.777282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63815845-2b9a-451e-b095-2e9e0389adda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:05.777886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63815845-2b9a-451e-b095-2e9e0389adda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:05.778338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63815845-2b9a-451e-b095-2e9e0389adda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:05.778771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63815845-2b9a-451e-b095-2e9e0389adda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:05.851810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2f265dbe-4121-4cb5-a0c2-45cb00e1bbba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:05.852269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2f265dbe-4121-4cb5-a0c2-45cb00e1bbba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:05.859101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f265dbe-4121-4cb5-a0c2-45cb00e1bbba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:05.859598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f265dbe-4121-4cb5-a0c2-45cb00e1bbba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:05.860041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f265dbe-4121-4cb5-a0c2-45cb00e1bbba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:05.860739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f265dbe-4121-4cb5-a0c2-45cb00e1bbba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:05.861196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f265dbe-4121-4cb5-a0c2-45cb00e1bbba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:05.861763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2f265dbe-4121-4cb5-a0c2-45cb00e1bbba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:05.904041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-63815845-2b9a-451e-b095-2e9e0389adda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:05.912225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-63815845-2b9a-451e-b095-2e9e0389adda tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.146636 Aug 18 22:17:05.912803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1922/3846] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:05 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:05.992999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2f265dbe-4121-4cb5-a0c2-45cb00e1bbba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:06.001228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2f265dbe-4121-4cb5-a0c2-45cb00e1bbba tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.153458 Aug 18 22:17:06.001844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1925/3847] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:05 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:06.034714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a5cc14ad-eaaa-444d-b8cb-3d09aa35ae62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:06.035363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a5cc14ad-eaaa-444d-b8cb-3d09aa35ae62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:06.041291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5cc14ad-eaaa-444d-b8cb-3d09aa35ae62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:06.041807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5cc14ad-eaaa-444d-b8cb-3d09aa35ae62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:06.042249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5cc14ad-eaaa-444d-b8cb-3d09aa35ae62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:06.043174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5cc14ad-eaaa-444d-b8cb-3d09aa35ae62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:06.043630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5cc14ad-eaaa-444d-b8cb-3d09aa35ae62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:06.044054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5cc14ad-eaaa-444d-b8cb-3d09aa35ae62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:06.179126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a5cc14ad-eaaa-444d-b8cb-3d09aa35ae62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:06.187689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a5cc14ad-eaaa-444d-b8cb-3d09aa35ae62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:06.189190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a5cc14ad-eaaa-444d-b8cb-3d09aa35ae62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:06.190373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a5cc14ad-eaaa-444d-b8cb-3d09aa35ae62 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 200 len: 1801 microversion: 2.20 time: 0.159563 Aug 18 22:17:06.190935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1923/3848] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:06 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 1801 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:06.212845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8c8b1ccf-ae0e-40bb-8ec1-2f9f2b94a689 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '.version_select at 0x7fd8896a0a60>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:06.235611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8c8b1ccf-ae0e-40bb-8ec1-2f9f2b94a689 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1329960640" status: 204 len: 0 microversion: 2.20 time: 0.026596 Aug 18 22:17:06.236181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1926/3849] 10.222.0.82 () {60 vars in 1262 bytes} [Thu Aug 18 22:17:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1329960640 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 22:17:06.668339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6bfcd6c5-04bb-4e71-b4e8-1e0e05670351 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:06.668986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6bfcd6c5-04bb-4e71-b4e8-1e0e05670351 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:06.675612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bfcd6c5-04bb-4e71-b4e8-1e0e05670351 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:06.676099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bfcd6c5-04bb-4e71-b4e8-1e0e05670351 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:06.676546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bfcd6c5-04bb-4e71-b4e8-1e0e05670351 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:06.677504 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bfcd6c5-04bb-4e71-b4e8-1e0e05670351 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:06.678212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bfcd6c5-04bb-4e71-b4e8-1e0e05670351 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:06.678649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6bfcd6c5-04bb-4e71-b4e8-1e0e05670351 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:06.740407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6bfcd6c5-04bb-4e71-b4e8-1e0e05670351 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:06.749633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6bfcd6c5-04bb-4e71-b4e8-1e0e05670351 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085181 Aug 18 22:17:06.750413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1924/3850] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:06.785382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-456e1c39-b162-4787-a890-cb8a02c31f17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:06.786041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-456e1c39-b162-4787-a890-cb8a02c31f17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:06.792113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-456e1c39-b162-4787-a890-cb8a02c31f17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:06.792598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-456e1c39-b162-4787-a890-cb8a02c31f17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:06.794284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-456e1c39-b162-4787-a890-cb8a02c31f17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:06.795567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-456e1c39-b162-4787-a890-cb8a02c31f17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:06.796066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-456e1c39-b162-4787-a890-cb8a02c31f17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:06.796504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-456e1c39-b162-4787-a890-cb8a02c31f17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:06.934083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2210fbe2-5803-40b4-9c81-d65f598a82de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:06.934700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2210fbe2-5803-40b4-9c81-d65f598a82de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:06.940593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2210fbe2-5803-40b4-9c81-d65f598a82de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:06.941101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2210fbe2-5803-40b4-9c81-d65f598a82de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:06.941536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2210fbe2-5803-40b4-9c81-d65f598a82de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:06.942244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2210fbe2-5803-40b4-9c81-d65f598a82de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:06.942695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2210fbe2-5803-40b4-9c81-d65f598a82de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:06.943118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2210fbe2-5803-40b4-9c81-d65f598a82de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:06.998457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-456e1c39-b162-4787-a890-cb8a02c31f17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:07.006953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-456e1c39-b162-4787-a890-cb8a02c31f17 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.226021 Aug 18 22:17:07.007631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1927/3851] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:06 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:07.022007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f906b8ec-34ad-4ba8-be0d-be655c512188 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:07.022709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f906b8ec-34ad-4ba8-be0d-be655c512188 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:07.029450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f906b8ec-34ad-4ba8-be0d-be655c512188 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:07.030901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f906b8ec-34ad-4ba8-be0d-be655c512188 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:07.031423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f906b8ec-34ad-4ba8-be0d-be655c512188 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:07.032670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f906b8ec-34ad-4ba8-be0d-be655c512188 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:07.033209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f906b8ec-34ad-4ba8-be0d-be655c512188 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:07.033758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f906b8ec-34ad-4ba8-be0d-be655c512188 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:07.085634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2210fbe2-5803-40b4-9c81-d65f598a82de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:07.094451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2210fbe2-5803-40b4-9c81-d65f598a82de tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.164214 Aug 18 22:17:07.103014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1925/3852] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:06 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:07.238580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f906b8ec-34ad-4ba8-be0d-be655c512188 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:07.248626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f906b8ec-34ad-4ba8-be0d-be655c512188 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.230327 Aug 18 22:17:07.257444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1928/3853] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:07 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:07.318069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-b2104839-d2e0-4650-b6e4-e17c88cebf5e req-17faf2f5-e816-401e-9b38-7dc0a09f9494 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0426bb7b-e862-4873-9c1e-7878b89cde47", "tag": "a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:07.329277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b2104839-d2e0-4650-b6e4-e17c88cebf5e req-17faf2f5-e816-401e-9b38-7dc0a09f9494 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:07.330044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b2104839-d2e0-4650-b6e4-e17c88cebf5e req-17faf2f5-e816-401e-9b38-7dc0a09f9494 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:07.330478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b2104839-d2e0-4650-b6e4-e17c88cebf5e req-17faf2f5-e816-401e-9b38-7dc0a09f9494 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:07.342140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-b2104839-d2e0-4650-b6e4-e17c88cebf5e req-17faf2f5-e816-401e-9b38-7dc0a09f9494 service nova] Creating event network-changed:a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b for instance 0426bb7b-e862-4873-9c1e-7878b89cde47 on hv-cinder-85367 Aug 18 22:17:07.348326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-b2104839-d2e0-4650-b6e4-e17c88cebf5e req-17faf2f5-e816-401e-9b38-7dc0a09f9494 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099765 Aug 18 22:17:07.349242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1926/3854] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:17:07.499575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da8b3fea-b657-4aa0-ac33-8f98ecdc9ee2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Action: 'create', calling method: .version_select at 0x7fd889633e50>, body: {"keypair": {"name": "tempest-keypair-2011985393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/qn163XxR8T8Jneyi3i1ofU6ASpG13d2f2L8VL4OU8+HGpCazyEdeiryG5nv8yoAp3veFYzBtxHnt//tb0tT0Mbv/sVkP2lLCtJoKcI/5AO303vNfrDw80HyWZvtDYxw=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:07.516632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-da8b3fea-b657-4aa0-ac33-8f98ecdc9ee2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Getting quotas for project efb811ce4fca47728e61489adbf97434. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:17:07.521229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-da8b3fea-b657-4aa0-ac33-8f98ecdc9ee2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Getting quotas for user e280bab439a3446b993c721bc98c1c6e and project efb811ce4fca47728e61489adbf97434. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:17:07.545917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da8b3fea-b657-4aa0-ac33-8f98ecdc9ee2 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050863 Aug 18 22:17:07.546890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1929/3855] 10.222.0.82 () {62 vars in 1200 bytes} [Thu Aug 18 22:17:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 22:17:07.771071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dfa11e56-f5d1-4ad2-af9a-795c842980b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:07.772497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dfa11e56-f5d1-4ad2-af9a-795c842980b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:07.779629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfa11e56-f5d1-4ad2-af9a-795c842980b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:07.780440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfa11e56-f5d1-4ad2-af9a-795c842980b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:07.781097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfa11e56-f5d1-4ad2-af9a-795c842980b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:07.782235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfa11e56-f5d1-4ad2-af9a-795c842980b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:07.783354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfa11e56-f5d1-4ad2-af9a-795c842980b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:07.783790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dfa11e56-f5d1-4ad2-af9a-795c842980b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:07.853020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dfa11e56-f5d1-4ad2-af9a-795c842980b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:07.862496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dfa11e56-f5d1-4ad2-af9a-795c842980b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.095526 Aug 18 22:17:07.866037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1927/3856] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:07 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:08.030556 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b3c73097-6614-4d2a-b626-098aa39488a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:08.031288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b3c73097-6614-4d2a-b626-098aa39488a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:08.039825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3c73097-6614-4d2a-b626-098aa39488a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:08.048197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3c73097-6614-4d2a-b626-098aa39488a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:08.049319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3c73097-6614-4d2a-b626-098aa39488a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:08.050353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3c73097-6614-4d2a-b626-098aa39488a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:08.055367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3c73097-6614-4d2a-b626-098aa39488a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:08.056828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b3c73097-6614-4d2a-b626-098aa39488a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:08.117903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aa5235db-1167-4260-bd3d-aef1d1e5a00d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:08.118763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-aa5235db-1167-4260-bd3d-aef1d1e5a00d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:08.127886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa5235db-1167-4260-bd3d-aef1d1e5a00d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:08.128385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa5235db-1167-4260-bd3d-aef1d1e5a00d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:08.129369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa5235db-1167-4260-bd3d-aef1d1e5a00d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:08.130333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa5235db-1167-4260-bd3d-aef1d1e5a00d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:08.130967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa5235db-1167-4260-bd3d-aef1d1e5a00d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:08.131397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-aa5235db-1167-4260-bd3d-aef1d1e5a00d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:08.294042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-aa5235db-1167-4260-bd3d-aef1d1e5a00d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:08.317756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aa5235db-1167-4260-bd3d-aef1d1e5a00d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.204697 Aug 18 22:17:08.318061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b3c73097-6614-4d2a-b626-098aa39488a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:08.319251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1928/3857] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:08 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:08.329891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1d610a23-9286-47a5-a9c6-c0aa386e7684 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:08.330295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b3c73097-6614-4d2a-b626-098aa39488a9 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.306319 Aug 18 22:17:08.337632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1930/3858] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:08 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:08.338070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1d610a23-9286-47a5-a9c6-c0aa386e7684 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:08.349349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d610a23-9286-47a5-a9c6-c0aa386e7684 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:08.349973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d610a23-9286-47a5-a9c6-c0aa386e7684 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:08.350636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d610a23-9286-47a5-a9c6-c0aa386e7684 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:08.352117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d610a23-9286-47a5-a9c6-c0aa386e7684 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:08.352598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d610a23-9286-47a5-a9c6-c0aa386e7684 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:08.353624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1d610a23-9286-47a5-a9c6-c0aa386e7684 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:08.491755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1d610a23-9286-47a5-a9c6-c0aa386e7684 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:08.500203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1d610a23-9286-47a5-a9c6-c0aa386e7684 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.179749 Aug 18 22:17:08.500782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1929/3859] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:08 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:08.886330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8e60a72b-3234-47b0-9346-13a659ee2297 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:08.886988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8e60a72b-3234-47b0-9346-13a659ee2297 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:08.893008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e60a72b-3234-47b0-9346-13a659ee2297 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:08.893411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e60a72b-3234-47b0-9346-13a659ee2297 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:08.893884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e60a72b-3234-47b0-9346-13a659ee2297 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:08.894588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e60a72b-3234-47b0-9346-13a659ee2297 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:08.895049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e60a72b-3234-47b0-9346-13a659ee2297 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:08.895486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8e60a72b-3234-47b0-9346-13a659ee2297 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:08.921372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-655445002", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a5f12da2-1a73-4ec6-b81b-e9c9d959cad7"}], "security_groups": [{"name": "tempest-securitygroup--1627336682"}], "key_name": "tempest-keypair-2011985393", "user_data": "}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:08.960099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8e60a72b-3234-47b0-9346-13a659ee2297 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:08.969232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8e60a72b-3234-47b0-9346-13a659ee2297 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086775 Aug 18 22:17:08.969831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1931/3860] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:09.030882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] validate_networks() for [('a5f12da2-1a73-4ec6-b81b-e9c9d959cad7', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 22:17:09.340324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3dd55778-48d3-4ca1-9c53-b6609f368b2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:09.340930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3dd55778-48d3-4ca1-9c53-b6609f368b2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:09.349396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dd55778-48d3-4ca1-9c53-b6609f368b2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:09.349940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dd55778-48d3-4ca1-9c53-b6609f368b2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:09.350381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dd55778-48d3-4ca1-9c53-b6609f368b2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:09.351083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dd55778-48d3-4ca1-9c53-b6609f368b2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:09.351539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dd55778-48d3-4ca1-9c53-b6609f368b2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:09.351965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3dd55778-48d3-4ca1-9c53-b6609f368b2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:09.457073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 22:17:09.457493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 22:17:09.458005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 22:17:09.458411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 22:17:09.458847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 22:17:09.468466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:09.468941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:09.469370 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:09.470116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:09.470563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:09.470982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:09.484306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3dd55778-48d3-4ca1-9c53-b6609f368b2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:09.487940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Getting quotas for project efb811ce4fca47728e61489adbf97434. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:17:09.491873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Getting quotas for user e280bab439a3446b993c721bc98c1c6e and project efb811ce4fca47728e61489adbf97434. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:17:09.493051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3dd55778-48d3-4ca1-9c53-b6609f368b2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.156614 Aug 18 22:17:09.493640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1932/3861] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:09 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:09.504390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 22:17:09.506727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 22:17:09.509264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c7a1f821-dc8a-4358-8f18-ae59feeb56fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:09.510008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c7a1f821-dc8a-4358-8f18-ae59feeb56fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:09.516612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7a1f821-dc8a-4358-8f18-ae59feeb56fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:09.517129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7a1f821-dc8a-4358-8f18-ae59feeb56fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:09.517570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7a1f821-dc8a-4358-8f18-ae59feeb56fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:09.518290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7a1f821-dc8a-4358-8f18-ae59feeb56fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:09.518747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7a1f821-dc8a-4358-8f18-ae59feeb56fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:09.519174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c7a1f821-dc8a-4358-8f18-ae59feeb56fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:09.554625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3e01d91e-f812-42bc-98fa-aa600dad7c3c tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.638020 Aug 18 22:17:09.555532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1930/3862] 10.222.0.82 () {62 vars in 1188 bytes} [Thu Aug 18 22:17:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 18 22:17:09.559879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-023b0ab0-b39b-4e5f-b5e5-bd215199b743 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:09.561114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-023b0ab0-b39b-4e5f-b5e5-bd215199b743 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:09.567366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023b0ab0-b39b-4e5f-b5e5-bd215199b743 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:09.567939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023b0ab0-b39b-4e5f-b5e5-bd215199b743 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:09.568546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023b0ab0-b39b-4e5f-b5e5-bd215199b743 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:09.569297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023b0ab0-b39b-4e5f-b5e5-bd215199b743 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:09.569854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023b0ab0-b39b-4e5f-b5e5-bd215199b743 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:09.570397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-023b0ab0-b39b-4e5f-b5e5-bd215199b743 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:09.660835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c7a1f821-dc8a-4358-8f18-ae59feeb56fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:09.670369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c7a1f821-dc8a-4358-8f18-ae59feeb56fc tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.175729 Aug 18 22:17:09.684789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1933/3863] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:09 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:09.694908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7b49f1dd-f17a-4e91-ad7f-901ed85497d7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:09.695809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7b49f1dd-f17a-4e91-ad7f-901ed85497d7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:09.730414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-023b0ab0-b39b-4e5f-b5e5-bd215199b743 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:09.746077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-023b0ab0-b39b-4e5f-b5e5-bd215199b743 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.189561 Aug 18 22:17:09.746840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1931/3864] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:09 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:09.756190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7b49f1dd-f17a-4e91-ad7f-901ed85497d7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:09.764206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7b49f1dd-f17a-4e91-ad7f-901ed85497d7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:09.765691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7b49f1dd-f17a-4e91-ad7f-901ed85497d7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:09.767062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7b49f1dd-f17a-4e91-ad7f-901ed85497d7 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1281 microversion: 2.20 time: 0.080488 Aug 18 22:17:09.770079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1934/3865] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:09 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:09.990708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2afc0726-fcd9-460b-9714-ddec61d516d4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:09.991339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2afc0726-fcd9-460b-9714-ddec61d516d4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:09.998682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2afc0726-fcd9-460b-9714-ddec61d516d4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:09.999212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2afc0726-fcd9-460b-9714-ddec61d516d4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:09.999909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2afc0726-fcd9-460b-9714-ddec61d516d4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:10.000887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2afc0726-fcd9-460b-9714-ddec61d516d4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:10.001397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2afc0726-fcd9-460b-9714-ddec61d516d4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:10.001887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2afc0726-fcd9-460b-9714-ddec61d516d4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:10.063960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2afc0726-fcd9-460b-9714-ddec61d516d4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:10.072421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2afc0726-fcd9-460b-9714-ddec61d516d4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085716 Aug 18 22:17:10.073004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1932/3866] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:10.515519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-95d9205c-e00b-4260-99e6-2de16984b8fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:10.516274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-95d9205c-e00b-4260-99e6-2de16984b8fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:10.523141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95d9205c-e00b-4260-99e6-2de16984b8fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:10.523616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95d9205c-e00b-4260-99e6-2de16984b8fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:10.524046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95d9205c-e00b-4260-99e6-2de16984b8fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:10.524749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95d9205c-e00b-4260-99e6-2de16984b8fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:10.525197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95d9205c-e00b-4260-99e6-2de16984b8fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:10.525638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95d9205c-e00b-4260-99e6-2de16984b8fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:10.672764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-95d9205c-e00b-4260-99e6-2de16984b8fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:10.698520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2652f095-022a-4f09-810e-1a31a0eba493 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:10.699292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2652f095-022a-4f09-810e-1a31a0eba493 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:10.700148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-95d9205c-e00b-4260-99e6-2de16984b8fc tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.188998 Aug 18 22:17:10.702119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1935/3867] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:10 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:10.707608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2652f095-022a-4f09-810e-1a31a0eba493 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:10.708225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2652f095-022a-4f09-810e-1a31a0eba493 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:10.708767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2652f095-022a-4f09-810e-1a31a0eba493 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:10.709690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2652f095-022a-4f09-810e-1a31a0eba493 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:10.710190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2652f095-022a-4f09-810e-1a31a0eba493 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:10.711634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2652f095-022a-4f09-810e-1a31a0eba493 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:10.767896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7dfdc55f-c243-42a9-9d46-bc5d21cc102c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:10.768640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7dfdc55f-c243-42a9-9d46-bc5d21cc102c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:10.774592 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dfdc55f-c243-42a9-9d46-bc5d21cc102c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:10.775078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dfdc55f-c243-42a9-9d46-bc5d21cc102c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:10.775520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dfdc55f-c243-42a9-9d46-bc5d21cc102c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:10.776219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dfdc55f-c243-42a9-9d46-bc5d21cc102c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:10.776678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dfdc55f-c243-42a9-9d46-bc5d21cc102c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:10.777105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7dfdc55f-c243-42a9-9d46-bc5d21cc102c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:10.906700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7dfdc55f-c243-42a9-9d46-bc5d21cc102c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:10.915016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7dfdc55f-c243-42a9-9d46-bc5d21cc102c tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151882 Aug 18 22:17:10.915711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1936/3868] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:10 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:10.920889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-df992330-2ec5-48ed-945d-65c203e1bf14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:10.921737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-df992330-2ec5-48ed-945d-65c203e1bf14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:10.927703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df992330-2ec5-48ed-945d-65c203e1bf14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:10.928186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df992330-2ec5-48ed-945d-65c203e1bf14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:10.928622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df992330-2ec5-48ed-945d-65c203e1bf14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:10.929517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df992330-2ec5-48ed-945d-65c203e1bf14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:10.930161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df992330-2ec5-48ed-945d-65c203e1bf14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:10.930768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df992330-2ec5-48ed-945d-65c203e1bf14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:10.939936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2652f095-022a-4f09-810e-1a31a0eba493 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:10.949522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2652f095-022a-4f09-810e-1a31a0eba493 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.256116 Aug 18 22:17:10.950265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1933/3869] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:10 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:10.999445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-df992330-2ec5-48ed-945d-65c203e1bf14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:11.008347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-df992330-2ec5-48ed-945d-65c203e1bf14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:11.009890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-df992330-2ec5-48ed-945d-65c203e1bf14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:11.011176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-df992330-2ec5-48ed-945d-65c203e1bf14 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1339 microversion: 2.20 time: 0.094333 Aug 18 22:17:11.011896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1937/3870] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:10 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1339 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:11.096176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8626c09b-cf84-4d17-bc6f-fc3e1cc65a49 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:11.097981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8626c09b-cf84-4d17-bc6f-fc3e1cc65a49 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:11.106029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8626c09b-cf84-4d17-bc6f-fc3e1cc65a49 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:11.106639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8626c09b-cf84-4d17-bc6f-fc3e1cc65a49 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:11.107655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8626c09b-cf84-4d17-bc6f-fc3e1cc65a49 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:11.108374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8626c09b-cf84-4d17-bc6f-fc3e1cc65a49 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:11.108842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8626c09b-cf84-4d17-bc6f-fc3e1cc65a49 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:11.109304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8626c09b-cf84-4d17-bc6f-fc3e1cc65a49 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:11.188142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8626c09b-cf84-4d17-bc6f-fc3e1cc65a49 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:11.198697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8626c09b-cf84-4d17-bc6f-fc3e1cc65a49 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.108747 Aug 18 22:17:11.212331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1934/3871] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:11.724235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-65c82277-6bd2-4f02-b216-3d282eaa026a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:11.724987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-65c82277-6bd2-4f02-b216-3d282eaa026a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:11.731903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65c82277-6bd2-4f02-b216-3d282eaa026a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:11.732267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65c82277-6bd2-4f02-b216-3d282eaa026a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:11.732745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65c82277-6bd2-4f02-b216-3d282eaa026a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:11.733562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65c82277-6bd2-4f02-b216-3d282eaa026a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:11.734147 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65c82277-6bd2-4f02-b216-3d282eaa026a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:11.734621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65c82277-6bd2-4f02-b216-3d282eaa026a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:11.864141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-65c82277-6bd2-4f02-b216-3d282eaa026a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:11.872455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-65c82277-6bd2-4f02-b216-3d282eaa026a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.152018 Aug 18 22:17:11.873037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1938/3872] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:11 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:11.936343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d026a28c-d5c9-4988-bf84-8973d99b0a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:11.937250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d026a28c-d5c9-4988-bf84-8973d99b0a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:11.943097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d026a28c-d5c9-4988-bf84-8973d99b0a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:11.943588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d026a28c-d5c9-4988-bf84-8973d99b0a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:11.944031 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d026a28c-d5c9-4988-bf84-8973d99b0a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:11.944727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d026a28c-d5c9-4988-bf84-8973d99b0a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:11.945184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d026a28c-d5c9-4988-bf84-8973d99b0a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:11.945637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d026a28c-d5c9-4988-bf84-8973d99b0a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:11.971657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5c6fb4f4-8308-4fae-83d1-ab224e89a792 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:11.972345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5c6fb4f4-8308-4fae-83d1-ab224e89a792 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:11.978638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c6fb4f4-8308-4fae-83d1-ab224e89a792 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:11.979116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c6fb4f4-8308-4fae-83d1-ab224e89a792 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:11.979545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c6fb4f4-8308-4fae-83d1-ab224e89a792 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:11.980438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c6fb4f4-8308-4fae-83d1-ab224e89a792 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:11.981063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c6fb4f4-8308-4fae-83d1-ab224e89a792 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:11.981482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5c6fb4f4-8308-4fae-83d1-ab224e89a792 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:11.985707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:12.113682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5c6fb4f4-8308-4fae-83d1-ab224e89a792 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:12.123906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5c6fb4f4-8308-4fae-83d1-ab224e89a792 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.156204 Aug 18 22:17:12.124485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1939/3873] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:11 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:12.128943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d41f1d6a-362d-4f2b-8413-b329493bb536 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:12.130335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d41f1d6a-362d-4f2b-8413-b329493bb536 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:12.137233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d41f1d6a-362d-4f2b-8413-b329493bb536 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:12.137785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d41f1d6a-362d-4f2b-8413-b329493bb536 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:12.138920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d41f1d6a-362d-4f2b-8413-b329493bb536 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:12.139691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d41f1d6a-362d-4f2b-8413-b329493bb536 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:12.140267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d41f1d6a-362d-4f2b-8413-b329493bb536 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:12.140755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d41f1d6a-362d-4f2b-8413-b329493bb536 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:12.167083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d026a28c-d5c9-4988-bf84-8973d99b0a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:12.176716 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d026a28c-d5c9-4988-bf84-8973d99b0a05 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.244171 Aug 18 22:17:12.177552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1935/3874] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:11 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:12.183451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-6060c95d-2308-438f-80f3-3a863c98fd56 req-346e0048-25f6-4a12-949a-e9e7bbd903d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb", "tag": "ff8ff962-990d-4a4b-b5eb-71ff8e49cee2"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:12.196430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6060c95d-2308-438f-80f3-3a863c98fd56 req-346e0048-25f6-4a12-949a-e9e7bbd903d9 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:12.197303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6060c95d-2308-438f-80f3-3a863c98fd56 req-346e0048-25f6-4a12-949a-e9e7bbd903d9 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:12.197860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6060c95d-2308-438f-80f3-3a863c98fd56 req-346e0048-25f6-4a12-949a-e9e7bbd903d9 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:12.210046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-6060c95d-2308-438f-80f3-3a863c98fd56 req-346e0048-25f6-4a12-949a-e9e7bbd903d9 service nova] Creating event network-changed:ff8ff962-990d-4a4b-b5eb-71ff8e49cee2 for instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb on hv-cinder-85367 Aug 18 22:17:12.216746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-6060c95d-2308-438f-80f3-3a863c98fd56 req-346e0048-25f6-4a12-949a-e9e7bbd903d9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036686 Aug 18 22:17:12.218086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1936/3875] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:17:12.223921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3f7a0e3e-332a-459d-8659-4d3c33f3c1da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:12.224625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3f7a0e3e-332a-459d-8659-4d3c33f3c1da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:12.231071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f7a0e3e-332a-459d-8659-4d3c33f3c1da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:12.232130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f7a0e3e-332a-459d-8659-4d3c33f3c1da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:12.232580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f7a0e3e-332a-459d-8659-4d3c33f3c1da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:12.233291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f7a0e3e-332a-459d-8659-4d3c33f3c1da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:12.233788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f7a0e3e-332a-459d-8659-4d3c33f3c1da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:12.234213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f7a0e3e-332a-459d-8659-4d3c33f3c1da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:12.289782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d41f1d6a-362d-4f2b-8413-b329493bb536 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:12.298641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d41f1d6a-362d-4f2b-8413-b329493bb536 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:12.300158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d41f1d6a-362d-4f2b-8413-b329493bb536 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:12.301273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d41f1d6a-362d-4f2b-8413-b329493bb536 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1407 microversion: 2.20 time: 0.175883 Aug 18 22:17:12.301890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1940/3876] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:12 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:12.322990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3f7a0e3e-332a-459d-8659-4d3c33f3c1da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:12.325337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:12.333572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3f7a0e3e-332a-459d-8659-4d3c33f3c1da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.114079 Aug 18 22:17:12.334169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1937/3877] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:12 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:12.893984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-221008a9-1aa3-4592-b074-1ba7c429682d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:12.894609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-221008a9-1aa3-4592-b074-1ba7c429682d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:12.901052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221008a9-1aa3-4592-b074-1ba7c429682d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:12.901542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221008a9-1aa3-4592-b074-1ba7c429682d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:12.902026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221008a9-1aa3-4592-b074-1ba7c429682d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:12.902720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221008a9-1aa3-4592-b074-1ba7c429682d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:12.903185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221008a9-1aa3-4592-b074-1ba7c429682d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:12.904101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-221008a9-1aa3-4592-b074-1ba7c429682d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:13.035691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-221008a9-1aa3-4592-b074-1ba7c429682d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:13.048913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-221008a9-1aa3-4592-b074-1ba7c429682d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.158504 Aug 18 22:17:13.049297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1941/3878] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:12 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:13.146439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4a7bbc0d-cefe-4721-a6e7-bbe15de1108a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:13.146975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4a7bbc0d-cefe-4721-a6e7-bbe15de1108a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:13.153452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a7bbc0d-cefe-4721-a6e7-bbe15de1108a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:13.154606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a7bbc0d-cefe-4721-a6e7-bbe15de1108a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:13.155044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a7bbc0d-cefe-4721-a6e7-bbe15de1108a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:13.155732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a7bbc0d-cefe-4721-a6e7-bbe15de1108a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:13.156190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a7bbc0d-cefe-4721-a6e7-bbe15de1108a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:13.156618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4a7bbc0d-cefe-4721-a6e7-bbe15de1108a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:13.200243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0b267851-e388-477f-b363-8d44cbeb9b19 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:13.201392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0b267851-e388-477f-b363-8d44cbeb9b19 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:13.207361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b267851-e388-477f-b363-8d44cbeb9b19 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:13.207840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b267851-e388-477f-b363-8d44cbeb9b19 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:13.208272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b267851-e388-477f-b363-8d44cbeb9b19 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:13.208962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b267851-e388-477f-b363-8d44cbeb9b19 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:13.209409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b267851-e388-477f-b363-8d44cbeb9b19 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:13.209849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0b267851-e388-477f-b363-8d44cbeb9b19 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:13.292829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4a7bbc0d-cefe-4721-a6e7-bbe15de1108a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:13.301183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4a7bbc0d-cefe-4721-a6e7-bbe15de1108a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.158652 Aug 18 22:17:13.301781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1938/3879] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:13 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:13.323812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6dcd65c9-c389-493c-9220-fe3b563ea2cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:13.324422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6dcd65c9-c389-493c-9220-fe3b563ea2cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:13.326830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:13.332058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dcd65c9-c389-493c-9220-fe3b563ea2cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:13.332537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dcd65c9-c389-493c-9220-fe3b563ea2cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:13.332974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dcd65c9-c389-493c-9220-fe3b563ea2cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:13.333691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dcd65c9-c389-493c-9220-fe3b563ea2cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:13.334143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dcd65c9-c389-493c-9220-fe3b563ea2cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:13.334564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6dcd65c9-c389-493c-9220-fe3b563ea2cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:13.345075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0b267851-e388-477f-b363-8d44cbeb9b19 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:13.353813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0b267851-e388-477f-b363-8d44cbeb9b19 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.157446 Aug 18 22:17:13.354480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1942/3880] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:13 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:13.360589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da7c7b57-a645-4300-ad9b-c50803dd72e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:13.361000 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-da7c7b57-a645-4300-ad9b-c50803dd72e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:13.367145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da7c7b57-a645-4300-ad9b-c50803dd72e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:13.367639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da7c7b57-a645-4300-ad9b-c50803dd72e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:13.368084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da7c7b57-a645-4300-ad9b-c50803dd72e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:13.368793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da7c7b57-a645-4300-ad9b-c50803dd72e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:13.369249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da7c7b57-a645-4300-ad9b-c50803dd72e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:13.369696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da7c7b57-a645-4300-ad9b-c50803dd72e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:13.433321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-da7c7b57-a645-4300-ad9b-c50803dd72e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:13.441633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da7c7b57-a645-4300-ad9b-c50803dd72e0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086129 Aug 18 22:17:13.442220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1943/3881] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:13.499026 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6dcd65c9-c389-493c-9220-fe3b563ea2cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:13.507099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6dcd65c9-c389-493c-9220-fe3b563ea2cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:13.508574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6dcd65c9-c389-493c-9220-fe3b563ea2cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:13.509998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6dcd65c9-c389-493c-9220-fe3b563ea2cf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1407 microversion: 2.20 time: 0.189763 Aug 18 22:17:13.510254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1939/3882] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:13 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:17:14.070199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cc3bed72-8e57-4553-81b6-ca7c2ca97fd8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:14.070824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cc3bed72-8e57-4553-81b6-ca7c2ca97fd8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:14.077221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc3bed72-8e57-4553-81b6-ca7c2ca97fd8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:14.077740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc3bed72-8e57-4553-81b6-ca7c2ca97fd8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:14.078177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc3bed72-8e57-4553-81b6-ca7c2ca97fd8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:14.078865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc3bed72-8e57-4553-81b6-ca7c2ca97fd8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:14.079323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc3bed72-8e57-4553-81b6-ca7c2ca97fd8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:14.079750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cc3bed72-8e57-4553-81b6-ca7c2ca97fd8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:14.204568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cc3bed72-8e57-4553-81b6-ca7c2ca97fd8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:14.213670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cc3bed72-8e57-4553-81b6-ca7c2ca97fd8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.146438 Aug 18 22:17:14.213670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1944/3883] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:14 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:14.322036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5f6db85a-f80d-4e36-9665-e6e9fee003b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:14.322624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5f6db85a-f80d-4e36-9665-e6e9fee003b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:14.329095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f6db85a-f80d-4e36-9665-e6e9fee003b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:14.329576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f6db85a-f80d-4e36-9665-e6e9fee003b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:14.330045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f6db85a-f80d-4e36-9665-e6e9fee003b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:14.330725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f6db85a-f80d-4e36-9665-e6e9fee003b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:14.331175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f6db85a-f80d-4e36-9665-e6e9fee003b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:14.331618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f6db85a-f80d-4e36-9665-e6e9fee003b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:14.374697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6efd601b-e405-401d-ad60-075c9a8bc062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:14.375445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6efd601b-e405-401d-ad60-075c9a8bc062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:14.381342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6efd601b-e405-401d-ad60-075c9a8bc062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:14.381923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6efd601b-e405-401d-ad60-075c9a8bc062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:14.382446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6efd601b-e405-401d-ad60-075c9a8bc062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:14.383199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6efd601b-e405-401d-ad60-075c9a8bc062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:14.383723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6efd601b-e405-401d-ad60-075c9a8bc062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:14.384212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6efd601b-e405-401d-ad60-075c9a8bc062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:14.460830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5f6db85a-f80d-4e36-9665-e6e9fee003b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:14.470374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5f6db85a-f80d-4e36-9665-e6e9fee003b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.152147 Aug 18 22:17:14.470962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1940/3884] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:14 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:14.475361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-085d2f73-cd89-4b28-abf4-7bdddfd7238d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:14.476315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-085d2f73-cd89-4b28-abf4-7bdddfd7238d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:14.482351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-085d2f73-cd89-4b28-abf4-7bdddfd7238d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:14.483016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-085d2f73-cd89-4b28-abf4-7bdddfd7238d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:14.483475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-085d2f73-cd89-4b28-abf4-7bdddfd7238d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:14.484371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-085d2f73-cd89-4b28-abf4-7bdddfd7238d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:14.484940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-085d2f73-cd89-4b28-abf4-7bdddfd7238d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:14.485564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-085d2f73-cd89-4b28-abf4-7bdddfd7238d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:14.514990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6efd601b-e405-401d-ad60-075c9a8bc062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:14.523640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6efd601b-e405-401d-ad60-075c9a8bc062 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.152818 Aug 18 22:17:14.524211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1945/3885] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:14 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:14.532377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-814b8586-902d-46f0-90be-d8149a1db60b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:14.533409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-814b8586-902d-46f0-90be-d8149a1db60b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:14.539789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-814b8586-902d-46f0-90be-d8149a1db60b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:14.540277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-814b8586-902d-46f0-90be-d8149a1db60b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:14.540718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-814b8586-902d-46f0-90be-d8149a1db60b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:14.541426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-814b8586-902d-46f0-90be-d8149a1db60b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:14.541904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-814b8586-902d-46f0-90be-d8149a1db60b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:14.542335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-814b8586-902d-46f0-90be-d8149a1db60b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:14.549888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-085d2f73-cd89-4b28-abf4-7bdddfd7238d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:14.558363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-085d2f73-cd89-4b28-abf4-7bdddfd7238d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086424 Aug 18 22:17:14.558937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1941/3886] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:14.668915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-814b8586-902d-46f0-90be-d8149a1db60b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:14.676997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-814b8586-902d-46f0-90be-d8149a1db60b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:14.678812 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-814b8586-902d-46f0-90be-d8149a1db60b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:14.679904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-814b8586-902d-46f0-90be-d8149a1db60b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1407 microversion: 2.20 time: 0.151787 Aug 18 22:17:14.680469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1946/3887] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:14 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 22:17:15.236459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6296d218-57de-4da9-89f7-e1b2421403e1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:15.237167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6296d218-57de-4da9-89f7-e1b2421403e1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:15.243171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6296d218-57de-4da9-89f7-e1b2421403e1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:15.243658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6296d218-57de-4da9-89f7-e1b2421403e1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:15.244102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6296d218-57de-4da9-89f7-e1b2421403e1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:15.244792 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6296d218-57de-4da9-89f7-e1b2421403e1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:15.245250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6296d218-57de-4da9-89f7-e1b2421403e1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:15.245699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6296d218-57de-4da9-89f7-e1b2421403e1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:15.375184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6296d218-57de-4da9-89f7-e1b2421403e1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:15.383507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6296d218-57de-4da9-89f7-e1b2421403e1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.151793 Aug 18 22:17:15.384079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1942/3888] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:15 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:15.492517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bafa8e03-ab7d-4c30-b869-50585447e3e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:15.493133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bafa8e03-ab7d-4c30-b869-50585447e3e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:15.500138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bafa8e03-ab7d-4c30-b869-50585447e3e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:15.500620 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bafa8e03-ab7d-4c30-b869-50585447e3e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:15.501057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bafa8e03-ab7d-4c30-b869-50585447e3e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:15.501783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bafa8e03-ab7d-4c30-b869-50585447e3e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:15.502243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bafa8e03-ab7d-4c30-b869-50585447e3e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:15.502668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bafa8e03-ab7d-4c30-b869-50585447e3e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:15.544362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ff484af4-8c2a-43c6-b55a-da208b6dc634 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:15.545079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ff484af4-8c2a-43c6-b55a-da208b6dc634 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:15.551258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff484af4-8c2a-43c6-b55a-da208b6dc634 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:15.551856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff484af4-8c2a-43c6-b55a-da208b6dc634 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:15.552618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff484af4-8c2a-43c6-b55a-da208b6dc634 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:15.553384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff484af4-8c2a-43c6-b55a-da208b6dc634 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:15.553972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff484af4-8c2a-43c6-b55a-da208b6dc634 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:15.554474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ff484af4-8c2a-43c6-b55a-da208b6dc634 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:15.635298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bafa8e03-ab7d-4c30-b869-50585447e3e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:15.643895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bafa8e03-ab7d-4c30-b869-50585447e3e1 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.155397 Aug 18 22:17:15.650299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1947/3889] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:15 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:15.659165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5bb1a0c5-cbd4-48e5-813c-32222767b8b4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:15.659934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5bb1a0c5-cbd4-48e5-813c-32222767b8b4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:15.666489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bb1a0c5-cbd4-48e5-813c-32222767b8b4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:15.667144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bb1a0c5-cbd4-48e5-813c-32222767b8b4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:15.667670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bb1a0c5-cbd4-48e5-813c-32222767b8b4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:15.668586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bb1a0c5-cbd4-48e5-813c-32222767b8b4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:15.668994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bb1a0c5-cbd4-48e5-813c-32222767b8b4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:15.669950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bb1a0c5-cbd4-48e5-813c-32222767b8b4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:15.690460 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ff484af4-8c2a-43c6-b55a-da208b6dc634 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:15.701161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ff484af4-8c2a-43c6-b55a-da208b6dc634 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.160241 Aug 18 22:17:15.701777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1943/3890] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:15 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:15.706368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-089bf281-8a5a-47fa-8308-32a92ef45d59 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:15.706978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-089bf281-8a5a-47fa-8308-32a92ef45d59 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:15.713343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-089bf281-8a5a-47fa-8308-32a92ef45d59 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:15.714136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-089bf281-8a5a-47fa-8308-32a92ef45d59 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:15.714574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-089bf281-8a5a-47fa-8308-32a92ef45d59 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:15.715273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-089bf281-8a5a-47fa-8308-32a92ef45d59 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:15.716021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-089bf281-8a5a-47fa-8308-32a92ef45d59 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:15.717078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-089bf281-8a5a-47fa-8308-32a92ef45d59 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:15.864650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-089bf281-8a5a-47fa-8308-32a92ef45d59 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:15.874450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-089bf281-8a5a-47fa-8308-32a92ef45d59 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:15.875972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-089bf281-8a5a-47fa-8308-32a92ef45d59 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:15.877104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-089bf281-8a5a-47fa-8308-32a92ef45d59 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1407 microversion: 2.20 time: 0.174222 Aug 18 22:17:15.877702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1944/3891] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:15 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:15.966826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5bb1a0c5-cbd4-48e5-813c-32222767b8b4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:15.975067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5bb1a0c5-cbd4-48e5-813c-32222767b8b4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.319690 Aug 18 22:17:15.975643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1948/3892] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:15 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:16.405621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bc6786ec-ae97-4f55-b385-ca14c4954c38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:16.406396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bc6786ec-ae97-4f55-b385-ca14c4954c38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:16.413203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc6786ec-ae97-4f55-b385-ca14c4954c38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:16.413828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc6786ec-ae97-4f55-b385-ca14c4954c38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:16.414278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc6786ec-ae97-4f55-b385-ca14c4954c38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:16.414977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc6786ec-ae97-4f55-b385-ca14c4954c38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:16.415442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc6786ec-ae97-4f55-b385-ca14c4954c38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:16.415873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc6786ec-ae97-4f55-b385-ca14c4954c38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:16.542720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bc6786ec-ae97-4f55-b385-ca14c4954c38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:16.551431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bc6786ec-ae97-4f55-b385-ca14c4954c38 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.149754 Aug 18 22:17:16.552013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1945/3893] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:16 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:16.672394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1c18d966-5408-4bb2-9b58-85f6a976c308 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:16.672929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1c18d966-5408-4bb2-9b58-85f6a976c308 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:16.679652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c18d966-5408-4bb2-9b58-85f6a976c308 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:16.680141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c18d966-5408-4bb2-9b58-85f6a976c308 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:16.680582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c18d966-5408-4bb2-9b58-85f6a976c308 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:16.681278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c18d966-5408-4bb2-9b58-85f6a976c308 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:16.681779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c18d966-5408-4bb2-9b58-85f6a976c308 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:16.682212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1c18d966-5408-4bb2-9b58-85f6a976c308 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:16.723100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d89ac3b2-c3fa-4df1-9c94-e20c918fce0f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:16.723720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d89ac3b2-c3fa-4df1-9c94-e20c918fce0f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:16.729841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d89ac3b2-c3fa-4df1-9c94-e20c918fce0f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:16.730331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d89ac3b2-c3fa-4df1-9c94-e20c918fce0f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:16.730769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d89ac3b2-c3fa-4df1-9c94-e20c918fce0f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:16.731470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d89ac3b2-c3fa-4df1-9c94-e20c918fce0f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:16.732674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d89ac3b2-c3fa-4df1-9c94-e20c918fce0f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:16.733103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d89ac3b2-c3fa-4df1-9c94-e20c918fce0f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:16.811213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1c18d966-5408-4bb2-9b58-85f6a976c308 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:16.819712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1c18d966-5408-4bb2-9b58-85f6a976c308 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151791 Aug 18 22:17:16.820293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1949/3894] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:16 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:16.862776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d89ac3b2-c3fa-4df1-9c94-e20c918fce0f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:16.870930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d89ac3b2-c3fa-4df1-9c94-e20c918fce0f tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.151639 Aug 18 22:17:16.871508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1946/3895] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:16 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:16.900063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d3cc03a-72e7-4c62-8987-1d1b7d18b420 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:16.900684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7d3cc03a-72e7-4c62-8987-1d1b7d18b420 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:16.907204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d3cc03a-72e7-4c62-8987-1d1b7d18b420 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:16.907691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d3cc03a-72e7-4c62-8987-1d1b7d18b420 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:16.908133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d3cc03a-72e7-4c62-8987-1d1b7d18b420 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:16.908829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d3cc03a-72e7-4c62-8987-1d1b7d18b420 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:16.909287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d3cc03a-72e7-4c62-8987-1d1b7d18b420 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:16.909752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7d3cc03a-72e7-4c62-8987-1d1b7d18b420 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:16.995072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2591b53e-c828-471d-95b6-f4de74062632 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:16.995692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2591b53e-c828-471d-95b6-f4de74062632 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:17.001869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2591b53e-c828-471d-95b6-f4de74062632 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:17.002362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2591b53e-c828-471d-95b6-f4de74062632 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:17.002805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2591b53e-c828-471d-95b6-f4de74062632 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:17.003499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2591b53e-c828-471d-95b6-f4de74062632 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:17.003956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2591b53e-c828-471d-95b6-f4de74062632 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:17.004385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2591b53e-c828-471d-95b6-f4de74062632 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:17.039234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7d3cc03a-72e7-4c62-8987-1d1b7d18b420 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:17.047476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7d3cc03a-72e7-4c62-8987-1d1b7d18b420 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:17.048977 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7d3cc03a-72e7-4c62-8987-1d1b7d18b420 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:17.050121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d3cc03a-72e7-4c62-8987-1d1b7d18b420 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1407 microversion: 2.20 time: 0.153903 Aug 18 22:17:17.050691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1950/3896] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:16 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:17.065328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2591b53e-c828-471d-95b6-f4de74062632 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:17.073487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2591b53e-c828-471d-95b6-f4de74062632 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082266 Aug 18 22:17:17.074087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1947/3897] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:17.403304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-78e3621e-6875-4020-82a9-2d5b8d29a6da req-fcefbe6d-4d1b-48b6-876d-9d8b6a5968c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb", "name": "network-vif-plugged", "status": "completed", "tag": "ff8ff962-990d-4a4b-b5eb-71ff8e49cee2"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:17.413106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-78e3621e-6875-4020-82a9-2d5b8d29a6da req-fcefbe6d-4d1b-48b6-876d-9d8b6a5968c1 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:17.413582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-78e3621e-6875-4020-82a9-2d5b8d29a6da req-fcefbe6d-4d1b-48b6-876d-9d8b6a5968c1 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:17.414033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-78e3621e-6875-4020-82a9-2d5b8d29a6da req-fcefbe6d-4d1b-48b6-876d-9d8b6a5968c1 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:17.425086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-78e3621e-6875-4020-82a9-2d5b8d29a6da req-fcefbe6d-4d1b-48b6-876d-9d8b6a5968c1 service nova] Creating event network-vif-plugged:ff8ff962-990d-4a4b-b5eb-71ff8e49cee2 for instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb on hv-cinder-85367 Aug 18 22:17:17.430372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-78e3621e-6875-4020-82a9-2d5b8d29a6da req-fcefbe6d-4d1b-48b6-876d-9d8b6a5968c1 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086601 Aug 18 22:17:17.430910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1951/3898] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:17:17.572341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-68c8ebce-5b14-43f4-9a4f-8454d35b19a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:17.573137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-68c8ebce-5b14-43f4-9a4f-8454d35b19a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:17.579846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68c8ebce-5b14-43f4-9a4f-8454d35b19a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:17.580495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68c8ebce-5b14-43f4-9a4f-8454d35b19a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:17.581074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68c8ebce-5b14-43f4-9a4f-8454d35b19a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:17.581883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68c8ebce-5b14-43f4-9a4f-8454d35b19a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:17.582413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68c8ebce-5b14-43f4-9a4f-8454d35b19a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:17.582909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-68c8ebce-5b14-43f4-9a4f-8454d35b19a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:17.738213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-68c8ebce-5b14-43f4-9a4f-8454d35b19a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:17.746625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-68c8ebce-5b14-43f4-9a4f-8454d35b19a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.178232 Aug 18 22:17:17.747225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1948/3899] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:17 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:17.842631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-18a2b128-c157-42e7-9cb8-d1ad5b0bd068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:17.843258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-18a2b128-c157-42e7-9cb8-d1ad5b0bd068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:17.849381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18a2b128-c157-42e7-9cb8-d1ad5b0bd068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:17.849898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18a2b128-c157-42e7-9cb8-d1ad5b0bd068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:17.850336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18a2b128-c157-42e7-9cb8-d1ad5b0bd068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:17.851052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18a2b128-c157-42e7-9cb8-d1ad5b0bd068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:17.851506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18a2b128-c157-42e7-9cb8-d1ad5b0bd068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:17.851933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18a2b128-c157-42e7-9cb8-d1ad5b0bd068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:17.892081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5f587fad-a273-4b2d-b23c-1d9509466bd7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:17.892915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5f587fad-a273-4b2d-b23c-1d9509466bd7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:17.898764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f587fad-a273-4b2d-b23c-1d9509466bd7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:17.899583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f587fad-a273-4b2d-b23c-1d9509466bd7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:17.899685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f587fad-a273-4b2d-b23c-1d9509466bd7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:17.900368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f587fad-a273-4b2d-b23c-1d9509466bd7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:17.900815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f587fad-a273-4b2d-b23c-1d9509466bd7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:17.901240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5f587fad-a273-4b2d-b23c-1d9509466bd7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:17.982960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-18a2b128-c157-42e7-9cb8-d1ad5b0bd068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:17.991134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-18a2b128-c157-42e7-9cb8-d1ad5b0bd068 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154146 Aug 18 22:17:17.991725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1952/3900] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:17 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:18.040646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5f587fad-a273-4b2d-b23c-1d9509466bd7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:18.048762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5f587fad-a273-4b2d-b23c-1d9509466bd7 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.160984 Aug 18 22:17:18.049332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1949/3901] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:17 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:18.072207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7a7f6831-64f2-4dd6-8d20-e8f029c5ba33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:18.072855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7a7f6831-64f2-4dd6-8d20-e8f029c5ba33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:18.079347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a7f6831-64f2-4dd6-8d20-e8f029c5ba33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:18.079842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a7f6831-64f2-4dd6-8d20-e8f029c5ba33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:18.080286 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a7f6831-64f2-4dd6-8d20-e8f029c5ba33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:18.080983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a7f6831-64f2-4dd6-8d20-e8f029c5ba33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:18.081443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a7f6831-64f2-4dd6-8d20-e8f029c5ba33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:18.081916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7a7f6831-64f2-4dd6-8d20-e8f029c5ba33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:18.095181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3454e527-4987-4082-a373-7601809f77c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:18.095743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3454e527-4987-4082-a373-7601809f77c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:18.101805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3454e527-4987-4082-a373-7601809f77c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:18.102298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3454e527-4987-4082-a373-7601809f77c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:18.102746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3454e527-4987-4082-a373-7601809f77c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:18.103449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3454e527-4987-4082-a373-7601809f77c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:18.103910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3454e527-4987-4082-a373-7601809f77c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:18.104343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3454e527-4987-4082-a373-7601809f77c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:18.165040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3454e527-4987-4082-a373-7601809f77c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:18.173654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3454e527-4987-4082-a373-7601809f77c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082276 Aug 18 22:17:18.174231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1950/3902] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:18 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:18.212732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7a7f6831-64f2-4dd6-8d20-e8f029c5ba33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:18.220865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7a7f6831-64f2-4dd6-8d20-e8f029c5ba33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:18.222413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7a7f6831-64f2-4dd6-8d20-e8f029c5ba33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:18.223501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7a7f6831-64f2-4dd6-8d20-e8f029c5ba33 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1407 microversion: 2.20 time: 0.155265 Aug 18 22:17:18.224054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1953/3903] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:18 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:18.767560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-03adbb99-52d9-4cc8-9b6a-8cbdd87b1ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:18.768278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-03adbb99-52d9-4cc8-9b6a-8cbdd87b1ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:18.775007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03adbb99-52d9-4cc8-9b6a-8cbdd87b1ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:18.775500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03adbb99-52d9-4cc8-9b6a-8cbdd87b1ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:18.775944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03adbb99-52d9-4cc8-9b6a-8cbdd87b1ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:18.776642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03adbb99-52d9-4cc8-9b6a-8cbdd87b1ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:18.777103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03adbb99-52d9-4cc8-9b6a-8cbdd87b1ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:18.777568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03adbb99-52d9-4cc8-9b6a-8cbdd87b1ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:18.913453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-03adbb99-52d9-4cc8-9b6a-8cbdd87b1ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:18.922436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-03adbb99-52d9-4cc8-9b6a-8cbdd87b1ade tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 200 len: 1728 microversion: 2.1 time: 0.158612 Aug 18 22:17:18.923035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1951/3904] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:18 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:18.944159 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-899b8319-f09f-435d-80d0-101bcc4f6a2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '.version_select at 0x7fd8897ee820>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:18.951247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:18.965540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-899b8319-f09f-435d-80d0-101bcc4f6a2a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473839402" status: 202 len: 0 microversion: 2.1 time: 0.025101 Aug 18 22:17:18.966667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1954/3905] 10.222.0.82 () {58 vars in 1221 bytes} [Thu Aug 18 22:17:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473839402 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:17:19.012975 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b4aa597d-6c8c-4857-a484-c3fb98e5dc4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:19.013746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b4aa597d-6c8c-4857-a484-c3fb98e5dc4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:19.020599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4aa597d-6c8c-4857-a484-c3fb98e5dc4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:19.021165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4aa597d-6c8c-4857-a484-c3fb98e5dc4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:19.021815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4aa597d-6c8c-4857-a484-c3fb98e5dc4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:19.022610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4aa597d-6c8c-4857-a484-c3fb98e5dc4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:19.023141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4aa597d-6c8c-4857-a484-c3fb98e5dc4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:19.023934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4aa597d-6c8c-4857-a484-c3fb98e5dc4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:19.072027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f3c0dbdd-617d-431f-942b-03a2f5c60387 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:19.072993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f3c0dbdd-617d-431f-942b-03a2f5c60387 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] [instance: e7b11b63-0232-4f27-bacb-2e3872f6ae18] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:19.079506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3c0dbdd-617d-431f-942b-03a2f5c60387 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:19.080277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3c0dbdd-617d-431f-942b-03a2f5c60387 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:19.080900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3c0dbdd-617d-431f-942b-03a2f5c60387 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:19.081818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3c0dbdd-617d-431f-942b-03a2f5c60387 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:19.082474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3c0dbdd-617d-431f-942b-03a2f5c60387 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:19.082900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f3c0dbdd-617d-431f-942b-03a2f5c60387 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:19.237381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b4aa597d-6c8c-4857-a484-c3fb98e5dc4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:19.246271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b4aa597d-6c8c-4857-a484-c3fb98e5dc4e tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.237277 Aug 18 22:17:19.259494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1952/3906] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:19 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:19.267222 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-761097e1-c8ca-4cc6-8118-55784197c4a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:19.268339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-761097e1-c8ca-4cc6-8118-55784197c4a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:19.275455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-761097e1-c8ca-4cc6-8118-55784197c4a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:19.276226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-761097e1-c8ca-4cc6-8118-55784197c4a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:19.277043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-761097e1-c8ca-4cc6-8118-55784197c4a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:19.279424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-761097e1-c8ca-4cc6-8118-55784197c4a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:19.280202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-761097e1-c8ca-4cc6-8118-55784197c4a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:19.280809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-761097e1-c8ca-4cc6-8118-55784197c4a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:19.369931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f3c0dbdd-617d-431f-942b-03a2f5c60387 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b51990c984e24a18a85534b121f3d9a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '740832491e454b40a6cd87be4ca40384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:19.379349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-761097e1-c8ca-4cc6-8118-55784197c4a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:19.382926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f3c0dbdd-617d-431f-942b-03a2f5c60387 tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18" status: 200 len: 1599 microversion: 2.1 time: 0.315993 Aug 18 22:17:19.384003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1955/3907] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:19 2022] GET /compute/v2.1/servers/e7b11b63-0232-4f27-bacb-2e3872f6ae18 => generated 1599 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:19.389647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-213cc0d6-bfe7-4b82-b4b5-45d1dde2d7ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:19.390642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-213cc0d6-bfe7-4b82-b4b5-45d1dde2d7ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:19.396809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-761097e1-c8ca-4cc6-8118-55784197c4a3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.135979 Aug 18 22:17:19.405651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1953/3908] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:19 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:19.405651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-37add91f-d672-48d1-8e0e-9bf488ae84fe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] Calling method '.version_select at 0x7fd88a024040>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:19.406403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-213cc0d6-bfe7-4b82-b4b5-45d1dde2d7ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:19.407755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-213cc0d6-bfe7-4b82-b4b5-45d1dde2d7ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:19.418035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-213cc0d6-bfe7-4b82-b4b5-45d1dde2d7ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:19.418912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-213cc0d6-bfe7-4b82-b4b5-45d1dde2d7ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:19.419533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-213cc0d6-bfe7-4b82-b4b5-45d1dde2d7ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:19.420063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-213cc0d6-bfe7-4b82-b4b5-45d1dde2d7ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:19.445490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-37add91f-d672-48d1-8e0e-9bf488ae84fe tempest-TestMinimumBasicScenario-248629472 tempest-TestMinimumBasicScenario-248629472-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2137782897" status: 202 len: 0 microversion: 2.1 time: 0.044391 Aug 18 22:17:19.447148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1954/3909] 10.222.0.82 () {58 vars in 1272 bytes} [Thu Aug 18 22:17:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2137782897 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 22:17:19.618270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-213cc0d6-bfe7-4b82-b4b5-45d1dde2d7ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:19.629457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-213cc0d6-bfe7-4b82-b4b5-45d1dde2d7ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:19.632029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-213cc0d6-bfe7-4b82-b4b5-45d1dde2d7ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:19.633741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-213cc0d6-bfe7-4b82-b4b5-45d1dde2d7ca tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1598 microversion: 2.20 time: 0.248569 Aug 18 22:17:19.649884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1956/3910] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:17:19 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1598 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:17:19.655106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:19.656313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:19.661698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-63b57f44-d931-41a4-a026-595403b06fbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:19.662416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-63b57f44-d931-41a4-a026-595403b06fbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:19.678321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63b57f44-d931-41a4-a026-595403b06fbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:19.678818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63b57f44-d931-41a4-a026-595403b06fbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:19.679606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63b57f44-d931-41a4-a026-595403b06fbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:19.680377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63b57f44-d931-41a4-a026-595403b06fbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:19.680834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63b57f44-d931-41a4-a026-595403b06fbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:19.681449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-63b57f44-d931-41a4-a026-595403b06fbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:19.704745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:20.067455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-63b57f44-d931-41a4-a026-595403b06fbf tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.412815 Aug 18 22:17:20.077777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1955/3911] 10.222.0.82 () {60 vars in 1316 bytes} [Thu Aug 18 22:17:19 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb/os-interface => generated 284 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 22:17:20.181932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-1c02713b-334f-4303-86d2-9af2945af71b req-037307cc-b74d-4865-a5d9-e0cb2d5be654 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca6f2dae-a492-46e5-ab40-5884ff13d01e", "tag": "4a3c71ba-f9de-4571-b035-a9ed943dcc83"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:20.189887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:20.195150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1c02713b-334f-4303-86d2-9af2945af71b req-037307cc-b74d-4865-a5d9-e0cb2d5be654 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:20.195790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1c02713b-334f-4303-86d2-9af2945af71b req-037307cc-b74d-4865-a5d9-e0cb2d5be654 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:20.196360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1c02713b-334f-4303-86d2-9af2945af71b req-037307cc-b74d-4865-a5d9-e0cb2d5be654 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:20.208405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-1c02713b-334f-4303-86d2-9af2945af71b req-037307cc-b74d-4865-a5d9-e0cb2d5be654 service nova] Creating event network-changed:4a3c71ba-f9de-4571-b035-a9ed943dcc83 for instance ca6f2dae-a492-46e5-ab40-5884ff13d01e on hv-cinder-85367 Aug 18 22:17:20.213909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-1c02713b-334f-4303-86d2-9af2945af71b req-037307cc-b74d-4865-a5d9-e0cb2d5be654 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036661 Aug 18 22:17:20.218799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1957/3912] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:17:20.274721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e4354d47-c291-4012-a137-0436bde7f044 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:20.276247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e4354d47-c291-4012-a137-0436bde7f044 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:20.288677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4354d47-c291-4012-a137-0436bde7f044 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:20.289925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4354d47-c291-4012-a137-0436bde7f044 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:20.290858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4354d47-c291-4012-a137-0436bde7f044 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:20.292249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4354d47-c291-4012-a137-0436bde7f044 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:20.293393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4354d47-c291-4012-a137-0436bde7f044 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:20.294976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4354d47-c291-4012-a137-0436bde7f044 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:20.423571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-13c66f8a-9c5b-4f39-9587-fdb984d4ae20 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:20.424992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-13c66f8a-9c5b-4f39-9587-fdb984d4ae20 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:20.433411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13c66f8a-9c5b-4f39-9587-fdb984d4ae20 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:20.434199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13c66f8a-9c5b-4f39-9587-fdb984d4ae20 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:20.434835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13c66f8a-9c5b-4f39-9587-fdb984d4ae20 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:20.435684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13c66f8a-9c5b-4f39-9587-fdb984d4ae20 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:20.436274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13c66f8a-9c5b-4f39-9587-fdb984d4ae20 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:20.441675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-13c66f8a-9c5b-4f39-9587-fdb984d4ae20 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:20.448349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:20.568259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-13c66f8a-9c5b-4f39-9587-fdb984d4ae20 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:20.585270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-13c66f8a-9c5b-4f39-9587-fdb984d4ae20 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.164615 Aug 18 22:17:20.587520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1958/3913] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:20 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:20.594951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-400ad775-5164-4a2e-8222-0b4383c1a6f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Action: 'create', calling method: .version_select at 0x7fd88964e040>, body: {"keypair": {"name": "tempest-keypair-172772601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI30+TdHSzYM72YESS9BKrf+f3HF4SLAYsayHCdVeosIgdoH6nS07qjq3/TRHdoR+Yi0zEyoja/VoEQMNx67D7Ds8ZAmABFZq/RKWy2bTqkff8TKwA9IZ955Ia9ZNOw9xg=="}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:20.618658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-400ad775-5164-4a2e-8222-0b4383c1a6f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for project aa6929ebd282417cb6ba149f50281240. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:17:20.623577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-400ad775-5164-4a2e-8222-0b4383c1a6f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for user 7790a2ef47644d62863aafc890d03249 and project aa6929ebd282417cb6ba149f50281240. Resources: {'key_pairs'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:17:20.663252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-400ad775-5164-4a2e-8222-0b4383c1a6f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.074463 Aug 18 22:17:20.664079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1959/3914] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 22:17:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:17:20.750072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e4354d47-c291-4012-a137-0436bde7f044 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:20.761144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e4354d47-c291-4012-a137-0436bde7f044 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.495308 Aug 18 22:17:20.765579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1956/3915] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:20 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:21.613916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0f57995b-3b70-48e7-ba56-360466755046 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:21.614555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0f57995b-3b70-48e7-ba56-360466755046 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:21.622281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f57995b-3b70-48e7-ba56-360466755046 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:21.623654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f57995b-3b70-48e7-ba56-360466755046 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:21.624145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f57995b-3b70-48e7-ba56-360466755046 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:21.625015 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f57995b-3b70-48e7-ba56-360466755046 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:21.625540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f57995b-3b70-48e7-ba56-360466755046 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:21.626062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f57995b-3b70-48e7-ba56-360466755046 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:21.699019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0f57995b-3b70-48e7-ba56-360466755046 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:21.707864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0f57995b-3b70-48e7-ba56-360466755046 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.098738 Aug 18 22:17:21.708526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1960/3916] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:21.787679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a6ca1116-879e-4d75-843e-617829c3a02f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:21.789137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a6ca1116-879e-4d75-843e-617829c3a02f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:21.797121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6ca1116-879e-4d75-843e-617829c3a02f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:21.798197 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6ca1116-879e-4d75-843e-617829c3a02f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:21.798990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6ca1116-879e-4d75-843e-617829c3a02f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:21.800125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6ca1116-879e-4d75-843e-617829c3a02f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:21.800743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6ca1116-879e-4d75-843e-617829c3a02f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:21.801379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a6ca1116-879e-4d75-843e-617829c3a02f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:22.009805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-d9322169-d103-4d82-a45c-0f20cb1283f8 req-31301b0c-29a6-4a04-b4ec-99b5a086745a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb", "tag": "ff8ff962-990d-4a4b-b5eb-71ff8e49cee2"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:22.027408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d9322169-d103-4d82-a45c-0f20cb1283f8 req-31301b0c-29a6-4a04-b4ec-99b5a086745a service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:22.028192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d9322169-d103-4d82-a45c-0f20cb1283f8 req-31301b0c-29a6-4a04-b4ec-99b5a086745a service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:22.029061 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d9322169-d103-4d82-a45c-0f20cb1283f8 req-31301b0c-29a6-4a04-b4ec-99b5a086745a service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:22.044568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-d9322169-d103-4d82-a45c-0f20cb1283f8 req-31301b0c-29a6-4a04-b4ec-99b5a086745a service nova] Creating event network-changed:ff8ff962-990d-4a4b-b5eb-71ff8e49cee2 for instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb on hv-cinder-85367 Aug 18 22:17:22.051340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-d9322169-d103-4d82-a45c-0f20cb1283f8 req-31301b0c-29a6-4a04-b4ec-99b5a086745a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046185 Aug 18 22:17:22.053126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1961/3917] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:17:22.101655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a6ca1116-879e-4d75-843e-617829c3a02f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:22.115065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a6ca1116-879e-4d75-843e-617829c3a02f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.331899 Aug 18 22:17:22.116924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1957/3918] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:21 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:22.734993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-173d75ea-6405-4a91-b720-397b0a43e99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:22.736037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-173d75ea-6405-4a91-b720-397b0a43e99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:22.753398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-173d75ea-6405-4a91-b720-397b0a43e99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:22.754165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-173d75ea-6405-4a91-b720-397b0a43e99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:22.754795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-173d75ea-6405-4a91-b720-397b0a43e99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:22.755649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-173d75ea-6405-4a91-b720-397b0a43e99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:22.756249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-173d75ea-6405-4a91-b720-397b0a43e99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:22.757168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-173d75ea-6405-4a91-b720-397b0a43e99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:22.849482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-173d75ea-6405-4a91-b720-397b0a43e99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:22.868892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-173d75ea-6405-4a91-b720-397b0a43e99a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.141082 Aug 18 22:17:22.869783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1962/3919] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:23.140498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b38a4368-cfac-4a65-bc7d-00e199c76528 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:23.141171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b38a4368-cfac-4a65-bc7d-00e199c76528 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:23.151724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b38a4368-cfac-4a65-bc7d-00e199c76528 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:23.153193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b38a4368-cfac-4a65-bc7d-00e199c76528 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:23.155394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b38a4368-cfac-4a65-bc7d-00e199c76528 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:23.156329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b38a4368-cfac-4a65-bc7d-00e199c76528 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:23.157541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b38a4368-cfac-4a65-bc7d-00e199c76528 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:23.158355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b38a4368-cfac-4a65-bc7d-00e199c76528 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:23.543862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b38a4368-cfac-4a65-bc7d-00e199c76528 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:23.553112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b38a4368-cfac-4a65-bc7d-00e199c76528 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.418113 Aug 18 22:17:23.553904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1958/3920] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:23 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:23.889706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4192a63c-802e-425e-bcfb-b22998ccf16a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:23.890324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4192a63c-802e-425e-bcfb-b22998ccf16a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:23.899405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4192a63c-802e-425e-bcfb-b22998ccf16a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:23.899928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4192a63c-802e-425e-bcfb-b22998ccf16a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:23.900564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4192a63c-802e-425e-bcfb-b22998ccf16a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:23.901410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4192a63c-802e-425e-bcfb-b22998ccf16a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:23.902034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4192a63c-802e-425e-bcfb-b22998ccf16a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:23.902662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4192a63c-802e-425e-bcfb-b22998ccf16a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:23.930148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-261887716", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4f28e51-196b-4c42-8717-0b4dbb184c81"}], "security_groups": [{"name": "tempest-securitygroup--697459671"}], "key_name": "tempest-keypair-172772601", "user_data": "}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:23.991778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4192a63c-802e-425e-bcfb-b22998ccf16a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:24.000731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4192a63c-802e-425e-bcfb-b22998ccf16a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.115148 Aug 18 22:17:24.001468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1963/3921] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:23 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:24.144850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.network.neutron [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] validate_networks() for [('b4f28e51-196b-4c42-8717-0b4dbb184c81', None, None, None, None, None)] {{(pid=120538) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 22:17:24.575916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aec690e8-f557-4996-aa1f-039b2fb4be0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:24.576541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aec690e8-f557-4996-aa1f-039b2fb4be0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:24.583949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aec690e8-f557-4996-aa1f-039b2fb4be0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:24.584357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aec690e8-f557-4996-aa1f-039b2fb4be0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:24.584965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aec690e8-f557-4996-aa1f-039b2fb4be0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:24.585846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aec690e8-f557-4996-aa1f-039b2fb4be0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:24.586310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aec690e8-f557-4996-aa1f-039b2fb4be0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:24.586742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aec690e8-f557-4996-aa1f-039b2fb4be0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:24.609314 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Flavor limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 22:17:24.609957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Image limits 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 22:17:24.610718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Flavor pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 22:17:24.611382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Image pref 0:0:0 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 22:17:24.611876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.virt.hardware [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 22:17:24.622560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:24.623160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:24.623677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:24.624799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:24.625538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:24.626078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:24.644671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for project aa6929ebd282417cb6ba149f50281240. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:17:24.649119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for user 7790a2ef47644d62863aafc890d03249 and project aa6929ebd282417cb6ba149f50281240. Resources: {'instances', 'cores', 'ram'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:17:24.661017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Going to run 1 instances... {{(pid=120538) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 22:17:24.663360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 22:17:24.720111 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e609fe1d-3c5d-44b8-8ff5-8e630645b0f7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.794587 Aug 18 22:17:24.720776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1959/3922] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 22:17:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 22:17:24.739036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f3b9c0a6-c4ee-4fbe-887d-da253632c8a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:24.739780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f3b9c0a6-c4ee-4fbe-887d-da253632c8a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:24.746736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aec690e8-f557-4996-aa1f-039b2fb4be0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:24.766248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aec690e8-f557-4996-aa1f-039b2fb4be0a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.194744 Aug 18 22:17:24.767363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1964/3923] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:24 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:24.799471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f3b9c0a6-c4ee-4fbe-887d-da253632c8a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:24.807507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f3b9c0a6-c4ee-4fbe-887d-da253632c8a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1240 microversion: 2.1 time: 0.072455 Aug 18 22:17:24.808079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1960/3924] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:24 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:25.021574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-94707174-8510-4919-9b3f-ddb902dbcb6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:25.022297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-94707174-8510-4919-9b3f-ddb902dbcb6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:25.029195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94707174-8510-4919-9b3f-ddb902dbcb6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:25.029985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94707174-8510-4919-9b3f-ddb902dbcb6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:25.030493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94707174-8510-4919-9b3f-ddb902dbcb6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:25.031338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94707174-8510-4919-9b3f-ddb902dbcb6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:25.031808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94707174-8510-4919-9b3f-ddb902dbcb6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:25.032244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-94707174-8510-4919-9b3f-ddb902dbcb6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:25.096485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-94707174-8510-4919-9b3f-ddb902dbcb6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:25.105334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-94707174-8510-4919-9b3f-ddb902dbcb6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.087746 Aug 18 22:17:25.105950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1965/3925] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:25.789192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3157764b-d35b-4375-bc8b-700a67d86ca7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:25.790579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3157764b-d35b-4375-bc8b-700a67d86ca7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:25.798312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3157764b-d35b-4375-bc8b-700a67d86ca7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:25.798796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3157764b-d35b-4375-bc8b-700a67d86ca7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:25.799428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3157764b-d35b-4375-bc8b-700a67d86ca7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:25.800134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3157764b-d35b-4375-bc8b-700a67d86ca7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:25.800588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3157764b-d35b-4375-bc8b-700a67d86ca7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:25.801012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3157764b-d35b-4375-bc8b-700a67d86ca7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:25.829336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-762f89cd-da34-4b48-bbca-d1f7570a326b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:25.830447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-762f89cd-da34-4b48-bbca-d1f7570a326b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:25.838714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-762f89cd-da34-4b48-bbca-d1f7570a326b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:25.839363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-762f89cd-da34-4b48-bbca-d1f7570a326b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:25.839966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-762f89cd-da34-4b48-bbca-d1f7570a326b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:25.841355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-762f89cd-da34-4b48-bbca-d1f7570a326b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:25.841988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-762f89cd-da34-4b48-bbca-d1f7570a326b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:25.842919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-762f89cd-da34-4b48-bbca-d1f7570a326b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:25.908292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-762f89cd-da34-4b48-bbca-d1f7570a326b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:25.916179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-762f89cd-da34-4b48-bbca-d1f7570a326b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1298 microversion: 2.1 time: 0.091247 Aug 18 22:17:25.917111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1966/3926] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:25 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:26.127447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-624443c6-547d-4059-bdbb-f5124db33c69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:26.128106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-624443c6-547d-4059-bdbb-f5124db33c69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:26.134894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-624443c6-547d-4059-bdbb-f5124db33c69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:26.135382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-624443c6-547d-4059-bdbb-f5124db33c69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:26.135841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-624443c6-547d-4059-bdbb-f5124db33c69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:26.136543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-624443c6-547d-4059-bdbb-f5124db33c69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:26.136992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-624443c6-547d-4059-bdbb-f5124db33c69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:26.137410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-624443c6-547d-4059-bdbb-f5124db33c69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:26.202268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-624443c6-547d-4059-bdbb-f5124db33c69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:26.219785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-624443c6-547d-4059-bdbb-f5124db33c69 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.096138 Aug 18 22:17:26.220386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1967/3927] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:26 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:26.269138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3157764b-d35b-4375-bc8b-700a67d86ca7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:26.277399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3157764b-d35b-4375-bc8b-700a67d86ca7 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.493242 Aug 18 22:17:26.278084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1961/3928] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:25 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:26.938550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d7ac6947-17a7-43dd-8fb2-c3ea61eb6bd4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:26.939058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d7ac6947-17a7-43dd-8fb2-c3ea61eb6bd4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:26.944860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7ac6947-17a7-43dd-8fb2-c3ea61eb6bd4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:26.945336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7ac6947-17a7-43dd-8fb2-c3ea61eb6bd4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:26.945801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7ac6947-17a7-43dd-8fb2-c3ea61eb6bd4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:26.946486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7ac6947-17a7-43dd-8fb2-c3ea61eb6bd4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:26.946982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7ac6947-17a7-43dd-8fb2-c3ea61eb6bd4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:26.947795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7ac6947-17a7-43dd-8fb2-c3ea61eb6bd4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:27.076343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d7ac6947-17a7-43dd-8fb2-c3ea61eb6bd4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:27.084288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d7ac6947-17a7-43dd-8fb2-c3ea61eb6bd4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1365 microversion: 2.1 time: 0.150596 Aug 18 22:17:27.084860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1968/3929] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:26 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:27.240232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-75de991f-817d-488d-b63f-8c875ba9ee30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:27.240879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-75de991f-817d-488d-b63f-8c875ba9ee30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:27.247171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75de991f-817d-488d-b63f-8c875ba9ee30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:27.247652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75de991f-817d-488d-b63f-8c875ba9ee30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:27.248083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75de991f-817d-488d-b63f-8c875ba9ee30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:27.248773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75de991f-817d-488d-b63f-8c875ba9ee30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:27.249220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75de991f-817d-488d-b63f-8c875ba9ee30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:27.249671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-75de991f-817d-488d-b63f-8c875ba9ee30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:27.300067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-89f96e0e-c739-4b9f-bb6a-4842925013dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:27.300607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-89f96e0e-c739-4b9f-bb6a-4842925013dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:27.306931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89f96e0e-c739-4b9f-bb6a-4842925013dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:27.307419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89f96e0e-c739-4b9f-bb6a-4842925013dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:27.307855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89f96e0e-c739-4b9f-bb6a-4842925013dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:27.308548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89f96e0e-c739-4b9f-bb6a-4842925013dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:27.309002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89f96e0e-c739-4b9f-bb6a-4842925013dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:27.309425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89f96e0e-c739-4b9f-bb6a-4842925013dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:27.320921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-75de991f-817d-488d-b63f-8c875ba9ee30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:27.330163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-75de991f-817d-488d-b63f-8c875ba9ee30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.093664 Aug 18 22:17:27.331419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1962/3930] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:27.374922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-06295393-b068-4690-9ecc-ab8109567322 req-0adf521b-6eb3-4f90-9506-7353b636fd15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efddf778-cd30-48e6-b04a-2a6277976fbd", "tag": "310cc3a7-4b4d-47e3-8d1b-8a713e646929"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:27.385219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-06295393-b068-4690-9ecc-ab8109567322 req-0adf521b-6eb3-4f90-9506-7353b636fd15 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:27.385893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-06295393-b068-4690-9ecc-ab8109567322 req-0adf521b-6eb3-4f90-9506-7353b636fd15 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:27.386430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-06295393-b068-4690-9ecc-ab8109567322 req-0adf521b-6eb3-4f90-9506-7353b636fd15 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:27.400163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-06295393-b068-4690-9ecc-ab8109567322 req-0adf521b-6eb3-4f90-9506-7353b636fd15 service nova] Creating event network-changed:310cc3a7-4b4d-47e3-8d1b-8a713e646929 for instance efddf778-cd30-48e6-b04a-2a6277976fbd on hv-cinder-85367 Aug 18 22:17:27.406416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-06295393-b068-4690-9ecc-ab8109567322 req-0adf521b-6eb3-4f90-9506-7353b636fd15 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035741 Aug 18 22:17:27.407030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1963/3931] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:17:27.457389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-89f96e0e-c739-4b9f-bb6a-4842925013dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:27.467356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-89f96e0e-c739-4b9f-bb6a-4842925013dd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.171227 Aug 18 22:17:27.467836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1969/3932] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:27 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:28.106160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-176a7f63-3fe0-4d7c-bf5e-75c84583ab9b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:28.107385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-176a7f63-3fe0-4d7c-bf5e-75c84583ab9b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:28.113551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-176a7f63-3fe0-4d7c-bf5e-75c84583ab9b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:28.114059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-176a7f63-3fe0-4d7c-bf5e-75c84583ab9b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:28.114496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-176a7f63-3fe0-4d7c-bf5e-75c84583ab9b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:28.115184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-176a7f63-3fe0-4d7c-bf5e-75c84583ab9b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:28.115643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-176a7f63-3fe0-4d7c-bf5e-75c84583ab9b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:28.116088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-176a7f63-3fe0-4d7c-bf5e-75c84583ab9b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:28.255167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-176a7f63-3fe0-4d7c-bf5e-75c84583ab9b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:28.262867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-176a7f63-3fe0-4d7c-bf5e-75c84583ab9b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1365 microversion: 2.1 time: 0.161140 Aug 18 22:17:28.263440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1964/3933] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:28 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:28.351582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-761e3f0c-4fb1-4574-b8f3-a4e4c274a67f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:28.352201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-761e3f0c-4fb1-4574-b8f3-a4e4c274a67f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:28.359381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761e3f0c-4fb1-4574-b8f3-a4e4c274a67f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:28.359808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761e3f0c-4fb1-4574-b8f3-a4e4c274a67f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:28.360247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761e3f0c-4fb1-4574-b8f3-a4e4c274a67f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:28.360938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761e3f0c-4fb1-4574-b8f3-a4e4c274a67f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:28.361395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761e3f0c-4fb1-4574-b8f3-a4e4c274a67f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:28.361858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761e3f0c-4fb1-4574-b8f3-a4e4c274a67f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:28.423487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-761e3f0c-4fb1-4574-b8f3-a4e4c274a67f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:28.431918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-761e3f0c-4fb1-4574-b8f3-a4e4c274a67f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084180 Aug 18 22:17:28.432485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1970/3934] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:28.488613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8d62e028-4639-4634-9961-4bf8d45fe04c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:28.489224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8d62e028-4639-4634-9961-4bf8d45fe04c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:28.495613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d62e028-4639-4634-9961-4bf8d45fe04c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:28.496103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d62e028-4639-4634-9961-4bf8d45fe04c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:28.496547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d62e028-4639-4634-9961-4bf8d45fe04c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:28.497270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d62e028-4639-4634-9961-4bf8d45fe04c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:28.497748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d62e028-4639-4634-9961-4bf8d45fe04c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:28.498175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d62e028-4639-4634-9961-4bf8d45fe04c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:28.630446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8d62e028-4639-4634-9961-4bf8d45fe04c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:28.639158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8d62e028-4639-4634-9961-4bf8d45fe04c tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.154367 Aug 18 22:17:28.639737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1965/3935] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:28 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:29.283682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-12285024-c5df-4fe5-9734-f1abd0e20689 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:29.284399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-12285024-c5df-4fe5-9734-f1abd0e20689 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:29.290544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12285024-c5df-4fe5-9734-f1abd0e20689 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:29.290941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12285024-c5df-4fe5-9734-f1abd0e20689 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:29.291381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12285024-c5df-4fe5-9734-f1abd0e20689 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:29.292080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12285024-c5df-4fe5-9734-f1abd0e20689 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:29.292538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12285024-c5df-4fe5-9734-f1abd0e20689 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:29.292971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-12285024-c5df-4fe5-9734-f1abd0e20689 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:29.420982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-12285024-c5df-4fe5-9734-f1abd0e20689 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:29.428867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-12285024-c5df-4fe5-9734-f1abd0e20689 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1365 microversion: 2.1 time: 0.149196 Aug 18 22:17:29.429444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1971/3936] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:29 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:29.453863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b8c90e69-d592-4e70-8ff1-91099eae91aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:29.454600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b8c90e69-d592-4e70-8ff1-91099eae91aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:29.461141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8c90e69-d592-4e70-8ff1-91099eae91aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:29.461654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8c90e69-d592-4e70-8ff1-91099eae91aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:29.462097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8c90e69-d592-4e70-8ff1-91099eae91aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:29.462795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8c90e69-d592-4e70-8ff1-91099eae91aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:29.463250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8c90e69-d592-4e70-8ff1-91099eae91aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:29.463680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b8c90e69-d592-4e70-8ff1-91099eae91aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:29.526601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b8c90e69-d592-4e70-8ff1-91099eae91aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:29.534863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b8c90e69-d592-4e70-8ff1-91099eae91aa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085411 Aug 18 22:17:29.535442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1966/3937] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:29 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:29.660357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8c740311-b159-420b-b810-6238db8e9638 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:29.660969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8c740311-b159-420b-b810-6238db8e9638 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:29.667006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c740311-b159-420b-b810-6238db8e9638 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:29.667486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c740311-b159-420b-b810-6238db8e9638 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:29.667921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c740311-b159-420b-b810-6238db8e9638 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:29.668609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c740311-b159-420b-b810-6238db8e9638 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:29.669550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c740311-b159-420b-b810-6238db8e9638 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:29.670058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8c740311-b159-420b-b810-6238db8e9638 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:29.799022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8c740311-b159-420b-b810-6238db8e9638 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:29.807365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8c740311-b159-420b-b810-6238db8e9638 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.150910 Aug 18 22:17:29.807939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1972/3938] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:29 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:30.449453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07381e01-7f48-4d07-a7ae-fc2c3eaba441 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:30.450578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07381e01-7f48-4d07-a7ae-fc2c3eaba441 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:30.456599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07381e01-7f48-4d07-a7ae-fc2c3eaba441 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:30.457160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07381e01-7f48-4d07-a7ae-fc2c3eaba441 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:30.457515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07381e01-7f48-4d07-a7ae-fc2c3eaba441 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:30.458229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07381e01-7f48-4d07-a7ae-fc2c3eaba441 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:30.458689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07381e01-7f48-4d07-a7ae-fc2c3eaba441 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:30.459120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07381e01-7f48-4d07-a7ae-fc2c3eaba441 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:30.555452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-16d208ba-4890-4d69-a1f1-26ba5e4faedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:30.556066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-16d208ba-4890-4d69-a1f1-26ba5e4faedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:30.562437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16d208ba-4890-4d69-a1f1-26ba5e4faedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:30.562923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16d208ba-4890-4d69-a1f1-26ba5e4faedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:30.563357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16d208ba-4890-4d69-a1f1-26ba5e4faedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:30.564054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16d208ba-4890-4d69-a1f1-26ba5e4faedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:30.564508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16d208ba-4890-4d69-a1f1-26ba5e4faedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:30.564960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-16d208ba-4890-4d69-a1f1-26ba5e4faedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:30.589036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-07381e01-7f48-4d07-a7ae-fc2c3eaba441 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:30.597439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07381e01-7f48-4d07-a7ae-fc2c3eaba441 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1365 microversion: 2.1 time: 0.151801 Aug 18 22:17:30.598047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1967/3939] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:30 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:30.627051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-16d208ba-4890-4d69-a1f1-26ba5e4faedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:30.633042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:30.636180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-16d208ba-4890-4d69-a1f1-26ba5e4faedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084789 Aug 18 22:17:30.636748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1973/3940] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:30.829308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-71e2c5c3-1207-49af-ba75-1ba45bdac45f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:30.829973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-71e2c5c3-1207-49af-ba75-1ba45bdac45f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:30.835935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71e2c5c3-1207-49af-ba75-1ba45bdac45f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:30.836424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71e2c5c3-1207-49af-ba75-1ba45bdac45f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:30.836869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71e2c5c3-1207-49af-ba75-1ba45bdac45f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:30.837560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71e2c5c3-1207-49af-ba75-1ba45bdac45f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:30.838045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71e2c5c3-1207-49af-ba75-1ba45bdac45f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:30.838482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71e2c5c3-1207-49af-ba75-1ba45bdac45f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:30.966310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-71e2c5c3-1207-49af-ba75-1ba45bdac45f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:30.974372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-71e2c5c3-1207-49af-ba75-1ba45bdac45f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.149417 Aug 18 22:17:30.974941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1968/3941] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:30 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:31.617429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f2c2d2e5-afc7-4797-8eb5-a795076860db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:31.618066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f2c2d2e5-afc7-4797-8eb5-a795076860db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:31.624965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2c2d2e5-afc7-4797-8eb5-a795076860db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:31.625437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2c2d2e5-afc7-4797-8eb5-a795076860db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:31.625905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2c2d2e5-afc7-4797-8eb5-a795076860db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:31.626582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2c2d2e5-afc7-4797-8eb5-a795076860db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:31.627028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2c2d2e5-afc7-4797-8eb5-a795076860db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:31.627447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f2c2d2e5-afc7-4797-8eb5-a795076860db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:31.658259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c88fc5d9-71b7-4bb6-a9de-5d0ddd369522 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:31.658985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c88fc5d9-71b7-4bb6-a9de-5d0ddd369522 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:31.666374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c88fc5d9-71b7-4bb6-a9de-5d0ddd369522 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:31.666374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c88fc5d9-71b7-4bb6-a9de-5d0ddd369522 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:31.666661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c88fc5d9-71b7-4bb6-a9de-5d0ddd369522 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:31.670125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c88fc5d9-71b7-4bb6-a9de-5d0ddd369522 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:31.670125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c88fc5d9-71b7-4bb6-a9de-5d0ddd369522 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:31.670125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c88fc5d9-71b7-4bb6-a9de-5d0ddd369522 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:31.734136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c88fc5d9-71b7-4bb6-a9de-5d0ddd369522 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:31.742753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c88fc5d9-71b7-4bb6-a9de-5d0ddd369522 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088147 Aug 18 22:17:31.743271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1969/3942] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:31.762094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f2c2d2e5-afc7-4797-8eb5-a795076860db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:31.769627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f2c2d2e5-afc7-4797-8eb5-a795076860db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1365 microversion: 2.1 time: 0.155946 Aug 18 22:17:31.770207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1974/3943] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:31 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:31.995620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4eee3c13-1a57-40e2-9f3e-c960a94e0309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:31.996166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4eee3c13-1a57-40e2-9f3e-c960a94e0309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:32.002143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eee3c13-1a57-40e2-9f3e-c960a94e0309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:32.002631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eee3c13-1a57-40e2-9f3e-c960a94e0309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:32.003075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eee3c13-1a57-40e2-9f3e-c960a94e0309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:32.003772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eee3c13-1a57-40e2-9f3e-c960a94e0309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:32.004234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eee3c13-1a57-40e2-9f3e-c960a94e0309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:32.004664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4eee3c13-1a57-40e2-9f3e-c960a94e0309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:32.128982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4eee3c13-1a57-40e2-9f3e-c960a94e0309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:32.137124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4eee3c13-1a57-40e2-9f3e-c960a94e0309 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.145458 Aug 18 22:17:32.138213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1970/3944] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:31 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:32.764150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e3c11bfe-f152-4fa7-934c-51828266cbac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:32.764769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e3c11bfe-f152-4fa7-934c-51828266cbac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:32.771240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3c11bfe-f152-4fa7-934c-51828266cbac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:32.771734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3c11bfe-f152-4fa7-934c-51828266cbac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:32.772174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3c11bfe-f152-4fa7-934c-51828266cbac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:32.772876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3c11bfe-f152-4fa7-934c-51828266cbac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:32.773335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3c11bfe-f152-4fa7-934c-51828266cbac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:32.773795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3c11bfe-f152-4fa7-934c-51828266cbac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:32.789538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9c0c6803-97e8-443b-b251-d030e6a8eb95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:32.790319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9c0c6803-97e8-443b-b251-d030e6a8eb95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:32.797242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c0c6803-97e8-443b-b251-d030e6a8eb95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:32.797766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c0c6803-97e8-443b-b251-d030e6a8eb95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:32.798213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c0c6803-97e8-443b-b251-d030e6a8eb95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:32.798919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c0c6803-97e8-443b-b251-d030e6a8eb95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:32.799374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c0c6803-97e8-443b-b251-d030e6a8eb95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:32.799804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9c0c6803-97e8-443b-b251-d030e6a8eb95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:32.835046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e3c11bfe-f152-4fa7-934c-51828266cbac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:32.843425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e3c11bfe-f152-4fa7-934c-51828266cbac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083274 Aug 18 22:17:32.844019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1975/3945] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:32.928230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9c0c6803-97e8-443b-b251-d030e6a8eb95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:32.936544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9c0c6803-97e8-443b-b251-d030e6a8eb95 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1365 microversion: 2.1 time: 0.150810 Aug 18 22:17:32.937119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1971/3946] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:32 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:17:33.159838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-df5821a4-3c13-47bc-aab1-2e303f337555 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:33.160576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-df5821a4-3c13-47bc-aab1-2e303f337555 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: c3f260fb-84bc-434c-b885-0a8f54494162] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:33.166502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df5821a4-3c13-47bc-aab1-2e303f337555 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:33.166989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df5821a4-3c13-47bc-aab1-2e303f337555 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:33.167430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df5821a4-3c13-47bc-aab1-2e303f337555 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:33.168121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df5821a4-3c13-47bc-aab1-2e303f337555 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:33.168578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df5821a4-3c13-47bc-aab1-2e303f337555 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:33.169688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df5821a4-3c13-47bc-aab1-2e303f337555 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:33.184322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:33.298729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-df5821a4-3c13-47bc-aab1-2e303f337555 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:33.307077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-df5821a4-3c13-47bc-aab1-2e303f337555 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162" status: 200 len: 1737 microversion: 2.1 time: 0.151156 Aug 18 22:17:33.307648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1976/3947] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:33 2022] GET /compute/v2.1/servers/c3f260fb-84bc-434c-b885-0a8f54494162 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:33.327394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f37066cd-9e7c-44f2-b5e8-f0c67d069f6b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '.version_select at 0x7fd889f01c10>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:33.346128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f37066cd-9e7c-44f2-b5e8-f0c67d069f6b tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2136457162" status: 202 len: 0 microversion: 2.1 time: 0.022489 Aug 18 22:17:33.346887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1972/3948] 10.222.0.82 () {58 vars in 1221 bytes} [Thu Aug 18 22:17:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2136457162 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:17:33.430209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-b3d361a3-5c57-450b-ac79-cbeea3ed01d9 req-1933a2e3-2fce-4eab-afde-4130ebb8d741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efddf778-cd30-48e6-b04a-2a6277976fbd", "name": "network-vif-plugged", "status": "completed", "tag": "310cc3a7-4b4d-47e3-8d1b-8a713e646929"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:33.439745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b3d361a3-5c57-450b-ac79-cbeea3ed01d9 req-1933a2e3-2fce-4eab-afde-4130ebb8d741 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:33.440273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b3d361a3-5c57-450b-ac79-cbeea3ed01d9 req-1933a2e3-2fce-4eab-afde-4130ebb8d741 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:33.440664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b3d361a3-5c57-450b-ac79-cbeea3ed01d9 req-1933a2e3-2fce-4eab-afde-4130ebb8d741 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:33.454241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-b3d361a3-5c57-450b-ac79-cbeea3ed01d9 req-1933a2e3-2fce-4eab-afde-4130ebb8d741 service nova] Creating event network-vif-plugged:310cc3a7-4b4d-47e3-8d1b-8a713e646929 for instance efddf778-cd30-48e6-b04a-2a6277976fbd on hv-cinder-85367 Aug 18 22:17:33.459221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-b3d361a3-5c57-450b-ac79-cbeea3ed01d9 req-1933a2e3-2fce-4eab-afde-4130ebb8d741 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032851 Aug 18 22:17:33.459848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1977/3949] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:17:33.864803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cbdb8342-ae62-431e-9fcd-280821a3630c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:33.865428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cbdb8342-ae62-431e-9fcd-280821a3630c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:33.871545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbdb8342-ae62-431e-9fcd-280821a3630c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:33.872584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbdb8342-ae62-431e-9fcd-280821a3630c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:33.873033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbdb8342-ae62-431e-9fcd-280821a3630c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:33.873766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbdb8342-ae62-431e-9fcd-280821a3630c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:33.874230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbdb8342-ae62-431e-9fcd-280821a3630c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:33.874663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cbdb8342-ae62-431e-9fcd-280821a3630c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:33.936033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cbdb8342-ae62-431e-9fcd-280821a3630c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:33.944167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cbdb8342-ae62-431e-9fcd-280821a3630c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083699 Aug 18 22:17:33.944671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1973/3950] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:33.958062 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-428d2d0a-cc2d-4749-99d1-58aa52d6a4a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:33.958769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-428d2d0a-cc2d-4749-99d1-58aa52d6a4a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:33.964836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-428d2d0a-cc2d-4749-99d1-58aa52d6a4a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:33.965513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-428d2d0a-cc2d-4749-99d1-58aa52d6a4a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:33.965993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-428d2d0a-cc2d-4749-99d1-58aa52d6a4a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:33.966663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-428d2d0a-cc2d-4749-99d1-58aa52d6a4a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:33.967098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-428d2d0a-cc2d-4749-99d1-58aa52d6a4a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:33.967533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-428d2d0a-cc2d-4749-99d1-58aa52d6a4a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:34.186287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-428d2d0a-cc2d-4749-99d1-58aa52d6a4a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:34.194328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-428d2d0a-cc2d-4749-99d1-58aa52d6a4a9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1365 microversion: 2.1 time: 0.240946 Aug 18 22:17:34.194841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1978/3951] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:33 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:34.524644 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-d2bc343e-d75b-4e93-9da7-6351ac666972 req-233b6923-42b2-4878-8c28-ecd34ceec1cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3f260fb-84bc-434c-b885-0a8f54494162", "tag": "859d4e5f-383d-4366-b08c-f0d6c9520205"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:34.534689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-d2bc343e-d75b-4e93-9da7-6351ac666972 req-233b6923-42b2-4878-8c28-ecd34ceec1cc service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:34.535178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-d2bc343e-d75b-4e93-9da7-6351ac666972 req-233b6923-42b2-4878-8c28-ecd34ceec1cc service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:34.535615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-d2bc343e-d75b-4e93-9da7-6351ac666972 req-233b6923-42b2-4878-8c28-ecd34ceec1cc service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:34.547616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-d2bc343e-d75b-4e93-9da7-6351ac666972 req-233b6923-42b2-4878-8c28-ecd34ceec1cc service nova] Creating event network-changed:859d4e5f-383d-4366-b08c-f0d6c9520205 for instance c3f260fb-84bc-434c-b885-0a8f54494162 on hv-cinder-85367 Aug 18 22:17:34.554048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-d2bc343e-d75b-4e93-9da7-6351ac666972 req-233b6923-42b2-4878-8c28-ecd34ceec1cc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032970 Aug 18 22:17:34.554863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1974/3952] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:17:34.966387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e9b85ff8-43f4-45fa-892b-b6994e638bb4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:34.967009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e9b85ff8-43f4-45fa-892b-b6994e638bb4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:34.973366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9b85ff8-43f4-45fa-892b-b6994e638bb4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:34.973819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9b85ff8-43f4-45fa-892b-b6994e638bb4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:34.974256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9b85ff8-43f4-45fa-892b-b6994e638bb4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:34.974952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9b85ff8-43f4-45fa-892b-b6994e638bb4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:34.975404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9b85ff8-43f4-45fa-892b-b6994e638bb4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:34.975884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e9b85ff8-43f4-45fa-892b-b6994e638bb4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:35.038349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e9b85ff8-43f4-45fa-892b-b6994e638bb4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:35.046805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e9b85ff8-43f4-45fa-892b-b6994e638bb4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084918 Aug 18 22:17:35.047387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1979/3953] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:35.212629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:35.213539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=8 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:35.219011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ab4c835a-d064-4714-aeee-b0b3f509a1c9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:35.219719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ab4c835a-d064-4714-aeee-b0b3f509a1c9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:35.227276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab4c835a-d064-4714-aeee-b0b3f509a1c9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:35.227806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab4c835a-d064-4714-aeee-b0b3f509a1c9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:35.228247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab4c835a-d064-4714-aeee-b0b3f509a1c9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:35.228966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab4c835a-d064-4714-aeee-b0b3f509a1c9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:35.229447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab4c835a-d064-4714-aeee-b0b3f509a1c9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:35.229899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab4c835a-d064-4714-aeee-b0b3f509a1c9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:35.480337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ab4c835a-d064-4714-aeee-b0b3f509a1c9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:35.488644 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ab4c835a-d064-4714-aeee-b0b3f509a1c9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1556 microversion: 2.1 time: 0.276835 Aug 18 22:17:35.489825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1975/3954] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:35 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1556 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:35.510611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-992ff585-4234-466d-af57-7723e05c05a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:35.511119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-992ff585-4234-466d-af57-7723e05c05a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:35.518451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-992ff585-4234-466d-af57-7723e05c05a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:35.519162 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-992ff585-4234-466d-af57-7723e05c05a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:35.519772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-992ff585-4234-466d-af57-7723e05c05a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:35.520633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-992ff585-4234-466d-af57-7723e05c05a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:35.521092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-992ff585-4234-466d-af57-7723e05c05a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:35.521528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-992ff585-4234-466d-af57-7723e05c05a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:35.602484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-992ff585-4234-466d-af57-7723e05c05a4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095965 Aug 18 22:17:35.603320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1980/3955] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 22:17:35 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:17:36.069185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8f7e3524-b11f-4381-920e-0a2d6ffeb526 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:36.069961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8f7e3524-b11f-4381-920e-0a2d6ffeb526 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:36.076404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f7e3524-b11f-4381-920e-0a2d6ffeb526 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:36.076896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f7e3524-b11f-4381-920e-0a2d6ffeb526 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:36.077338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f7e3524-b11f-4381-920e-0a2d6ffeb526 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:36.078065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f7e3524-b11f-4381-920e-0a2d6ffeb526 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:36.078522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f7e3524-b11f-4381-920e-0a2d6ffeb526 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:36.078953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f7e3524-b11f-4381-920e-0a2d6ffeb526 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:36.096003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:36.144776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8f7e3524-b11f-4381-920e-0a2d6ffeb526 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:36.153816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8f7e3524-b11f-4381-920e-0a2d6ffeb526 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088023 Aug 18 22:17:36.154425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1976/3956] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:36.569524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-7d97d55e-9a9c-4c54-8900-1be81877fae2 req-1443f0b9-9ae6-452f-8938-cf85b3a9c6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efddf778-cd30-48e6-b04a-2a6277976fbd", "tag": "310cc3a7-4b4d-47e3-8d1b-8a713e646929"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:17:36.579619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-7d97d55e-9a9c-4c54-8900-1be81877fae2 req-1443f0b9-9ae6-452f-8938-cf85b3a9c6d8 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:36.580099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-7d97d55e-9a9c-4c54-8900-1be81877fae2 req-1443f0b9-9ae6-452f-8938-cf85b3a9c6d8 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:36.580532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-7d97d55e-9a9c-4c54-8900-1be81877fae2 req-1443f0b9-9ae6-452f-8938-cf85b3a9c6d8 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:36.592228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-7d97d55e-9a9c-4c54-8900-1be81877fae2 req-1443f0b9-9ae6-452f-8938-cf85b3a9c6d8 service nova] Creating event network-changed:310cc3a7-4b4d-47e3-8d1b-8a713e646929 for instance efddf778-cd30-48e6-b04a-2a6277976fbd on hv-cinder-85367 Aug 18 22:17:36.597468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-7d97d55e-9a9c-4c54-8900-1be81877fae2 req-1443f0b9-9ae6-452f-8938-cf85b3a9c6d8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032192 Aug 18 22:17:36.598492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1981/3957] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:17:37.174883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-08617154-6dae-4e3b-a449-e3c8f28a3891 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:37.175715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-08617154-6dae-4e3b-a449-e3c8f28a3891 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:37.182745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08617154-6dae-4e3b-a449-e3c8f28a3891 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:37.183179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08617154-6dae-4e3b-a449-e3c8f28a3891 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:37.183607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08617154-6dae-4e3b-a449-e3c8f28a3891 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:37.184326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08617154-6dae-4e3b-a449-e3c8f28a3891 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:37.185355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08617154-6dae-4e3b-a449-e3c8f28a3891 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:37.185871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08617154-6dae-4e3b-a449-e3c8f28a3891 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:37.252905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-08617154-6dae-4e3b-a449-e3c8f28a3891 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:37.261797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-08617154-6dae-4e3b-a449-e3c8f28a3891 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.090740 Aug 18 22:17:37.262374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1977/3958] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:37 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:38.283653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-10788f39-02e3-4b8f-9b8a-c37fd18ecfed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:38.284381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-10788f39-02e3-4b8f-9b8a-c37fd18ecfed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:38.291112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10788f39-02e3-4b8f-9b8a-c37fd18ecfed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:38.291589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10788f39-02e3-4b8f-9b8a-c37fd18ecfed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:38.292030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10788f39-02e3-4b8f-9b8a-c37fd18ecfed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:38.292723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10788f39-02e3-4b8f-9b8a-c37fd18ecfed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:38.293181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10788f39-02e3-4b8f-9b8a-c37fd18ecfed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:38.293715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10788f39-02e3-4b8f-9b8a-c37fd18ecfed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:38.354243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-10788f39-02e3-4b8f-9b8a-c37fd18ecfed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:38.362360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-10788f39-02e3-4b8f-9b8a-c37fd18ecfed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082921 Aug 18 22:17:38.362934 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1982/3959] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:38 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:39.383905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-50ab0016-8e5e-46ed-affe-f3aa30069de2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:39.384547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-50ab0016-8e5e-46ed-affe-f3aa30069de2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:39.386925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:39.392968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50ab0016-8e5e-46ed-affe-f3aa30069de2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:39.393452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50ab0016-8e5e-46ed-affe-f3aa30069de2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:39.393923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50ab0016-8e5e-46ed-affe-f3aa30069de2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:39.394613 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50ab0016-8e5e-46ed-affe-f3aa30069de2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:39.395066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50ab0016-8e5e-46ed-affe-f3aa30069de2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:39.395493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50ab0016-8e5e-46ed-affe-f3aa30069de2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:39.457373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-50ab0016-8e5e-46ed-affe-f3aa30069de2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:39.465435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-50ab0016-8e5e-46ed-affe-f3aa30069de2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085500 Aug 18 22:17:39.466718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1978/3960] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:39 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:40.486901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1153243a-0be8-4186-9e87-21e171facfe3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:40.487513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1153243a-0be8-4186-9e87-21e171facfe3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:40.494086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1153243a-0be8-4186-9e87-21e171facfe3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:40.494584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1153243a-0be8-4186-9e87-21e171facfe3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:40.495001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1153243a-0be8-4186-9e87-21e171facfe3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:40.495686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1153243a-0be8-4186-9e87-21e171facfe3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:40.496136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1153243a-0be8-4186-9e87-21e171facfe3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:40.496558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1153243a-0be8-4186-9e87-21e171facfe3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:40.555947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1153243a-0be8-4186-9e87-21e171facfe3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:40.563981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1153243a-0be8-4186-9e87-21e171facfe3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.080918 Aug 18 22:17:40.564549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1983/3961] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:40 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:41.584219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fc863a6a-17fa-4e42-9919-96d0cb14a375 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:41.584832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fc863a6a-17fa-4e42-9919-96d0cb14a375 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:41.591367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc863a6a-17fa-4e42-9919-96d0cb14a375 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:41.591846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc863a6a-17fa-4e42-9919-96d0cb14a375 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:41.592281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc863a6a-17fa-4e42-9919-96d0cb14a375 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:41.592960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc863a6a-17fa-4e42-9919-96d0cb14a375 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:41.593411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc863a6a-17fa-4e42-9919-96d0cb14a375 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:41.593860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fc863a6a-17fa-4e42-9919-96d0cb14a375 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:41.652991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fc863a6a-17fa-4e42-9919-96d0cb14a375 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:41.661287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fc863a6a-17fa-4e42-9919-96d0cb14a375 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.080881 Aug 18 22:17:41.661903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1979/3962] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:41 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:42.682621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-40cadbbd-7000-4f01-9e41-6f90aea61b80 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:42.683243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-40cadbbd-7000-4f01-9e41-6f90aea61b80 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:42.689805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40cadbbd-7000-4f01-9e41-6f90aea61b80 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:42.690292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40cadbbd-7000-4f01-9e41-6f90aea61b80 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:42.690732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40cadbbd-7000-4f01-9e41-6f90aea61b80 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:42.691436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40cadbbd-7000-4f01-9e41-6f90aea61b80 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:42.691898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40cadbbd-7000-4f01-9e41-6f90aea61b80 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:42.692327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40cadbbd-7000-4f01-9e41-6f90aea61b80 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:42.756176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-40cadbbd-7000-4f01-9e41-6f90aea61b80 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:42.765168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-40cadbbd-7000-4f01-9e41-6f90aea61b80 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086361 Aug 18 22:17:42.765713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1984/3963] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:43.786099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2fd91b73-2691-4cf0-9980-3d0c19050015 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:43.786739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2fd91b73-2691-4cf0-9980-3d0c19050015 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:43.793183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fd91b73-2691-4cf0-9980-3d0c19050015 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:43.793741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fd91b73-2691-4cf0-9980-3d0c19050015 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:43.794185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fd91b73-2691-4cf0-9980-3d0c19050015 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:43.794869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fd91b73-2691-4cf0-9980-3d0c19050015 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:43.795323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fd91b73-2691-4cf0-9980-3d0c19050015 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:43.795751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fd91b73-2691-4cf0-9980-3d0c19050015 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:43.856579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2fd91b73-2691-4cf0-9980-3d0c19050015 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:43.864777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2fd91b73-2691-4cf0-9980-3d0c19050015 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082502 Aug 18 22:17:43.865331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1980/3964] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:43 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:44.886212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aa3e700b-b383-4cbc-acb8-a45ec1c21592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:44.886908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aa3e700b-b383-4cbc-acb8-a45ec1c21592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:44.893848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa3e700b-b383-4cbc-acb8-a45ec1c21592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:44.894322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa3e700b-b383-4cbc-acb8-a45ec1c21592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:44.894751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa3e700b-b383-4cbc-acb8-a45ec1c21592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:44.895427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa3e700b-b383-4cbc-acb8-a45ec1c21592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:44.895878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa3e700b-b383-4cbc-acb8-a45ec1c21592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:44.896295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa3e700b-b383-4cbc-acb8-a45ec1c21592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:44.959491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aa3e700b-b383-4cbc-acb8-a45ec1c21592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:44.968338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aa3e700b-b383-4cbc-acb8-a45ec1c21592 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085934 Aug 18 22:17:44.968906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1985/3965] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:44 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:45.988354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d4c8c4f8-020a-4ded-a403-e356b5256f45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:45.988898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d4c8c4f8-020a-4ded-a403-e356b5256f45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:45.995452 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4c8c4f8-020a-4ded-a403-e356b5256f45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:45.995932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4c8c4f8-020a-4ded-a403-e356b5256f45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:45.996388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4c8c4f8-020a-4ded-a403-e356b5256f45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:45.997082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4c8c4f8-020a-4ded-a403-e356b5256f45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:45.997591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4c8c4f8-020a-4ded-a403-e356b5256f45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:45.998028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4c8c4f8-020a-4ded-a403-e356b5256f45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:46.061759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d4c8c4f8-020a-4ded-a403-e356b5256f45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:46.069848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d4c8c4f8-020a-4ded-a403-e356b5256f45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085429 Aug 18 22:17:46.070414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1981/3966] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:47.091295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aae7c122-b170-4f7e-97da-bbd57dc6fead tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:47.091925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aae7c122-b170-4f7e-97da-bbd57dc6fead tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:47.097920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aae7c122-b170-4f7e-97da-bbd57dc6fead tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:47.098396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aae7c122-b170-4f7e-97da-bbd57dc6fead tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:47.098825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aae7c122-b170-4f7e-97da-bbd57dc6fead tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:47.099502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aae7c122-b170-4f7e-97da-bbd57dc6fead tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:47.099948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aae7c122-b170-4f7e-97da-bbd57dc6fead tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:47.100366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aae7c122-b170-4f7e-97da-bbd57dc6fead tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:47.159899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aae7c122-b170-4f7e-97da-bbd57dc6fead tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:47.168160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aae7c122-b170-4f7e-97da-bbd57dc6fead tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.080911 Aug 18 22:17:47.169257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1986/3967] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:47 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:48.190458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8ed69bd8-bde2-4dcc-9af9-b0b7156f3af2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:48.191069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8ed69bd8-bde2-4dcc-9af9-b0b7156f3af2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:48.197463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ed69bd8-bde2-4dcc-9af9-b0b7156f3af2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:48.197981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ed69bd8-bde2-4dcc-9af9-b0b7156f3af2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:48.198418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ed69bd8-bde2-4dcc-9af9-b0b7156f3af2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:48.199103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ed69bd8-bde2-4dcc-9af9-b0b7156f3af2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:48.199551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ed69bd8-bde2-4dcc-9af9-b0b7156f3af2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:48.200714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8ed69bd8-bde2-4dcc-9af9-b0b7156f3af2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:48.259830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8ed69bd8-bde2-4dcc-9af9-b0b7156f3af2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:48.268528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8ed69bd8-bde2-4dcc-9af9-b0b7156f3af2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081954 Aug 18 22:17:48.269100 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1982/3968] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:48 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:49.289300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a24a4c3c-e28b-4f23-89f7-714341683dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:49.289938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a24a4c3c-e28b-4f23-89f7-714341683dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:49.292405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:17:49.297652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a24a4c3c-e28b-4f23-89f7-714341683dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:49.298133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a24a4c3c-e28b-4f23-89f7-714341683dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:49.298569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a24a4c3c-e28b-4f23-89f7-714341683dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:49.299257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a24a4c3c-e28b-4f23-89f7-714341683dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:49.299709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a24a4c3c-e28b-4f23-89f7-714341683dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:49.300134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a24a4c3c-e28b-4f23-89f7-714341683dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:49.363666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a24a4c3c-e28b-4f23-89f7-714341683dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:49.371909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a24a4c3c-e28b-4f23-89f7-714341683dac tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086507 Aug 18 22:17:49.372472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1987/3969] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:49 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:50.393041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-985bd22f-a5c1-440b-a529-93cb49afc6f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:50.393670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-985bd22f-a5c1-440b-a529-93cb49afc6f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:50.400437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-985bd22f-a5c1-440b-a529-93cb49afc6f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:50.400917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-985bd22f-a5c1-440b-a529-93cb49afc6f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:50.401349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-985bd22f-a5c1-440b-a529-93cb49afc6f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:50.402069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-985bd22f-a5c1-440b-a529-93cb49afc6f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:50.402526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-985bd22f-a5c1-440b-a529-93cb49afc6f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:50.403439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-985bd22f-a5c1-440b-a529-93cb49afc6f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:50.463020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-985bd22f-a5c1-440b-a529-93cb49afc6f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:50.471685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-985bd22f-a5c1-440b-a529-93cb49afc6f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082579 Aug 18 22:17:50.472248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1983/3970] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:50 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:51.493664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69a61f0f-3fd6-4f3c-8db4-f17cfe9e3285 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:51.494244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-69a61f0f-3fd6-4f3c-8db4-f17cfe9e3285 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:51.501181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69a61f0f-3fd6-4f3c-8db4-f17cfe9e3285 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:51.501680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69a61f0f-3fd6-4f3c-8db4-f17cfe9e3285 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:51.502114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69a61f0f-3fd6-4f3c-8db4-f17cfe9e3285 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:51.502788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69a61f0f-3fd6-4f3c-8db4-f17cfe9e3285 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:51.503246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69a61f0f-3fd6-4f3c-8db4-f17cfe9e3285 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:51.503665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69a61f0f-3fd6-4f3c-8db4-f17cfe9e3285 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:51.565872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-69a61f0f-3fd6-4f3c-8db4-f17cfe9e3285 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:51.573894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-69a61f0f-3fd6-4f3c-8db4-f17cfe9e3285 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084161 Aug 18 22:17:51.574459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1988/3971] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:51 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:52.595557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cf9c18e5-4990-462c-9f24-2f1fbad0a6a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:52.596264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cf9c18e5-4990-462c-9f24-2f1fbad0a6a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:52.603049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf9c18e5-4990-462c-9f24-2f1fbad0a6a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:52.603539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf9c18e5-4990-462c-9f24-2f1fbad0a6a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:52.603978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf9c18e5-4990-462c-9f24-2f1fbad0a6a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:52.604669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf9c18e5-4990-462c-9f24-2f1fbad0a6a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:52.605136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf9c18e5-4990-462c-9f24-2f1fbad0a6a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:52.605579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cf9c18e5-4990-462c-9f24-2f1fbad0a6a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:52.670779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cf9c18e5-4990-462c-9f24-2f1fbad0a6a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:52.680126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cf9c18e5-4990-462c-9f24-2f1fbad0a6a0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.089079 Aug 18 22:17:52.680702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1984/3972] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:52 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:53.702197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d7e1317f-7643-4692-965f-82b87a314dfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:53.702833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d7e1317f-7643-4692-965f-82b87a314dfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:53.709232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7e1317f-7643-4692-965f-82b87a314dfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:53.709745 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7e1317f-7643-4692-965f-82b87a314dfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:53.710179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7e1317f-7643-4692-965f-82b87a314dfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:53.710860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7e1317f-7643-4692-965f-82b87a314dfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:53.711307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7e1317f-7643-4692-965f-82b87a314dfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:53.711737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7e1317f-7643-4692-965f-82b87a314dfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:53.772003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d7e1317f-7643-4692-965f-82b87a314dfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:53.780937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d7e1317f-7643-4692-965f-82b87a314dfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083083 Aug 18 22:17:53.781500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1989/3973] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:53 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:54.801754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a0ba67b8-2fae-4b94-93c2-c55d9f9cfed7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:54.802621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a0ba67b8-2fae-4b94-93c2-c55d9f9cfed7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:54.810517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0ba67b8-2fae-4b94-93c2-c55d9f9cfed7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:54.811079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0ba67b8-2fae-4b94-93c2-c55d9f9cfed7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:54.811495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0ba67b8-2fae-4b94-93c2-c55d9f9cfed7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:54.812172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0ba67b8-2fae-4b94-93c2-c55d9f9cfed7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:54.812635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0ba67b8-2fae-4b94-93c2-c55d9f9cfed7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:54.813068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a0ba67b8-2fae-4b94-93c2-c55d9f9cfed7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:54.878713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a0ba67b8-2fae-4b94-93c2-c55d9f9cfed7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:54.886813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a0ba67b8-2fae-4b94-93c2-c55d9f9cfed7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088946 Aug 18 22:17:54.887379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1985/3974] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:54 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:55.907577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-91de3a4c-77ec-4c62-9742-133803f5cc73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:55.908193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-91de3a4c-77ec-4c62-9742-133803f5cc73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:55.914599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91de3a4c-77ec-4c62-9742-133803f5cc73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:55.915175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91de3a4c-77ec-4c62-9742-133803f5cc73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:55.915605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91de3a4c-77ec-4c62-9742-133803f5cc73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:55.916292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91de3a4c-77ec-4c62-9742-133803f5cc73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:55.916743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91de3a4c-77ec-4c62-9742-133803f5cc73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:55.917167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91de3a4c-77ec-4c62-9742-133803f5cc73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:55.943275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0f509b4b-89c9-4ccf-8c44-ad4ddca23c1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:55.943784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0f509b4b-89c9-4ccf-8c44-ad4ddca23c1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:55.950175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f509b4b-89c9-4ccf-8c44-ad4ddca23c1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:55.950662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f509b4b-89c9-4ccf-8c44-ad4ddca23c1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:55.951131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f509b4b-89c9-4ccf-8c44-ad4ddca23c1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:55.951824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f509b4b-89c9-4ccf-8c44-ad4ddca23c1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:55.952277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f509b4b-89c9-4ccf-8c44-ad4ddca23c1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:55.952700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f509b4b-89c9-4ccf-8c44-ad4ddca23c1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:55.976673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0f509b4b-89c9-4ccf-8c44-ad4ddca23c1d tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb/ips" status: 200 len: 150 microversion: 2.20 time: 0.037113 Aug 18 22:17:55.977292 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1986/3975] 10.222.0.82 () {60 vars in 1289 bytes} [Thu Aug 18 22:17:55 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 22:17:55.983059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-91de3a4c-77ec-4c62-9742-133803f5cc73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:55.991399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-91de3a4c-77ec-4c62-9742-133803f5cc73 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.087650 Aug 18 22:17:55.992003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1990/3976] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:55 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:57.014530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8579c533-2204-438e-b7cc-2aa8f402092f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:57.015036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8579c533-2204-438e-b7cc-2aa8f402092f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:57.022123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8579c533-2204-438e-b7cc-2aa8f402092f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:57.022601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8579c533-2204-438e-b7cc-2aa8f402092f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:57.023032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8579c533-2204-438e-b7cc-2aa8f402092f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:57.023719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8579c533-2204-438e-b7cc-2aa8f402092f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:57.024166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8579c533-2204-438e-b7cc-2aa8f402092f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:57.024589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8579c533-2204-438e-b7cc-2aa8f402092f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:57.085130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8579c533-2204-438e-b7cc-2aa8f402092f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:57.093404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8579c533-2204-438e-b7cc-2aa8f402092f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083454 Aug 18 22:17:57.093997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1987/3977] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:57 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:58.114603 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c2072da-4820-461b-bb9b-18b95de95d45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:58.115215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c2072da-4820-461b-bb9b-18b95de95d45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:58.122428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c2072da-4820-461b-bb9b-18b95de95d45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:58.122428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c2072da-4820-461b-bb9b-18b95de95d45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:58.122700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c2072da-4820-461b-bb9b-18b95de95d45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:58.123390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c2072da-4820-461b-bb9b-18b95de95d45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:58.123841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c2072da-4820-461b-bb9b-18b95de95d45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:58.124265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c2072da-4820-461b-bb9b-18b95de95d45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:58.185238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4c2072da-4820-461b-bb9b-18b95de95d45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:58.193425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c2072da-4820-461b-bb9b-18b95de95d45 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082635 Aug 18 22:17:58.194028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1991/3978] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:58 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:17:59.214699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c0fb2cee-1c11-4e4d-b2a6-535b7b691f83 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:17:59.215829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c0fb2cee-1c11-4e4d-b2a6-535b7b691f83 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:17:59.222008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fb2cee-1c11-4e4d-b2a6-535b7b691f83 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:59.222492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fb2cee-1c11-4e4d-b2a6-535b7b691f83 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:59.222924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fb2cee-1c11-4e4d-b2a6-535b7b691f83 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:59.223609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fb2cee-1c11-4e4d-b2a6-535b7b691f83 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:17:59.224062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fb2cee-1c11-4e4d-b2a6-535b7b691f83 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:17:59.224496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0fb2cee-1c11-4e4d-b2a6-535b7b691f83 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:17:59.284176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c0fb2cee-1c11-4e4d-b2a6-535b7b691f83 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:17:59.292628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c0fb2cee-1c11-4e4d-b2a6-535b7b691f83 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081796 Aug 18 22:17:59.293327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1988/3979] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:17:59 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:00.316059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-898fd34b-5271-4661-9aa6-480343ba68b2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:00.316668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-898fd34b-5271-4661-9aa6-480343ba68b2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:00.323142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-898fd34b-5271-4661-9aa6-480343ba68b2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:00.323618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-898fd34b-5271-4661-9aa6-480343ba68b2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:00.324046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-898fd34b-5271-4661-9aa6-480343ba68b2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:00.325346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-898fd34b-5271-4661-9aa6-480343ba68b2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:00.325837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-898fd34b-5271-4661-9aa6-480343ba68b2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:00.326253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-898fd34b-5271-4661-9aa6-480343ba68b2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:00.390126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-898fd34b-5271-4661-9aa6-480343ba68b2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:00.398255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-898fd34b-5271-4661-9aa6-480343ba68b2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086052 Aug 18 22:18:00.398824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1992/3980] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:00 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:01.419955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3f3b2c45-a613-4d4e-a98e-8aa87fdef4e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:01.420567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3f3b2c45-a613-4d4e-a98e-8aa87fdef4e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:01.427340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f3b2c45-a613-4d4e-a98e-8aa87fdef4e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:01.428075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f3b2c45-a613-4d4e-a98e-8aa87fdef4e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:01.428509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f3b2c45-a613-4d4e-a98e-8aa87fdef4e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:01.429189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f3b2c45-a613-4d4e-a98e-8aa87fdef4e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:01.429663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f3b2c45-a613-4d4e-a98e-8aa87fdef4e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:01.430088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f3b2c45-a613-4d4e-a98e-8aa87fdef4e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:01.490696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3f3b2c45-a613-4d4e-a98e-8aa87fdef4e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:01.499406 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3f3b2c45-a613-4d4e-a98e-8aa87fdef4e5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083250 Aug 18 22:18:01.499988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1989/3981] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:01 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:02.520885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0ff28087-cc18-4857-b16e-c8f982bd906e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:02.521495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0ff28087-cc18-4857-b16e-c8f982bd906e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:02.528423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ff28087-cc18-4857-b16e-c8f982bd906e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:02.528901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ff28087-cc18-4857-b16e-c8f982bd906e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:02.529327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ff28087-cc18-4857-b16e-c8f982bd906e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:02.530033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ff28087-cc18-4857-b16e-c8f982bd906e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:02.530482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ff28087-cc18-4857-b16e-c8f982bd906e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:02.531248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ff28087-cc18-4857-b16e-c8f982bd906e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:02.591288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0ff28087-cc18-4857-b16e-c8f982bd906e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:02.599393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0ff28087-cc18-4857-b16e-c8f982bd906e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082412 Aug 18 22:18:02.599965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1993/3982] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:03.622118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c8780810-9bd7-441f-80d6-147495ab7c05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:03.622740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c8780810-9bd7-441f-80d6-147495ab7c05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:03.629157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8780810-9bd7-441f-80d6-147495ab7c05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:03.629671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8780810-9bd7-441f-80d6-147495ab7c05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:03.630118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8780810-9bd7-441f-80d6-147495ab7c05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:03.630812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8780810-9bd7-441f-80d6-147495ab7c05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:03.631272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8780810-9bd7-441f-80d6-147495ab7c05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:03.631703 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c8780810-9bd7-441f-80d6-147495ab7c05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:03.694562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c8780810-9bd7-441f-80d6-147495ab7c05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:03.702750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c8780810-9bd7-441f-80d6-147495ab7c05 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085137 Aug 18 22:18:03.703331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1990/3983] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:04.724486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f15ee094-620e-41b2-8d1d-1ddc7f38a87b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:04.725106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f15ee094-620e-41b2-8d1d-1ddc7f38a87b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:04.731569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f15ee094-620e-41b2-8d1d-1ddc7f38a87b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:04.732051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f15ee094-620e-41b2-8d1d-1ddc7f38a87b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:04.732495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f15ee094-620e-41b2-8d1d-1ddc7f38a87b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:04.733194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f15ee094-620e-41b2-8d1d-1ddc7f38a87b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:04.733696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f15ee094-620e-41b2-8d1d-1ddc7f38a87b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:04.734125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f15ee094-620e-41b2-8d1d-1ddc7f38a87b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:04.736639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=96 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:18:04.795886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f15ee094-620e-41b2-8d1d-1ddc7f38a87b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:04.804209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f15ee094-620e-41b2-8d1d-1ddc7f38a87b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083951 Aug 18 22:18:04.804785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1994/3984] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:05.825827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ee0dd503-182b-4d44-b1ae-e2f632360dab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:05.826440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ee0dd503-182b-4d44-b1ae-e2f632360dab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:05.832822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee0dd503-182b-4d44-b1ae-e2f632360dab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:05.833304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee0dd503-182b-4d44-b1ae-e2f632360dab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:05.833776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee0dd503-182b-4d44-b1ae-e2f632360dab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:05.834468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee0dd503-182b-4d44-b1ae-e2f632360dab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:05.834925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee0dd503-182b-4d44-b1ae-e2f632360dab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:05.835385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee0dd503-182b-4d44-b1ae-e2f632360dab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:05.899388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ee0dd503-182b-4d44-b1ae-e2f632360dab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:05.907633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ee0dd503-182b-4d44-b1ae-e2f632360dab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085682 Aug 18 22:18:05.908208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1991/3985] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:06.929320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b5bad0c9-9dbe-4def-8e8c-b61a8b8b79a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:06.929965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b5bad0c9-9dbe-4def-8e8c-b61a8b8b79a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:06.937011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5bad0c9-9dbe-4def-8e8c-b61a8b8b79a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:06.937497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5bad0c9-9dbe-4def-8e8c-b61a8b8b79a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:06.937971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5bad0c9-9dbe-4def-8e8c-b61a8b8b79a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:06.938665 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5bad0c9-9dbe-4def-8e8c-b61a8b8b79a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:06.939120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5bad0c9-9dbe-4def-8e8c-b61a8b8b79a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:06.939552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b5bad0c9-9dbe-4def-8e8c-b61a8b8b79a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:07.000852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b5bad0c9-9dbe-4def-8e8c-b61a8b8b79a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:07.009055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b5bad0c9-9dbe-4def-8e8c-b61a8b8b79a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083888 Aug 18 22:18:07.009647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1995/3986] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:08.032321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bcfa5b49-5d87-4021-a63b-a85b24bff15a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:08.032934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bcfa5b49-5d87-4021-a63b-a85b24bff15a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:08.040039 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcfa5b49-5d87-4021-a63b-a85b24bff15a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:08.040517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcfa5b49-5d87-4021-a63b-a85b24bff15a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:08.040947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcfa5b49-5d87-4021-a63b-a85b24bff15a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:08.041648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcfa5b49-5d87-4021-a63b-a85b24bff15a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:08.042139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcfa5b49-5d87-4021-a63b-a85b24bff15a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:08.042759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bcfa5b49-5d87-4021-a63b-a85b24bff15a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:08.045368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=92 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:18:08.104180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bcfa5b49-5d87-4021-a63b-a85b24bff15a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:08.112249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bcfa5b49-5d87-4021-a63b-a85b24bff15a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085040 Aug 18 22:18:08.112813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1992/3987] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:09.132294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d2e3c117-dc7a-4b49-b3bc-70a020db6d86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:09.132909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d2e3c117-dc7a-4b49-b3bc-70a020db6d86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:09.139458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2e3c117-dc7a-4b49-b3bc-70a020db6d86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:09.139954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2e3c117-dc7a-4b49-b3bc-70a020db6d86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:09.140382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2e3c117-dc7a-4b49-b3bc-70a020db6d86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:09.141071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2e3c117-dc7a-4b49-b3bc-70a020db6d86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:09.141529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2e3c117-dc7a-4b49-b3bc-70a020db6d86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:09.141989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d2e3c117-dc7a-4b49-b3bc-70a020db6d86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:09.205989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d2e3c117-dc7a-4b49-b3bc-70a020db6d86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:09.214590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d2e3c117-dc7a-4b49-b3bc-70a020db6d86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086216 Aug 18 22:18:09.215163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1996/3988] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:10.237114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dcea8f80-ccbc-4345-b7e1-c0c1d2544b5f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:10.237766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dcea8f80-ccbc-4345-b7e1-c0c1d2544b5f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:10.240104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:18:10.245503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcea8f80-ccbc-4345-b7e1-c0c1d2544b5f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:10.246020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcea8f80-ccbc-4345-b7e1-c0c1d2544b5f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:10.246469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcea8f80-ccbc-4345-b7e1-c0c1d2544b5f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:10.247199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcea8f80-ccbc-4345-b7e1-c0c1d2544b5f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:10.247714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcea8f80-ccbc-4345-b7e1-c0c1d2544b5f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:10.248148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dcea8f80-ccbc-4345-b7e1-c0c1d2544b5f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:10.309133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dcea8f80-ccbc-4345-b7e1-c0c1d2544b5f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:10.317936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dcea8f80-ccbc-4345-b7e1-c0c1d2544b5f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084725 Aug 18 22:18:10.318512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1993/3989] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:10 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:11.338562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-27ff3880-74d4-4a08-92c2-cee52331db5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:11.339177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-27ff3880-74d4-4a08-92c2-cee52331db5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:11.345749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27ff3880-74d4-4a08-92c2-cee52331db5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:11.346244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27ff3880-74d4-4a08-92c2-cee52331db5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:11.346690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27ff3880-74d4-4a08-92c2-cee52331db5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:11.347382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27ff3880-74d4-4a08-92c2-cee52331db5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:11.347849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27ff3880-74d4-4a08-92c2-cee52331db5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:11.348272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-27ff3880-74d4-4a08-92c2-cee52331db5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:11.408024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-27ff3880-74d4-4a08-92c2-cee52331db5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:11.416069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-27ff3880-74d4-4a08-92c2-cee52331db5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081352 Aug 18 22:18:11.416643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1997/3990] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:12.368021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d03ae645-a3c6-4d13-bdfb-7d4152522f40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:12.368578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d03ae645-a3c6-4d13-bdfb-7d4152522f40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:12.376379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d03ae645-a3c6-4d13-bdfb-7d4152522f40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:12.377114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d03ae645-a3c6-4d13-bdfb-7d4152522f40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:12.377552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d03ae645-a3c6-4d13-bdfb-7d4152522f40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:12.378266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d03ae645-a3c6-4d13-bdfb-7d4152522f40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:12.378717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d03ae645-a3c6-4d13-bdfb-7d4152522f40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:12.379140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d03ae645-a3c6-4d13-bdfb-7d4152522f40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:12.406300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d03ae645-a3c6-4d13-bdfb-7d4152522f40 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd/ips" status: 200 len: 151 microversion: 2.1 time: 0.043788 Aug 18 22:18:12.406880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1994/3991] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 22:18:12 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:18:12.437329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae43b6bf-526f-4e3b-97c3-2d85c757dfdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:12.438011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ae43b6bf-526f-4e3b-97c3-2d85c757dfdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:12.444295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae43b6bf-526f-4e3b-97c3-2d85c757dfdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:12.444774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae43b6bf-526f-4e3b-97c3-2d85c757dfdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:12.445205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae43b6bf-526f-4e3b-97c3-2d85c757dfdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:12.445907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae43b6bf-526f-4e3b-97c3-2d85c757dfdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:12.446357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae43b6bf-526f-4e3b-97c3-2d85c757dfdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:12.446770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae43b6bf-526f-4e3b-97c3-2d85c757dfdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:12.508236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ae43b6bf-526f-4e3b-97c3-2d85c757dfdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:12.517239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ae43b6bf-526f-4e3b-97c3-2d85c757dfdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083786 Aug 18 22:18:12.517836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1998/3992] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:12 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:13.538661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d190d78f-ad16-470c-80e9-29eaf0a485f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:13.539283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d190d78f-ad16-470c-80e9-29eaf0a485f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:13.545780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d190d78f-ad16-470c-80e9-29eaf0a485f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:13.546268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d190d78f-ad16-470c-80e9-29eaf0a485f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:13.546709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d190d78f-ad16-470c-80e9-29eaf0a485f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:13.547402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d190d78f-ad16-470c-80e9-29eaf0a485f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:13.547858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d190d78f-ad16-470c-80e9-29eaf0a485f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:13.548291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d190d78f-ad16-470c-80e9-29eaf0a485f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:13.611174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d190d78f-ad16-470c-80e9-29eaf0a485f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:13.619293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d190d78f-ad16-470c-80e9-29eaf0a485f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084464 Aug 18 22:18:13.619862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1995/3993] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:14.641063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c09c2de5-2a05-4704-864b-e27134898f27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:14.641694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c09c2de5-2a05-4704-864b-e27134898f27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:14.648462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c09c2de5-2a05-4704-864b-e27134898f27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:14.648947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c09c2de5-2a05-4704-864b-e27134898f27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:14.649387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c09c2de5-2a05-4704-864b-e27134898f27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:14.650219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c09c2de5-2a05-4704-864b-e27134898f27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:14.650672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c09c2de5-2a05-4704-864b-e27134898f27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:14.651124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c09c2de5-2a05-4704-864b-e27134898f27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:14.712526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c09c2de5-2a05-4704-864b-e27134898f27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:14.721462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c09c2de5-2a05-4704-864b-e27134898f27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084674 Aug 18 22:18:14.722076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 1999/3994] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:15.742270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9905f419-d74b-411b-9ea7-a3f401c8f407 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:15.742899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9905f419-d74b-411b-9ea7-a3f401c8f407 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:15.749303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9905f419-d74b-411b-9ea7-a3f401c8f407 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:15.749830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9905f419-d74b-411b-9ea7-a3f401c8f407 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:15.750281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9905f419-d74b-411b-9ea7-a3f401c8f407 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:15.750981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9905f419-d74b-411b-9ea7-a3f401c8f407 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:15.751443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9905f419-d74b-411b-9ea7-a3f401c8f407 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:15.751879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9905f419-d74b-411b-9ea7-a3f401c8f407 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:15.812085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9905f419-d74b-411b-9ea7-a3f401c8f407 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:15.820283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9905f419-d74b-411b-9ea7-a3f401c8f407 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081853 Aug 18 22:18:15.820856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1996/3995] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:15 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:16.840218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c8ad157a-7062-490b-9154-e058fa40dc25 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:16.840890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c8ad157a-7062-490b-9154-e058fa40dc25 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:16.846832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8ad157a-7062-490b-9154-e058fa40dc25 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:16.847302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8ad157a-7062-490b-9154-e058fa40dc25 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:16.847730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8ad157a-7062-490b-9154-e058fa40dc25 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:16.848404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8ad157a-7062-490b-9154-e058fa40dc25 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:16.848852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8ad157a-7062-490b-9154-e058fa40dc25 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:16.849271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c8ad157a-7062-490b-9154-e058fa40dc25 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:16.911291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c8ad157a-7062-490b-9154-e058fa40dc25 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:16.919870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c8ad157a-7062-490b-9154-e058fa40dc25 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083578 Aug 18 22:18:16.920438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2000/3996] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:17.941723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8e199255-9826-4b55-8632-b66921ab80e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:17.942338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8e199255-9826-4b55-8632-b66921ab80e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:17.948797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e199255-9826-4b55-8632-b66921ab80e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:17.949283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e199255-9826-4b55-8632-b66921ab80e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:17.949756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e199255-9826-4b55-8632-b66921ab80e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:17.951117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e199255-9826-4b55-8632-b66921ab80e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:17.951589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e199255-9826-4b55-8632-b66921ab80e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:17.952027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e199255-9826-4b55-8632-b66921ab80e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:18.015150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8e199255-9826-4b55-8632-b66921ab80e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:18.023300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8e199255-9826-4b55-8632-b66921ab80e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085536 Aug 18 22:18:18.023866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1997/3997] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:17 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:18:19.044842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-10f9c933-8b12-4831-a175-b0953f670663 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:19.045453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-10f9c933-8b12-4831-a175-b0953f670663 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:19.052213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10f9c933-8b12-4831-a175-b0953f670663 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:19.052958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10f9c933-8b12-4831-a175-b0953f670663 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:19.053399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10f9c933-8b12-4831-a175-b0953f670663 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:19.054133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10f9c933-8b12-4831-a175-b0953f670663 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:19.054597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10f9c933-8b12-4831-a175-b0953f670663 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:19.055028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-10f9c933-8b12-4831-a175-b0953f670663 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:19.116368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-10f9c933-8b12-4831-a175-b0953f670663 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:19.125145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-10f9c933-8b12-4831-a175-b0953f670663 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085180 Aug 18 22:18:19.125895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2001/3998] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:19 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:20.146456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-10243522-c259-4d81-928c-b153939748c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:20.147080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-10243522-c259-4d81-928c-b153939748c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:20.153715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10243522-c259-4d81-928c-b153939748c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:20.154210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10243522-c259-4d81-928c-b153939748c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:20.154651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10243522-c259-4d81-928c-b153939748c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:20.155348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10243522-c259-4d81-928c-b153939748c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:20.155811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10243522-c259-4d81-928c-b153939748c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:20.156244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-10243522-c259-4d81-928c-b153939748c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:20.219658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-10243522-c259-4d81-928c-b153939748c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:20.227838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-10243522-c259-4d81-928c-b153939748c9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085234 Aug 18 22:18:20.228411 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1998/3999] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:20 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:21.248902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ea230776-3bac-4bc1-a011-61c1379ae7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:21.249503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ea230776-3bac-4bc1-a011-61c1379ae7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:21.251857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=30 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:18:21.257380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea230776-3bac-4bc1-a011-61c1379ae7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:21.257893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea230776-3bac-4bc1-a011-61c1379ae7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:21.258326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea230776-3bac-4bc1-a011-61c1379ae7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:21.259024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea230776-3bac-4bc1-a011-61c1379ae7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:21.259472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea230776-3bac-4bc1-a011-61c1379ae7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:21.259890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ea230776-3bac-4bc1-a011-61c1379ae7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:21.323254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ea230776-3bac-4bc1-a011-61c1379ae7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:21.332410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ea230776-3bac-4bc1-a011-61c1379ae7fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.087792 Aug 18 22:18:21.332989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2002/4000] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:18:22.352455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e32041af-0f37-4c51-ace0-152b2c9a77f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:22.353057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e32041af-0f37-4c51-ace0-152b2c9a77f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:22.359416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e32041af-0f37-4c51-ace0-152b2c9a77f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:22.359897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e32041af-0f37-4c51-ace0-152b2c9a77f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:22.360334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e32041af-0f37-4c51-ace0-152b2c9a77f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:22.361012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e32041af-0f37-4c51-ace0-152b2c9a77f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:22.361463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e32041af-0f37-4c51-ace0-152b2c9a77f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:22.361927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e32041af-0f37-4c51-ace0-152b2c9a77f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:22.424688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e32041af-0f37-4c51-ace0-152b2c9a77f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:22.433015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e32041af-0f37-4c51-ace0-152b2c9a77f0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084599 Aug 18 22:18:22.433581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 1999/4001] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:23.453800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-820414e9-679c-465d-b212-b9ba73b84ed2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:23.454317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-820414e9-679c-465d-b212-b9ba73b84ed2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:23.460677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-820414e9-679c-465d-b212-b9ba73b84ed2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:23.461151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-820414e9-679c-465d-b212-b9ba73b84ed2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:23.461732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-820414e9-679c-465d-b212-b9ba73b84ed2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:23.462378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-820414e9-679c-465d-b212-b9ba73b84ed2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:23.462827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-820414e9-679c-465d-b212-b9ba73b84ed2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:23.463241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-820414e9-679c-465d-b212-b9ba73b84ed2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:23.522623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-820414e9-679c-465d-b212-b9ba73b84ed2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:23.531366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-820414e9-679c-465d-b212-b9ba73b84ed2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081505 Aug 18 22:18:23.531936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2003/4002] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:23 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:24.553014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9306bdb9-f775-4e7b-aeda-f79017c6ab86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:24.553766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9306bdb9-f775-4e7b-aeda-f79017c6ab86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:24.560820 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9306bdb9-f775-4e7b-aeda-f79017c6ab86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:24.561304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9306bdb9-f775-4e7b-aeda-f79017c6ab86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:24.561779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9306bdb9-f775-4e7b-aeda-f79017c6ab86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:24.562469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9306bdb9-f775-4e7b-aeda-f79017c6ab86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:24.562929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9306bdb9-f775-4e7b-aeda-f79017c6ab86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:24.563354 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9306bdb9-f775-4e7b-aeda-f79017c6ab86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:24.623225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9306bdb9-f775-4e7b-aeda-f79017c6ab86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:24.631402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9306bdb9-f775-4e7b-aeda-f79017c6ab86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082502 Aug 18 22:18:24.631965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2000/4003] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:25.652089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1ce59dca-a380-47cb-ba49-4ce43a371c00 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:25.652707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1ce59dca-a380-47cb-ba49-4ce43a371c00 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:25.660185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ce59dca-a380-47cb-ba49-4ce43a371c00 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:25.660966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ce59dca-a380-47cb-ba49-4ce43a371c00 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:25.661411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ce59dca-a380-47cb-ba49-4ce43a371c00 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:25.662137 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ce59dca-a380-47cb-ba49-4ce43a371c00 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:25.662597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ce59dca-a380-47cb-ba49-4ce43a371c00 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:25.663026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ce59dca-a380-47cb-ba49-4ce43a371c00 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:25.726324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1ce59dca-a380-47cb-ba49-4ce43a371c00 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:25.735562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1ce59dca-a380-47cb-ba49-4ce43a371c00 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.087272 Aug 18 22:18:25.736143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2004/4004] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:26.755902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5a8fa794-5c2e-45a5-bcb9-2067a801b738 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:26.756523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5a8fa794-5c2e-45a5-bcb9-2067a801b738 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:26.762978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a8fa794-5c2e-45a5-bcb9-2067a801b738 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:26.763464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a8fa794-5c2e-45a5-bcb9-2067a801b738 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:26.763903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a8fa794-5c2e-45a5-bcb9-2067a801b738 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:26.764593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a8fa794-5c2e-45a5-bcb9-2067a801b738 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:26.765054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a8fa794-5c2e-45a5-bcb9-2067a801b738 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:26.765488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5a8fa794-5c2e-45a5-bcb9-2067a801b738 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:26.826652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5a8fa794-5c2e-45a5-bcb9-2067a801b738 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:26.834879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5a8fa794-5c2e-45a5-bcb9-2067a801b738 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082763 Aug 18 22:18:26.835533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2001/4005] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:26 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:27.856122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4896bb8b-de0f-48be-8efd-b77e07057d81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:27.856731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4896bb8b-de0f-48be-8efd-b77e07057d81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:27.863204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4896bb8b-de0f-48be-8efd-b77e07057d81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:27.863682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4896bb8b-de0f-48be-8efd-b77e07057d81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:27.864118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4896bb8b-de0f-48be-8efd-b77e07057d81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:27.864804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4896bb8b-de0f-48be-8efd-b77e07057d81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:27.865254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4896bb8b-de0f-48be-8efd-b77e07057d81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:27.865709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4896bb8b-de0f-48be-8efd-b77e07057d81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:27.927568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4896bb8b-de0f-48be-8efd-b77e07057d81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:27.936522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4896bb8b-de0f-48be-8efd-b77e07057d81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084220 Aug 18 22:18:27.937096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2005/4006] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:28.957218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-08ca25d3-e0e8-4274-b4b6-b9296023cced tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:28.957871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-08ca25d3-e0e8-4274-b4b6-b9296023cced tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:28.963901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08ca25d3-e0e8-4274-b4b6-b9296023cced tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:28.964384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08ca25d3-e0e8-4274-b4b6-b9296023cced tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:28.964823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08ca25d3-e0e8-4274-b4b6-b9296023cced tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:28.966165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08ca25d3-e0e8-4274-b4b6-b9296023cced tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:28.966627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08ca25d3-e0e8-4274-b4b6-b9296023cced tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:28.967054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-08ca25d3-e0e8-4274-b4b6-b9296023cced tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:29.026089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-08ca25d3-e0e8-4274-b4b6-b9296023cced tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:29.034906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-08ca25d3-e0e8-4274-b4b6-b9296023cced tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081861 Aug 18 22:18:29.035464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2002/4007] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:18:30.056163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ec9f59e7-cd5a-4cf0-bd71-13c1f69ab985 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:30.056767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ec9f59e7-cd5a-4cf0-bd71-13c1f69ab985 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:30.063177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec9f59e7-cd5a-4cf0-bd71-13c1f69ab985 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:30.063655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec9f59e7-cd5a-4cf0-bd71-13c1f69ab985 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:30.064084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec9f59e7-cd5a-4cf0-bd71-13c1f69ab985 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:30.064762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec9f59e7-cd5a-4cf0-bd71-13c1f69ab985 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:30.065210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec9f59e7-cd5a-4cf0-bd71-13c1f69ab985 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:30.065645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec9f59e7-cd5a-4cf0-bd71-13c1f69ab985 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:30.127631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ec9f59e7-cd5a-4cf0-bd71-13c1f69ab985 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:30.135827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ec9f59e7-cd5a-4cf0-bd71-13c1f69ab985 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083804 Aug 18 22:18:30.136398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2006/4008] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:31.156684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d3e2510f-8c43-41f5-a64d-838c8a419a98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:31.157364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d3e2510f-8c43-41f5-a64d-838c8a419a98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:31.163969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3e2510f-8c43-41f5-a64d-838c8a419a98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:31.164457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3e2510f-8c43-41f5-a64d-838c8a419a98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:31.164896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3e2510f-8c43-41f5-a64d-838c8a419a98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:31.165584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3e2510f-8c43-41f5-a64d-838c8a419a98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:31.166070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3e2510f-8c43-41f5-a64d-838c8a419a98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:31.166502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3e2510f-8c43-41f5-a64d-838c8a419a98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:31.229162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d3e2510f-8c43-41f5-a64d-838c8a419a98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:31.237818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d3e2510f-8c43-41f5-a64d-838c8a419a98 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085042 Aug 18 22:18:31.238391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2003/4009] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:32.258572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d1d479d4-8a15-4fd3-a6f5-09acf2d30166 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:32.259209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d1d479d4-8a15-4fd3-a6f5-09acf2d30166 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:32.266172 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1d479d4-8a15-4fd3-a6f5-09acf2d30166 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:32.266653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1d479d4-8a15-4fd3-a6f5-09acf2d30166 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:32.267091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1d479d4-8a15-4fd3-a6f5-09acf2d30166 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:32.267783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1d479d4-8a15-4fd3-a6f5-09acf2d30166 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:32.268238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1d479d4-8a15-4fd3-a6f5-09acf2d30166 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:32.268663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1d479d4-8a15-4fd3-a6f5-09acf2d30166 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:32.329200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d1d479d4-8a15-4fd3-a6f5-09acf2d30166 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:32.337310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d1d479d4-8a15-4fd3-a6f5-09acf2d30166 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082695 Aug 18 22:18:32.337906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2007/4010] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:33.359612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0bbc6322-cb61-4d1b-819f-5359fcf101e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:33.360302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0bbc6322-cb61-4d1b-819f-5359fcf101e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:33.367746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bbc6322-cb61-4d1b-819f-5359fcf101e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:33.368227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bbc6322-cb61-4d1b-819f-5359fcf101e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:33.368655 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bbc6322-cb61-4d1b-819f-5359fcf101e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:33.369344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bbc6322-cb61-4d1b-819f-5359fcf101e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:33.369839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bbc6322-cb61-4d1b-819f-5359fcf101e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:33.370267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0bbc6322-cb61-4d1b-819f-5359fcf101e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:33.443598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0bbc6322-cb61-4d1b-819f-5359fcf101e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:33.452520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0bbc6322-cb61-4d1b-819f-5359fcf101e1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.096524 Aug 18 22:18:33.453099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2004/4011] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:34.474302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-771d6246-82bd-456e-8bce-565175c01e03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:34.474920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-771d6246-82bd-456e-8bce-565175c01e03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:34.482048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-771d6246-82bd-456e-8bce-565175c01e03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:34.482536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-771d6246-82bd-456e-8bce-565175c01e03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:34.482979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-771d6246-82bd-456e-8bce-565175c01e03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:34.483672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-771d6246-82bd-456e-8bce-565175c01e03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:34.484132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-771d6246-82bd-456e-8bce-565175c01e03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:34.484561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-771d6246-82bd-456e-8bce-565175c01e03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:34.547879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-771d6246-82bd-456e-8bce-565175c01e03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:34.556181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-771d6246-82bd-456e-8bce-565175c01e03 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085781 Aug 18 22:18:34.556752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2008/4012] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:35.577351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-774f6247-f034-4745-999e-bed8e39b414d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:35.578004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-774f6247-f034-4745-999e-bed8e39b414d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:35.584462 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-774f6247-f034-4745-999e-bed8e39b414d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:35.584947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-774f6247-f034-4745-999e-bed8e39b414d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:35.585394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-774f6247-f034-4745-999e-bed8e39b414d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:35.586123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-774f6247-f034-4745-999e-bed8e39b414d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:35.586584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-774f6247-f034-4745-999e-bed8e39b414d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:35.587019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-774f6247-f034-4745-999e-bed8e39b414d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:35.648482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-774f6247-f034-4745-999e-bed8e39b414d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:35.656576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-774f6247-f034-4745-999e-bed8e39b414d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083657 Aug 18 22:18:35.657148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2005/4013] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:35 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:36.678113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e2bbaac1-6848-4e0f-9f24-882f8e4406ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:36.678720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e2bbaac1-6848-4e0f-9f24-882f8e4406ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:36.685534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2bbaac1-6848-4e0f-9f24-882f8e4406ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:36.686073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2bbaac1-6848-4e0f-9f24-882f8e4406ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:36.686503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2bbaac1-6848-4e0f-9f24-882f8e4406ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:36.687183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2bbaac1-6848-4e0f-9f24-882f8e4406ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:36.687634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2bbaac1-6848-4e0f-9f24-882f8e4406ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:36.688054 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e2bbaac1-6848-4e0f-9f24-882f8e4406ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:36.690588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=90 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:18:36.749290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e2bbaac1-6848-4e0f-9f24-882f8e4406ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:36.757347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e2bbaac1-6848-4e0f-9f24-882f8e4406ed tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083429 Aug 18 22:18:36.758017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2009/4014] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:37.779286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6a759651-5fee-4a98-bf3d-d39e5b4be558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:37.779895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6a759651-5fee-4a98-bf3d-d39e5b4be558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:37.786313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a759651-5fee-4a98-bf3d-d39e5b4be558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:37.786790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a759651-5fee-4a98-bf3d-d39e5b4be558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:37.787224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a759651-5fee-4a98-bf3d-d39e5b4be558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:37.787911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a759651-5fee-4a98-bf3d-d39e5b4be558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:37.788360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a759651-5fee-4a98-bf3d-d39e5b4be558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:37.788780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6a759651-5fee-4a98-bf3d-d39e5b4be558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:37.850013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6a759651-5fee-4a98-bf3d-d39e5b4be558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:37.858132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6a759651-5fee-4a98-bf3d-d39e5b4be558 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083213 Aug 18 22:18:37.858698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2006/4015] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:37 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:38.878854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9f9fb94d-6a88-4cfc-ba80-e81bd46ea7c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:38.879467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9f9fb94d-6a88-4cfc-ba80-e81bd46ea7c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:38.885944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f9fb94d-6a88-4cfc-ba80-e81bd46ea7c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:38.886425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f9fb94d-6a88-4cfc-ba80-e81bd46ea7c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:38.886864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f9fb94d-6a88-4cfc-ba80-e81bd46ea7c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:38.887549 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f9fb94d-6a88-4cfc-ba80-e81bd46ea7c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:38.888006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f9fb94d-6a88-4cfc-ba80-e81bd46ea7c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:38.888432 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f9fb94d-6a88-4cfc-ba80-e81bd46ea7c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:38.950587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9f9fb94d-6a88-4cfc-ba80-e81bd46ea7c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:38.958858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9f9fb94d-6a88-4cfc-ba80-e81bd46ea7c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083855 Aug 18 22:18:38.959417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2010/4016] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:38 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:39.979740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-312d3e39-81a0-443a-83e2-ecebea94e434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:39.980265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-312d3e39-81a0-443a-83e2-ecebea94e434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:39.986773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-312d3e39-81a0-443a-83e2-ecebea94e434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:39.987256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-312d3e39-81a0-443a-83e2-ecebea94e434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:39.987690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-312d3e39-81a0-443a-83e2-ecebea94e434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:39.988378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-312d3e39-81a0-443a-83e2-ecebea94e434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:39.988835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-312d3e39-81a0-443a-83e2-ecebea94e434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:39.989268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-312d3e39-81a0-443a-83e2-ecebea94e434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:39.993135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=88 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:18:40.051422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-312d3e39-81a0-443a-83e2-ecebea94e434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:40.060556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-312d3e39-81a0-443a-83e2-ecebea94e434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084704 Aug 18 22:18:40.061140 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2007/4017] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:39 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:41.081827 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d3c4cf7d-26d0-4634-b878-865b59fefe57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:41.082468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d3c4cf7d-26d0-4634-b878-865b59fefe57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:41.089169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3c4cf7d-26d0-4634-b878-865b59fefe57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:41.089684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3c4cf7d-26d0-4634-b878-865b59fefe57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:41.090123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3c4cf7d-26d0-4634-b878-865b59fefe57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:41.091459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3c4cf7d-26d0-4634-b878-865b59fefe57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:41.091913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3c4cf7d-26d0-4634-b878-865b59fefe57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:41.092340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d3c4cf7d-26d0-4634-b878-865b59fefe57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:41.151081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d3c4cf7d-26d0-4634-b878-865b59fefe57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:41.159908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d3c4cf7d-26d0-4634-b878-865b59fefe57 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081966 Aug 18 22:18:41.160476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2011/4018] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:41 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:42.180871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a3211ae2-40b8-46b4-a2d0-bc24f38c5b5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:42.181488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a3211ae2-40b8-46b4-a2d0-bc24f38c5b5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:42.183926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:18:42.189660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3211ae2-40b8-46b4-a2d0-bc24f38c5b5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:42.190146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3211ae2-40b8-46b4-a2d0-bc24f38c5b5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:42.190588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3211ae2-40b8-46b4-a2d0-bc24f38c5b5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:42.191280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3211ae2-40b8-46b4-a2d0-bc24f38c5b5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:42.191733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3211ae2-40b8-46b4-a2d0-bc24f38c5b5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:42.192160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a3211ae2-40b8-46b4-a2d0-bc24f38c5b5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:42.251330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a3211ae2-40b8-46b4-a2d0-bc24f38c5b5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:42.259360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a3211ae2-40b8-46b4-a2d0-bc24f38c5b5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082703 Aug 18 22:18:42.259937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2008/4019] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:43.279395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-df000dd4-c6d1-4ef5-9ac5-1beedf8972d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:43.280010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-df000dd4-c6d1-4ef5-9ac5-1beedf8972d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:43.286566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df000dd4-c6d1-4ef5-9ac5-1beedf8972d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:43.287046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df000dd4-c6d1-4ef5-9ac5-1beedf8972d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:43.287483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df000dd4-c6d1-4ef5-9ac5-1beedf8972d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:43.288167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df000dd4-c6d1-4ef5-9ac5-1beedf8972d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:43.288618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df000dd4-c6d1-4ef5-9ac5-1beedf8972d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:43.289044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df000dd4-c6d1-4ef5-9ac5-1beedf8972d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:43.353070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-df000dd4-c6d1-4ef5-9ac5-1beedf8972d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:43.361693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-df000dd4-c6d1-4ef5-9ac5-1beedf8972d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086191 Aug 18 22:18:43.362261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2012/4020] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:43 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:44.382916 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d1dc9623-9c8d-4127-ab1a-c62d2140461c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:44.383567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d1dc9623-9c8d-4127-ab1a-c62d2140461c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:44.390590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d1dc9623-9c8d-4127-ab1a-c62d2140461c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:44.391079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d1dc9623-9c8d-4127-ab1a-c62d2140461c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:44.391526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d1dc9623-9c8d-4127-ab1a-c62d2140461c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:44.392227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d1dc9623-9c8d-4127-ab1a-c62d2140461c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:44.392698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d1dc9623-9c8d-4127-ab1a-c62d2140461c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:44.393132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d1dc9623-9c8d-4127-ab1a-c62d2140461c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:44.453723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d1dc9623-9c8d-4127-ab1a-c62d2140461c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:44.461956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d1dc9623-9c8d-4127-ab1a-c62d2140461c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082917 Aug 18 22:18:44.462544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2009/4021] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:44 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:45.483786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ef613117-be3e-40c7-ab38-b08b3954fb75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:45.484399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ef613117-be3e-40c7-ab38-b08b3954fb75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:45.490508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef613117-be3e-40c7-ab38-b08b3954fb75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:45.490990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef613117-be3e-40c7-ab38-b08b3954fb75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:45.491426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef613117-be3e-40c7-ab38-b08b3954fb75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:45.492109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef613117-be3e-40c7-ab38-b08b3954fb75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:45.492618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef613117-be3e-40c7-ab38-b08b3954fb75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:45.492974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef613117-be3e-40c7-ab38-b08b3954fb75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:45.552255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ef613117-be3e-40c7-ab38-b08b3954fb75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:45.561489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ef613117-be3e-40c7-ab38-b08b3954fb75 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082030 Aug 18 22:18:45.562117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2013/4022] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:46.582506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2c81fd44-97a0-4274-b08e-87f9f935d7fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:46.583141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2c81fd44-97a0-4274-b08e-87f9f935d7fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:46.589446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c81fd44-97a0-4274-b08e-87f9f935d7fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:46.589960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c81fd44-97a0-4274-b08e-87f9f935d7fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:46.591463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c81fd44-97a0-4274-b08e-87f9f935d7fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:46.592149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c81fd44-97a0-4274-b08e-87f9f935d7fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:46.592604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c81fd44-97a0-4274-b08e-87f9f935d7fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:46.593028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c81fd44-97a0-4274-b08e-87f9f935d7fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:46.652546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2c81fd44-97a0-4274-b08e-87f9f935d7fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:46.660647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2c81fd44-97a0-4274-b08e-87f9f935d7fa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082050 Aug 18 22:18:46.661216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2010/4023] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:46 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:18:47.682452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bfaa0dea-7a8b-43ad-8e3c-ed8aae44520f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:47.682990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bfaa0dea-7a8b-43ad-8e3c-ed8aae44520f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:47.689405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfaa0dea-7a8b-43ad-8e3c-ed8aae44520f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:47.689923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfaa0dea-7a8b-43ad-8e3c-ed8aae44520f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:47.690363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfaa0dea-7a8b-43ad-8e3c-ed8aae44520f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:47.691065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfaa0dea-7a8b-43ad-8e3c-ed8aae44520f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:47.691517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfaa0dea-7a8b-43ad-8e3c-ed8aae44520f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:47.691942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bfaa0dea-7a8b-43ad-8e3c-ed8aae44520f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:47.752358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bfaa0dea-7a8b-43ad-8e3c-ed8aae44520f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:47.760619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bfaa0dea-7a8b-43ad-8e3c-ed8aae44520f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082345 Aug 18 22:18:47.761199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2014/4024] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:47 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:48.782830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a5d6b75b-ba16-44b5-b4b4-eb1108bcb581 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:48.783458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a5d6b75b-ba16-44b5-b4b4-eb1108bcb581 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:48.789994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5d6b75b-ba16-44b5-b4b4-eb1108bcb581 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:48.790485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5d6b75b-ba16-44b5-b4b4-eb1108bcb581 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:48.790932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5d6b75b-ba16-44b5-b4b4-eb1108bcb581 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:48.791625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5d6b75b-ba16-44b5-b4b4-eb1108bcb581 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:48.792089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5d6b75b-ba16-44b5-b4b4-eb1108bcb581 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:48.792521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a5d6b75b-ba16-44b5-b4b4-eb1108bcb581 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:48.854688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a5d6b75b-ba16-44b5-b4b4-eb1108bcb581 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:48.863710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a5d6b75b-ba16-44b5-b4b4-eb1108bcb581 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084796 Aug 18 22:18:48.864286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2011/4025] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:48 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:49.884361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ed594921-86b6-40ec-9941-6ca9e9ab9004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:49.884885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ed594921-86b6-40ec-9941-6ca9e9ab9004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:49.891385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed594921-86b6-40ec-9941-6ca9e9ab9004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:49.891857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed594921-86b6-40ec-9941-6ca9e9ab9004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:49.892285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed594921-86b6-40ec-9941-6ca9e9ab9004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:49.892958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed594921-86b6-40ec-9941-6ca9e9ab9004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:49.893406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed594921-86b6-40ec-9941-6ca9e9ab9004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:49.893876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed594921-86b6-40ec-9941-6ca9e9ab9004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:49.953429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ed594921-86b6-40ec-9941-6ca9e9ab9004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:49.961708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ed594921-86b6-40ec-9941-6ca9e9ab9004 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081290 Aug 18 22:18:49.962271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2015/4026] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:49 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:50.981945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2c685a4c-3fcc-4a5d-9b50-c23709339846 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:50.982550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2c685a4c-3fcc-4a5d-9b50-c23709339846 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:50.988785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c685a4c-3fcc-4a5d-9b50-c23709339846 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:50.989286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c685a4c-3fcc-4a5d-9b50-c23709339846 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:50.989754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c685a4c-3fcc-4a5d-9b50-c23709339846 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:50.990436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c685a4c-3fcc-4a5d-9b50-c23709339846 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:50.990886 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c685a4c-3fcc-4a5d-9b50-c23709339846 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:50.991308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c685a4c-3fcc-4a5d-9b50-c23709339846 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:51.053486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2c685a4c-3fcc-4a5d-9b50-c23709339846 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:51.062053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2c685a4c-3fcc-4a5d-9b50-c23709339846 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084017 Aug 18 22:18:51.062621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2012/4027] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:50 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:52.082505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-df562cbd-5a87-47f5-907c-6170c9971d11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:52.083120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-df562cbd-5a87-47f5-907c-6170c9971d11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:52.085365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=28 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:18:52.091896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df562cbd-5a87-47f5-907c-6170c9971d11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:52.092368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df562cbd-5a87-47f5-907c-6170c9971d11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:52.092797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df562cbd-5a87-47f5-907c-6170c9971d11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:52.093481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df562cbd-5a87-47f5-907c-6170c9971d11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:52.093953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df562cbd-5a87-47f5-907c-6170c9971d11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:52.094471 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-df562cbd-5a87-47f5-907c-6170c9971d11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:52.157204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-df562cbd-5a87-47f5-907c-6170c9971d11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:52.165440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-df562cbd-5a87-47f5-907c-6170c9971d11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086791 Aug 18 22:18:52.166053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2016/4028] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:52 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:53.185763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-91150800-733f-4946-80a3-775c53e35ca6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:53.186683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-91150800-733f-4946-80a3-775c53e35ca6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:53.193822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91150800-733f-4946-80a3-775c53e35ca6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:53.194332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91150800-733f-4946-80a3-775c53e35ca6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:53.194761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91150800-733f-4946-80a3-775c53e35ca6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:53.195463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91150800-733f-4946-80a3-775c53e35ca6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:53.195925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91150800-733f-4946-80a3-775c53e35ca6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:53.196356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91150800-733f-4946-80a3-775c53e35ca6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:53.256165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-91150800-733f-4946-80a3-775c53e35ca6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:53.264372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-91150800-733f-4946-80a3-775c53e35ca6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082850 Aug 18 22:18:53.264942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2013/4029] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:53 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:54.285685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-65276e6e-6a8c-4a80-8ac3-43a33ec2841f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:54.286311 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-65276e6e-6a8c-4a80-8ac3-43a33ec2841f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:54.292830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65276e6e-6a8c-4a80-8ac3-43a33ec2841f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:54.293313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65276e6e-6a8c-4a80-8ac3-43a33ec2841f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:54.293789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65276e6e-6a8c-4a80-8ac3-43a33ec2841f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:54.295082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65276e6e-6a8c-4a80-8ac3-43a33ec2841f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:54.295538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65276e6e-6a8c-4a80-8ac3-43a33ec2841f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:54.295970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65276e6e-6a8c-4a80-8ac3-43a33ec2841f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:54.598818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-65276e6e-6a8c-4a80-8ac3-43a33ec2841f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:54.607196 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-65276e6e-6a8c-4a80-8ac3-43a33ec2841f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.325314 Aug 18 22:18:54.607759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2017/4030] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:54 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:55.627994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5440064b-b9c5-45a5-8614-33add2b206a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:55.628537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5440064b-b9c5-45a5-8614-33add2b206a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:55.634928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5440064b-b9c5-45a5-8614-33add2b206a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:55.635414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5440064b-b9c5-45a5-8614-33add2b206a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:55.635852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5440064b-b9c5-45a5-8614-33add2b206a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:55.636538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5440064b-b9c5-45a5-8614-33add2b206a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:55.636994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5440064b-b9c5-45a5-8614-33add2b206a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:55.637417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5440064b-b9c5-45a5-8614-33add2b206a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:55.697698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5440064b-b9c5-45a5-8614-33add2b206a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:55.705765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5440064b-b9c5-45a5-8614-33add2b206a5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081661 Aug 18 22:18:55.706324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2014/4031] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:55 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:56.727203 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-32d6823d-af64-48cb-aaf1-d67d8f91eea3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:56.727817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-32d6823d-af64-48cb-aaf1-d67d8f91eea3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:56.734801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32d6823d-af64-48cb-aaf1-d67d8f91eea3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:56.735283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32d6823d-af64-48cb-aaf1-d67d8f91eea3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:56.735723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32d6823d-af64-48cb-aaf1-d67d8f91eea3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:56.736434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32d6823d-af64-48cb-aaf1-d67d8f91eea3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:56.736898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32d6823d-af64-48cb-aaf1-d67d8f91eea3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:56.737323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-32d6823d-af64-48cb-aaf1-d67d8f91eea3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:56.796798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-32d6823d-af64-48cb-aaf1-d67d8f91eea3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:56.805216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-32d6823d-af64-48cb-aaf1-d67d8f91eea3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081848 Aug 18 22:18:56.805822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2018/4032] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:56 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:57.827129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5eeb4f04-6dad-4009-b922-b77df8e11a0d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:57.827749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5eeb4f04-6dad-4009-b922-b77df8e11a0d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:57.833938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5eeb4f04-6dad-4009-b922-b77df8e11a0d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:57.834426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5eeb4f04-6dad-4009-b922-b77df8e11a0d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:57.834863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5eeb4f04-6dad-4009-b922-b77df8e11a0d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:57.835586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5eeb4f04-6dad-4009-b922-b77df8e11a0d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:57.836044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5eeb4f04-6dad-4009-b922-b77df8e11a0d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:57.836471 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5eeb4f04-6dad-4009-b922-b77df8e11a0d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:57.899544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5eeb4f04-6dad-4009-b922-b77df8e11a0d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:57.907758 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5eeb4f04-6dad-4009-b922-b77df8e11a0d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085120 Aug 18 22:18:57.908336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2015/4033] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:57 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:18:58.928625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-148de4b3-0297-4186-b7d5-343ff454ef8b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:18:58.929274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-148de4b3-0297-4186-b7d5-343ff454ef8b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:18:58.935721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-148de4b3-0297-4186-b7d5-343ff454ef8b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:58.936207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-148de4b3-0297-4186-b7d5-343ff454ef8b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:58.936649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-148de4b3-0297-4186-b7d5-343ff454ef8b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:58.937347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-148de4b3-0297-4186-b7d5-343ff454ef8b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:18:58.937834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-148de4b3-0297-4186-b7d5-343ff454ef8b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:18:58.938266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-148de4b3-0297-4186-b7d5-343ff454ef8b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:18:58.999666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-148de4b3-0297-4186-b7d5-343ff454ef8b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:18:59.007845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-148de4b3-0297-4186-b7d5-343ff454ef8b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083391 Aug 18 22:18:59.008423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2019/4034] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:18:58 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:00.029625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e4c80654-772e-4405-b513-72062553bb38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:00.030282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e4c80654-772e-4405-b513-72062553bb38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:00.036676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4c80654-772e-4405-b513-72062553bb38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:00.037166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4c80654-772e-4405-b513-72062553bb38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:00.037620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4c80654-772e-4405-b513-72062553bb38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:00.038335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4c80654-772e-4405-b513-72062553bb38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:00.039085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4c80654-772e-4405-b513-72062553bb38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:00.039233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e4c80654-772e-4405-b513-72062553bb38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:00.099688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e4c80654-772e-4405-b513-72062553bb38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:00.108401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e4c80654-772e-4405-b513-72062553bb38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083213 Aug 18 22:19:00.108967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2016/4035] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:00 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:01.129564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-283da2bf-73e0-4c38-8460-42101987c2c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:01.130209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-283da2bf-73e0-4c38-8460-42101987c2c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:01.137619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-283da2bf-73e0-4c38-8460-42101987c2c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:01.138160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-283da2bf-73e0-4c38-8460-42101987c2c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:01.138605 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-283da2bf-73e0-4c38-8460-42101987c2c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:01.139294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-283da2bf-73e0-4c38-8460-42101987c2c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:01.139749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-283da2bf-73e0-4c38-8460-42101987c2c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:01.140210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-283da2bf-73e0-4c38-8460-42101987c2c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:01.202232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-283da2bf-73e0-4c38-8460-42101987c2c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:01.210320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-283da2bf-73e0-4c38-8460-42101987c2c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084602 Aug 18 22:19:01.210891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2020/4036] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:01 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:19:02.231383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-449d42b1-7422-49e2-bb00-9e177b8595a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:02.231996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-449d42b1-7422-49e2-bb00-9e177b8595a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:02.238464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-449d42b1-7422-49e2-bb00-9e177b8595a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:02.238947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-449d42b1-7422-49e2-bb00-9e177b8595a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:02.239388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-449d42b1-7422-49e2-bb00-9e177b8595a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:02.240075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-449d42b1-7422-49e2-bb00-9e177b8595a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:02.240531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-449d42b1-7422-49e2-bb00-9e177b8595a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:02.240957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-449d42b1-7422-49e2-bb00-9e177b8595a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:02.300710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-449d42b1-7422-49e2-bb00-9e177b8595a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:02.309027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-449d42b1-7422-49e2-bb00-9e177b8595a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081518 Aug 18 22:19:02.310102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2017/4037] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:03.330815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-da825955-0da8-4551-9547-d32048ec2b4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:03.331431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-da825955-0da8-4551-9547-d32048ec2b4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:03.337870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da825955-0da8-4551-9547-d32048ec2b4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:03.338358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da825955-0da8-4551-9547-d32048ec2b4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:03.338794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da825955-0da8-4551-9547-d32048ec2b4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:03.339495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da825955-0da8-4551-9547-d32048ec2b4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:03.339950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da825955-0da8-4551-9547-d32048ec2b4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:03.340383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-da825955-0da8-4551-9547-d32048ec2b4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:03.402039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-da825955-0da8-4551-9547-d32048ec2b4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:03.410763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-da825955-0da8-4551-9547-d32048ec2b4c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083851 Aug 18 22:19:03.411332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2021/4038] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:04.431922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-13189166-7637-436a-a7e9-e1f6f2628ae7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:04.432564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-13189166-7637-436a-a7e9-e1f6f2628ae7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:04.439145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13189166-7637-436a-a7e9-e1f6f2628ae7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:04.439672 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13189166-7637-436a-a7e9-e1f6f2628ae7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:04.440114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13189166-7637-436a-a7e9-e1f6f2628ae7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:04.440811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13189166-7637-436a-a7e9-e1f6f2628ae7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:04.441272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13189166-7637-436a-a7e9-e1f6f2628ae7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:04.441739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-13189166-7637-436a-a7e9-e1f6f2628ae7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:04.500995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-13189166-7637-436a-a7e9-e1f6f2628ae7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:04.509165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-13189166-7637-436a-a7e9-e1f6f2628ae7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081354 Aug 18 22:19:04.509780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2018/4039] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:05.530119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-61e51a96-cac3-4d48-a8ef-06c688070a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:05.530735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-61e51a96-cac3-4d48-a8ef-06c688070a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:05.537169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61e51a96-cac3-4d48-a8ef-06c688070a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:05.537643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61e51a96-cac3-4d48-a8ef-06c688070a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:05.538085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61e51a96-cac3-4d48-a8ef-06c688070a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:05.538771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61e51a96-cac3-4d48-a8ef-06c688070a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:05.539252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61e51a96-cac3-4d48-a8ef-06c688070a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:05.539673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-61e51a96-cac3-4d48-a8ef-06c688070a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:05.598942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-61e51a96-cac3-4d48-a8ef-06c688070a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:05.608012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-61e51a96-cac3-4d48-a8ef-06c688070a42 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081779 Aug 18 22:19:05.608583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2022/4040] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:06.628680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-09d8f5c0-67c6-4c9b-850d-6478529944bf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:06.629289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-09d8f5c0-67c6-4c9b-850d-6478529944bf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:06.635713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09d8f5c0-67c6-4c9b-850d-6478529944bf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:06.636193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09d8f5c0-67c6-4c9b-850d-6478529944bf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:06.636626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09d8f5c0-67c6-4c9b-850d-6478529944bf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:06.637309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09d8f5c0-67c6-4c9b-850d-6478529944bf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:06.638269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09d8f5c0-67c6-4c9b-850d-6478529944bf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:06.638693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-09d8f5c0-67c6-4c9b-850d-6478529944bf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:06.703409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-09d8f5c0-67c6-4c9b-850d-6478529944bf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:06.711557 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-09d8f5c0-67c6-4c9b-850d-6478529944bf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086682 Aug 18 22:19:06.712128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2019/4041] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:07.732957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8cd3c56f-aa51-4145-81c3-bf1157d74486 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:07.733566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8cd3c56f-aa51-4145-81c3-bf1157d74486 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:07.739961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8cd3c56f-aa51-4145-81c3-bf1157d74486 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:07.740438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8cd3c56f-aa51-4145-81c3-bf1157d74486 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:07.740870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8cd3c56f-aa51-4145-81c3-bf1157d74486 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:07.741546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8cd3c56f-aa51-4145-81c3-bf1157d74486 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:07.742214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8cd3c56f-aa51-4145-81c3-bf1157d74486 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:07.742639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8cd3c56f-aa51-4145-81c3-bf1157d74486 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:07.746459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=84 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:07.805013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8cd3c56f-aa51-4145-81c3-bf1157d74486 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:07.813297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8cd3c56f-aa51-4145-81c3-bf1157d74486 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084858 Aug 18 22:19:07.813906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2023/4042] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:07 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:08.839175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e428b4d9-bf34-4972-b8cf-e01313b65d2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:08.839790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e428b4d9-bf34-4972-b8cf-e01313b65d2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:08.846208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e428b4d9-bf34-4972-b8cf-e01313b65d2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:08.846689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e428b4d9-bf34-4972-b8cf-e01313b65d2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:08.847123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e428b4d9-bf34-4972-b8cf-e01313b65d2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:08.847804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e428b4d9-bf34-4972-b8cf-e01313b65d2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:08.848252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e428b4d9-bf34-4972-b8cf-e01313b65d2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:08.848671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e428b4d9-bf34-4972-b8cf-e01313b65d2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:08.910135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e428b4d9-bf34-4972-b8cf-e01313b65d2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:08.918303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e428b4d9-bf34-4972-b8cf-e01313b65d2a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082980 Aug 18 22:19:08.919736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2020/4043] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:09.940921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-44a6eee8-1335-4eb3-9029-2d35abf414f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:09.941536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-44a6eee8-1335-4eb3-9029-2d35abf414f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:09.948454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44a6eee8-1335-4eb3-9029-2d35abf414f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:09.948935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44a6eee8-1335-4eb3-9029-2d35abf414f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:09.949368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44a6eee8-1335-4eb3-9029-2d35abf414f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:09.950706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44a6eee8-1335-4eb3-9029-2d35abf414f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:09.951165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44a6eee8-1335-4eb3-9029-2d35abf414f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:09.951593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-44a6eee8-1335-4eb3-9029-2d35abf414f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:10.015627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-44a6eee8-1335-4eb3-9029-2d35abf414f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:10.023711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-44a6eee8-1335-4eb3-9029-2d35abf414f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086806 Aug 18 22:19:10.024488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2024/4044] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:11.044319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3d6a3764-3cf4-4858-ae20-3ea176e6fdd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:11.044974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3d6a3764-3cf4-4858-ae20-3ea176e6fdd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:11.051439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d6a3764-3cf4-4858-ae20-3ea176e6fdd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:11.051929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d6a3764-3cf4-4858-ae20-3ea176e6fdd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:11.052372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d6a3764-3cf4-4858-ae20-3ea176e6fdd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:11.053065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d6a3764-3cf4-4858-ae20-3ea176e6fdd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:11.053830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d6a3764-3cf4-4858-ae20-3ea176e6fdd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:11.054568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d6a3764-3cf4-4858-ae20-3ea176e6fdd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:11.058187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=84 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:11.124517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3d6a3764-3cf4-4858-ae20-3ea176e6fdd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:11.133355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3d6a3764-3cf4-4858-ae20-3ea176e6fdd5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.092816 Aug 18 22:19:11.133999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2021/4045] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:12.158501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c460cc0b-7ff1-4f4f-89d9-865968534cf3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:12.159122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c460cc0b-7ff1-4f4f-89d9-865968534cf3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:12.165690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c460cc0b-7ff1-4f4f-89d9-865968534cf3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:12.166179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c460cc0b-7ff1-4f4f-89d9-865968534cf3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:12.166700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c460cc0b-7ff1-4f4f-89d9-865968534cf3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:12.167331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c460cc0b-7ff1-4f4f-89d9-865968534cf3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:12.167791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c460cc0b-7ff1-4f4f-89d9-865968534cf3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:12.168223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c460cc0b-7ff1-4f4f-89d9-865968534cf3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:12.233903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c460cc0b-7ff1-4f4f-89d9-865968534cf3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:12.242099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c460cc0b-7ff1-4f4f-89d9-865968534cf3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.087529 Aug 18 22:19:12.242691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2025/4046] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:12 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:13.262941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-65a243c2-7b82-46ed-95f7-9b92bba35856 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:13.263865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-65a243c2-7b82-46ed-95f7-9b92bba35856 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:13.266189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=28 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:13.271425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65a243c2-7b82-46ed-95f7-9b92bba35856 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:13.271902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65a243c2-7b82-46ed-95f7-9b92bba35856 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:13.272335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65a243c2-7b82-46ed-95f7-9b92bba35856 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:13.273018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65a243c2-7b82-46ed-95f7-9b92bba35856 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:13.273467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65a243c2-7b82-46ed-95f7-9b92bba35856 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:13.273915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-65a243c2-7b82-46ed-95f7-9b92bba35856 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:13.333818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-65a243c2-7b82-46ed-95f7-9b92bba35856 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:13.342600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-65a243c2-7b82-46ed-95f7-9b92bba35856 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083975 Aug 18 22:19:13.343180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2022/4047] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:14.363498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6bbdb306-97d8-47f8-98ba-cbdabda2c5e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:14.364109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6bbdb306-97d8-47f8-98ba-cbdabda2c5e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:14.370532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbdb306-97d8-47f8-98ba-cbdabda2c5e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:14.371011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbdb306-97d8-47f8-98ba-cbdabda2c5e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:14.371446 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbdb306-97d8-47f8-98ba-cbdabda2c5e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:14.372127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbdb306-97d8-47f8-98ba-cbdabda2c5e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:14.372578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbdb306-97d8-47f8-98ba-cbdabda2c5e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:14.372998 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6bbdb306-97d8-47f8-98ba-cbdabda2c5e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:14.431899 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6bbdb306-97d8-47f8-98ba-cbdabda2c5e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:14.439900 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6bbdb306-97d8-47f8-98ba-cbdabda2c5e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.080237 Aug 18 22:19:14.440465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2026/4048] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:15.460919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a7128609-53ba-471f-b7a5-815601223af1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:15.461542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a7128609-53ba-471f-b7a5-815601223af1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:15.468094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7128609-53ba-471f-b7a5-815601223af1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:15.468581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7128609-53ba-471f-b7a5-815601223af1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:15.469024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7128609-53ba-471f-b7a5-815601223af1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:15.469748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7128609-53ba-471f-b7a5-815601223af1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:15.470217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7128609-53ba-471f-b7a5-815601223af1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:15.470651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7128609-53ba-471f-b7a5-815601223af1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:15.532480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a7128609-53ba-471f-b7a5-815601223af1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:15.540616 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a7128609-53ba-471f-b7a5-815601223af1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083566 Aug 18 22:19:15.541188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2023/4049] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:15 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:16.562769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c6a6f34c-0edd-4c45-a6e7-038409564308 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:16.563379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c6a6f34c-0edd-4c45-a6e7-038409564308 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:16.569404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6a6f34c-0edd-4c45-a6e7-038409564308 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:16.569907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6a6f34c-0edd-4c45-a6e7-038409564308 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:16.570345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6a6f34c-0edd-4c45-a6e7-038409564308 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:16.571027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6a6f34c-0edd-4c45-a6e7-038409564308 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:16.571482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6a6f34c-0edd-4c45-a6e7-038409564308 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:16.571912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c6a6f34c-0edd-4c45-a6e7-038409564308 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:16.631119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c6a6f34c-0edd-4c45-a6e7-038409564308 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:16.639994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c6a6f34c-0edd-4c45-a6e7-038409564308 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081748 Aug 18 22:19:16.640562 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2027/4050] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:17.660341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6cf0ddc5-a9ad-49c7-b984-05a3ad85df26 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:17.660881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6cf0ddc5-a9ad-49c7-b984-05a3ad85df26 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:17.667495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cf0ddc5-a9ad-49c7-b984-05a3ad85df26 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:17.667980 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cf0ddc5-a9ad-49c7-b984-05a3ad85df26 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:17.668421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cf0ddc5-a9ad-49c7-b984-05a3ad85df26 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:17.669182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cf0ddc5-a9ad-49c7-b984-05a3ad85df26 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:17.669661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cf0ddc5-a9ad-49c7-b984-05a3ad85df26 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:17.670096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6cf0ddc5-a9ad-49c7-b984-05a3ad85df26 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:17.954580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6cf0ddc5-a9ad-49c7-b984-05a3ad85df26 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:17.962864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6cf0ddc5-a9ad-49c7-b984-05a3ad85df26 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.306451 Aug 18 22:19:17.963446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2024/4051] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:17 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:18.986078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-346cb58d-90d1-4463-b01b-918e589fd1be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:18.986700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-346cb58d-90d1-4463-b01b-918e589fd1be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:18.993548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-346cb58d-90d1-4463-b01b-918e589fd1be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:18.994065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-346cb58d-90d1-4463-b01b-918e589fd1be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:18.994504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-346cb58d-90d1-4463-b01b-918e589fd1be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:18.995205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-346cb58d-90d1-4463-b01b-918e589fd1be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:18.995664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-346cb58d-90d1-4463-b01b-918e589fd1be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:18.996096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-346cb58d-90d1-4463-b01b-918e589fd1be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:19.056748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-346cb58d-90d1-4463-b01b-918e589fd1be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:19.064968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-346cb58d-90d1-4463-b01b-918e589fd1be tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082781 Aug 18 22:19:19.065875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2028/4052] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:18 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:20.086097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b059cebd-de1c-45eb-9c79-7268f6989fc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:20.086710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b059cebd-de1c-45eb-9c79-7268f6989fc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:20.093729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b059cebd-de1c-45eb-9c79-7268f6989fc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:20.094216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b059cebd-de1c-45eb-9c79-7268f6989fc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:20.094674 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b059cebd-de1c-45eb-9c79-7268f6989fc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:20.095364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b059cebd-de1c-45eb-9c79-7268f6989fc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:20.095816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b059cebd-de1c-45eb-9c79-7268f6989fc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:20.096241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b059cebd-de1c-45eb-9c79-7268f6989fc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:20.156206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b059cebd-de1c-45eb-9c79-7268f6989fc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:20.164335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b059cebd-de1c-45eb-9c79-7268f6989fc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082119 Aug 18 22:19:20.164904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2025/4053] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:20 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:21.185116 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0497003-17dd-4c1e-87c4-8a2b78495a3f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:21.185775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c0497003-17dd-4c1e-87c4-8a2b78495a3f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:21.192120 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0497003-17dd-4c1e-87c4-8a2b78495a3f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:21.192606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0497003-17dd-4c1e-87c4-8a2b78495a3f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:21.193047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0497003-17dd-4c1e-87c4-8a2b78495a3f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:21.193770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0497003-17dd-4c1e-87c4-8a2b78495a3f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:21.194234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0497003-17dd-4c1e-87c4-8a2b78495a3f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:21.194657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0497003-17dd-4c1e-87c4-8a2b78495a3f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:21.258185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c0497003-17dd-4c1e-87c4-8a2b78495a3f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:21.266938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c0497003-17dd-4c1e-87c4-8a2b78495a3f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086260 Aug 18 22:19:21.267513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2029/4054] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:22.287770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5521f2e9-b7d5-4b03-a15a-fe2f267c8df6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:22.288392 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5521f2e9-b7d5-4b03-a15a-fe2f267c8df6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:22.295009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5521f2e9-b7d5-4b03-a15a-fe2f267c8df6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:22.295507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5521f2e9-b7d5-4b03-a15a-fe2f267c8df6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:22.295954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5521f2e9-b7d5-4b03-a15a-fe2f267c8df6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:22.296661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5521f2e9-b7d5-4b03-a15a-fe2f267c8df6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:22.297126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5521f2e9-b7d5-4b03-a15a-fe2f267c8df6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:22.297612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5521f2e9-b7d5-4b03-a15a-fe2f267c8df6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:22.363761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5521f2e9-b7d5-4b03-a15a-fe2f267c8df6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:22.371955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5521f2e9-b7d5-4b03-a15a-fe2f267c8df6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088155 Aug 18 22:19:22.372531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2026/4055] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:23.391747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7fd97657-b4f5-4da1-a715-a840554be47d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:23.392388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7fd97657-b4f5-4da1-a715-a840554be47d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:23.394778 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=28 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:23.400214 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fd97657-b4f5-4da1-a715-a840554be47d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:23.400697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fd97657-b4f5-4da1-a715-a840554be47d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:23.401132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fd97657-b4f5-4da1-a715-a840554be47d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:23.401847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fd97657-b4f5-4da1-a715-a840554be47d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:23.402301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fd97657-b4f5-4da1-a715-a840554be47d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:23.402725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fd97657-b4f5-4da1-a715-a840554be47d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:23.461964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7fd97657-b4f5-4da1-a715-a840554be47d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:23.470539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7fd97657-b4f5-4da1-a715-a840554be47d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082664 Aug 18 22:19:23.471102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2030/4056] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:23 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:24.492097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-461aacfd-1822-489b-94f8-6761f390a00a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:24.492737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-461aacfd-1822-489b-94f8-6761f390a00a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:24.499989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-461aacfd-1822-489b-94f8-6761f390a00a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:24.500476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-461aacfd-1822-489b-94f8-6761f390a00a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:24.500919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-461aacfd-1822-489b-94f8-6761f390a00a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:24.501727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-461aacfd-1822-489b-94f8-6761f390a00a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:24.502189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-461aacfd-1822-489b-94f8-6761f390a00a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:24.502617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-461aacfd-1822-489b-94f8-6761f390a00a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:24.568258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-461aacfd-1822-489b-94f8-6761f390a00a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:24.576426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-461aacfd-1822-489b-94f8-6761f390a00a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088291 Aug 18 22:19:24.576987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2027/4057] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:25.597020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-25ab0b7d-342c-4c8d-a544-1b88e49443ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:25.597553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-25ab0b7d-342c-4c8d-a544-1b88e49443ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:25.603957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ab0b7d-342c-4c8d-a544-1b88e49443ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:25.604433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ab0b7d-342c-4c8d-a544-1b88e49443ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:25.604865 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ab0b7d-342c-4c8d-a544-1b88e49443ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:25.605544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ab0b7d-342c-4c8d-a544-1b88e49443ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:25.606018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ab0b7d-342c-4c8d-a544-1b88e49443ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:25.606436 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ab0b7d-342c-4c8d-a544-1b88e49443ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:25.667387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-25ab0b7d-342c-4c8d-a544-1b88e49443ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:25.675525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-25ab0b7d-342c-4c8d-a544-1b88e49443ee tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082460 Aug 18 22:19:25.676095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2031/4058] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:26.696305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-37469af5-cd49-4108-b3fe-af498ef7d9ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:26.696913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-37469af5-cd49-4108-b3fe-af498ef7d9ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:26.703895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37469af5-cd49-4108-b3fe-af498ef7d9ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:26.704372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37469af5-cd49-4108-b3fe-af498ef7d9ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:26.704803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37469af5-cd49-4108-b3fe-af498ef7d9ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:26.705511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37469af5-cd49-4108-b3fe-af498ef7d9ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:26.705991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37469af5-cd49-4108-b3fe-af498ef7d9ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:26.706410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-37469af5-cd49-4108-b3fe-af498ef7d9ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:26.766261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-37469af5-cd49-4108-b3fe-af498ef7d9ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:26.774330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-37469af5-cd49-4108-b3fe-af498ef7d9ea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081914 Aug 18 22:19:26.774908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2028/4059] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:26 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:27.796705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0f9cf9b0-b5bf-4d4d-a886-a8ab1d486661 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:27.798106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0f9cf9b0-b5bf-4d4d-a886-a8ab1d486661 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:27.804730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f9cf9b0-b5bf-4d4d-a886-a8ab1d486661 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:27.805210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f9cf9b0-b5bf-4d4d-a886-a8ab1d486661 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:27.805668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f9cf9b0-b5bf-4d4d-a886-a8ab1d486661 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:27.806361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f9cf9b0-b5bf-4d4d-a886-a8ab1d486661 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:27.806815 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f9cf9b0-b5bf-4d4d-a886-a8ab1d486661 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:27.807244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f9cf9b0-b5bf-4d4d-a886-a8ab1d486661 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:27.868646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0f9cf9b0-b5bf-4d4d-a886-a8ab1d486661 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:27.876677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0f9cf9b0-b5bf-4d4d-a886-a8ab1d486661 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084809 Aug 18 22:19:27.877243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2032/4060] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:28.897011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7eac32a6-d736-4fde-b9fa-7c0abdbc2bea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:28.897656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7eac32a6-d736-4fde-b9fa-7c0abdbc2bea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:28.904283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7eac32a6-d736-4fde-b9fa-7c0abdbc2bea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:28.904770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7eac32a6-d736-4fde-b9fa-7c0abdbc2bea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:28.905209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7eac32a6-d736-4fde-b9fa-7c0abdbc2bea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:28.905921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7eac32a6-d736-4fde-b9fa-7c0abdbc2bea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:28.906378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7eac32a6-d736-4fde-b9fa-7c0abdbc2bea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:28.906806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7eac32a6-d736-4fde-b9fa-7c0abdbc2bea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:28.967680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7eac32a6-d736-4fde-b9fa-7c0abdbc2bea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:28.975874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7eac32a6-d736-4fde-b9fa-7c0abdbc2bea tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082586 Aug 18 22:19:28.976358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2029/4061] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:29.998770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4aa2e746-242e-4204-8daf-9951eada453e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:29.999336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4aa2e746-242e-4204-8daf-9951eada453e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:30.005757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa2e746-242e-4204-8daf-9951eada453e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:30.006237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa2e746-242e-4204-8daf-9951eada453e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:30.006790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa2e746-242e-4204-8daf-9951eada453e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:30.007450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa2e746-242e-4204-8daf-9951eada453e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:30.007902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa2e746-242e-4204-8daf-9951eada453e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:30.008326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4aa2e746-242e-4204-8daf-9951eada453e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:30.070670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4aa2e746-242e-4204-8daf-9951eada453e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:30.079268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4aa2e746-242e-4204-8daf-9951eada453e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084408 Aug 18 22:19:30.079822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2033/4062] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:29 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:31.099981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f317426d-9190-4ebb-9761-893074137110 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:31.100590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f317426d-9190-4ebb-9761-893074137110 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:31.107030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f317426d-9190-4ebb-9761-893074137110 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:31.107514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f317426d-9190-4ebb-9761-893074137110 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:31.107954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f317426d-9190-4ebb-9761-893074137110 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:31.108640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f317426d-9190-4ebb-9761-893074137110 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:31.109095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f317426d-9190-4ebb-9761-893074137110 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:31.109520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f317426d-9190-4ebb-9761-893074137110 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:31.172040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f317426d-9190-4ebb-9761-893074137110 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:31.180552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f317426d-9190-4ebb-9761-893074137110 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084431 Aug 18 22:19:31.181123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2030/4063] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:32.202390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9e573728-6691-4d9f-84ff-de1ee2a891c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:32.202984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9e573728-6691-4d9f-84ff-de1ee2a891c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:32.209315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e573728-6691-4d9f-84ff-de1ee2a891c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:32.209825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e573728-6691-4d9f-84ff-de1ee2a891c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:32.210259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e573728-6691-4d9f-84ff-de1ee2a891c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:32.210944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e573728-6691-4d9f-84ff-de1ee2a891c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:32.211396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e573728-6691-4d9f-84ff-de1ee2a891c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:32.211813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9e573728-6691-4d9f-84ff-de1ee2a891c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:32.272833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9e573728-6691-4d9f-84ff-de1ee2a891c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:32.281901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9e573728-6691-4d9f-84ff-de1ee2a891c4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083708 Aug 18 22:19:32.282484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2034/4064] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:33.301987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6480ac23-eb4e-4e78-9eb0-f4f38ecfffb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:33.303045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6480ac23-eb4e-4e78-9eb0-f4f38ecfffb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:33.310476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6480ac23-eb4e-4e78-9eb0-f4f38ecfffb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:33.311488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6480ac23-eb4e-4e78-9eb0-f4f38ecfffb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:33.311926 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6480ac23-eb4e-4e78-9eb0-f4f38ecfffb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:33.312621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6480ac23-eb4e-4e78-9eb0-f4f38ecfffb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:33.313079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6480ac23-eb4e-4e78-9eb0-f4f38ecfffb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:33.313506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6480ac23-eb4e-4e78-9eb0-f4f38ecfffb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:33.372546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6480ac23-eb4e-4e78-9eb0-f4f38ecfffb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:33.381146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6480ac23-eb4e-4e78-9eb0-f4f38ecfffb8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083027 Aug 18 22:19:33.381745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2031/4065] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:34.402712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-89ca115d-60c3-4724-9560-8f7e2f9e369d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:34.403353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-89ca115d-60c3-4724-9560-8f7e2f9e369d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:34.410653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ca115d-60c3-4724-9560-8f7e2f9e369d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:34.411134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ca115d-60c3-4724-9560-8f7e2f9e369d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:34.411570 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ca115d-60c3-4724-9560-8f7e2f9e369d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:34.412257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ca115d-60c3-4724-9560-8f7e2f9e369d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:34.412716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ca115d-60c3-4724-9560-8f7e2f9e369d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:34.413219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-89ca115d-60c3-4724-9560-8f7e2f9e369d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:34.472897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-89ca115d-60c3-4724-9560-8f7e2f9e369d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:34.480930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-89ca115d-60c3-4724-9560-8f7e2f9e369d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082128 Aug 18 22:19:34.481497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2035/4066] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:19:35.501888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-85e799f7-bfbb-4ffe-8aa1-5446bb94eb0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:35.502509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-85e799f7-bfbb-4ffe-8aa1-5446bb94eb0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:35.508913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85e799f7-bfbb-4ffe-8aa1-5446bb94eb0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:35.509402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85e799f7-bfbb-4ffe-8aa1-5446bb94eb0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:35.509877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85e799f7-bfbb-4ffe-8aa1-5446bb94eb0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:35.510567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85e799f7-bfbb-4ffe-8aa1-5446bb94eb0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:35.511022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85e799f7-bfbb-4ffe-8aa1-5446bb94eb0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:35.511449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-85e799f7-bfbb-4ffe-8aa1-5446bb94eb0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:35.578070 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-85e799f7-bfbb-4ffe-8aa1-5446bb94eb0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:35.586371 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-85e799f7-bfbb-4ffe-8aa1-5446bb94eb0e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088267 Aug 18 22:19:35.586950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2032/4067] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:35 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:36.007771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-40325c48-38c6-4228-9178-9e708bf9ba61 req-bf421c54-edce-48d4-90aa-b159c763c32c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0426bb7b-e862-4873-9c1e-7878b89cde47", "name": "network-vif-deleted", "tag": "a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:19:36.020674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-40325c48-38c6-4228-9178-9e708bf9ba61 req-bf421c54-edce-48d4-90aa-b159c763c32c service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:36.021156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-40325c48-38c6-4228-9178-9e708bf9ba61 req-bf421c54-edce-48d4-90aa-b159c763c32c service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:36.021583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-40325c48-38c6-4228-9178-9e708bf9ba61 req-bf421c54-edce-48d4-90aa-b159c763c32c service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:36.034861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-40325c48-38c6-4228-9178-9e708bf9ba61 req-bf421c54-edce-48d4-90aa-b159c763c32c service nova] Creating event network-vif-deleted:a0e88e6c-9d6d-4d0e-8694-de8e7e82a88b for instance 0426bb7b-e862-4873-9c1e-7878b89cde47 on hv-cinder-85367 Aug 18 22:19:36.040211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-40325c48-38c6-4228-9178-9e708bf9ba61 req-bf421c54-edce-48d4-90aa-b159c763c32c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036085 Aug 18 22:19:36.040813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2036/4068] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:19:36.607305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3bdf42e0-bad9-4da1-814e-c4708ce91ce0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:36.607837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3bdf42e0-bad9-4da1-814e-c4708ce91ce0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:36.614801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bdf42e0-bad9-4da1-814e-c4708ce91ce0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:36.615281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bdf42e0-bad9-4da1-814e-c4708ce91ce0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:36.615714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bdf42e0-bad9-4da1-814e-c4708ce91ce0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:36.616394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bdf42e0-bad9-4da1-814e-c4708ce91ce0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:36.616843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bdf42e0-bad9-4da1-814e-c4708ce91ce0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:36.617264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3bdf42e0-bad9-4da1-814e-c4708ce91ce0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:36.678748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3bdf42e0-bad9-4da1-814e-c4708ce91ce0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:36.686610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3bdf42e0-bad9-4da1-814e-c4708ce91ce0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083188 Aug 18 22:19:36.687179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2033/4069] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:37.709380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f9b8e46d-0357-47bf-82b5-920e457241a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:37.710095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f9b8e46d-0357-47bf-82b5-920e457241a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:37.716201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9b8e46d-0357-47bf-82b5-920e457241a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:37.716678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9b8e46d-0357-47bf-82b5-920e457241a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:37.717111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9b8e46d-0357-47bf-82b5-920e457241a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:37.717823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9b8e46d-0357-47bf-82b5-920e457241a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:37.718276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9b8e46d-0357-47bf-82b5-920e457241a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:37.718945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9b8e46d-0357-47bf-82b5-920e457241a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:37.779253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f9b8e46d-0357-47bf-82b5-920e457241a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:37.781501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=84 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:37.788761 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f9b8e46d-0357-47bf-82b5-920e457241a4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084108 Aug 18 22:19:37.789333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2037/4070] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:37 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:38.809831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2d1832c-f1c7-4ac8-a36f-0d4ef1cc1c89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:38.810467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e2d1832c-f1c7-4ac8-a36f-0d4ef1cc1c89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:38.816929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2d1832c-f1c7-4ac8-a36f-0d4ef1cc1c89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:38.817413 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2d1832c-f1c7-4ac8-a36f-0d4ef1cc1c89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:38.817874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2d1832c-f1c7-4ac8-a36f-0d4ef1cc1c89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:38.818558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2d1832c-f1c7-4ac8-a36f-0d4ef1cc1c89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:38.819015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2d1832c-f1c7-4ac8-a36f-0d4ef1cc1c89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:38.819432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2d1832c-f1c7-4ac8-a36f-0d4ef1cc1c89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:38.878829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e2d1832c-f1c7-4ac8-a36f-0d4ef1cc1c89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:38.886832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e2d1832c-f1c7-4ac8-a36f-0d4ef1cc1c89 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.080812 Aug 18 22:19:38.887400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2034/4071] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:38 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:39.908419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8b83a8eb-d764-4322-99c3-7402cfd5b8c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:39.909043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8b83a8eb-d764-4322-99c3-7402cfd5b8c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:39.916444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b83a8eb-d764-4322-99c3-7402cfd5b8c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:39.916940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b83a8eb-d764-4322-99c3-7402cfd5b8c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:39.917379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b83a8eb-d764-4322-99c3-7402cfd5b8c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:39.918113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b83a8eb-d764-4322-99c3-7402cfd5b8c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:39.918574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b83a8eb-d764-4322-99c3-7402cfd5b8c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:39.919005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8b83a8eb-d764-4322-99c3-7402cfd5b8c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:39.985437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8b83a8eb-d764-4322-99c3-7402cfd5b8c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:39.993687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8b83a8eb-d764-4322-99c3-7402cfd5b8c5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.089755 Aug 18 22:19:39.994261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2038/4072] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:39 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:41.014684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2d5bee39-0406-4ae9-824b-212a7e558b39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:41.015226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2d5bee39-0406-4ae9-824b-212a7e558b39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:41.021660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d5bee39-0406-4ae9-824b-212a7e558b39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:41.022156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d5bee39-0406-4ae9-824b-212a7e558b39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:41.022607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d5bee39-0406-4ae9-824b-212a7e558b39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:41.023299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d5bee39-0406-4ae9-824b-212a7e558b39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:41.023761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d5bee39-0406-4ae9-824b-212a7e558b39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:41.024194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2d5bee39-0406-4ae9-824b-212a7e558b39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:41.084700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2d5bee39-0406-4ae9-824b-212a7e558b39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:41.086914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=88 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:41.094191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2d5bee39-0406-4ae9-824b-212a7e558b39 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083638 Aug 18 22:19:41.095318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2035/4073] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:41 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:42.116335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6dcba399-142e-486a-8639-bb7888d26b51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:42.116939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6dcba399-142e-486a-8639-bb7888d26b51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:42.123347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dcba399-142e-486a-8639-bb7888d26b51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:42.123820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dcba399-142e-486a-8639-bb7888d26b51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:42.124250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dcba399-142e-486a-8639-bb7888d26b51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:42.124931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dcba399-142e-486a-8639-bb7888d26b51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:42.125377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dcba399-142e-486a-8639-bb7888d26b51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:42.126457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6dcba399-142e-486a-8639-bb7888d26b51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:42.190941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6dcba399-142e-486a-8639-bb7888d26b51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:42.199217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6dcba399-142e-486a-8639-bb7888d26b51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086716 Aug 18 22:19:42.199783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2039/4074] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:43.219941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-db3d6475-c5ef-446c-aa79-34f27996ce70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:43.220554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-db3d6475-c5ef-446c-aa79-34f27996ce70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:43.227125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db3d6475-c5ef-446c-aa79-34f27996ce70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:43.227607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db3d6475-c5ef-446c-aa79-34f27996ce70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:43.228042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db3d6475-c5ef-446c-aa79-34f27996ce70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:43.228732 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db3d6475-c5ef-446c-aa79-34f27996ce70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:43.229186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db3d6475-c5ef-446c-aa79-34f27996ce70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:43.229642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-db3d6475-c5ef-446c-aa79-34f27996ce70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:43.292535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-db3d6475-c5ef-446c-aa79-34f27996ce70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:43.300572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-db3d6475-c5ef-446c-aa79-34f27996ce70 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084543 Aug 18 22:19:43.301142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2036/4075] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:43 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:44.322093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52ee61f6-02e8-4e76-b295-aa53e5af5067 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:44.322711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-52ee61f6-02e8-4e76-b295-aa53e5af5067 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:44.329624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52ee61f6-02e8-4e76-b295-aa53e5af5067 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:44.330111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52ee61f6-02e8-4e76-b295-aa53e5af5067 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:44.330552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52ee61f6-02e8-4e76-b295-aa53e5af5067 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:44.331237 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52ee61f6-02e8-4e76-b295-aa53e5af5067 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:44.331694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52ee61f6-02e8-4e76-b295-aa53e5af5067 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:44.332119 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52ee61f6-02e8-4e76-b295-aa53e5af5067 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:44.391229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-52ee61f6-02e8-4e76-b295-aa53e5af5067 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:44.399929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-52ee61f6-02e8-4e76-b295-aa53e5af5067 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081740 Aug 18 22:19:44.400493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2040/4076] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:44 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:45.421189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-95ff4fcf-53a9-4382-98a9-ca3d124953f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:45.421832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-95ff4fcf-53a9-4382-98a9-ca3d124953f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:45.424764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=30 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:45.429987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95ff4fcf-53a9-4382-98a9-ca3d124953f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:45.430468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95ff4fcf-53a9-4382-98a9-ca3d124953f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:45.430904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95ff4fcf-53a9-4382-98a9-ca3d124953f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:45.431591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95ff4fcf-53a9-4382-98a9-ca3d124953f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:45.432045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95ff4fcf-53a9-4382-98a9-ca3d124953f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:45.432472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-95ff4fcf-53a9-4382-98a9-ca3d124953f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:45.492688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-95ff4fcf-53a9-4382-98a9-ca3d124953f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:45.500827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-95ff4fcf-53a9-4382-98a9-ca3d124953f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083414 Aug 18 22:19:45.501396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2037/4077] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:46.521868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-58290dd8-5f7c-4d10-b2af-551679279b6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:46.522485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-58290dd8-5f7c-4d10-b2af-551679279b6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:46.528494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58290dd8-5f7c-4d10-b2af-551679279b6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:46.528973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58290dd8-5f7c-4d10-b2af-551679279b6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:46.529409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58290dd8-5f7c-4d10-b2af-551679279b6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:46.530122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58290dd8-5f7c-4d10-b2af-551679279b6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:46.530578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58290dd8-5f7c-4d10-b2af-551679279b6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:46.531002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58290dd8-5f7c-4d10-b2af-551679279b6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:46.590324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-58290dd8-5f7c-4d10-b2af-551679279b6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:46.598456 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-58290dd8-5f7c-4d10-b2af-551679279b6d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.080633 Aug 18 22:19:46.599031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2041/4078] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:46 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:47.619316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b2c4f6c0-e79d-46f7-8382-712f394d67c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:47.619831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b2c4f6c0-e79d-46f7-8382-712f394d67c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:47.626860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2c4f6c0-e79d-46f7-8382-712f394d67c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:47.632874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2c4f6c0-e79d-46f7-8382-712f394d67c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:47.632874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2c4f6c0-e79d-46f7-8382-712f394d67c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:47.632874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2c4f6c0-e79d-46f7-8382-712f394d67c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:47.632874 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2c4f6c0-e79d-46f7-8382-712f394d67c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:47.633231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b2c4f6c0-e79d-46f7-8382-712f394d67c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:47.690837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b2c4f6c0-e79d-46f7-8382-712f394d67c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:47.699168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b2c4f6c0-e79d-46f7-8382-712f394d67c6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083780 Aug 18 22:19:47.699747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2038/4079] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:47 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:48.720322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3c189cdd-e6e7-4155-85b4-5473d37f5fd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:48.720966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3c189cdd-e6e7-4155-85b4-5473d37f5fd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:48.727590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c189cdd-e6e7-4155-85b4-5473d37f5fd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:48.728079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c189cdd-e6e7-4155-85b4-5473d37f5fd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:48.728541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c189cdd-e6e7-4155-85b4-5473d37f5fd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:48.729240 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c189cdd-e6e7-4155-85b4-5473d37f5fd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:48.729726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c189cdd-e6e7-4155-85b4-5473d37f5fd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:48.730156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3c189cdd-e6e7-4155-85b4-5473d37f5fd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:48.792627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3c189cdd-e6e7-4155-85b4-5473d37f5fd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:48.801190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3c189cdd-e6e7-4155-85b4-5473d37f5fd0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084746 Aug 18 22:19:48.801868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2042/4080] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:48 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:49.822119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9836a8ba-318a-4075-95ef-b7d19663f3ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:49.822745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9836a8ba-318a-4075-95ef-b7d19663f3ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:49.829277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9836a8ba-318a-4075-95ef-b7d19663f3ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:49.829851 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9836a8ba-318a-4075-95ef-b7d19663f3ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:49.830250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9836a8ba-318a-4075-95ef-b7d19663f3ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:49.830943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9836a8ba-318a-4075-95ef-b7d19663f3ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:49.831404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9836a8ba-318a-4075-95ef-b7d19663f3ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:49.831837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9836a8ba-318a-4075-95ef-b7d19663f3ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:49.892007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9836a8ba-318a-4075-95ef-b7d19663f3ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:49.900227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9836a8ba-318a-4075-95ef-b7d19663f3ce tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081965 Aug 18 22:19:49.900800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2039/4081] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:49 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:50.921920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e3a88371-8304-461e-a89e-259c7d12c143 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:50.923025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e3a88371-8304-461e-a89e-259c7d12c143 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:50.930011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3a88371-8304-461e-a89e-259c7d12c143 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:50.930501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3a88371-8304-461e-a89e-259c7d12c143 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:50.930962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3a88371-8304-461e-a89e-259c7d12c143 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:50.931751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3a88371-8304-461e-a89e-259c7d12c143 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:50.932216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3a88371-8304-461e-a89e-259c7d12c143 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:50.932645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3a88371-8304-461e-a89e-259c7d12c143 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:50.992942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e3a88371-8304-461e-a89e-259c7d12c143 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:51.001610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e3a88371-8304-461e-a89e-259c7d12c143 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083946 Aug 18 22:19:51.002181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2043/4082] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:50 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:52.023356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3d06fb53-8a0d-4384-9a05-0a125c479bf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:52.024012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3d06fb53-8a0d-4384-9a05-0a125c479bf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:52.030536 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d06fb53-8a0d-4384-9a05-0a125c479bf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:52.031021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d06fb53-8a0d-4384-9a05-0a125c479bf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:52.031461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d06fb53-8a0d-4384-9a05-0a125c479bf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:52.032178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d06fb53-8a0d-4384-9a05-0a125c479bf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:52.032636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d06fb53-8a0d-4384-9a05-0a125c479bf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:52.033065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d06fb53-8a0d-4384-9a05-0a125c479bf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:52.099248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3d06fb53-8a0d-4384-9a05-0a125c479bf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:52.107492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3d06fb53-8a0d-4384-9a05-0a125c479bf2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088383 Aug 18 22:19:52.108064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2040/4083] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:52 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:53.127820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-63fa518c-fd01-431a-9251-574d79270a0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:53.128434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-63fa518c-fd01-431a-9251-574d79270a0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:53.135037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63fa518c-fd01-431a-9251-574d79270a0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:53.135514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63fa518c-fd01-431a-9251-574d79270a0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:53.135948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63fa518c-fd01-431a-9251-574d79270a0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:53.136641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63fa518c-fd01-431a-9251-574d79270a0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:53.137094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63fa518c-fd01-431a-9251-574d79270a0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:53.137518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-63fa518c-fd01-431a-9251-574d79270a0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:53.199971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-63fa518c-fd01-431a-9251-574d79270a0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:53.208738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-63fa518c-fd01-431a-9251-574d79270a0a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084847 Aug 18 22:19:53.209307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2044/4084] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:53 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:54.230444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4910a366-deab-4ef0-a87f-c031831d50f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:54.231093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4910a366-deab-4ef0-a87f-c031831d50f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:54.238324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4910a366-deab-4ef0-a87f-c031831d50f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:54.238807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4910a366-deab-4ef0-a87f-c031831d50f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:54.239241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4910a366-deab-4ef0-a87f-c031831d50f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:54.239959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4910a366-deab-4ef0-a87f-c031831d50f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:54.240415 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4910a366-deab-4ef0-a87f-c031831d50f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:54.240840 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4910a366-deab-4ef0-a87f-c031831d50f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:54.300475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4910a366-deab-4ef0-a87f-c031831d50f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:54.308962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4910a366-deab-4ef0-a87f-c031831d50f7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082355 Aug 18 22:19:54.309535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2041/4085] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:54 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:55.388969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f337490e-63ae-47f2-b796-17c051174e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:55.389587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f337490e-63ae-47f2-b796-17c051174e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:55.391440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=30 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:19:55.402502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f337490e-63ae-47f2-b796-17c051174e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:55.402996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f337490e-63ae-47f2-b796-17c051174e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:55.403440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f337490e-63ae-47f2-b796-17c051174e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:55.404153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f337490e-63ae-47f2-b796-17c051174e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:55.404610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f337490e-63ae-47f2-b796-17c051174e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:55.405039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f337490e-63ae-47f2-b796-17c051174e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:55.465301 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f337490e-63ae-47f2-b796-17c051174e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:55.473355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f337490e-63ae-47f2-b796-17c051174e5a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.144955 Aug 18 22:19:55.473957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2045/4086] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:55 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:55.552208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:19:55.552390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:19:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:19:56.495910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fa5ff47b-b833-47c8-b682-38e28a56e496 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:56.496520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fa5ff47b-b833-47c8-b682-38e28a56e496 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:56.503673 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa5ff47b-b833-47c8-b682-38e28a56e496 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:56.504164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa5ff47b-b833-47c8-b682-38e28a56e496 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:56.504606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa5ff47b-b833-47c8-b682-38e28a56e496 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:56.505301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa5ff47b-b833-47c8-b682-38e28a56e496 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:56.505862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa5ff47b-b833-47c8-b682-38e28a56e496 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:56.506637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fa5ff47b-b833-47c8-b682-38e28a56e496 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:56.566569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fa5ff47b-b833-47c8-b682-38e28a56e496 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:56.574881 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fa5ff47b-b833-47c8-b682-38e28a56e496 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082816 Aug 18 22:19:56.575449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2042/4087] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:56 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:19:57.062261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:19:57.062461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:19:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:19:57.487650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:19:57.487853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:19:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:19:57.596591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c5aedad1-a83a-42e3-a041-551724dc8008 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:57.597205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c5aedad1-a83a-42e3-a041-551724dc8008 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:57.603635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5aedad1-a83a-42e3-a041-551724dc8008 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:57.604115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5aedad1-a83a-42e3-a041-551724dc8008 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:57.604548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5aedad1-a83a-42e3-a041-551724dc8008 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:57.605233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5aedad1-a83a-42e3-a041-551724dc8008 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:57.605727 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5aedad1-a83a-42e3-a041-551724dc8008 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:57.606139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c5aedad1-a83a-42e3-a041-551724dc8008 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:57.673380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c5aedad1-a83a-42e3-a041-551724dc8008 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:57.681809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c5aedad1-a83a-42e3-a041-551724dc8008 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.089732 Aug 18 22:19:57.682384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2046/4088] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:57 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:58.702957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8978937a-0808-4871-838b-552ad66cb830 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:58.703505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8978937a-0808-4871-838b-552ad66cb830 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:58.709576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8978937a-0808-4871-838b-552ad66cb830 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:58.710115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8978937a-0808-4871-838b-552ad66cb830 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:58.710646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8978937a-0808-4871-838b-552ad66cb830 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:58.711229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8978937a-0808-4871-838b-552ad66cb830 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:58.711686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8978937a-0808-4871-838b-552ad66cb830 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:58.712112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8978937a-0808-4871-838b-552ad66cb830 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:58.772085 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8978937a-0808-4871-838b-552ad66cb830 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:58.780275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8978937a-0808-4871-838b-552ad66cb830 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081267 Aug 18 22:19:58.780839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2043/4089] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:58 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:19:59.801400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-709ee749-520e-4a35-8526-ff14c5c5aff8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:19:59.802041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-709ee749-520e-4a35-8526-ff14c5c5aff8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:19:59.808814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-709ee749-520e-4a35-8526-ff14c5c5aff8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:59.809296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-709ee749-520e-4a35-8526-ff14c5c5aff8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:59.809763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-709ee749-520e-4a35-8526-ff14c5c5aff8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:59.810451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-709ee749-520e-4a35-8526-ff14c5c5aff8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:19:59.810904 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-709ee749-520e-4a35-8526-ff14c5c5aff8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:19:59.811330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-709ee749-520e-4a35-8526-ff14c5c5aff8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:19:59.871376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-709ee749-520e-4a35-8526-ff14c5c5aff8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:19:59.880088 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-709ee749-520e-4a35-8526-ff14c5c5aff8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082510 Aug 18 22:19:59.880659 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2047/4090] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:19:59 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:00.900663 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-67b2d13c-8c84-4ab6-8944-5c06bb8f2d44 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:00.901272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-67b2d13c-8c84-4ab6-8944-5c06bb8f2d44 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:00.908571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67b2d13c-8c84-4ab6-8944-5c06bb8f2d44 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:00.909064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67b2d13c-8c84-4ab6-8944-5c06bb8f2d44 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:00.909510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67b2d13c-8c84-4ab6-8944-5c06bb8f2d44 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:00.910246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67b2d13c-8c84-4ab6-8944-5c06bb8f2d44 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:00.910711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67b2d13c-8c84-4ab6-8944-5c06bb8f2d44 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:00.911157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67b2d13c-8c84-4ab6-8944-5c06bb8f2d44 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:00.976744 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-67b2d13c-8c84-4ab6-8944-5c06bb8f2d44 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:00.985261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-67b2d13c-8c84-4ab6-8944-5c06bb8f2d44 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088394 Aug 18 22:20:00.985876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2044/4091] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:00 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:02.006455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8a6b9df4-b980-49e8-b4e8-9512bd5a5aa4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:02.007106 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8a6b9df4-b980-49e8-b4e8-9512bd5a5aa4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:02.013531 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a6b9df4-b980-49e8-b4e8-9512bd5a5aa4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:02.014064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a6b9df4-b980-49e8-b4e8-9512bd5a5aa4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:02.014502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a6b9df4-b980-49e8-b4e8-9512bd5a5aa4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:02.015194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a6b9df4-b980-49e8-b4e8-9512bd5a5aa4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:02.015680 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a6b9df4-b980-49e8-b4e8-9512bd5a5aa4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:02.016109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a6b9df4-b980-49e8-b4e8-9512bd5a5aa4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:02.075747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8a6b9df4-b980-49e8-b4e8-9512bd5a5aa4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:02.084326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8a6b9df4-b980-49e8-b4e8-9512bd5a5aa4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082637 Aug 18 22:20:02.084891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2048/4092] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:02.728953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:20:02.729139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:20:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:20:03.105680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-529911e3-7a8c-435a-9a7c-d1516c60ed51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:03.106333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-529911e3-7a8c-435a-9a7c-d1516c60ed51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:03.113387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-529911e3-7a8c-435a-9a7c-d1516c60ed51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:03.113920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-529911e3-7a8c-435a-9a7c-d1516c60ed51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:03.114366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-529911e3-7a8c-435a-9a7c-d1516c60ed51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:03.115063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-529911e3-7a8c-435a-9a7c-d1516c60ed51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:03.115573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-529911e3-7a8c-435a-9a7c-d1516c60ed51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:03.116033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-529911e3-7a8c-435a-9a7c-d1516c60ed51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:03.175982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-529911e3-7a8c-435a-9a7c-d1516c60ed51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:03.184412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-529911e3-7a8c-435a-9a7c-d1516c60ed51 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082603 Aug 18 22:20:03.184986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2045/4093] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:04.207300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e5086c7a-7348-4728-aacd-6c68d74b2dcd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:04.207916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e5086c7a-7348-4728-aacd-6c68d74b2dcd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:04.214582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5086c7a-7348-4728-aacd-6c68d74b2dcd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:04.215071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5086c7a-7348-4728-aacd-6c68d74b2dcd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:04.215518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5086c7a-7348-4728-aacd-6c68d74b2dcd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:04.216209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5086c7a-7348-4728-aacd-6c68d74b2dcd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:04.216669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5086c7a-7348-4728-aacd-6c68d74b2dcd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:04.217097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e5086c7a-7348-4728-aacd-6c68d74b2dcd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:04.277912 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e5086c7a-7348-4728-aacd-6c68d74b2dcd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:04.286148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e5086c7a-7348-4728-aacd-6c68d74b2dcd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083331 Aug 18 22:20:04.286726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2049/4094] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:05.307190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-80763c6e-96b9-4e1f-be84-6ff8dcbd0ac5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:05.307798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-80763c6e-96b9-4e1f-be84-6ff8dcbd0ac5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:05.314258 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80763c6e-96b9-4e1f-be84-6ff8dcbd0ac5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:05.314750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80763c6e-96b9-4e1f-be84-6ff8dcbd0ac5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:05.315192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80763c6e-96b9-4e1f-be84-6ff8dcbd0ac5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:05.315894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80763c6e-96b9-4e1f-be84-6ff8dcbd0ac5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:05.316348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80763c6e-96b9-4e1f-be84-6ff8dcbd0ac5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:05.316783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-80763c6e-96b9-4e1f-be84-6ff8dcbd0ac5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:05.379130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-80763c6e-96b9-4e1f-be84-6ff8dcbd0ac5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:05.387162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-80763c6e-96b9-4e1f-be84-6ff8dcbd0ac5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084054 Aug 18 22:20:05.387735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2046/4095] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:06.409130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2558f875-8ff6-4d73-a629-6b1da9a4725b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:06.409766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2558f875-8ff6-4d73-a629-6b1da9a4725b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:06.416140 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2558f875-8ff6-4d73-a629-6b1da9a4725b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:06.416618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2558f875-8ff6-4d73-a629-6b1da9a4725b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:06.417047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2558f875-8ff6-4d73-a629-6b1da9a4725b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:06.417765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2558f875-8ff6-4d73-a629-6b1da9a4725b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:06.418217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2558f875-8ff6-4d73-a629-6b1da9a4725b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:06.418635 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2558f875-8ff6-4d73-a629-6b1da9a4725b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:06.481490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2558f875-8ff6-4d73-a629-6b1da9a4725b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:06.490359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2558f875-8ff6-4d73-a629-6b1da9a4725b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085590 Aug 18 22:20:06.490935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2050/4096] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:07.511291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9bd61515-f46b-416d-826e-bf19044b062a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:07.511898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9bd61515-f46b-416d-826e-bf19044b062a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:07.518221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd61515-f46b-416d-826e-bf19044b062a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:07.518699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd61515-f46b-416d-826e-bf19044b062a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:07.519130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd61515-f46b-416d-826e-bf19044b062a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:07.519809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd61515-f46b-416d-826e-bf19044b062a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:07.520261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd61515-f46b-416d-826e-bf19044b062a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:07.520679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9bd61515-f46b-416d-826e-bf19044b062a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:07.583320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9bd61515-f46b-416d-826e-bf19044b062a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:07.591445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9bd61515-f46b-416d-826e-bf19044b062a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084201 Aug 18 22:20:07.592010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2047/4097] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:07 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:08.612448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f7402568-9242-4b23-97be-c3e57192442c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:08.613070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f7402568-9242-4b23-97be-c3e57192442c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:08.619545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7402568-9242-4b23-97be-c3e57192442c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:08.620032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7402568-9242-4b23-97be-c3e57192442c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:08.620481 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7402568-9242-4b23-97be-c3e57192442c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:08.621173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7402568-9242-4b23-97be-c3e57192442c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:08.621652 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7402568-9242-4b23-97be-c3e57192442c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:08.622081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f7402568-9242-4b23-97be-c3e57192442c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:08.624589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=80 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:20:08.683417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f7402568-9242-4b23-97be-c3e57192442c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:08.692115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f7402568-9242-4b23-97be-c3e57192442c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083671 Aug 18 22:20:08.692725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2051/4098] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:09.713938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8abc8bae-b20e-483d-a383-c692ac3c4681 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:09.714601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8abc8bae-b20e-483d-a383-c692ac3c4681 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:09.721837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8abc8bae-b20e-483d-a383-c692ac3c4681 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:09.722319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8abc8bae-b20e-483d-a383-c692ac3c4681 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:09.722750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8abc8bae-b20e-483d-a383-c692ac3c4681 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:09.723442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8abc8bae-b20e-483d-a383-c692ac3c4681 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:09.723890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8abc8bae-b20e-483d-a383-c692ac3c4681 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:09.724345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8abc8bae-b20e-483d-a383-c692ac3c4681 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:09.786884 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8abc8bae-b20e-483d-a383-c692ac3c4681 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:09.794983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8abc8bae-b20e-483d-a383-c692ac3c4681 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085116 Aug 18 22:20:09.795539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2048/4099] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:10.816258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-359c3c6a-3f07-40d7-9a60-dc6c9d217d35 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:10.816870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-359c3c6a-3f07-40d7-9a60-dc6c9d217d35 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:10.823345 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-359c3c6a-3f07-40d7-9a60-dc6c9d217d35 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:10.823823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-359c3c6a-3f07-40d7-9a60-dc6c9d217d35 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:10.824260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-359c3c6a-3f07-40d7-9a60-dc6c9d217d35 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:10.824948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-359c3c6a-3f07-40d7-9a60-dc6c9d217d35 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:10.825404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-359c3c6a-3f07-40d7-9a60-dc6c9d217d35 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:10.825859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-359c3c6a-3f07-40d7-9a60-dc6c9d217d35 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:10.888372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-359c3c6a-3f07-40d7-9a60-dc6c9d217d35 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:10.896551 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-359c3c6a-3f07-40d7-9a60-dc6c9d217d35 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084532 Aug 18 22:20:10.897396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2052/4100] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:10 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:11.918173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-60e97956-bd02-45ba-ba45-d3ab94ec801a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:11.918902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-60e97956-bd02-45ba-ba45-d3ab94ec801a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:11.926075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60e97956-bd02-45ba-ba45-d3ab94ec801a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:11.926558 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60e97956-bd02-45ba-ba45-d3ab94ec801a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:11.926993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60e97956-bd02-45ba-ba45-d3ab94ec801a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:11.927686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60e97956-bd02-45ba-ba45-d3ab94ec801a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:11.928167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60e97956-bd02-45ba-ba45-d3ab94ec801a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:11.928595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-60e97956-bd02-45ba-ba45-d3ab94ec801a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:11.931405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=80 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:20:11.992293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-60e97956-bd02-45ba-ba45-d3ab94ec801a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:12.001275 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-60e97956-bd02-45ba-ba45-d3ab94ec801a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086435 Aug 18 22:20:12.002225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2049/4101] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:13.022598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ff71e7a8-6f33-459d-b78d-f180afd7f2dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:13.023206 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ff71e7a8-6f33-459d-b78d-f180afd7f2dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:13.029532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff71e7a8-6f33-459d-b78d-f180afd7f2dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:13.030050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff71e7a8-6f33-459d-b78d-f180afd7f2dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:13.030485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff71e7a8-6f33-459d-b78d-f180afd7f2dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:13.031169 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff71e7a8-6f33-459d-b78d-f180afd7f2dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:13.032118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff71e7a8-6f33-459d-b78d-f180afd7f2dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:13.032545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff71e7a8-6f33-459d-b78d-f180afd7f2dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:13.094495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ff71e7a8-6f33-459d-b78d-f180afd7f2dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:13.102760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ff71e7a8-6f33-459d-b78d-f180afd7f2dc tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084058 Aug 18 22:20:13.103332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2053/4102] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:14.124298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-de69a077-851d-41d7-9a30-39f2df673e67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:14.124943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-de69a077-851d-41d7-9a30-39f2df673e67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:14.132040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de69a077-851d-41d7-9a30-39f2df673e67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:14.132526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de69a077-851d-41d7-9a30-39f2df673e67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:14.132967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de69a077-851d-41d7-9a30-39f2df673e67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:14.133686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de69a077-851d-41d7-9a30-39f2df673e67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:14.134147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de69a077-851d-41d7-9a30-39f2df673e67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:14.134579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-de69a077-851d-41d7-9a30-39f2df673e67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:14.195109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-de69a077-851d-41d7-9a30-39f2df673e67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:14.203374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-de69a077-851d-41d7-9a30-39f2df673e67 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083001 Aug 18 22:20:14.203944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2050/4103] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:15.224771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2af45900-26c8-4af4-9b50-466092ff3eef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:15.225385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2af45900-26c8-4af4-9b50-466092ff3eef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:15.231564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2af45900-26c8-4af4-9b50-466092ff3eef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:15.232049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2af45900-26c8-4af4-9b50-466092ff3eef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:15.232488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2af45900-26c8-4af4-9b50-466092ff3eef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:15.233179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2af45900-26c8-4af4-9b50-466092ff3eef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:15.233662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2af45900-26c8-4af4-9b50-466092ff3eef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:15.234095 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2af45900-26c8-4af4-9b50-466092ff3eef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:15.296646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2af45900-26c8-4af4-9b50-466092ff3eef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:15.305844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2af45900-26c8-4af4-9b50-466092ff3eef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084864 Aug 18 22:20:15.306421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2054/4104] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:15 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:16.326691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-48eef6c9-faa1-44ee-b389-4bc833ab62a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:16.327300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-48eef6c9-faa1-44ee-b389-4bc833ab62a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:16.330217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=28 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:20:16.335649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48eef6c9-faa1-44ee-b389-4bc833ab62a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:16.336138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48eef6c9-faa1-44ee-b389-4bc833ab62a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:16.336579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48eef6c9-faa1-44ee-b389-4bc833ab62a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:16.337270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48eef6c9-faa1-44ee-b389-4bc833ab62a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:16.337760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48eef6c9-faa1-44ee-b389-4bc833ab62a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:16.338191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-48eef6c9-faa1-44ee-b389-4bc833ab62a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:16.397933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-48eef6c9-faa1-44ee-b389-4bc833ab62a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:16.406099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-48eef6c9-faa1-44ee-b389-4bc833ab62a7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083257 Aug 18 22:20:16.406670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2051/4105] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:17.427006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c1a64d25-16f3-47c0-b023-72a33f0a9866 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:17.427852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c1a64d25-16f3-47c0-b023-72a33f0a9866 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:17.434384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1a64d25-16f3-47c0-b023-72a33f0a9866 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:17.434870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1a64d25-16f3-47c0-b023-72a33f0a9866 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:17.435308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1a64d25-16f3-47c0-b023-72a33f0a9866 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:17.436003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1a64d25-16f3-47c0-b023-72a33f0a9866 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:17.436459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1a64d25-16f3-47c0-b023-72a33f0a9866 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:17.436885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c1a64d25-16f3-47c0-b023-72a33f0a9866 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:17.497142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c1a64d25-16f3-47c0-b023-72a33f0a9866 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:17.505271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c1a64d25-16f3-47c0-b023-72a33f0a9866 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082067 Aug 18 22:20:17.505884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2055/4106] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:17 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:18.526018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e3d5d60f-c913-49cc-8dda-5642d4fcc283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:18.526638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e3d5d60f-c913-49cc-8dda-5642d4fcc283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:18.533091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3d5d60f-c913-49cc-8dda-5642d4fcc283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:18.533584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3d5d60f-c913-49cc-8dda-5642d4fcc283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:18.534052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3d5d60f-c913-49cc-8dda-5642d4fcc283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:18.534749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3d5d60f-c913-49cc-8dda-5642d4fcc283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:18.535211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3d5d60f-c913-49cc-8dda-5642d4fcc283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:18.535643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e3d5d60f-c913-49cc-8dda-5642d4fcc283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:18.601804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e3d5d60f-c913-49cc-8dda-5642d4fcc283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:18.610556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e3d5d60f-c913-49cc-8dda-5642d4fcc283 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088412 Aug 18 22:20:18.611131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2052/4107] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:18 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:19.631947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d44d7a9e-d8d9-4973-9bd3-a4abbd87735f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:19.632855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d44d7a9e-d8d9-4973-9bd3-a4abbd87735f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:19.643089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d44d7a9e-d8d9-4973-9bd3-a4abbd87735f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:19.643708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d44d7a9e-d8d9-4973-9bd3-a4abbd87735f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:19.644479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d44d7a9e-d8d9-4973-9bd3-a4abbd87735f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:19.645719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d44d7a9e-d8d9-4973-9bd3-a4abbd87735f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:19.646514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d44d7a9e-d8d9-4973-9bd3-a4abbd87735f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:19.647268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d44d7a9e-d8d9-4973-9bd3-a4abbd87735f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:19.728200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d44d7a9e-d8d9-4973-9bd3-a4abbd87735f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:19.737353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d44d7a9e-d8d9-4973-9bd3-a4abbd87735f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.109961 Aug 18 22:20:19.738133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2056/4108] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:19 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:20.758865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ad03c81c-9d95-4d3f-b767-b0e4c533ca58 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:20.759513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ad03c81c-9d95-4d3f-b767-b0e4c533ca58 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:20.766709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad03c81c-9d95-4d3f-b767-b0e4c533ca58 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:20.767199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad03c81c-9d95-4d3f-b767-b0e4c533ca58 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:20.767642 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad03c81c-9d95-4d3f-b767-b0e4c533ca58 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:20.768350 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad03c81c-9d95-4d3f-b767-b0e4c533ca58 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:20.768809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad03c81c-9d95-4d3f-b767-b0e4c533ca58 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:20.769242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad03c81c-9d95-4d3f-b767-b0e4c533ca58 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:20.840548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ad03c81c-9d95-4d3f-b767-b0e4c533ca58 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:20.849498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ad03c81c-9d95-4d3f-b767-b0e4c533ca58 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.094484 Aug 18 22:20:20.850102 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2053/4109] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:20 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:21.872771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1594270f-3680-486a-a3f3-0cd5bfef4a10 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:21.873928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1594270f-3680-486a-a3f3-0cd5bfef4a10 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:21.885544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1594270f-3680-486a-a3f3-0cd5bfef4a10 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:21.886155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1594270f-3680-486a-a3f3-0cd5bfef4a10 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:21.887929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1594270f-3680-486a-a3f3-0cd5bfef4a10 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:21.888816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1594270f-3680-486a-a3f3-0cd5bfef4a10 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:21.889265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1594270f-3680-486a-a3f3-0cd5bfef4a10 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:21.889752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1594270f-3680-486a-a3f3-0cd5bfef4a10 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:21.958295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1594270f-3680-486a-a3f3-0cd5bfef4a10 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:21.971564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1594270f-3680-486a-a3f3-0cd5bfef4a10 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.104514 Aug 18 22:20:21.971959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2057/4110] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:22.749296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:20:22.749749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:20:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:20:22.992552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d3d55bcc-99ef-47a8-8ced-06c858c8f740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:22.993086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d3d55bcc-99ef-47a8-8ced-06c858c8f740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:22.999621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3d55bcc-99ef-47a8-8ced-06c858c8f740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:23.000149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3d55bcc-99ef-47a8-8ced-06c858c8f740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:23.000592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3d55bcc-99ef-47a8-8ced-06c858c8f740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:23.001281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3d55bcc-99ef-47a8-8ced-06c858c8f740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:23.001767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3d55bcc-99ef-47a8-8ced-06c858c8f740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:23.002194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d3d55bcc-99ef-47a8-8ced-06c858c8f740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:23.062329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d3d55bcc-99ef-47a8-8ced-06c858c8f740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:23.070465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d3d55bcc-99ef-47a8-8ced-06c858c8f740 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081790 Aug 18 22:20:23.071036 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2054/4111] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:24.091930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab464f4c-42b7-4d37-a90d-e0b10a4d73e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:24.092799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab464f4c-42b7-4d37-a90d-e0b10a4d73e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:24.099599 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab464f4c-42b7-4d37-a90d-e0b10a4d73e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:24.100087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab464f4c-42b7-4d37-a90d-e0b10a4d73e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:24.100523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab464f4c-42b7-4d37-a90d-e0b10a4d73e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:24.101209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab464f4c-42b7-4d37-a90d-e0b10a4d73e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:24.101698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab464f4c-42b7-4d37-a90d-e0b10a4d73e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:24.102123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab464f4c-42b7-4d37-a90d-e0b10a4d73e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:24.164789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ab464f4c-42b7-4d37-a90d-e0b10a4d73e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:24.173046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab464f4c-42b7-4d37-a90d-e0b10a4d73e2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084938 Aug 18 22:20:24.173638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2058/4112] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:25.194131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bb45aa40-caf7-4f0a-9b18-d98fd68bb032 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:25.194751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bb45aa40-caf7-4f0a-9b18-d98fd68bb032 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:25.201345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb45aa40-caf7-4f0a-9b18-d98fd68bb032 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:25.201889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb45aa40-caf7-4f0a-9b18-d98fd68bb032 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:25.202326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb45aa40-caf7-4f0a-9b18-d98fd68bb032 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:25.203013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb45aa40-caf7-4f0a-9b18-d98fd68bb032 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:25.203461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb45aa40-caf7-4f0a-9b18-d98fd68bb032 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:25.203882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bb45aa40-caf7-4f0a-9b18-d98fd68bb032 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:25.267112 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bb45aa40-caf7-4f0a-9b18-d98fd68bb032 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:25.275521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bb45aa40-caf7-4f0a-9b18-d98fd68bb032 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085333 Aug 18 22:20:25.276110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2055/4113] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:26.296542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1f5b7788-1063-42d3-a1d7-24b678b758ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:26.297161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1f5b7788-1063-42d3-a1d7-24b678b758ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:26.299580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=28 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:20:26.305294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f5b7788-1063-42d3-a1d7-24b678b758ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:26.305802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f5b7788-1063-42d3-a1d7-24b678b758ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:26.306241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f5b7788-1063-42d3-a1d7-24b678b758ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:26.306940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f5b7788-1063-42d3-a1d7-24b678b758ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:26.307397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f5b7788-1063-42d3-a1d7-24b678b758ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:26.307826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1f5b7788-1063-42d3-a1d7-24b678b758ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:26.369295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1f5b7788-1063-42d3-a1d7-24b678b758ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:26.377482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1f5b7788-1063-42d3-a1d7-24b678b758ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084819 Aug 18 22:20:26.378077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2059/4114] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:26 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:27.398021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-912624d2-ed7c-42fa-ab1a-d2c6c4444e5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:27.398653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-912624d2-ed7c-42fa-ab1a-d2c6c4444e5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:27.405029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-912624d2-ed7c-42fa-ab1a-d2c6c4444e5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:27.405507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-912624d2-ed7c-42fa-ab1a-d2c6c4444e5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:27.405981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-912624d2-ed7c-42fa-ab1a-d2c6c4444e5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:27.406714 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-912624d2-ed7c-42fa-ab1a-d2c6c4444e5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:27.407168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-912624d2-ed7c-42fa-ab1a-d2c6c4444e5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:27.407617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-912624d2-ed7c-42fa-ab1a-d2c6c4444e5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:27.468080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-912624d2-ed7c-42fa-ab1a-d2c6c4444e5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:27.476167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-912624d2-ed7c-42fa-ab1a-d2c6c4444e5e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081985 Aug 18 22:20:27.477525 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2056/4115] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:28.497210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7e16b519-b08f-4d33-bfd4-1be0aee15d30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:28.497887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7e16b519-b08f-4d33-bfd4-1be0aee15d30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:28.504293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e16b519-b08f-4d33-bfd4-1be0aee15d30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:28.504777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e16b519-b08f-4d33-bfd4-1be0aee15d30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:28.505216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e16b519-b08f-4d33-bfd4-1be0aee15d30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:28.505948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e16b519-b08f-4d33-bfd4-1be0aee15d30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:28.506402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e16b519-b08f-4d33-bfd4-1be0aee15d30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:28.506825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e16b519-b08f-4d33-bfd4-1be0aee15d30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:28.566450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7e16b519-b08f-4d33-bfd4-1be0aee15d30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:28.574513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7e16b519-b08f-4d33-bfd4-1be0aee15d30 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081109 Aug 18 22:20:28.575087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2060/4116] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:29.595909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-00173ab5-1654-41bb-a36e-32474610c4f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:29.596439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-00173ab5-1654-41bb-a36e-32474610c4f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:29.602737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00173ab5-1654-41bb-a36e-32474610c4f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:29.603224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00173ab5-1654-41bb-a36e-32474610c4f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:29.603666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00173ab5-1654-41bb-a36e-32474610c4f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:29.604418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00173ab5-1654-41bb-a36e-32474610c4f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:29.604898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00173ab5-1654-41bb-a36e-32474610c4f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:29.605334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-00173ab5-1654-41bb-a36e-32474610c4f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:29.665963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-00173ab5-1654-41bb-a36e-32474610c4f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:29.673989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-00173ab5-1654-41bb-a36e-32474610c4f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082080 Aug 18 22:20:29.674552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2057/4117] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:29 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:30.695187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8045b021-fb18-448b-8eed-678885000dda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:30.695805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8045b021-fb18-448b-8eed-678885000dda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:30.702396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8045b021-fb18-448b-8eed-678885000dda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:30.702882 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8045b021-fb18-448b-8eed-678885000dda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:30.703321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8045b021-fb18-448b-8eed-678885000dda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:30.704013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8045b021-fb18-448b-8eed-678885000dda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:30.704972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8045b021-fb18-448b-8eed-678885000dda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:30.705401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8045b021-fb18-448b-8eed-678885000dda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:30.765920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8045b021-fb18-448b-8eed-678885000dda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:30.774822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8045b021-fb18-448b-8eed-678885000dda tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083524 Aug 18 22:20:30.775401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2061/4118] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:31.805343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ee69be58-b82c-44fd-8f90-956c3af99036 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:31.806109 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ee69be58-b82c-44fd-8f90-956c3af99036 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:31.812605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee69be58-b82c-44fd-8f90-956c3af99036 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:31.813104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee69be58-b82c-44fd-8f90-956c3af99036 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:31.813629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee69be58-b82c-44fd-8f90-956c3af99036 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:31.814368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee69be58-b82c-44fd-8f90-956c3af99036 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:31.814843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee69be58-b82c-44fd-8f90-956c3af99036 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:31.815280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee69be58-b82c-44fd-8f90-956c3af99036 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:31.875647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ee69be58-b82c-44fd-8f90-956c3af99036 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:31.883713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ee69be58-b82c-44fd-8f90-956c3af99036 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082534 Aug 18 22:20:31.884287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2058/4119] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:32.904052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-725a7702-1e40-45d5-b7d8-b8edaf75f4d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:32.904660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-725a7702-1e40-45d5-b7d8-b8edaf75f4d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:32.911403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-725a7702-1e40-45d5-b7d8-b8edaf75f4d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:32.911883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-725a7702-1e40-45d5-b7d8-b8edaf75f4d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:32.912319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-725a7702-1e40-45d5-b7d8-b8edaf75f4d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:32.913038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-725a7702-1e40-45d5-b7d8-b8edaf75f4d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:32.913491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-725a7702-1e40-45d5-b7d8-b8edaf75f4d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:32.913969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-725a7702-1e40-45d5-b7d8-b8edaf75f4d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:32.976843 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-725a7702-1e40-45d5-b7d8-b8edaf75f4d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:32.984919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-725a7702-1e40-45d5-b7d8-b8edaf75f4d2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084726 Aug 18 22:20:32.986179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2062/4120] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:34.006727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-462734e0-3092-444d-9572-271555e1704b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:34.007457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-462734e0-3092-444d-9572-271555e1704b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:34.014305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-462734e0-3092-444d-9572-271555e1704b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:34.014852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-462734e0-3092-444d-9572-271555e1704b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:34.015268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-462734e0-3092-444d-9572-271555e1704b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:34.015962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-462734e0-3092-444d-9572-271555e1704b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:34.016414 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-462734e0-3092-444d-9572-271555e1704b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:34.016839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-462734e0-3092-444d-9572-271555e1704b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:34.082729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-462734e0-3092-444d-9572-271555e1704b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:34.090656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-462734e0-3092-444d-9572-271555e1704b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.087735 Aug 18 22:20:34.091231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2059/4121] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:35.111146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4dea1dde-169f-455a-b9da-f7499a7eab96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:35.111770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4dea1dde-169f-455a-b9da-f7499a7eab96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:35.118256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dea1dde-169f-455a-b9da-f7499a7eab96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:35.118841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dea1dde-169f-455a-b9da-f7499a7eab96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:35.119441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dea1dde-169f-455a-b9da-f7499a7eab96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:35.119860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dea1dde-169f-455a-b9da-f7499a7eab96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:35.120323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dea1dde-169f-455a-b9da-f7499a7eab96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:35.120753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4dea1dde-169f-455a-b9da-f7499a7eab96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:35.181766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4dea1dde-169f-455a-b9da-f7499a7eab96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:35.190043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4dea1dde-169f-455a-b9da-f7499a7eab96 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082802 Aug 18 22:20:35.190615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2063/4122] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:35 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:36.211412 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6e45ed1f-6429-4df4-b658-ec52ae524fd2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:36.212020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6e45ed1f-6429-4df4-b658-ec52ae524fd2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:36.218373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e45ed1f-6429-4df4-b658-ec52ae524fd2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:36.218853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e45ed1f-6429-4df4-b658-ec52ae524fd2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:36.219283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e45ed1f-6429-4df4-b658-ec52ae524fd2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:36.219963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e45ed1f-6429-4df4-b658-ec52ae524fd2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:36.220417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e45ed1f-6429-4df4-b658-ec52ae524fd2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:36.221748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e45ed1f-6429-4df4-b658-ec52ae524fd2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:36.282783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6e45ed1f-6429-4df4-b658-ec52ae524fd2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:36.291676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6e45ed1f-6429-4df4-b658-ec52ae524fd2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084085 Aug 18 22:20:36.292239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2060/4123] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:37.313721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bc3ec32e-3e40-4296-b03d-6e678f581ab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:37.314929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bc3ec32e-3e40-4296-b03d-6e678f581ab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:37.321435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc3ec32e-3e40-4296-b03d-6e678f581ab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:37.321947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc3ec32e-3e40-4296-b03d-6e678f581ab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:37.322384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc3ec32e-3e40-4296-b03d-6e678f581ab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:37.323076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc3ec32e-3e40-4296-b03d-6e678f581ab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:37.323534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc3ec32e-3e40-4296-b03d-6e678f581ab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:37.323959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc3ec32e-3e40-4296-b03d-6e678f581ab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:37.482909 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bc3ec32e-3e40-4296-b03d-6e678f581ab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:37.491760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bc3ec32e-3e40-4296-b03d-6e678f581ab5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.181902 Aug 18 22:20:37.492327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2064/4124] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:37 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:38.512991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-272d7900-3c76-4a0f-b57a-8993b07da433 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:38.513627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-272d7900-3c76-4a0f-b57a-8993b07da433 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:38.520693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-272d7900-3c76-4a0f-b57a-8993b07da433 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:38.521180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-272d7900-3c76-4a0f-b57a-8993b07da433 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:38.521680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-272d7900-3c76-4a0f-b57a-8993b07da433 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:38.522355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-272d7900-3c76-4a0f-b57a-8993b07da433 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:38.522811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-272d7900-3c76-4a0f-b57a-8993b07da433 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:38.523238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-272d7900-3c76-4a0f-b57a-8993b07da433 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:38.671169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-272d7900-3c76-4a0f-b57a-8993b07da433 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:38.679685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-272d7900-3c76-4a0f-b57a-8993b07da433 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.170335 Aug 18 22:20:38.680263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2061/4125] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:38 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:39.701117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-40dbec18-8622-4b3e-98f0-64260bd451fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:39.701688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-40dbec18-8622-4b3e-98f0-64260bd451fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:39.708155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40dbec18-8622-4b3e-98f0-64260bd451fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:39.708640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40dbec18-8622-4b3e-98f0-64260bd451fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:39.709086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40dbec18-8622-4b3e-98f0-64260bd451fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:39.709819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40dbec18-8622-4b3e-98f0-64260bd451fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:39.710277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40dbec18-8622-4b3e-98f0-64260bd451fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:39.710704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-40dbec18-8622-4b3e-98f0-64260bd451fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:39.713229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=84 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:20:39.772636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-40dbec18-8622-4b3e-98f0-64260bd451fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:39.780712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-40dbec18-8622-4b3e-98f0-64260bd451fd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083524 Aug 18 22:20:39.781277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2065/4126] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:39 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:40.801242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a7b5fd22-3a2e-4e13-847b-730352af17e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:40.801903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a7b5fd22-3a2e-4e13-847b-730352af17e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:40.808535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7b5fd22-3a2e-4e13-847b-730352af17e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:40.809011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7b5fd22-3a2e-4e13-847b-730352af17e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:40.809445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7b5fd22-3a2e-4e13-847b-730352af17e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:40.810164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7b5fd22-3a2e-4e13-847b-730352af17e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:40.810614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7b5fd22-3a2e-4e13-847b-730352af17e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:40.811035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a7b5fd22-3a2e-4e13-847b-730352af17e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:40.872004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a7b5fd22-3a2e-4e13-847b-730352af17e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:40.880542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a7b5fd22-3a2e-4e13-847b-730352af17e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083223 Aug 18 22:20:40.881106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2062/4127] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:40 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:41.901618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c76ec855-1299-4b8f-86c6-65083f2cd0a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:41.902233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c76ec855-1299-4b8f-86c6-65083f2cd0a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:41.909191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c76ec855-1299-4b8f-86c6-65083f2cd0a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:41.909697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c76ec855-1299-4b8f-86c6-65083f2cd0a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:41.910127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c76ec855-1299-4b8f-86c6-65083f2cd0a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:41.910803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c76ec855-1299-4b8f-86c6-65083f2cd0a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:41.911251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c76ec855-1299-4b8f-86c6-65083f2cd0a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:41.911666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c76ec855-1299-4b8f-86c6-65083f2cd0a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:41.975540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c76ec855-1299-4b8f-86c6-65083f2cd0a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:41.983577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c76ec855-1299-4b8f-86c6-65083f2cd0a1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085818 Aug 18 22:20:41.984138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2066/4128] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:41 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:43.003562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fdd0aeb7-bf25-4ea9-8667-3d774c9a0233 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:43.004103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fdd0aeb7-bf25-4ea9-8667-3d774c9a0233 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:43.010572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdd0aeb7-bf25-4ea9-8667-3d774c9a0233 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:43.011063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdd0aeb7-bf25-4ea9-8667-3d774c9a0233 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:43.011506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdd0aeb7-bf25-4ea9-8667-3d774c9a0233 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:43.012251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdd0aeb7-bf25-4ea9-8667-3d774c9a0233 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:43.012696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdd0aeb7-bf25-4ea9-8667-3d774c9a0233 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:43.013127 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fdd0aeb7-bf25-4ea9-8667-3d774c9a0233 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:43.015669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=84 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:20:43.076727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fdd0aeb7-bf25-4ea9-8667-3d774c9a0233 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:43.084939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fdd0aeb7-bf25-4ea9-8667-3d774c9a0233 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085315 Aug 18 22:20:43.085507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2063/4129] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:44.105440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-57bdb3a5-66df-4e2b-923f-2e06306d63f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:44.106084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-57bdb3a5-66df-4e2b-923f-2e06306d63f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:44.112978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-57bdb3a5-66df-4e2b-923f-2e06306d63f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:44.113461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-57bdb3a5-66df-4e2b-923f-2e06306d63f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:44.113926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-57bdb3a5-66df-4e2b-923f-2e06306d63f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:44.114709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-57bdb3a5-66df-4e2b-923f-2e06306d63f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:44.115076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-57bdb3a5-66df-4e2b-923f-2e06306d63f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:44.115542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-57bdb3a5-66df-4e2b-923f-2e06306d63f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:44.180382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-57bdb3a5-66df-4e2b-923f-2e06306d63f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:44.188533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-57bdb3a5-66df-4e2b-923f-2e06306d63f5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086916 Aug 18 22:20:44.189097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2067/4130] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:44 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:45.210555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-91d4c257-fd0b-480c-99ac-79415a4c2176 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:45.211173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-91d4c257-fd0b-480c-99ac-79415a4c2176 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:45.217819 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91d4c257-fd0b-480c-99ac-79415a4c2176 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:45.218310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91d4c257-fd0b-480c-99ac-79415a4c2176 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:45.218751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91d4c257-fd0b-480c-99ac-79415a4c2176 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:45.219446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91d4c257-fd0b-480c-99ac-79415a4c2176 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:45.219907 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91d4c257-fd0b-480c-99ac-79415a4c2176 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:45.220342 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-91d4c257-fd0b-480c-99ac-79415a4c2176 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:45.281448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-91d4c257-fd0b-480c-99ac-79415a4c2176 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:45.289425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-91d4c257-fd0b-480c-99ac-79415a4c2176 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082698 Aug 18 22:20:45.290028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2064/4131] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:46.310502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf7928bc-de29-4be8-8947-355e55929dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:46.311127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf7928bc-de29-4be8-8947-355e55929dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:46.317227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf7928bc-de29-4be8-8947-355e55929dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:46.317748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf7928bc-de29-4be8-8947-355e55929dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:46.318187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf7928bc-de29-4be8-8947-355e55929dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:46.318881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf7928bc-de29-4be8-8947-355e55929dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:46.319340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf7928bc-de29-4be8-8947-355e55929dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:46.319770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf7928bc-de29-4be8-8947-355e55929dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:46.378617 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bf7928bc-de29-4be8-8947-355e55929dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:46.386772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf7928bc-de29-4be8-8947-355e55929dae tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.080141 Aug 18 22:20:46.387350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2068/4132] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:46 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:47.408555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-952e73e9-e9be-414b-b2e3-d3f45cddd912 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:47.409178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-952e73e9-e9be-414b-b2e3-d3f45cddd912 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:47.411499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=28 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:20:47.416698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-952e73e9-e9be-414b-b2e3-d3f45cddd912 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:47.417192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-952e73e9-e9be-414b-b2e3-d3f45cddd912 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:47.417726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-952e73e9-e9be-414b-b2e3-d3f45cddd912 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:47.418426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-952e73e9-e9be-414b-b2e3-d3f45cddd912 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:47.418887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-952e73e9-e9be-414b-b2e3-d3f45cddd912 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:47.419320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-952e73e9-e9be-414b-b2e3-d3f45cddd912 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:47.479621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-952e73e9-e9be-414b-b2e3-d3f45cddd912 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:47.488416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-952e73e9-e9be-414b-b2e3-d3f45cddd912 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084242 Aug 18 22:20:47.489101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2065/4133] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:47 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:48.513181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e3f1a175-f4cc-4e97-a6c6-1f003d0fcd16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:48.513846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e3f1a175-f4cc-4e97-a6c6-1f003d0fcd16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:48.520858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3f1a175-f4cc-4e97-a6c6-1f003d0fcd16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:48.521340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3f1a175-f4cc-4e97-a6c6-1f003d0fcd16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:48.521817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3f1a175-f4cc-4e97-a6c6-1f003d0fcd16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:48.522537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3f1a175-f4cc-4e97-a6c6-1f003d0fcd16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:48.522990 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3f1a175-f4cc-4e97-a6c6-1f003d0fcd16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:48.523415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3f1a175-f4cc-4e97-a6c6-1f003d0fcd16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:48.587074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e3f1a175-f4cc-4e97-a6c6-1f003d0fcd16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:48.595218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e3f1a175-f4cc-4e97-a6c6-1f003d0fcd16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085869 Aug 18 22:20:48.595947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2069/4134] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:48 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:49.617181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5d8fc435-d4c1-475e-adb5-6642e5f0d434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:49.617800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5d8fc435-d4c1-475e-adb5-6642e5f0d434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:49.624308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d8fc435-d4c1-475e-adb5-6642e5f0d434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:49.624804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d8fc435-d4c1-475e-adb5-6642e5f0d434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:49.625250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d8fc435-d4c1-475e-adb5-6642e5f0d434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:49.625998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d8fc435-d4c1-475e-adb5-6642e5f0d434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:49.627367 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d8fc435-d4c1-475e-adb5-6642e5f0d434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:49.627829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d8fc435-d4c1-475e-adb5-6642e5f0d434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:49.690805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5d8fc435-d4c1-475e-adb5-6642e5f0d434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:49.700146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5d8fc435-d4c1-475e-adb5-6642e5f0d434 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086958 Aug 18 22:20:49.700722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2066/4135] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:49 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:50.721488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f3edf82-5e83-4a8f-9737-d59a6e79ba12 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:50.722129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f3edf82-5e83-4a8f-9737-d59a6e79ba12 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:50.728750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f3edf82-5e83-4a8f-9737-d59a6e79ba12 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:50.729231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f3edf82-5e83-4a8f-9737-d59a6e79ba12 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:50.729690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f3edf82-5e83-4a8f-9737-d59a6e79ba12 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:50.730796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f3edf82-5e83-4a8f-9737-d59a6e79ba12 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:50.730913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f3edf82-5e83-4a8f-9737-d59a6e79ba12 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:50.731289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f3edf82-5e83-4a8f-9737-d59a6e79ba12 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:50.794457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4f3edf82-5e83-4a8f-9737-d59a6e79ba12 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:50.803288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f3edf82-5e83-4a8f-9737-d59a6e79ba12 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085613 Aug 18 22:20:50.803857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2070/4136] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:50 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:51.824889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0e4b603b-83ac-400b-a4be-7d1f3dcb3cfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:51.825502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0e4b603b-83ac-400b-a4be-7d1f3dcb3cfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:51.832529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e4b603b-83ac-400b-a4be-7d1f3dcb3cfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:51.833007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e4b603b-83ac-400b-a4be-7d1f3dcb3cfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:51.833442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e4b603b-83ac-400b-a4be-7d1f3dcb3cfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:51.834160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e4b603b-83ac-400b-a4be-7d1f3dcb3cfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:51.834612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e4b603b-83ac-400b-a4be-7d1f3dcb3cfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:51.835033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0e4b603b-83ac-400b-a4be-7d1f3dcb3cfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:51.897766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0e4b603b-83ac-400b-a4be-7d1f3dcb3cfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:51.905912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0e4b603b-83ac-400b-a4be-7d1f3dcb3cfb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084816 Aug 18 22:20:51.906474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2067/4137] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:51 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:52.927859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-18756cea-b5e9-46d8-abf0-f2817010e4f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:52.928467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-18756cea-b5e9-46d8-abf0-f2817010e4f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:52.935282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18756cea-b5e9-46d8-abf0-f2817010e4f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:52.935756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18756cea-b5e9-46d8-abf0-f2817010e4f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:52.936187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18756cea-b5e9-46d8-abf0-f2817010e4f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:52.936863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18756cea-b5e9-46d8-abf0-f2817010e4f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:52.937312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18756cea-b5e9-46d8-abf0-f2817010e4f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:52.937763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-18756cea-b5e9-46d8-abf0-f2817010e4f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:52.997492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-18756cea-b5e9-46d8-abf0-f2817010e4f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:53.005491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-18756cea-b5e9-46d8-abf0-f2817010e4f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082040 Aug 18 22:20:53.006079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2071/4138] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:52 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:54.027089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-929df3c5-a107-4b4d-b8e7-b7936f9864d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:54.027700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-929df3c5-a107-4b4d-b8e7-b7936f9864d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:54.034779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-929df3c5-a107-4b4d-b8e7-b7936f9864d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:54.035256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-929df3c5-a107-4b4d-b8e7-b7936f9864d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:54.035687 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-929df3c5-a107-4b4d-b8e7-b7936f9864d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:54.036364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-929df3c5-a107-4b4d-b8e7-b7936f9864d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:54.036842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-929df3c5-a107-4b4d-b8e7-b7936f9864d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:54.037241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-929df3c5-a107-4b4d-b8e7-b7936f9864d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:54.097125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-929df3c5-a107-4b4d-b8e7-b7936f9864d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:54.105195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-929df3c5-a107-4b4d-b8e7-b7936f9864d3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082230 Aug 18 22:20:54.105779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2068/4139] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:54 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:55.125829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cf90fe3c-77cc-43f9-a29e-bd389821fa17 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:55.126460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cf90fe3c-77cc-43f9-a29e-bd389821fa17 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:55.132854 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf90fe3c-77cc-43f9-a29e-bd389821fa17 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:55.133325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf90fe3c-77cc-43f9-a29e-bd389821fa17 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:55.133785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf90fe3c-77cc-43f9-a29e-bd389821fa17 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:55.134470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf90fe3c-77cc-43f9-a29e-bd389821fa17 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:55.134918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf90fe3c-77cc-43f9-a29e-bd389821fa17 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:55.135335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cf90fe3c-77cc-43f9-a29e-bd389821fa17 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:55.195211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cf90fe3c-77cc-43f9-a29e-bd389821fa17 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:55.203260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cf90fe3c-77cc-43f9-a29e-bd389821fa17 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081413 Aug 18 22:20:55.203822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2072/4140] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:55 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:56.223856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-72ab2270-2a93-4e49-a9b1-9022d05ff142 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:56.224461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-72ab2270-2a93-4e49-a9b1-9022d05ff142 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:56.230978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72ab2270-2a93-4e49-a9b1-9022d05ff142 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:56.231463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72ab2270-2a93-4e49-a9b1-9022d05ff142 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:56.231893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72ab2270-2a93-4e49-a9b1-9022d05ff142 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:56.232571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72ab2270-2a93-4e49-a9b1-9022d05ff142 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:56.233018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72ab2270-2a93-4e49-a9b1-9022d05ff142 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:56.233439 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-72ab2270-2a93-4e49-a9b1-9022d05ff142 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:56.292770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-72ab2270-2a93-4e49-a9b1-9022d05ff142 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:56.301339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-72ab2270-2a93-4e49-a9b1-9022d05ff142 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081384 Aug 18 22:20:56.301941 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2069/4141] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:56 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:57.323102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ec9e566c-4c92-4beb-9fa7-8cae1639e0b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:57.323720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ec9e566c-4c92-4beb-9fa7-8cae1639e0b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:57.326037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=28 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:20:57.332090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec9e566c-4c92-4beb-9fa7-8cae1639e0b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:57.332576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec9e566c-4c92-4beb-9fa7-8cae1639e0b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:57.333020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec9e566c-4c92-4beb-9fa7-8cae1639e0b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:57.333743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec9e566c-4c92-4beb-9fa7-8cae1639e0b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:57.334204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec9e566c-4c92-4beb-9fa7-8cae1639e0b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:57.334637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ec9e566c-4c92-4beb-9fa7-8cae1639e0b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:57.396484 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ec9e566c-4c92-4beb-9fa7-8cae1639e0b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:57.404584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ec9e566c-4c92-4beb-9fa7-8cae1639e0b5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085389 Aug 18 22:20:57.405161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2073/4142] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:57 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:58.425693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c45eee42-cdaa-492b-8a37-13a43186f5f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:58.426330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c45eee42-cdaa-492b-8a37-13a43186f5f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:58.432549 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c45eee42-cdaa-492b-8a37-13a43186f5f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:58.433033 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c45eee42-cdaa-492b-8a37-13a43186f5f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:58.433472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c45eee42-cdaa-492b-8a37-13a43186f5f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:58.434186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c45eee42-cdaa-492b-8a37-13a43186f5f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:58.434643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c45eee42-cdaa-492b-8a37-13a43186f5f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:58.435069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c45eee42-cdaa-492b-8a37-13a43186f5f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:58.494559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c45eee42-cdaa-492b-8a37-13a43186f5f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:58.503179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c45eee42-cdaa-492b-8a37-13a43186f5f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082034 Aug 18 22:20:58.503750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2070/4143] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:58 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:20:59.524254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f9c394cc-833d-40f0-9dbf-f63297ee2b11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:20:59.525099 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f9c394cc-833d-40f0-9dbf-f63297ee2b11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:20:59.531351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9c394cc-833d-40f0-9dbf-f63297ee2b11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:59.531823 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9c394cc-833d-40f0-9dbf-f63297ee2b11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:59.532251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9c394cc-833d-40f0-9dbf-f63297ee2b11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:59.533199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9c394cc-833d-40f0-9dbf-f63297ee2b11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:20:59.533675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9c394cc-833d-40f0-9dbf-f63297ee2b11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:20:59.534098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f9c394cc-833d-40f0-9dbf-f63297ee2b11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:20:59.597708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f9c394cc-833d-40f0-9dbf-f63297ee2b11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:20:59.606030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f9c394cc-833d-40f0-9dbf-f63297ee2b11 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085591 Aug 18 22:20:59.606600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2074/4144] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:20:59 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:00.626752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-27e6346a-0e0b-44f5-8e5a-db0371d9ebd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:00.627368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-27e6346a-0e0b-44f5-8e5a-db0371d9ebd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:00.633795 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27e6346a-0e0b-44f5-8e5a-db0371d9ebd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:00.634298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27e6346a-0e0b-44f5-8e5a-db0371d9ebd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:00.634719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27e6346a-0e0b-44f5-8e5a-db0371d9ebd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:00.635409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27e6346a-0e0b-44f5-8e5a-db0371d9ebd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:00.635863 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27e6346a-0e0b-44f5-8e5a-db0371d9ebd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:00.636289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-27e6346a-0e0b-44f5-8e5a-db0371d9ebd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:00.699741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-27e6346a-0e0b-44f5-8e5a-db0371d9ebd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:00.708521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-27e6346a-0e0b-44f5-8e5a-db0371d9ebd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085572 Aug 18 22:21:00.709089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2071/4145] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:00 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:01.729798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-620c571b-1bcd-4386-abab-532f50e3a0ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:01.730442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-620c571b-1bcd-4386-abab-532f50e3a0ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:01.737863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-620c571b-1bcd-4386-abab-532f50e3a0ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:01.738357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-620c571b-1bcd-4386-abab-532f50e3a0ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:01.738797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-620c571b-1bcd-4386-abab-532f50e3a0ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:01.739498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-620c571b-1bcd-4386-abab-532f50e3a0ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:01.739950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-620c571b-1bcd-4386-abab-532f50e3a0ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:01.740378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-620c571b-1bcd-4386-abab-532f50e3a0ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:01.800317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-620c571b-1bcd-4386-abab-532f50e3a0ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:01.808694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-620c571b-1bcd-4386-abab-532f50e3a0ad tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082775 Aug 18 22:21:01.809265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2075/4146] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:01 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:02.829501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7bcac7e1-b9da-4de7-b9d4-1fd5ffb5ede8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:02.830129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7bcac7e1-b9da-4de7-b9d4-1fd5ffb5ede8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:02.836599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7bcac7e1-b9da-4de7-b9d4-1fd5ffb5ede8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:02.837081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7bcac7e1-b9da-4de7-b9d4-1fd5ffb5ede8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:02.837519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7bcac7e1-b9da-4de7-b9d4-1fd5ffb5ede8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:02.838233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7bcac7e1-b9da-4de7-b9d4-1fd5ffb5ede8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:02.838691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7bcac7e1-b9da-4de7-b9d4-1fd5ffb5ede8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:02.839118 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7bcac7e1-b9da-4de7-b9d4-1fd5ffb5ede8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:02.904052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7bcac7e1-b9da-4de7-b9d4-1fd5ffb5ede8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:02.912287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7bcac7e1-b9da-4de7-b9d4-1fd5ffb5ede8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086725 Aug 18 22:21:02.912849 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2072/4147] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:03.933915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ed0b8f33-96ef-4b9b-8418-95bcb92c794f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:03.934567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ed0b8f33-96ef-4b9b-8418-95bcb92c794f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:03.941472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed0b8f33-96ef-4b9b-8418-95bcb92c794f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:03.941978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed0b8f33-96ef-4b9b-8418-95bcb92c794f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:03.942505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed0b8f33-96ef-4b9b-8418-95bcb92c794f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:03.943314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed0b8f33-96ef-4b9b-8418-95bcb92c794f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:03.943881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed0b8f33-96ef-4b9b-8418-95bcb92c794f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:03.944470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ed0b8f33-96ef-4b9b-8418-95bcb92c794f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:04.005693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ed0b8f33-96ef-4b9b-8418-95bcb92c794f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:04.013789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ed0b8f33-96ef-4b9b-8418-95bcb92c794f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084176 Aug 18 22:21:04.014353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2076/4148] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:05.035830 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-513c3713-0706-43ff-aa6b-f527f2b94f54 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:05.036442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-513c3713-0706-43ff-aa6b-f527f2b94f54 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:05.043063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-513c3713-0706-43ff-aa6b-f527f2b94f54 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:05.043646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-513c3713-0706-43ff-aa6b-f527f2b94f54 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:05.044089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-513c3713-0706-43ff-aa6b-f527f2b94f54 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:05.044783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-513c3713-0706-43ff-aa6b-f527f2b94f54 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:05.045239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-513c3713-0706-43ff-aa6b-f527f2b94f54 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:05.045693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-513c3713-0706-43ff-aa6b-f527f2b94f54 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:05.108188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-513c3713-0706-43ff-aa6b-f527f2b94f54 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:05.116832 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-513c3713-0706-43ff-aa6b-f527f2b94f54 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085472 Aug 18 22:21:05.117589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2073/4149] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:06.137788 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5ea6d459-178a-492c-be48-bf3551a8b01a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:06.138397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5ea6d459-178a-492c-be48-bf3551a8b01a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:06.145192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ea6d459-178a-492c-be48-bf3551a8b01a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:06.145731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ea6d459-178a-492c-be48-bf3551a8b01a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:06.146252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ea6d459-178a-492c-be48-bf3551a8b01a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:06.146935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ea6d459-178a-492c-be48-bf3551a8b01a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:06.147384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ea6d459-178a-492c-be48-bf3551a8b01a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:06.147799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5ea6d459-178a-492c-be48-bf3551a8b01a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:06.208358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5ea6d459-178a-492c-be48-bf3551a8b01a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:06.216302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5ea6d459-178a-492c-be48-bf3551a8b01a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082410 Aug 18 22:21:06.216862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2077/4150] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:07.237651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-983ab992-c871-41e2-b282-fd0c916c0f5d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:07.238269 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-983ab992-c871-41e2-b282-fd0c916c0f5d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:07.244743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-983ab992-c871-41e2-b282-fd0c916c0f5d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:07.245229 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-983ab992-c871-41e2-b282-fd0c916c0f5d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:07.245698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-983ab992-c871-41e2-b282-fd0c916c0f5d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:07.246382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-983ab992-c871-41e2-b282-fd0c916c0f5d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:07.246842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-983ab992-c871-41e2-b282-fd0c916c0f5d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:07.247267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-983ab992-c871-41e2-b282-fd0c916c0f5d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:07.307442 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-983ab992-c871-41e2-b282-fd0c916c0f5d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:07.315531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-983ab992-c871-41e2-b282-fd0c916c0f5d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082324 Aug 18 22:21:07.316106 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2074/4151] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:07 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:08.336457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f4f1c4f8-4fc6-4b28-8dab-e279cbcabedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:08.337070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f4f1c4f8-4fc6-4b28-8dab-e279cbcabedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:08.343466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4f1c4f8-4fc6-4b28-8dab-e279cbcabedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:08.343950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4f1c4f8-4fc6-4b28-8dab-e279cbcabedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:08.344388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4f1c4f8-4fc6-4b28-8dab-e279cbcabedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:08.345086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4f1c4f8-4fc6-4b28-8dab-e279cbcabedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:08.345542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4f1c4f8-4fc6-4b28-8dab-e279cbcabedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:08.345992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f4f1c4f8-4fc6-4b28-8dab-e279cbcabedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:08.410133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f4f1c4f8-4fc6-4b28-8dab-e279cbcabedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:08.418280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f4f1c4f8-4fc6-4b28-8dab-e279cbcabedb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085714 Aug 18 22:21:08.418867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2078/4152] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:09.440416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d466c1c1-2826-49c4-8dd2-878e668c37d7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:09.441034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d466c1c1-2826-49c4-8dd2-878e668c37d7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:09.447503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d466c1c1-2826-49c4-8dd2-878e668c37d7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:09.447994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d466c1c1-2826-49c4-8dd2-878e668c37d7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:09.448436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d466c1c1-2826-49c4-8dd2-878e668c37d7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:09.449126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d466c1c1-2826-49c4-8dd2-878e668c37d7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:09.449587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d466c1c1-2826-49c4-8dd2-878e668c37d7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:09.450044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d466c1c1-2826-49c4-8dd2-878e668c37d7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:09.514293 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d466c1c1-2826-49c4-8dd2-878e668c37d7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:09.522956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d466c1c1-2826-49c4-8dd2-878e668c37d7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086893 Aug 18 22:21:09.523527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2075/4153] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:10.544181 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5cb53be9-f3a4-40ee-a723-0dbc05ee9fe9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:10.544792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5cb53be9-f3a4-40ee-a723-0dbc05ee9fe9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:10.551340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cb53be9-f3a4-40ee-a723-0dbc05ee9fe9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:10.551828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cb53be9-f3a4-40ee-a723-0dbc05ee9fe9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:10.552287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cb53be9-f3a4-40ee-a723-0dbc05ee9fe9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:10.552982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cb53be9-f3a4-40ee-a723-0dbc05ee9fe9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:10.553442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cb53be9-f3a4-40ee-a723-0dbc05ee9fe9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:10.553898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5cb53be9-f3a4-40ee-a723-0dbc05ee9fe9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:10.556664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=84 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:21:10.616609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5cb53be9-f3a4-40ee-a723-0dbc05ee9fe9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:10.624681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5cb53be9-f3a4-40ee-a723-0dbc05ee9fe9 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084376 Aug 18 22:21:10.625253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2079/4154] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:10 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:11.645623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c35d3188-8689-4d39-bdc0-397bde9849c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:11.646308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c35d3188-8689-4d39-bdc0-397bde9849c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:11.652522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c35d3188-8689-4d39-bdc0-397bde9849c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:11.652997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c35d3188-8689-4d39-bdc0-397bde9849c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:11.653429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c35d3188-8689-4d39-bdc0-397bde9849c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:11.654139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c35d3188-8689-4d39-bdc0-397bde9849c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:11.654588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c35d3188-8689-4d39-bdc0-397bde9849c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:11.655010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c35d3188-8689-4d39-bdc0-397bde9849c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:11.714661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c35d3188-8689-4d39-bdc0-397bde9849c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:11.723344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c35d3188-8689-4d39-bdc0-397bde9849c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081679 Aug 18 22:21:11.724006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2076/4155] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:12.744564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-915be0a6-506a-4ab0-ab3a-cee67b1fd555 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:12.745211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-915be0a6-506a-4ab0-ab3a-cee67b1fd555 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:12.752213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-915be0a6-506a-4ab0-ab3a-cee67b1fd555 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:12.752709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-915be0a6-506a-4ab0-ab3a-cee67b1fd555 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:12.753142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-915be0a6-506a-4ab0-ab3a-cee67b1fd555 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:12.753858 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-915be0a6-506a-4ab0-ab3a-cee67b1fd555 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:12.754317 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-915be0a6-506a-4ab0-ab3a-cee67b1fd555 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:12.754746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-915be0a6-506a-4ab0-ab3a-cee67b1fd555 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:12.813354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-915be0a6-506a-4ab0-ab3a-cee67b1fd555 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:12.822135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-915be0a6-506a-4ab0-ab3a-cee67b1fd555 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081732 Aug 18 22:21:12.822701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2080/4156] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:12 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:13.842580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8c03b5a9-b9c9-4ce3-a49f-b183af9e4f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:13.843191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8c03b5a9-b9c9-4ce3-a49f-b183af9e4f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:13.849846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c03b5a9-b9c9-4ce3-a49f-b183af9e4f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:13.850333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c03b5a9-b9c9-4ce3-a49f-b183af9e4f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:13.850771 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c03b5a9-b9c9-4ce3-a49f-b183af9e4f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:13.851466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c03b5a9-b9c9-4ce3-a49f-b183af9e4f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:13.851923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c03b5a9-b9c9-4ce3-a49f-b183af9e4f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:13.852351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8c03b5a9-b9c9-4ce3-a49f-b183af9e4f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:13.854985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=84 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:21:13.913905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8c03b5a9-b9c9-4ce3-a49f-b183af9e4f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:13.921995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8c03b5a9-b9c9-4ce3-a49f-b183af9e4f9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083274 Aug 18 22:21:13.922665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2077/4157] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:14.942675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2931e52b-fdd0-4415-b208-dc6a2056dba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:14.943321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2931e52b-fdd0-4415-b208-dc6a2056dba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:14.949703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2931e52b-fdd0-4415-b208-dc6a2056dba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:14.950194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2931e52b-fdd0-4415-b208-dc6a2056dba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:14.950629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2931e52b-fdd0-4415-b208-dc6a2056dba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:14.951315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2931e52b-fdd0-4415-b208-dc6a2056dba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:14.951766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2931e52b-fdd0-4415-b208-dc6a2056dba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:14.952188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2931e52b-fdd0-4415-b208-dc6a2056dba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:15.020782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2931e52b-fdd0-4415-b208-dc6a2056dba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:15.028872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2931e52b-fdd0-4415-b208-dc6a2056dba7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.090023 Aug 18 22:21:15.029448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2081/4158] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:16.050602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-795d0e2f-bb84-4555-bfad-20e3f19fae81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:16.051334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-795d0e2f-bb84-4555-bfad-20e3f19fae81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:16.058323 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-795d0e2f-bb84-4555-bfad-20e3f19fae81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:16.058808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-795d0e2f-bb84-4555-bfad-20e3f19fae81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:16.059271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-795d0e2f-bb84-4555-bfad-20e3f19fae81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:16.059957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-795d0e2f-bb84-4555-bfad-20e3f19fae81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:16.060431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-795d0e2f-bb84-4555-bfad-20e3f19fae81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:16.060853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-795d0e2f-bb84-4555-bfad-20e3f19fae81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:16.120055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-795d0e2f-bb84-4555-bfad-20e3f19fae81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:16.128731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-795d0e2f-bb84-4555-bfad-20e3f19fae81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081679 Aug 18 22:21:16.129296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2078/4159] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:17.150111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-afe22597-16ed-42ca-9db4-d6747f170a8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:17.150712 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-afe22597-16ed-42ca-9db4-d6747f170a8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:17.156980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-afe22597-16ed-42ca-9db4-d6747f170a8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:17.157474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-afe22597-16ed-42ca-9db4-d6747f170a8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:17.157952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-afe22597-16ed-42ca-9db4-d6747f170a8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:17.158679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-afe22597-16ed-42ca-9db4-d6747f170a8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:17.159784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-afe22597-16ed-42ca-9db4-d6747f170a8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:17.160253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-afe22597-16ed-42ca-9db4-d6747f170a8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:17.224257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-afe22597-16ed-42ca-9db4-d6747f170a8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:17.232516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-afe22597-16ed-42ca-9db4-d6747f170a8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086338 Aug 18 22:21:17.233094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2082/4160] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:17 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:18.254152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a4618981-6682-4dc3-93c3-1dcbe2330138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:18.255499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a4618981-6682-4dc3-93c3-1dcbe2330138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:18.258409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=28 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:21:18.263991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4618981-6682-4dc3-93c3-1dcbe2330138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:18.264480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4618981-6682-4dc3-93c3-1dcbe2330138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:18.264923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4618981-6682-4dc3-93c3-1dcbe2330138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:18.265629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4618981-6682-4dc3-93c3-1dcbe2330138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:18.266091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4618981-6682-4dc3-93c3-1dcbe2330138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:18.266516 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a4618981-6682-4dc3-93c3-1dcbe2330138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:18.330319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a4618981-6682-4dc3-93c3-1dcbe2330138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:18.338532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a4618981-6682-4dc3-93c3-1dcbe2330138 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088223 Aug 18 22:21:18.339099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2079/4161] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:18 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:19.360634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ff3a9651-a36d-4a78-9d78-2befbd66d234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:19.361378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ff3a9651-a36d-4a78-9d78-2befbd66d234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:19.368838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff3a9651-a36d-4a78-9d78-2befbd66d234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:19.369324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff3a9651-a36d-4a78-9d78-2befbd66d234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:19.369791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff3a9651-a36d-4a78-9d78-2befbd66d234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:19.370494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff3a9651-a36d-4a78-9d78-2befbd66d234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:19.370950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff3a9651-a36d-4a78-9d78-2befbd66d234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:19.371378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff3a9651-a36d-4a78-9d78-2befbd66d234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:19.431710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ff3a9651-a36d-4a78-9d78-2befbd66d234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:19.439759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ff3a9651-a36d-4a78-9d78-2befbd66d234 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083366 Aug 18 22:21:19.440366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2083/4162] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:19 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:20.461563 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3d1627d1-08ec-425d-b96a-7c5f0cbb0091 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:20.462195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3d1627d1-08ec-425d-b96a-7c5f0cbb0091 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:20.468531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d1627d1-08ec-425d-b96a-7c5f0cbb0091 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:20.469008 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d1627d1-08ec-425d-b96a-7c5f0cbb0091 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:20.469441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d1627d1-08ec-425d-b96a-7c5f0cbb0091 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:20.470147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d1627d1-08ec-425d-b96a-7c5f0cbb0091 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:20.470603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d1627d1-08ec-425d-b96a-7c5f0cbb0091 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:20.471042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d1627d1-08ec-425d-b96a-7c5f0cbb0091 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:20.533016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3d1627d1-08ec-425d-b96a-7c5f0cbb0091 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:20.541363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3d1627d1-08ec-425d-b96a-7c5f0cbb0091 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083601 Aug 18 22:21:20.541977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2080/4163] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:20 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:21.563134 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-97bbd916-f8bd-4010-b918-953ff25a141c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:21.563746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-97bbd916-f8bd-4010-b918-953ff25a141c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:21.570251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97bbd916-f8bd-4010-b918-953ff25a141c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:21.570730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97bbd916-f8bd-4010-b918-953ff25a141c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:21.571164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97bbd916-f8bd-4010-b918-953ff25a141c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:21.571852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97bbd916-f8bd-4010-b918-953ff25a141c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:21.572299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97bbd916-f8bd-4010-b918-953ff25a141c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:21.572719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97bbd916-f8bd-4010-b918-953ff25a141c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:21.631961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-97bbd916-f8bd-4010-b918-953ff25a141c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:21.639921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-97bbd916-f8bd-4010-b918-953ff25a141c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.080612 Aug 18 22:21:21.640489 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2084/4164] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:22.661671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5c88a634-58dc-4d24-82f5-1ca3ed0bfc4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:22.662435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5c88a634-58dc-4d24-82f5-1ca3ed0bfc4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:22.668706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c88a634-58dc-4d24-82f5-1ca3ed0bfc4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:22.669195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c88a634-58dc-4d24-82f5-1ca3ed0bfc4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:22.669660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c88a634-58dc-4d24-82f5-1ca3ed0bfc4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:22.670365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c88a634-58dc-4d24-82f5-1ca3ed0bfc4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:22.670824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c88a634-58dc-4d24-82f5-1ca3ed0bfc4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:22.671256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c88a634-58dc-4d24-82f5-1ca3ed0bfc4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:22.733348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5c88a634-58dc-4d24-82f5-1ca3ed0bfc4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:22.742377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5c88a634-58dc-4d24-82f5-1ca3ed0bfc4a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085085 Aug 18 22:21:22.742958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2081/4165] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:23.763503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e4b548af-ab26-4af1-83bc-89c1b21a3582 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:23.764149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e4b548af-ab26-4af1-83bc-89c1b21a3582 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:23.770554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4b548af-ab26-4af1-83bc-89c1b21a3582 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:23.771028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4b548af-ab26-4af1-83bc-89c1b21a3582 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:23.771470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4b548af-ab26-4af1-83bc-89c1b21a3582 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:23.772161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4b548af-ab26-4af1-83bc-89c1b21a3582 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:23.772621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4b548af-ab26-4af1-83bc-89c1b21a3582 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:23.773050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e4b548af-ab26-4af1-83bc-89c1b21a3582 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:23.834510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e4b548af-ab26-4af1-83bc-89c1b21a3582 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:23.842892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e4b548af-ab26-4af1-83bc-89c1b21a3582 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083210 Aug 18 22:21:23.843468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2085/4166] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:23 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:24.864095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c27bfa96-9b4a-4039-9d87-f577a8bf904f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:24.864738 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c27bfa96-9b4a-4039-9d87-f577a8bf904f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:24.871236 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c27bfa96-9b4a-4039-9d87-f577a8bf904f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:24.871717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c27bfa96-9b4a-4039-9d87-f577a8bf904f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:24.872154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c27bfa96-9b4a-4039-9d87-f577a8bf904f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:24.872844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c27bfa96-9b4a-4039-9d87-f577a8bf904f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:24.873300 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c27bfa96-9b4a-4039-9d87-f577a8bf904f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:24.873775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c27bfa96-9b4a-4039-9d87-f577a8bf904f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:24.937464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c27bfa96-9b4a-4039-9d87-f577a8bf904f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:24.946133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c27bfa96-9b4a-4039-9d87-f577a8bf904f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086421 Aug 18 22:21:24.946719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2082/4167] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:25.968430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-34d5d247-2e4b-4c7e-87d5-6638acfd7394 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:25.968973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-34d5d247-2e4b-4c7e-87d5-6638acfd7394 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:25.975737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34d5d247-2e4b-4c7e-87d5-6638acfd7394 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:25.976235 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34d5d247-2e4b-4c7e-87d5-6638acfd7394 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:25.976672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34d5d247-2e4b-4c7e-87d5-6638acfd7394 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:25.977367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34d5d247-2e4b-4c7e-87d5-6638acfd7394 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:25.977851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34d5d247-2e4b-4c7e-87d5-6638acfd7394 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:25.978283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-34d5d247-2e4b-4c7e-87d5-6638acfd7394 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:26.043372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-34d5d247-2e4b-4c7e-87d5-6638acfd7394 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:26.052177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-34d5d247-2e4b-4c7e-87d5-6638acfd7394 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.087711 Aug 18 22:21:26.052753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2086/4168] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:27.072304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c2239e6d-7c69-4cab-8563-2d565f47bf27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:27.072923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c2239e6d-7c69-4cab-8563-2d565f47bf27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:27.079330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2239e6d-7c69-4cab-8563-2d565f47bf27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:27.079811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2239e6d-7c69-4cab-8563-2d565f47bf27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:27.080248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2239e6d-7c69-4cab-8563-2d565f47bf27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:27.081677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2239e6d-7c69-4cab-8563-2d565f47bf27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:27.082138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2239e6d-7c69-4cab-8563-2d565f47bf27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:27.082570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c2239e6d-7c69-4cab-8563-2d565f47bf27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:27.141091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c2239e6d-7c69-4cab-8563-2d565f47bf27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:27.149893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c2239e6d-7c69-4cab-8563-2d565f47bf27 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081425 Aug 18 22:21:27.150459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2083/4169] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:28.169581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-55a35f10-5378-42f2-a439-3c8ee6ad9e8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:28.170241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-55a35f10-5378-42f2-a439-3c8ee6ad9e8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:28.172654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=28 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:21:28.178004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55a35f10-5378-42f2-a439-3c8ee6ad9e8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:28.178490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55a35f10-5378-42f2-a439-3c8ee6ad9e8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:28.178922 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55a35f10-5378-42f2-a439-3c8ee6ad9e8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:28.179871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55a35f10-5378-42f2-a439-3c8ee6ad9e8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:28.180323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55a35f10-5378-42f2-a439-3c8ee6ad9e8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:28.180772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-55a35f10-5378-42f2-a439-3c8ee6ad9e8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:28.241047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-55a35f10-5378-42f2-a439-3c8ee6ad9e8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:28.249190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-55a35f10-5378-42f2-a439-3c8ee6ad9e8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083481 Aug 18 22:21:28.249785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2087/4170] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:29.270715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-96611b00-ab74-4945-aacc-46abae950f0f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:29.271321 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-96611b00-ab74-4945-aacc-46abae950f0f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:29.277378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-96611b00-ab74-4945-aacc-46abae950f0f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:29.277897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-96611b00-ab74-4945-aacc-46abae950f0f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:29.278366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-96611b00-ab74-4945-aacc-46abae950f0f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:29.279049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-96611b00-ab74-4945-aacc-46abae950f0f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:29.279505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-96611b00-ab74-4945-aacc-46abae950f0f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:29.279931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-96611b00-ab74-4945-aacc-46abae950f0f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:29.340435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-96611b00-ab74-4945-aacc-46abae950f0f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:29.348726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-96611b00-ab74-4945-aacc-46abae950f0f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082694 Aug 18 22:21:29.349305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2084/4171] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:29 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:30.370168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-031ee6f5-a176-42f1-8c70-76ba111dbb81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:30.370794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-031ee6f5-a176-42f1-8c70-76ba111dbb81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:30.377221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-031ee6f5-a176-42f1-8c70-76ba111dbb81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:30.377768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-031ee6f5-a176-42f1-8c70-76ba111dbb81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:30.378205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-031ee6f5-a176-42f1-8c70-76ba111dbb81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:30.378889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-031ee6f5-a176-42f1-8c70-76ba111dbb81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:30.379346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-031ee6f5-a176-42f1-8c70-76ba111dbb81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:30.380113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-031ee6f5-a176-42f1-8c70-76ba111dbb81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:30.439758 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-031ee6f5-a176-42f1-8c70-76ba111dbb81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:30.447831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-031ee6f5-a176-42f1-8c70-76ba111dbb81 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081506 Aug 18 22:21:30.448407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2088/4172] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:31.468636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b52c7306-4f7c-4c4e-8c1a-fc1fe69ed9f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:31.469248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b52c7306-4f7c-4c4e-8c1a-fc1fe69ed9f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:31.476302 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b52c7306-4f7c-4c4e-8c1a-fc1fe69ed9f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:31.476789 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b52c7306-4f7c-4c4e-8c1a-fc1fe69ed9f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:31.477231 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b52c7306-4f7c-4c4e-8c1a-fc1fe69ed9f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:31.477960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b52c7306-4f7c-4c4e-8c1a-fc1fe69ed9f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:31.478420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b52c7306-4f7c-4c4e-8c1a-fc1fe69ed9f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:31.478883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b52c7306-4f7c-4c4e-8c1a-fc1fe69ed9f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:31.539423 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b52c7306-4f7c-4c4e-8c1a-fc1fe69ed9f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:31.547554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b52c7306-4f7c-4c4e-8c1a-fc1fe69ed9f8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082824 Aug 18 22:21:31.548133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2085/4173] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:21:32.570234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7075a90d-31ed-4338-b2a9-81a1a838d199 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:32.570838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7075a90d-31ed-4338-b2a9-81a1a838d199 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:32.577231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7075a90d-31ed-4338-b2a9-81a1a838d199 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:32.577730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7075a90d-31ed-4338-b2a9-81a1a838d199 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:32.578211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7075a90d-31ed-4338-b2a9-81a1a838d199 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:32.578948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7075a90d-31ed-4338-b2a9-81a1a838d199 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:32.579395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7075a90d-31ed-4338-b2a9-81a1a838d199 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:32.579811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7075a90d-31ed-4338-b2a9-81a1a838d199 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:32.639291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7075a90d-31ed-4338-b2a9-81a1a838d199 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:32.647306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7075a90d-31ed-4338-b2a9-81a1a838d199 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081585 Aug 18 22:21:32.647869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2089/4174] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:32 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:33.669277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6e3e2ff3-a076-402c-96c8-714bc270d26d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:33.669835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6e3e2ff3-a076-402c-96c8-714bc270d26d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:33.676160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e3e2ff3-a076-402c-96c8-714bc270d26d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:33.676635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e3e2ff3-a076-402c-96c8-714bc270d26d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:33.677063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e3e2ff3-a076-402c-96c8-714bc270d26d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:33.677777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e3e2ff3-a076-402c-96c8-714bc270d26d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:33.678227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e3e2ff3-a076-402c-96c8-714bc270d26d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:33.678647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6e3e2ff3-a076-402c-96c8-714bc270d26d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:33.742743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6e3e2ff3-a076-402c-96c8-714bc270d26d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:33.750824 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6e3e2ff3-a076-402c-96c8-714bc270d26d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085536 Aug 18 22:21:33.751395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2086/4175] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:33 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:34.771560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1b381824-fd5d-4244-8387-0322126334ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:34.772178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1b381824-fd5d-4244-8387-0322126334ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:34.778558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b381824-fd5d-4244-8387-0322126334ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:34.779041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b381824-fd5d-4244-8387-0322126334ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:34.779480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b381824-fd5d-4244-8387-0322126334ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:34.780177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b381824-fd5d-4244-8387-0322126334ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:34.780638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b381824-fd5d-4244-8387-0322126334ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:34.781069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b381824-fd5d-4244-8387-0322126334ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:34.843653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1b381824-fd5d-4244-8387-0322126334ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:34.851779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1b381824-fd5d-4244-8387-0322126334ef tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084159 Aug 18 22:21:34.852353 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2090/4176] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:34 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:35.873028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1c8249ec-2002-48b2-9770-2a9f82c19530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:35.873692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1c8249ec-2002-48b2-9770-2a9f82c19530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:35.880778 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c8249ec-2002-48b2-9770-2a9f82c19530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:35.881267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c8249ec-2002-48b2-9770-2a9f82c19530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:35.881743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c8249ec-2002-48b2-9770-2a9f82c19530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:35.882436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c8249ec-2002-48b2-9770-2a9f82c19530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:35.883119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c8249ec-2002-48b2-9770-2a9f82c19530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:35.883883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1c8249ec-2002-48b2-9770-2a9f82c19530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:35.948022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1c8249ec-2002-48b2-9770-2a9f82c19530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:35.956827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1c8249ec-2002-48b2-9770-2a9f82c19530 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.087711 Aug 18 22:21:35.957404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2087/4177] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:35 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:36.978540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-406f3ec7-2124-4c41-a2e4-ef03a364d9f4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:36.979079 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-406f3ec7-2124-4c41-a2e4-ef03a364d9f4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:36.985510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-406f3ec7-2124-4c41-a2e4-ef03a364d9f4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:36.986028 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-406f3ec7-2124-4c41-a2e4-ef03a364d9f4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:36.986468 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-406f3ec7-2124-4c41-a2e4-ef03a364d9f4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:36.987254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-406f3ec7-2124-4c41-a2e4-ef03a364d9f4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:36.987732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-406f3ec7-2124-4c41-a2e4-ef03a364d9f4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:36.988167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-406f3ec7-2124-4c41-a2e4-ef03a364d9f4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:37.048183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-406f3ec7-2124-4c41-a2e4-ef03a364d9f4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:37.056730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-406f3ec7-2124-4c41-a2e4-ef03a364d9f4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082149 Aug 18 22:21:37.057300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2091/4178] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:38.077010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b83ee62b-71ce-497b-ab92-6aaf02e3b01d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:38.077658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b83ee62b-71ce-497b-ab92-6aaf02e3b01d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:38.085487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83ee62b-71ce-497b-ab92-6aaf02e3b01d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:38.086017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83ee62b-71ce-497b-ab92-6aaf02e3b01d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:38.086464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83ee62b-71ce-497b-ab92-6aaf02e3b01d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:38.087165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83ee62b-71ce-497b-ab92-6aaf02e3b01d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:38.087624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83ee62b-71ce-497b-ab92-6aaf02e3b01d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:38.088056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83ee62b-71ce-497b-ab92-6aaf02e3b01d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:38.148494 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b83ee62b-71ce-497b-ab92-6aaf02e3b01d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:38.156599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b83ee62b-71ce-497b-ab92-6aaf02e3b01d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083596 Aug 18 22:21:38.157188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2088/4179] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:38 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:39.177422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7c5ab624-364c-46b9-98c7-e7b0b7102a61 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:39.178055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7c5ab624-364c-46b9-98c7-e7b0b7102a61 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:39.184846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5ab624-364c-46b9-98c7-e7b0b7102a61 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:39.185324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5ab624-364c-46b9-98c7-e7b0b7102a61 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:39.185793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5ab624-364c-46b9-98c7-e7b0b7102a61 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:39.186480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5ab624-364c-46b9-98c7-e7b0b7102a61 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:39.186932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5ab624-364c-46b9-98c7-e7b0b7102a61 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:39.187359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c5ab624-364c-46b9-98c7-e7b0b7102a61 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:39.248020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7c5ab624-364c-46b9-98c7-e7b0b7102a61 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:39.256547 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7c5ab624-364c-46b9-98c7-e7b0b7102a61 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082952 Aug 18 22:21:39.257122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2092/4180] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:39 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:40.278192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6ac202dc-13f2-46eb-8e31-1e6deec7543f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:40.278807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6ac202dc-13f2-46eb-8e31-1e6deec7543f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:40.285836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ac202dc-13f2-46eb-8e31-1e6deec7543f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:40.286306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ac202dc-13f2-46eb-8e31-1e6deec7543f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:40.286743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ac202dc-13f2-46eb-8e31-1e6deec7543f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:40.287422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ac202dc-13f2-46eb-8e31-1e6deec7543f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:40.287872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ac202dc-13f2-46eb-8e31-1e6deec7543f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:40.288298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6ac202dc-13f2-46eb-8e31-1e6deec7543f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:40.350508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6ac202dc-13f2-46eb-8e31-1e6deec7543f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:40.358594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6ac202dc-13f2-46eb-8e31-1e6deec7543f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084264 Aug 18 22:21:40.359162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2089/4181] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:40 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:41.380622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-82b36bf5-fe7d-4674-b896-770e42c64b52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:41.381239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-82b36bf5-fe7d-4674-b896-770e42c64b52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:41.387686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82b36bf5-fe7d-4674-b896-770e42c64b52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:41.388164 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82b36bf5-fe7d-4674-b896-770e42c64b52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:41.388597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82b36bf5-fe7d-4674-b896-770e42c64b52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:41.389283 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82b36bf5-fe7d-4674-b896-770e42c64b52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:41.389771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82b36bf5-fe7d-4674-b896-770e42c64b52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:41.390194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-82b36bf5-fe7d-4674-b896-770e42c64b52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:41.392677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=84 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:21:41.452542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-82b36bf5-fe7d-4674-b896-770e42c64b52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:41.460943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-82b36bf5-fe7d-4674-b896-770e42c64b52 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084774 Aug 18 22:21:41.461523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2093/4182] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:41 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:42.481224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-742b4778-9073-4bcd-81b0-3d612ef115e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:42.481857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-742b4778-9073-4bcd-81b0-3d612ef115e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:42.488249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-742b4778-9073-4bcd-81b0-3d612ef115e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:42.488729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-742b4778-9073-4bcd-81b0-3d612ef115e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:42.489161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-742b4778-9073-4bcd-81b0-3d612ef115e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:42.489876 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-742b4778-9073-4bcd-81b0-3d612ef115e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:42.490331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-742b4778-9073-4bcd-81b0-3d612ef115e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:42.490761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-742b4778-9073-4bcd-81b0-3d612ef115e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:42.553618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-742b4778-9073-4bcd-81b0-3d612ef115e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:42.561937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-742b4778-9073-4bcd-81b0-3d612ef115e7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084619 Aug 18 22:21:42.562507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2090/4183] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:42 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:43.584094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4c75b351-48da-4a1c-a648-dcca0382b7ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:43.584692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4c75b351-48da-4a1c-a648-dcca0382b7ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:43.591082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c75b351-48da-4a1c-a648-dcca0382b7ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:43.591555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c75b351-48da-4a1c-a648-dcca0382b7ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:43.591983 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c75b351-48da-4a1c-a648-dcca0382b7ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:43.592661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c75b351-48da-4a1c-a648-dcca0382b7ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:43.593107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c75b351-48da-4a1c-a648-dcca0382b7ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:43.593527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4c75b351-48da-4a1c-a648-dcca0382b7ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:43.817493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4c75b351-48da-4a1c-a648-dcca0382b7ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:43.825717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4c75b351-48da-4a1c-a648-dcca0382b7ca tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.245381 Aug 18 22:21:43.826278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2094/4184] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:43 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:44.847453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-826b6725-1003-4ada-ad92-07fc8962aee4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:44.848123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-826b6725-1003-4ada-ad92-07fc8962aee4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:44.854548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-826b6725-1003-4ada-ad92-07fc8962aee4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:44.855035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-826b6725-1003-4ada-ad92-07fc8962aee4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:44.855480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-826b6725-1003-4ada-ad92-07fc8962aee4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:44.856171 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-826b6725-1003-4ada-ad92-07fc8962aee4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:44.856631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-826b6725-1003-4ada-ad92-07fc8962aee4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:44.857069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-826b6725-1003-4ada-ad92-07fc8962aee4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:44.859615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=84 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:21:44.917931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-826b6725-1003-4ada-ad92-07fc8962aee4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:44.926661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-826b6725-1003-4ada-ad92-07fc8962aee4 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083700 Aug 18 22:21:44.927224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2091/4185] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:44 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:45.947633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d1beb429-809a-400a-ae4f-0fe81da2001f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:45.948272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d1beb429-809a-400a-ae4f-0fe81da2001f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:45.954451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1beb429-809a-400a-ae4f-0fe81da2001f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:45.954932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1beb429-809a-400a-ae4f-0fe81da2001f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:45.955367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1beb429-809a-400a-ae4f-0fe81da2001f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:45.956066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1beb429-809a-400a-ae4f-0fe81da2001f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:45.956523 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1beb429-809a-400a-ae4f-0fe81da2001f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:45.956946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1beb429-809a-400a-ae4f-0fe81da2001f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:46.015824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d1beb429-809a-400a-ae4f-0fe81da2001f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:46.023883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d1beb429-809a-400a-ae4f-0fe81da2001f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.080048 Aug 18 22:21:46.024451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2095/4186] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:45 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:47.044523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9a09280a-c0cb-438b-a3bd-f57de113e70a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:47.045132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9a09280a-c0cb-438b-a3bd-f57de113e70a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:47.051579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a09280a-c0cb-438b-a3bd-f57de113e70a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:47.052057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a09280a-c0cb-438b-a3bd-f57de113e70a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:47.052488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a09280a-c0cb-438b-a3bd-f57de113e70a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:47.053172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a09280a-c0cb-438b-a3bd-f57de113e70a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:47.053648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a09280a-c0cb-438b-a3bd-f57de113e70a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:47.054081 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9a09280a-c0cb-438b-a3bd-f57de113e70a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:47.113416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9a09280a-c0cb-438b-a3bd-f57de113e70a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:47.121482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9a09280a-c0cb-438b-a3bd-f57de113e70a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.080775 Aug 18 22:21:47.122076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2092/4187] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:47 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:48.143030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-52d34948-158e-4b8f-b679-575c0ce08d76 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:48.143649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-52d34948-158e-4b8f-b679-575c0ce08d76 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:48.150194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52d34948-158e-4b8f-b679-575c0ce08d76 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:48.150675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52d34948-158e-4b8f-b679-575c0ce08d76 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:48.151109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52d34948-158e-4b8f-b679-575c0ce08d76 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:48.151805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52d34948-158e-4b8f-b679-575c0ce08d76 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:48.152258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52d34948-158e-4b8f-b679-575c0ce08d76 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:48.152717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-52d34948-158e-4b8f-b679-575c0ce08d76 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:48.215090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-52d34948-158e-4b8f-b679-575c0ce08d76 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:48.223217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-52d34948-158e-4b8f-b679-575c0ce08d76 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084170 Aug 18 22:21:48.223779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2096/4188] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:48 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:49.244459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-64d8668a-1319-4f7e-92c9-10342cdfe709 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:49.245083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-64d8668a-1319-4f7e-92c9-10342cdfe709 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:49.247493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=28 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:21:49.252760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64d8668a-1319-4f7e-92c9-10342cdfe709 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:49.253764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64d8668a-1319-4f7e-92c9-10342cdfe709 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:49.254307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64d8668a-1319-4f7e-92c9-10342cdfe709 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:49.255009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64d8668a-1319-4f7e-92c9-10342cdfe709 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:49.255468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64d8668a-1319-4f7e-92c9-10342cdfe709 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:49.255898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64d8668a-1319-4f7e-92c9-10342cdfe709 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:49.318295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-64d8668a-1319-4f7e-92c9-10342cdfe709 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:49.327184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-64d8668a-1319-4f7e-92c9-10342cdfe709 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086507 Aug 18 22:21:49.327799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2093/4189] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:49 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:50.348655 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4e25fd93-ef94-4cf3-bb3b-30b5b0933c4f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:50.349273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4e25fd93-ef94-4cf3-bb3b-30b5b0933c4f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:50.355689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e25fd93-ef94-4cf3-bb3b-30b5b0933c4f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:50.356175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e25fd93-ef94-4cf3-bb3b-30b5b0933c4f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:50.356614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e25fd93-ef94-4cf3-bb3b-30b5b0933c4f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:50.357307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e25fd93-ef94-4cf3-bb3b-30b5b0933c4f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:50.357794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e25fd93-ef94-4cf3-bb3b-30b5b0933c4f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:50.358224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4e25fd93-ef94-4cf3-bb3b-30b5b0933c4f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:50.423976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4e25fd93-ef94-4cf3-bb3b-30b5b0933c4f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:50.432447 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4e25fd93-ef94-4cf3-bb3b-30b5b0933c4f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088121 Aug 18 22:21:50.433006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2097/4190] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:50 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:51.453985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-90152f06-ef86-457d-8444-dfd33ad28258 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:51.454608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-90152f06-ef86-457d-8444-dfd33ad28258 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:51.461346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90152f06-ef86-457d-8444-dfd33ad28258 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:51.461865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90152f06-ef86-457d-8444-dfd33ad28258 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:51.462310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90152f06-ef86-457d-8444-dfd33ad28258 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:51.463005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90152f06-ef86-457d-8444-dfd33ad28258 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:51.463466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90152f06-ef86-457d-8444-dfd33ad28258 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:51.463896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-90152f06-ef86-457d-8444-dfd33ad28258 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:51.525586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-90152f06-ef86-457d-8444-dfd33ad28258 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:51.533781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-90152f06-ef86-457d-8444-dfd33ad28258 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083811 Aug 18 22:21:51.534913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2094/4191] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:51 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:52.555314 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e3170ad2-37cb-4619-9496-1c6d26c6ec8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:52.555923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e3170ad2-37cb-4619-9496-1c6d26c6ec8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:52.562305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3170ad2-37cb-4619-9496-1c6d26c6ec8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:52.562779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3170ad2-37cb-4619-9496-1c6d26c6ec8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:52.563212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3170ad2-37cb-4619-9496-1c6d26c6ec8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:52.563896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3170ad2-37cb-4619-9496-1c6d26c6ec8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:52.564346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3170ad2-37cb-4619-9496-1c6d26c6ec8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:52.564768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e3170ad2-37cb-4619-9496-1c6d26c6ec8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:52.627271 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e3170ad2-37cb-4619-9496-1c6d26c6ec8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:52.636003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e3170ad2-37cb-4619-9496-1c6d26c6ec8c tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084795 Aug 18 22:21:52.636560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2098/4192] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:52 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:53.655947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ef636f5d-d60b-4884-bd31-43751ce12343 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:53.656567 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ef636f5d-d60b-4884-bd31-43751ce12343 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:53.663902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef636f5d-d60b-4884-bd31-43751ce12343 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:53.664387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef636f5d-d60b-4884-bd31-43751ce12343 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:53.664822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef636f5d-d60b-4884-bd31-43751ce12343 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:53.665512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef636f5d-d60b-4884-bd31-43751ce12343 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:53.665995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef636f5d-d60b-4884-bd31-43751ce12343 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:53.666466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ef636f5d-d60b-4884-bd31-43751ce12343 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:53.727032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ef636f5d-d60b-4884-bd31-43751ce12343 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:53.735259 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ef636f5d-d60b-4884-bd31-43751ce12343 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083164 Aug 18 22:21:53.735834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2095/4193] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:53 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:54.811691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9cb4eddb-473e-4122-a808-7f089442cbc7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:54.812307 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9cb4eddb-473e-4122-a808-7f089442cbc7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:54.818898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9cb4eddb-473e-4122-a808-7f089442cbc7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:54.819384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9cb4eddb-473e-4122-a808-7f089442cbc7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:54.819817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9cb4eddb-473e-4122-a808-7f089442cbc7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:54.820511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9cb4eddb-473e-4122-a808-7f089442cbc7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:54.820970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9cb4eddb-473e-4122-a808-7f089442cbc7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:54.821398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9cb4eddb-473e-4122-a808-7f089442cbc7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:54.884689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9cb4eddb-473e-4122-a808-7f089442cbc7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:54.892955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9cb4eddb-473e-4122-a808-7f089442cbc7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085121 Aug 18 22:21:54.894056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2099/4194] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:54 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:55.914474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b61d7260-2146-4c2e-9e03-fdab32ea72b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:55.915090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b61d7260-2146-4c2e-9e03-fdab32ea72b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:55.921765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b61d7260-2146-4c2e-9e03-fdab32ea72b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:55.922246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b61d7260-2146-4c2e-9e03-fdab32ea72b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:55.922700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b61d7260-2146-4c2e-9e03-fdab32ea72b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:55.923363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b61d7260-2146-4c2e-9e03-fdab32ea72b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:55.923813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b61d7260-2146-4c2e-9e03-fdab32ea72b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:55.924237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b61d7260-2146-4c2e-9e03-fdab32ea72b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:55.984963 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b61d7260-2146-4c2e-9e03-fdab32ea72b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:55.993190 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b61d7260-2146-4c2e-9e03-fdab32ea72b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082584 Aug 18 22:21:55.993802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2096/4195] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:55 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:57.014439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-92e26b6e-ffa9-4443-ab9b-04eaa1512ff5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:57.014957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-92e26b6e-ffa9-4443-ab9b-04eaa1512ff5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:57.021454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92e26b6e-ffa9-4443-ab9b-04eaa1512ff5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:57.021954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92e26b6e-ffa9-4443-ab9b-04eaa1512ff5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:57.022386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92e26b6e-ffa9-4443-ab9b-04eaa1512ff5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:57.023064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92e26b6e-ffa9-4443-ab9b-04eaa1512ff5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:57.023510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92e26b6e-ffa9-4443-ab9b-04eaa1512ff5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:57.023930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92e26b6e-ffa9-4443-ab9b-04eaa1512ff5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:57.083699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-92e26b6e-ffa9-4443-ab9b-04eaa1512ff5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:57.091845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-92e26b6e-ffa9-4443-ab9b-04eaa1512ff5 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081363 Aug 18 22:21:57.092408 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2100/4196] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:57 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:58.113146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6243ab23-846c-480a-b0c3-074f22993541 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:58.113943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6243ab23-846c-480a-b0c3-074f22993541 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:58.119902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6243ab23-846c-480a-b0c3-074f22993541 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:58.120379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6243ab23-846c-480a-b0c3-074f22993541 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:58.120812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6243ab23-846c-480a-b0c3-074f22993541 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:58.121490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6243ab23-846c-480a-b0c3-074f22993541 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:58.121969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6243ab23-846c-480a-b0c3-074f22993541 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:58.122389 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6243ab23-846c-480a-b0c3-074f22993541 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:58.182773 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6243ab23-846c-480a-b0c3-074f22993541 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:58.191523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6243ab23-846c-480a-b0c3-074f22993541 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082703 Aug 18 22:21:58.192090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2097/4197] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:58 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:21:59.213047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26f417ed-a0ed-4ea4-b8ac-c7d112b594f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:21:59.213870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26f417ed-a0ed-4ea4-b8ac-c7d112b594f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:21:59.216239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=28 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:21:59.221948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f417ed-a0ed-4ea4-b8ac-c7d112b594f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:59.222491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f417ed-a0ed-4ea4-b8ac-c7d112b594f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:59.222988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f417ed-a0ed-4ea4-b8ac-c7d112b594f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:59.223751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f417ed-a0ed-4ea4-b8ac-c7d112b594f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:21:59.224208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f417ed-a0ed-4ea4-b8ac-c7d112b594f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:21:59.224638 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26f417ed-a0ed-4ea4-b8ac-c7d112b594f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:21:59.284342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26f417ed-a0ed-4ea4-b8ac-c7d112b594f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:21:59.292499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26f417ed-a0ed-4ea4-b8ac-c7d112b594f3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083283 Aug 18 22:21:59.293067 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2101/4198] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:21:59 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:00.312790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2c69b98-76c1-476c-a80d-e04a4b28b0c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:00.313410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e2c69b98-76c1-476c-a80d-e04a4b28b0c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:00.320569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2c69b98-76c1-476c-a80d-e04a4b28b0c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:00.321054 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2c69b98-76c1-476c-a80d-e04a4b28b0c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:00.321490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2c69b98-76c1-476c-a80d-e04a4b28b0c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:00.322226 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2c69b98-76c1-476c-a80d-e04a4b28b0c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:00.322680 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2c69b98-76c1-476c-a80d-e04a4b28b0c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:00.323104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2c69b98-76c1-476c-a80d-e04a4b28b0c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:00.385853 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e2c69b98-76c1-476c-a80d-e04a4b28b0c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:00.394014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e2c69b98-76c1-476c-a80d-e04a4b28b0c1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085046 Aug 18 22:22:00.394596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2098/4199] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:00 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:01.414261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-943bbac3-191e-4037-9298-962f033b3971 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:01.414884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-943bbac3-191e-4037-9298-962f033b3971 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:01.421297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-943bbac3-191e-4037-9298-962f033b3971 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:01.421813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-943bbac3-191e-4037-9298-962f033b3971 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:01.422252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-943bbac3-191e-4037-9298-962f033b3971 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:01.422942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-943bbac3-191e-4037-9298-962f033b3971 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:01.423397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-943bbac3-191e-4037-9298-962f033b3971 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:01.423820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-943bbac3-191e-4037-9298-962f033b3971 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:01.487114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-943bbac3-191e-4037-9298-962f033b3971 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:01.495723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-943bbac3-191e-4037-9298-962f033b3971 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085274 Aug 18 22:22:01.496297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2102/4200] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:01 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:02.517157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5d336866-ef52-470b-8e40-1c0042092911 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:02.517809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5d336866-ef52-470b-8e40-1c0042092911 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:02.524809 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d336866-ef52-470b-8e40-1c0042092911 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:02.525298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d336866-ef52-470b-8e40-1c0042092911 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:02.525777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d336866-ef52-470b-8e40-1c0042092911 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:02.526482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d336866-ef52-470b-8e40-1c0042092911 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:02.526944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d336866-ef52-470b-8e40-1c0042092911 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:02.527379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5d336866-ef52-470b-8e40-1c0042092911 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:02.587887 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5d336866-ef52-470b-8e40-1c0042092911 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:02.595856 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5d336866-ef52-470b-8e40-1c0042092911 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082557 Aug 18 22:22:02.597084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2099/4201] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:02 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:03.617064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-01931011-b362-48a5-95ca-35f270d7bbdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:03.617705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-01931011-b362-48a5-95ca-35f270d7bbdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:03.624175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01931011-b362-48a5-95ca-35f270d7bbdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:03.624654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01931011-b362-48a5-95ca-35f270d7bbdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:03.625084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01931011-b362-48a5-95ca-35f270d7bbdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:03.625803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01931011-b362-48a5-95ca-35f270d7bbdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:03.626252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01931011-b362-48a5-95ca-35f270d7bbdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:03.626673 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-01931011-b362-48a5-95ca-35f270d7bbdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:03.685849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-01931011-b362-48a5-95ca-35f270d7bbdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:03.694734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-01931011-b362-48a5-95ca-35f270d7bbdf tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081468 Aug 18 22:22:03.695303 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2103/4202] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:03 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:04.716219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-284962d2-15bd-4874-9721-46b5a12b4b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:04.716864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-284962d2-15bd-4874-9721-46b5a12b4b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:04.723331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-284962d2-15bd-4874-9721-46b5a12b4b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:04.723812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-284962d2-15bd-4874-9721-46b5a12b4b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:04.724248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-284962d2-15bd-4874-9721-46b5a12b4b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:04.724947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-284962d2-15bd-4874-9721-46b5a12b4b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:04.725400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-284962d2-15bd-4874-9721-46b5a12b4b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:04.725927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-284962d2-15bd-4874-9721-46b5a12b4b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:04.787667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-284962d2-15bd-4874-9721-46b5a12b4b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:04.795817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-284962d2-15bd-4874-9721-46b5a12b4b86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083468 Aug 18 22:22:04.796385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2100/4203] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:04 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:05.817740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7e54c4de-129c-4211-9668-f7955ec7bc36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:05.818415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7e54c4de-129c-4211-9668-f7955ec7bc36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:05.825263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e54c4de-129c-4211-9668-f7955ec7bc36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:05.825787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e54c4de-129c-4211-9668-f7955ec7bc36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:05.826221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e54c4de-129c-4211-9668-f7955ec7bc36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:05.826925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e54c4de-129c-4211-9668-f7955ec7bc36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:05.827376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e54c4de-129c-4211-9668-f7955ec7bc36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:05.827799 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7e54c4de-129c-4211-9668-f7955ec7bc36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:05.889263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7e54c4de-129c-4211-9668-f7955ec7bc36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:05.897448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7e54c4de-129c-4211-9668-f7955ec7bc36 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083958 Aug 18 22:22:05.898063 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2104/4204] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:05 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:06.918909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-01171455-d279-4902-a4f2-d255f5ddf342 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:06.919550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-01171455-d279-4902-a4f2-d255f5ddf342 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:06.926676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01171455-d279-4902-a4f2-d255f5ddf342 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:06.927150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01171455-d279-4902-a4f2-d255f5ddf342 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:06.927589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01171455-d279-4902-a4f2-d255f5ddf342 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:06.928281 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01171455-d279-4902-a4f2-d255f5ddf342 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:06.928733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01171455-d279-4902-a4f2-d255f5ddf342 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:06.929159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-01171455-d279-4902-a4f2-d255f5ddf342 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:06.988440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-01171455-d279-4902-a4f2-d255f5ddf342 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:06.996495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-01171455-d279-4902-a4f2-d255f5ddf342 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081478 Aug 18 22:22:06.997066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2101/4205] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:06 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:08.017850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c86fce1f-6ae8-425c-bf16-716d0e3bb239 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:08.019009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c86fce1f-6ae8-425c-bf16-716d0e3bb239 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:08.025777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c86fce1f-6ae8-425c-bf16-716d0e3bb239 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:08.026266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c86fce1f-6ae8-425c-bf16-716d0e3bb239 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:08.026705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c86fce1f-6ae8-425c-bf16-716d0e3bb239 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:08.027406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c86fce1f-6ae8-425c-bf16-716d0e3bb239 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:08.027860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c86fce1f-6ae8-425c-bf16-716d0e3bb239 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:08.028287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c86fce1f-6ae8-425c-bf16-716d0e3bb239 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:08.090874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c86fce1f-6ae8-425c-bf16-716d0e3bb239 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:08.099094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c86fce1f-6ae8-425c-bf16-716d0e3bb239 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085191 Aug 18 22:22:08.099845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2105/4206] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:08 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:09.119272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9618b066-5ddb-4c62-a374-39264c448f16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:09.119885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9618b066-5ddb-4c62-a374-39264c448f16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:09.126521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9618b066-5ddb-4c62-a374-39264c448f16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:09.127015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9618b066-5ddb-4c62-a374-39264c448f16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:09.127454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9618b066-5ddb-4c62-a374-39264c448f16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:09.128717 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9618b066-5ddb-4c62-a374-39264c448f16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:09.129174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9618b066-5ddb-4c62-a374-39264c448f16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:09.129624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9618b066-5ddb-4c62-a374-39264c448f16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:09.192610 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9618b066-5ddb-4c62-a374-39264c448f16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:09.200633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9618b066-5ddb-4c62-a374-39264c448f16 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085192 Aug 18 22:22:09.201198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2102/4207] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:09 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:10.222139 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-38f42ccc-9b61-4a48-a02e-39472c3aa8bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:10.222755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-38f42ccc-9b61-4a48-a02e-39472c3aa8bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:10.229200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38f42ccc-9b61-4a48-a02e-39472c3aa8bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:10.229779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38f42ccc-9b61-4a48-a02e-39472c3aa8bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:10.230227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38f42ccc-9b61-4a48-a02e-39472c3aa8bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:10.230919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38f42ccc-9b61-4a48-a02e-39472c3aa8bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:10.231375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38f42ccc-9b61-4a48-a02e-39472c3aa8bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:10.231802 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-38f42ccc-9b61-4a48-a02e-39472c3aa8bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:10.295175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-38f42ccc-9b61-4a48-a02e-39472c3aa8bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:10.303985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-38f42ccc-9b61-4a48-a02e-39472c3aa8bd tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086251 Aug 18 22:22:10.304558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2106/4208] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:10 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:11.325139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-faeb89fe-7336-454a-a531-6b8263d808c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:11.325784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-faeb89fe-7336-454a-a531-6b8263d808c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:11.332899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faeb89fe-7336-454a-a531-6b8263d808c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:11.333380 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faeb89fe-7336-454a-a531-6b8263d808c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:11.333838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faeb89fe-7336-454a-a531-6b8263d808c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:11.334531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faeb89fe-7336-454a-a531-6b8263d808c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:11.334986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faeb89fe-7336-454a-a531-6b8263d808c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:11.335408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-faeb89fe-7336-454a-a531-6b8263d808c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:11.396062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-faeb89fe-7336-454a-a531-6b8263d808c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:11.404385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-faeb89fe-7336-454a-a531-6b8263d808c0 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083133 Aug 18 22:22:11.404953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2103/4209] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:11 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:12.424473 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-06580c5a-e443-407e-aff9-4535cb2f8d7a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:12.425790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-06580c5a-e443-407e-aff9-4535cb2f8d7a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:12.432644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06580c5a-e443-407e-aff9-4535cb2f8d7a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:12.433138 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06580c5a-e443-407e-aff9-4535cb2f8d7a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:12.433580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06580c5a-e443-407e-aff9-4535cb2f8d7a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:12.434302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06580c5a-e443-407e-aff9-4535cb2f8d7a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:12.434762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06580c5a-e443-407e-aff9-4535cb2f8d7a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:12.435197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-06580c5a-e443-407e-aff9-4535cb2f8d7a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:12.439178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=84 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:22:12.496767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-06580c5a-e443-407e-aff9-4535cb2f8d7a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:12.505284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-06580c5a-e443-407e-aff9-4535cb2f8d7a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084723 Aug 18 22:22:12.506089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2107/4210] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:12 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:13.526472 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2f285f6-1fb6-4714-99da-616bc6328c38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:13.527094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e2f285f6-1fb6-4714-99da-616bc6328c38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:13.533648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2f285f6-1fb6-4714-99da-616bc6328c38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:13.534141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2f285f6-1fb6-4714-99da-616bc6328c38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:13.534623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2f285f6-1fb6-4714-99da-616bc6328c38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:13.535309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2f285f6-1fb6-4714-99da-616bc6328c38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:13.535770 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2f285f6-1fb6-4714-99da-616bc6328c38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:13.536203 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2f285f6-1fb6-4714-99da-616bc6328c38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:13.596155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e2f285f6-1fb6-4714-99da-616bc6328c38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:13.604355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e2f285f6-1fb6-4714-99da-616bc6328c38 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081732 Aug 18 22:22:13.604927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2104/4211] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:13 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:14.627152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d399ab7e-6aec-48db-a315-108d0fa16c1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:14.627768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d399ab7e-6aec-48db-a315-108d0fa16c1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:14.634746 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d399ab7e-6aec-48db-a315-108d0fa16c1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:14.635234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d399ab7e-6aec-48db-a315-108d0fa16c1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:14.635671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d399ab7e-6aec-48db-a315-108d0fa16c1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:14.636370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d399ab7e-6aec-48db-a315-108d0fa16c1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:14.636826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d399ab7e-6aec-48db-a315-108d0fa16c1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:14.637256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d399ab7e-6aec-48db-a315-108d0fa16c1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:14.696582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d399ab7e-6aec-48db-a315-108d0fa16c1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:14.704645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d399ab7e-6aec-48db-a315-108d0fa16c1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081425 Aug 18 22:22:14.705213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2108/4212] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:14 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:15.725490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-40f167e7-0eb0-4e04-bcf5-8bc2231acc8f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:15.726138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-40f167e7-0eb0-4e04-bcf5-8bc2231acc8f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:15.732618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40f167e7-0eb0-4e04-bcf5-8bc2231acc8f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:15.733114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40f167e7-0eb0-4e04-bcf5-8bc2231acc8f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:15.733551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40f167e7-0eb0-4e04-bcf5-8bc2231acc8f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:15.734340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40f167e7-0eb0-4e04-bcf5-8bc2231acc8f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:15.734801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40f167e7-0eb0-4e04-bcf5-8bc2231acc8f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:15.735233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40f167e7-0eb0-4e04-bcf5-8bc2231acc8f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:15.739670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=84 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:22:15.795595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-40f167e7-0eb0-4e04-bcf5-8bc2231acc8f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:15.804217 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-40f167e7-0eb0-4e04-bcf5-8bc2231acc8f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083048 Aug 18 22:22:15.804775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2105/4213] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:15 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:16.825220 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1b9e7a5a-d157-41c2-823d-8df64be788ab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:16.825868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1b9e7a5a-d157-41c2-823d-8df64be788ab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:16.831777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b9e7a5a-d157-41c2-823d-8df64be788ab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:16.832255 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b9e7a5a-d157-41c2-823d-8df64be788ab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:16.832685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b9e7a5a-d157-41c2-823d-8df64be788ab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:16.833364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b9e7a5a-d157-41c2-823d-8df64be788ab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:16.833842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b9e7a5a-d157-41c2-823d-8df64be788ab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:16.834268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1b9e7a5a-d157-41c2-823d-8df64be788ab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:16.892981 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1b9e7a5a-d157-41c2-823d-8df64be788ab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:16.901092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1b9e7a5a-d157-41c2-823d-8df64be788ab tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.079844 Aug 18 22:22:16.901681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2109/4214] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:16 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:17.922195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2159c64f-0908-45c7-ac91-c014473dac09 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:17.922808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2159c64f-0908-45c7-ac91-c014473dac09 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:17.929690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2159c64f-0908-45c7-ac91-c014473dac09 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:17.930434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2159c64f-0908-45c7-ac91-c014473dac09 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:17.930873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2159c64f-0908-45c7-ac91-c014473dac09 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:17.931559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2159c64f-0908-45c7-ac91-c014473dac09 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:17.932016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2159c64f-0908-45c7-ac91-c014473dac09 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:17.932443 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2159c64f-0908-45c7-ac91-c014473dac09 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:17.994901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2159c64f-0908-45c7-ac91-c014473dac09 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:18.003045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2159c64f-0908-45c7-ac91-c014473dac09 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084680 Aug 18 22:22:18.003620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2106/4215] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:17 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:19.024715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-24900810-fdfe-47b0-b9db-359c56b04d14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:19.025359 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-24900810-fdfe-47b0-b9db-359c56b04d14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:19.031756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24900810-fdfe-47b0-b9db-359c56b04d14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:19.032231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24900810-fdfe-47b0-b9db-359c56b04d14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:19.032661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24900810-fdfe-47b0-b9db-359c56b04d14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:19.033338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24900810-fdfe-47b0-b9db-359c56b04d14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:19.033814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24900810-fdfe-47b0-b9db-359c56b04d14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:19.034239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-24900810-fdfe-47b0-b9db-359c56b04d14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:19.096751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-24900810-fdfe-47b0-b9db-359c56b04d14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:19.105811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-24900810-fdfe-47b0-b9db-359c56b04d14 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.085388 Aug 18 22:22:19.106381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2110/4216] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:19 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:20.126727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9e508b9e-7460-4814-9cf0-6bb946292fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:20.127346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9e508b9e-7460-4814-9cf0-6bb946292fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:20.129702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=28 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:22:20.135120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e508b9e-7460-4814-9cf0-6bb946292fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:20.135604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e508b9e-7460-4814-9cf0-6bb946292fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:20.136043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e508b9e-7460-4814-9cf0-6bb946292fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:20.136736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e508b9e-7460-4814-9cf0-6bb946292fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:20.137191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e508b9e-7460-4814-9cf0-6bb946292fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:20.137648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9e508b9e-7460-4814-9cf0-6bb946292fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:20.203205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9e508b9e-7460-4814-9cf0-6bb946292fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:20.211548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9e508b9e-7460-4814-9cf0-6bb946292fb3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.088685 Aug 18 22:22:20.212119 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2107/4217] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:20 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:21.232751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-20ea0f81-2c5d-4d14-b40b-6b78bb7f3527 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:21.233291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-20ea0f81-2c5d-4d14-b40b-6b78bb7f3527 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:21.242739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20ea0f81-2c5d-4d14-b40b-6b78bb7f3527 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:21.243238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20ea0f81-2c5d-4d14-b40b-6b78bb7f3527 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:21.243682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20ea0f81-2c5d-4d14-b40b-6b78bb7f3527 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:21.244485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20ea0f81-2c5d-4d14-b40b-6b78bb7f3527 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:21.245084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20ea0f81-2c5d-4d14-b40b-6b78bb7f3527 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:21.245742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-20ea0f81-2c5d-4d14-b40b-6b78bb7f3527 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:21.310003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-20ea0f81-2c5d-4d14-b40b-6b78bb7f3527 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:21.319597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-20ea0f81-2c5d-4d14-b40b-6b78bb7f3527 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.090874 Aug 18 22:22:21.320195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2111/4218] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:21 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:22.340320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d90924d6-5d17-4d91-98f0-2d3d40ae95ff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:22.340974 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d90924d6-5d17-4d91-98f0-2d3d40ae95ff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:22.347388 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d90924d6-5d17-4d91-98f0-2d3d40ae95ff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:22.347883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d90924d6-5d17-4d91-98f0-2d3d40ae95ff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:22.348326 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d90924d6-5d17-4d91-98f0-2d3d40ae95ff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:22.349018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d90924d6-5d17-4d91-98f0-2d3d40ae95ff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:22.349481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d90924d6-5d17-4d91-98f0-2d3d40ae95ff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:22.349953 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d90924d6-5d17-4d91-98f0-2d3d40ae95ff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:22.409750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d90924d6-5d17-4d91-98f0-2d3d40ae95ff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:22.417909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d90924d6-5d17-4d91-98f0-2d3d40ae95ff tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081435 Aug 18 22:22:22.418487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2108/4219] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:22 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:23.438984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5bbc735d-5796-420e-873e-deae66366c91 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:23.439604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5bbc735d-5796-420e-873e-deae66366c91 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:23.446192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bbc735d-5796-420e-873e-deae66366c91 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:23.446678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bbc735d-5796-420e-873e-deae66366c91 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:23.447118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bbc735d-5796-420e-873e-deae66366c91 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:23.447813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bbc735d-5796-420e-873e-deae66366c91 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:23.448276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bbc735d-5796-420e-873e-deae66366c91 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:23.448705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bbc735d-5796-420e-873e-deae66366c91 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:23.512509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-5bbc735d-5796-420e-873e-deae66366c91 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:23.521270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5bbc735d-5796-420e-873e-deae66366c91 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086221 Aug 18 22:22:23.521871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2112/4220] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:23 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:24.542739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d42a1bdc-65b3-4184-aacd-7aedfac91083 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:24.543366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d42a1bdc-65b3-4184-aacd-7aedfac91083 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:24.549928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d42a1bdc-65b3-4184-aacd-7aedfac91083 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:24.550562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d42a1bdc-65b3-4184-aacd-7aedfac91083 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:24.551014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d42a1bdc-65b3-4184-aacd-7aedfac91083 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:24.552357 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d42a1bdc-65b3-4184-aacd-7aedfac91083 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:24.552818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d42a1bdc-65b3-4184-aacd-7aedfac91083 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:24.553252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d42a1bdc-65b3-4184-aacd-7aedfac91083 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:24.616721 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d42a1bdc-65b3-4184-aacd-7aedfac91083 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:24.624909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d42a1bdc-65b3-4184-aacd-7aedfac91083 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.086023 Aug 18 22:22:24.625484 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2109/4221] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:24 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:25.645794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-683d4907-3480-49f0-a9d2-14ef2808f786 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:25.646452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-683d4907-3480-49f0-a9d2-14ef2808f786 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:25.652784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-683d4907-3480-49f0-a9d2-14ef2808f786 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:25.653264 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-683d4907-3480-49f0-a9d2-14ef2808f786 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:25.653723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-683d4907-3480-49f0-a9d2-14ef2808f786 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:25.654412 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-683d4907-3480-49f0-a9d2-14ef2808f786 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:25.654867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-683d4907-3480-49f0-a9d2-14ef2808f786 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:25.655291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-683d4907-3480-49f0-a9d2-14ef2808f786 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:25.714440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-683d4907-3480-49f0-a9d2-14ef2808f786 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:25.722753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-683d4907-3480-49f0-a9d2-14ef2808f786 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.080829 Aug 18 22:22:25.723355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2113/4222] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:25 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:26.743577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-97ee3a8b-ff58-4a01-a2c6-8259428fe84b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:26.744186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-97ee3a8b-ff58-4a01-a2c6-8259428fe84b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:26.750510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97ee3a8b-ff58-4a01-a2c6-8259428fe84b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:26.750990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97ee3a8b-ff58-4a01-a2c6-8259428fe84b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:26.751424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97ee3a8b-ff58-4a01-a2c6-8259428fe84b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:26.752107 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97ee3a8b-ff58-4a01-a2c6-8259428fe84b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:26.752561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97ee3a8b-ff58-4a01-a2c6-8259428fe84b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:26.752983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97ee3a8b-ff58-4a01-a2c6-8259428fe84b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:26.813096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97ee3a8b-ff58-4a01-a2c6-8259428fe84b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:26.821883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-97ee3a8b-ff58-4a01-a2c6-8259428fe84b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.082140 Aug 18 22:22:26.822459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2110/4223] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:26 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:27.843349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ef97aacf-8274-47b8-bffa-e2d8a8f4cffa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:27.844087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ef97aacf-8274-47b8-bffa-e2d8a8f4cffa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:27.850647 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef97aacf-8274-47b8-bffa-e2d8a8f4cffa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:27.851668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef97aacf-8274-47b8-bffa-e2d8a8f4cffa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:27.852104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef97aacf-8274-47b8-bffa-e2d8a8f4cffa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:27.852798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef97aacf-8274-47b8-bffa-e2d8a8f4cffa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:27.853249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef97aacf-8274-47b8-bffa-e2d8a8f4cffa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:27.853705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ef97aacf-8274-47b8-bffa-e2d8a8f4cffa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:27.915818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ef97aacf-8274-47b8-bffa-e2d8a8f4cffa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:27.923985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ef97aacf-8274-47b8-bffa-e2d8a8f4cffa tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.084471 Aug 18 22:22:27.924560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2114/4224] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:27 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:28.944322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-57220cf3-7498-4afb-b62f-3aba7815a35d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:28.944934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-57220cf3-7498-4afb-b62f-3aba7815a35d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:28.951018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57220cf3-7498-4afb-b62f-3aba7815a35d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:28.951496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57220cf3-7498-4afb-b62f-3aba7815a35d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:28.951931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57220cf3-7498-4afb-b62f-3aba7815a35d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:28.952608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57220cf3-7498-4afb-b62f-3aba7815a35d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:28.953059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57220cf3-7498-4afb-b62f-3aba7815a35d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:28.953481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-57220cf3-7498-4afb-b62f-3aba7815a35d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:29.012951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-57220cf3-7498-4afb-b62f-3aba7815a35d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:29.021911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-57220cf3-7498-4afb-b62f-3aba7815a35d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081409 Aug 18 22:22:29.022485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2111/4225] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:28 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:30.041820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f5e7024-5b0a-470a-97c6-15a38542a44f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:30.042433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f5e7024-5b0a-470a-97c6-15a38542a44f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:30.044715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=28 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:22:30.049906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f5e7024-5b0a-470a-97c6-15a38542a44f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:30.050384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f5e7024-5b0a-470a-97c6-15a38542a44f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:30.050817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f5e7024-5b0a-470a-97c6-15a38542a44f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:30.051767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f5e7024-5b0a-470a-97c6-15a38542a44f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:30.052853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f5e7024-5b0a-470a-97c6-15a38542a44f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:30.053287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f5e7024-5b0a-470a-97c6-15a38542a44f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:30.113262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4f5e7024-5b0a-470a-97c6-15a38542a44f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:30.121947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f5e7024-5b0a-470a-97c6-15a38542a44f tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.083990 Aug 18 22:22:30.122515 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2115/4226] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:30 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:31.143168 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-236ffb9c-c4cf-4db8-a3cc-dfd54b7f7d9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:31.143800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-236ffb9c-c4cf-4db8-a3cc-dfd54b7f7d9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:31.150836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-236ffb9c-c4cf-4db8-a3cc-dfd54b7f7d9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:31.151317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-236ffb9c-c4cf-4db8-a3cc-dfd54b7f7d9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:31.151751 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-236ffb9c-c4cf-4db8-a3cc-dfd54b7f7d9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:31.152457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-236ffb9c-c4cf-4db8-a3cc-dfd54b7f7d9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:31.152889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-236ffb9c-c4cf-4db8-a3cc-dfd54b7f7d9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:31.153311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-236ffb9c-c4cf-4db8-a3cc-dfd54b7f7d9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:31.213060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-236ffb9c-c4cf-4db8-a3cc-dfd54b7f7d9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:31.221059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-236ffb9c-c4cf-4db8-a3cc-dfd54b7f7d9d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1368 microversion: 2.1 time: 0.081741 Aug 18 22:22:31.221640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2112/4227] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:31 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:31.241495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-57b60d16-b74e-4071-aa7a-d3a3b99cd0b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '.version_select at 0x7fd88e65e5e0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:31.264621 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-57b60d16-b74e-4071-aa7a-d3a3b99cd0b7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1047384521" status: 202 len: 0 microversion: 2.1 time: 0.026847 Aug 18 22:22:31.265189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2116/4228] 10.222.0.82 () {58 vars in 1221 bytes} [Thu Aug 18 22:22:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1047384521 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:22:32.146155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-aaaf61ac-d2ee-46ba-8564-9567191f91df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Action: 'create', calling method: .version_select at 0x7fd88e5af430>, body: {"keypair": {"name": "tempest-keypair-1695282245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPPcbhGS218HbmXrSjwr0HkBzXeckRCD3xbbn+9ZJwXKRv416B1iniX1AZ1XG1FC5TZnLPkX5SoV4I9CSnaCSmEbhjDbOt5QkE1AJiTzUZrQxi4alqEDEbcqhcBxeGopYQ=="}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:22:32.161813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-aaaf61ac-d2ee-46ba-8564-9567191f91df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Getting quotas for project 1c52341f519e47f59defbd74b623efac. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:22:32.166160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-aaaf61ac-d2ee-46ba-8564-9567191f91df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Getting quotas for user a01cda302c5841cc937f219d7a06dc56 and project 1c52341f519e47f59defbd74b623efac. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:22:32.192390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-aaaf61ac-d2ee-46ba-8564-9567191f91df tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050040 Aug 18 22:22:32.192997 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2113/4229] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 22:22:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:22:33.372280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-672435410", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08ef7d38-de50-45f0-b217-f8b194131841"}], "security_groups": [{"name": "tempest-securitygroup--1508652110"}], "key_name": "tempest-keypair-1695282245", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:22:33.474994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] validate_networks() for [('08ef7d38-de50-45f0-b217-f8b194131841', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 22:22:33.892982 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 22:22:33.893410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 22:22:33.894002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 22:22:33.894423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 22:22:33.894834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 22:22:33.903972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:33.904454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:33.904884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:33.905622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:33.906076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:33.906499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:33.923406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Getting quotas for project 1c52341f519e47f59defbd74b623efac. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:22:33.927313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Getting quotas for user a01cda302c5841cc937f219d7a06dc56 and project 1c52341f519e47f59defbd74b623efac. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:22:33.938474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 22:22:33.940811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 22:22:33.989392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-717ba999-8a1c-403c-a10e-c251504d88cb tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.621880 Aug 18 22:22:33.990072 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2117/4230] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 22:22:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 22:22:34.001186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-13b5adb8-a832-4cfc-9661-9e5cea69664a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:34.001858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-13b5adb8-a832-4cfc-9661-9e5cea69664a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:34.059347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-13b5adb8-a832-4cfc-9661-9e5cea69664a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:34.066303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-13b5adb8-a832-4cfc-9661-9e5cea69664a tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 200 len: 1237 microversion: 2.1 time: 0.069437 Aug 18 22:22:34.066944 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2114/4231] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:33 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:35.087395 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4f1dba95-5f23-4595-8cc7-485627a25d48 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:35.088019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4f1dba95-5f23-4595-8cc7-485627a25d48 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:35.094739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1dba95-5f23-4595-8cc7-485627a25d48 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:35.095233 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1dba95-5f23-4595-8cc7-485627a25d48 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:35.095679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1dba95-5f23-4595-8cc7-485627a25d48 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:35.096384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1dba95-5f23-4595-8cc7-485627a25d48 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:35.097451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1dba95-5f23-4595-8cc7-485627a25d48 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:35.097926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4f1dba95-5f23-4595-8cc7-485627a25d48 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:35.167404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4f1dba95-5f23-4595-8cc7-485627a25d48 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:35.175311 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4f1dba95-5f23-4595-8cc7-485627a25d48 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 200 len: 1307 microversion: 2.1 time: 0.092271 Aug 18 22:22:35.175995 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2118/4232] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:35 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 1307 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:36.197062 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f6408bd5-7345-46ff-8807-e9d7bde208b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:36.197701 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f6408bd5-7345-46ff-8807-e9d7bde208b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:36.204048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6408bd5-7345-46ff-8807-e9d7bde208b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:36.204514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6408bd5-7345-46ff-8807-e9d7bde208b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:36.204943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6408bd5-7345-46ff-8807-e9d7bde208b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:36.205645 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6408bd5-7345-46ff-8807-e9d7bde208b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:36.206095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6408bd5-7345-46ff-8807-e9d7bde208b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:36.206555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f6408bd5-7345-46ff-8807-e9d7bde208b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:36.401683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f6408bd5-7345-46ff-8807-e9d7bde208b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:36.410652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f6408bd5-7345-46ff-8807-e9d7bde208b6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 200 len: 1363 microversion: 2.1 time: 0.217867 Aug 18 22:22:36.411322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2115/4233] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:36 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:36.483945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-965ec7e3-0b6c-4783-b99b-e9e83cc3bd4b req-69b6ec1d-f171-4b62-91db-45ce2bbffd25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1be180e-f545-4063-a9ad-b65ffffe1942", "tag": "a76502cd-849e-4137-8796-c234cb8e0037"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:22:36.493853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-965ec7e3-0b6c-4783-b99b-e9e83cc3bd4b req-69b6ec1d-f171-4b62-91db-45ce2bbffd25 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:36.494333 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-965ec7e3-0b6c-4783-b99b-e9e83cc3bd4b req-69b6ec1d-f171-4b62-91db-45ce2bbffd25 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:36.494748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-965ec7e3-0b6c-4783-b99b-e9e83cc3bd4b req-69b6ec1d-f171-4b62-91db-45ce2bbffd25 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:36.506559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-965ec7e3-0b6c-4783-b99b-e9e83cc3bd4b req-69b6ec1d-f171-4b62-91db-45ce2bbffd25 service nova] Creating event network-changed:a76502cd-849e-4137-8796-c234cb8e0037 for instance c1be180e-f545-4063-a9ad-b65ffffe1942 on hv-cinder-85367 Aug 18 22:22:36.512575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-965ec7e3-0b6c-4783-b99b-e9e83cc3bd4b req-69b6ec1d-f171-4b62-91db-45ce2bbffd25 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089073 Aug 18 22:22:36.513180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2119/4234] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:22:37.434000 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6985cbb7-5d87-4915-99a0-790e423814f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:37.434615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6985cbb7-5d87-4915-99a0-790e423814f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:37.441098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6985cbb7-5d87-4915-99a0-790e423814f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:37.441576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6985cbb7-5d87-4915-99a0-790e423814f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:37.442042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6985cbb7-5d87-4915-99a0-790e423814f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:37.442731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6985cbb7-5d87-4915-99a0-790e423814f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:37.443188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6985cbb7-5d87-4915-99a0-790e423814f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:37.443618 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6985cbb7-5d87-4915-99a0-790e423814f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:37.575069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6985cbb7-5d87-4915-99a0-790e423814f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:37.582833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6985cbb7-5d87-4915-99a0-790e423814f2 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 200 len: 1363 microversion: 2.1 time: 0.152951 Aug 18 22:22:37.583397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2116/4235] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:37 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:38.604849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0ad67c4c-7f71-4bf5-9533-7e50c0abba9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:38.605546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0ad67c4c-7f71-4bf5-9533-7e50c0abba9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:38.612155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ad67c4c-7f71-4bf5-9533-7e50c0abba9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:38.612628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ad67c4c-7f71-4bf5-9533-7e50c0abba9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:38.613058 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ad67c4c-7f71-4bf5-9533-7e50c0abba9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:38.613763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ad67c4c-7f71-4bf5-9533-7e50c0abba9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:38.614211 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ad67c4c-7f71-4bf5-9533-7e50c0abba9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:38.614630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0ad67c4c-7f71-4bf5-9533-7e50c0abba9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:38.745277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0ad67c4c-7f71-4bf5-9533-7e50c0abba9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:38.752853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0ad67c4c-7f71-4bf5-9533-7e50c0abba9e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 200 len: 1363 microversion: 2.1 time: 0.153082 Aug 18 22:22:38.753420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2120/4236] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:38 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:39.774315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e22cbb98-6674-40a6-b515-e22049e238da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:39.774938 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e22cbb98-6674-40a6-b515-e22049e238da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:39.781431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e22cbb98-6674-40a6-b515-e22049e238da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:39.781951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e22cbb98-6674-40a6-b515-e22049e238da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:39.782398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e22cbb98-6674-40a6-b515-e22049e238da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:39.783090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e22cbb98-6674-40a6-b515-e22049e238da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:39.783550 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e22cbb98-6674-40a6-b515-e22049e238da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:39.783982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e22cbb98-6674-40a6-b515-e22049e238da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:39.916533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e22cbb98-6674-40a6-b515-e22049e238da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:39.923971 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e22cbb98-6674-40a6-b515-e22049e238da tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 200 len: 1363 microversion: 2.1 time: 0.154114 Aug 18 22:22:39.924533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2117/4237] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:39 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:40.945390 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fc00c53b-93a0-445b-82c3-2d2960b8438b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:40.946441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fc00c53b-93a0-445b-82c3-2d2960b8438b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:40.953171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc00c53b-93a0-445b-82c3-2d2960b8438b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:40.953690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc00c53b-93a0-445b-82c3-2d2960b8438b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:40.954132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc00c53b-93a0-445b-82c3-2d2960b8438b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:40.954836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc00c53b-93a0-445b-82c3-2d2960b8438b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:40.955281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc00c53b-93a0-445b-82c3-2d2960b8438b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:40.955713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc00c53b-93a0-445b-82c3-2d2960b8438b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:41.091505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fc00c53b-93a0-445b-82c3-2d2960b8438b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:41.099751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fc00c53b-93a0-445b-82c3-2d2960b8438b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 200 len: 1363 microversion: 2.1 time: 0.158432 Aug 18 22:22:41.101371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2121/4238] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:40 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:41.184745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-07220179-2003-4a8e-8715-dd65c6b06e57 req-ab47656c-3fdf-468a-85d7-9ec6f7cce032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1be180e-f545-4063-a9ad-b65ffffe1942", "name": "network-vif-plugged", "status": "completed", "tag": "a76502cd-849e-4137-8796-c234cb8e0037"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:22:41.194485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-07220179-2003-4a8e-8715-dd65c6b06e57 req-ab47656c-3fdf-468a-85d7-9ec6f7cce032 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:41.195152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-07220179-2003-4a8e-8715-dd65c6b06e57 req-ab47656c-3fdf-468a-85d7-9ec6f7cce032 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:41.195587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-07220179-2003-4a8e-8715-dd65c6b06e57 req-ab47656c-3fdf-468a-85d7-9ec6f7cce032 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:41.206440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-07220179-2003-4a8e-8715-dd65c6b06e57 req-ab47656c-3fdf-468a-85d7-9ec6f7cce032 service nova] Creating event network-vif-plugged:a76502cd-849e-4137-8796-c234cb8e0037 for instance c1be180e-f545-4063-a9ad-b65ffffe1942 on hv-cinder-85367 Aug 18 22:22:41.212356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-07220179-2003-4a8e-8715-dd65c6b06e57 req-ab47656c-3fdf-468a-85d7-9ec6f7cce032 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089530 Aug 18 22:22:41.212943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2118/4239] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:22:42.121428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f6a7e1e3-8175-449c-ae0f-9bc00d1a9839 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:42.122066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f6a7e1e3-8175-449c-ae0f-9bc00d1a9839 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:42.128493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6a7e1e3-8175-449c-ae0f-9bc00d1a9839 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:42.128975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6a7e1e3-8175-449c-ae0f-9bc00d1a9839 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:42.129409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6a7e1e3-8175-449c-ae0f-9bc00d1a9839 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:42.130123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6a7e1e3-8175-449c-ae0f-9bc00d1a9839 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:42.130579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6a7e1e3-8175-449c-ae0f-9bc00d1a9839 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:42.131004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f6a7e1e3-8175-449c-ae0f-9bc00d1a9839 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:42.260933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f6a7e1e3-8175-449c-ae0f-9bc00d1a9839 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:42.268535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f6a7e1e3-8175-449c-ae0f-9bc00d1a9839 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 200 len: 1363 microversion: 2.1 time: 0.150997 Aug 18 22:22:42.269113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2122/4240] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:42 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:43.290927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dafef0e0-a26a-465e-b2df-2fb0f8e12ee6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:43.291653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dafef0e0-a26a-465e-b2df-2fb0f8e12ee6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:43.297724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dafef0e0-a26a-465e-b2df-2fb0f8e12ee6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:43.298199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dafef0e0-a26a-465e-b2df-2fb0f8e12ee6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:43.298630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dafef0e0-a26a-465e-b2df-2fb0f8e12ee6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:43.299308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dafef0e0-a26a-465e-b2df-2fb0f8e12ee6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:43.299760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dafef0e0-a26a-465e-b2df-2fb0f8e12ee6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:43.300179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dafef0e0-a26a-465e-b2df-2fb0f8e12ee6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:43.430284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dafef0e0-a26a-465e-b2df-2fb0f8e12ee6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:22:43.438374 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dafef0e0-a26a-465e-b2df-2fb0f8e12ee6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 200 len: 1548 microversion: 2.1 time: 0.152064 Aug 18 22:22:43.438949 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2119/4241] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:22:43 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:22:43.459322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bd186316-dfa9-4834-be6d-d055a87b2ef3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:22:43.459819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bd186316-dfa9-4834-be6d-d055a87b2ef3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:22:43.466674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd186316-dfa9-4834-be6d-d055a87b2ef3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:43.467150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd186316-dfa9-4834-be6d-d055a87b2ef3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:43.467580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd186316-dfa9-4834-be6d-d055a87b2ef3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:43.468268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd186316-dfa9-4834-be6d-d055a87b2ef3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:43.468715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd186316-dfa9-4834-be6d-d055a87b2ef3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:43.469135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bd186316-dfa9-4834-be6d-d055a87b2ef3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:43.471688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=82 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:22:43.545511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bd186316-dfa9-4834-be6d-d055a87b2ef3 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090258 Aug 18 22:22:43.546186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2123/4242] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 22:22:43 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:22:44.677117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:22:44.729045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-3c842187-86f4-47c9-8614-3bfac946bf7c req-1b289f22-867c-4c7b-ad89-4d74ade474b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1be180e-f545-4063-a9ad-b65ffffe1942", "tag": "a76502cd-849e-4137-8796-c234cb8e0037"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:22:44.738547 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-3c842187-86f4-47c9-8614-3bfac946bf7c req-1b289f22-867c-4c7b-ad89-4d74ade474b3 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:22:44.739035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-3c842187-86f4-47c9-8614-3bfac946bf7c req-1b289f22-867c-4c7b-ad89-4d74ade474b3 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:22:44.739475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-3c842187-86f4-47c9-8614-3bfac946bf7c req-1b289f22-867c-4c7b-ad89-4d74ade474b3 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:22:44.750992 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-3c842187-86f4-47c9-8614-3bfac946bf7c req-1b289f22-867c-4c7b-ad89-4d74ade474b3 service nova] Creating event network-changed:a76502cd-849e-4137-8796-c234cb8e0037 for instance c1be180e-f545-4063-a9ad-b65ffffe1942 on hv-cinder-85367 Aug 18 22:22:44.756160 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-3c842187-86f4-47c9-8614-3bfac946bf7c req-1b289f22-867c-4c7b-ad89-4d74ade474b3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083456 Aug 18 22:22:44.756839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2120/4243] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:23:17.070582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:23:17.071243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:23:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:23:19.254075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:23:19.254851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:23:19.256212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:23:19.256839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:23:19.261806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-328ef3c5-8fd9-48c1-9294-0b1266b9e596 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:23:19.262302 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-328ef3c5-8fd9-48c1-9294-0b1266b9e596 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:23:19.269953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-328ef3c5-8fd9-48c1-9294-0b1266b9e596 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:23:19.270440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-328ef3c5-8fd9-48c1-9294-0b1266b9e596 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:23:19.270880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-328ef3c5-8fd9-48c1-9294-0b1266b9e596 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:23:19.271584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-328ef3c5-8fd9-48c1-9294-0b1266b9e596 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:23:19.272041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-328ef3c5-8fd9-48c1-9294-0b1266b9e596 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:23:19.272474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-328ef3c5-8fd9-48c1-9294-0b1266b9e596 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:23:19.296516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-328ef3c5-8fd9-48c1-9294-0b1266b9e596 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942/ips" status: 200 len: 144 microversion: 2.1 time: 0.043086 Aug 18 22:23:19.297021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2124/4244] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 22:23:19 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942/ips => generated 144 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:24:19.377394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:24:19.378330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=75 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:24:19.382588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0f3c83c8-84a2-4192-9d26-e26f6fedbb86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:24:19.383166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0f3c83c8-84a2-4192-9d26-e26f6fedbb86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:24:19.391933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f3c83c8-84a2-4192-9d26-e26f6fedbb86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:19.392410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f3c83c8-84a2-4192-9d26-e26f6fedbb86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:19.392842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f3c83c8-84a2-4192-9d26-e26f6fedbb86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:19.393531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f3c83c8-84a2-4192-9d26-e26f6fedbb86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:19.394011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f3c83c8-84a2-4192-9d26-e26f6fedbb86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:19.394433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0f3c83c8-84a2-4192-9d26-e26f6fedbb86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:19.418951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0f3c83c8-84a2-4192-9d26-e26f6fedbb86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:24:19.495902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0f3c83c8-84a2-4192-9d26-e26f6fedbb86 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 204 len: 0 microversion: 2.1 time: 0.120075 Aug 18 22:24:19.496490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2121/4245] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:24:19 2022] DELETE /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:24:19.507146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fc6d302c-ded0-4c58-8ba3-1806bc8077d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:24:19.507764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fc6d302c-ded0-4c58-8ba3-1806bc8077d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:24:19.509919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:24:19.511292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:24:19.518248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc6d302c-ded0-4c58-8ba3-1806bc8077d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:19.518738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc6d302c-ded0-4c58-8ba3-1806bc8077d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:19.519177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc6d302c-ded0-4c58-8ba3-1806bc8077d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:19.519885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc6d302c-ded0-4c58-8ba3-1806bc8077d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:19.520344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc6d302c-ded0-4c58-8ba3-1806bc8077d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:19.520768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fc6d302c-ded0-4c58-8ba3-1806bc8077d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:19.655335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fc6d302c-ded0-4c58-8ba3-1806bc8077d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:24:19.663441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fc6d302c-ded0-4c58-8ba3-1806bc8077d1 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 200 len: 1672 microversion: 2.1 time: 0.162610 Aug 18 22:24:19.664018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2125/4246] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:24:19 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:24:20.686076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2a428bd-256e-4a4d-8cff-1b09458a9410 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:24:20.686777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e2a428bd-256e-4a4d-8cff-1b09458a9410 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:24:20.693263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2a428bd-256e-4a4d-8cff-1b09458a9410 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:20.693871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2a428bd-256e-4a4d-8cff-1b09458a9410 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:20.694315 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2a428bd-256e-4a4d-8cff-1b09458a9410 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:20.695017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2a428bd-256e-4a4d-8cff-1b09458a9410 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:20.695479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2a428bd-256e-4a4d-8cff-1b09458a9410 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:20.695910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2a428bd-256e-4a4d-8cff-1b09458a9410 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:20.829386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e2a428bd-256e-4a4d-8cff-1b09458a9410 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:24:20.837185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e2a428bd-256e-4a4d-8cff-1b09458a9410 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 200 len: 1672 microversion: 2.1 time: 0.155542 Aug 18 22:24:20.837799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2122/4247] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:24:20 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:24:21.863532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d0e717b-b62a-4735-b2b3-0b16efb2144e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:24:21.864230 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1d0e717b-b62a-4735-b2b3-0b16efb2144e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:24:21.874097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d0e717b-b62a-4735-b2b3-0b16efb2144e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:21.874626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d0e717b-b62a-4735-b2b3-0b16efb2144e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:21.875098 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d0e717b-b62a-4735-b2b3-0b16efb2144e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:21.876754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d0e717b-b62a-4735-b2b3-0b16efb2144e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:21.877227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d0e717b-b62a-4735-b2b3-0b16efb2144e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:21.877736 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d0e717b-b62a-4735-b2b3-0b16efb2144e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:21.943742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1d0e717b-b62a-4735-b2b3-0b16efb2144e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:24:21.951419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1d0e717b-b62a-4735-b2b3-0b16efb2144e tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 200 len: 1604 microversion: 2.1 time: 0.094863 Aug 18 22:24:21.951978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2126/4248] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:24:21 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 1604 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:24:22.138775 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-e801d7c2-ac2b-48ea-a703-1457e967456b req-52750275-44e3-49cf-b01a-146dc62d8863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1be180e-f545-4063-a9ad-b65ffffe1942", "name": "network-vif-deleted", "tag": "a76502cd-849e-4137-8796-c234cb8e0037"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:24:22.149049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-e801d7c2-ac2b-48ea-a703-1457e967456b req-52750275-44e3-49cf-b01a-146dc62d8863 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:22.149533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-e801d7c2-ac2b-48ea-a703-1457e967456b req-52750275-44e3-49cf-b01a-146dc62d8863 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:22.149991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-e801d7c2-ac2b-48ea-a703-1457e967456b req-52750275-44e3-49cf-b01a-146dc62d8863 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:22.163146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-e801d7c2-ac2b-48ea-a703-1457e967456b req-52750275-44e3-49cf-b01a-146dc62d8863 service nova] Creating event network-vif-deleted:a76502cd-849e-4137-8796-c234cb8e0037 for instance c1be180e-f545-4063-a9ad-b65ffffe1942 on hv-cinder-85367 Aug 18 22:24:22.168427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-e801d7c2-ac2b-48ea-a703-1457e967456b req-52750275-44e3-49cf-b01a-146dc62d8863 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033782 Aug 18 22:24:22.169234 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2123/4249] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:24:22.972540 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e364ff6a-37d9-47f4-b155-9f248acc0c2b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:24:22.973892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e364ff6a-37d9-47f4-b155-9f248acc0c2b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:24:22.981258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e364ff6a-37d9-47f4-b155-9f248acc0c2b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:22.981805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e364ff6a-37d9-47f4-b155-9f248acc0c2b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:22.982250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e364ff6a-37d9-47f4-b155-9f248acc0c2b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:22.983111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e364ff6a-37d9-47f4-b155-9f248acc0c2b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:22.983583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e364ff6a-37d9-47f4-b155-9f248acc0c2b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:22.984016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e364ff6a-37d9-47f4-b155-9f248acc0c2b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:22.998611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-e364ff6a-37d9-47f4-b155-9f248acc0c2b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] HTTP exception thrown: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e364ff6a-37d9-47f4-b155-9f248acc0c2b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Request method failure captured: Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 HTTP/1.1 Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rUu3YcED0opSArrHM9V_E-nmsU4oucISRsaRvWk457ynGLMM_jS_jaMlflVxT57pDtC8v-lcMX4S2Eh731RKVU_uYV3OrSf7SL0qVKR_PLqs5a92dmXa18vt_FkL5lfZsgMYn0DkE0Ua1laG_qOe9YeGCIIpRnzKaC8v6x4ZZS_2ko Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 1c52341f519e47f59defbd74b623efac Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeTestJSON-914459124 Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:24:23.000543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:24:23.002084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_1c52341f519e47f59defbd74b623efac", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/1c52341f519e47f59defbd74b623efac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/1c52341f519e47f59defbd74b623efac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/1c52341f519e47f59defbd74b623efac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:24:23.002084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeTestJSON-914459124 Aug 18 22:24:23.002084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 1c52341f519e47f59defbd74b623efac Aug 18 22:24:23.002084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeTestJSON-914459124 Aug 18 22:24:23.002084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeTestJSON-914459124-project Aug 18 22:24:23.002084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:24:23.002084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:24:23.002084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: a01cda302c5841cc937f219d7a06dc56 Aug 18 22:24:23.002084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeTestJSON-914459124-project Aug 18 22:24:23.002084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:24:23.002084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.002084 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': 'c1be180e-f545-4063-a9ad-b65ffffe1942'} Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:24:23.002920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.004274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.006750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e364ff6a-37d9-47f4-b155-9f248acc0c2b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Returning 404 to user: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:24:23.007790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e364ff6a-37d9-47f4-b155-9f248acc0c2b tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 404 len: 111 microversion: 2.1 time: 0.039482 Aug 18 22:24:23.008543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2127/4250] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:24:22 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:24:23.022837 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7b648cef-303c-410a-ad41-8c8306e88bd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '.version_select at 0x7fd88e56ee50>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:24:23.047641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7b648cef-303c-410a-ad41-8c8306e88bd6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695282245" status: 202 len: 0 microversion: 2.1 time: 0.030170 Aug 18 22:24:23.051885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2124/4251] 10.222.0.82 () {58 vars in 1221 bytes} [Thu Aug 18 22:24:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1695282245 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:24:23.672435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-048b59ab-6930-4830-a699-8dc3251ecd1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:24:23.672918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-048b59ab-6930-4830-a699-8dc3251ecd1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:24:23.679104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-048b59ab-6930-4830-a699-8dc3251ecd1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:23.679574 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-048b59ab-6930-4830-a699-8dc3251ecd1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:23.680002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-048b59ab-6930-4830-a699-8dc3251ecd1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:23.680675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-048b59ab-6930-4830-a699-8dc3251ecd1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:23.681122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-048b59ab-6930-4830-a699-8dc3251ecd1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:23.681803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-048b59ab-6930-4830-a699-8dc3251ecd1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:23.694971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-048b59ab-6930-4830-a699-8dc3251ecd1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] HTTP exception thrown: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-048b59ab-6930-4830-a699-8dc3251ecd1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Request method failure captured: Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 HTTP/1.1 Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rUu3YcED0opSArrHM9V_E-nmsU4oucISRsaRvWk457ynGLMM_jS_jaMlflVxT57pDtC8v-lcMX4S2Eh731RKVU_uYV3OrSf7SL0qVKR_PLqs5a92dmXa18vt_FkL5lfZsgMYn0DkE0Ua1laG_qOe9YeGCIIpRnzKaC8v6x4ZZS_2ko Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 1c52341f519e47f59defbd74b623efac Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeTestJSON-914459124 Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:24:23.696507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:24:23.698387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_1c52341f519e47f59defbd74b623efac", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/1c52341f519e47f59defbd74b623efac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/1c52341f519e47f59defbd74b623efac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/1c52341f519e47f59defbd74b623efac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:24:23.698387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeTestJSON-914459124 Aug 18 22:24:23.698387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 1c52341f519e47f59defbd74b623efac Aug 18 22:24:23.698387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeTestJSON-914459124 Aug 18 22:24:23.698387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeTestJSON-914459124-project Aug 18 22:24:23.698387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:24:23.698387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:24:23.698387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: a01cda302c5841cc937f219d7a06dc56 Aug 18 22:24:23.698387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeTestJSON-914459124-project Aug 18 22:24:23.698387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:24:23.698387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.698387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': 'c1be180e-f545-4063-a9ad-b65ffffe1942'} Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:24:23.699163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.700385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.701999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-048b59ab-6930-4830-a699-8dc3251ecd1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Returning 404 to user: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:24:23.701999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-048b59ab-6930-4830-a699-8dc3251ecd1d tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 404 len: 111 microversion: 2.1 time: 0.029531 Aug 18 22:24:23.701999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2128/4252] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:24:23 2022] DELETE /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:24:23.707232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c0f28ef1-d8e5-4f56-aedf-75904cf6bcc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:24:23.707958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c0f28ef1-d8e5-4f56-aedf-75904cf6bcc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: c1be180e-f545-4063-a9ad-b65ffffe1942] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:24:23.715377 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0f28ef1-d8e5-4f56-aedf-75904cf6bcc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:23.715943 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0f28ef1-d8e5-4f56-aedf-75904cf6bcc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:23.716395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0f28ef1-d8e5-4f56-aedf-75904cf6bcc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:23.717097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0f28ef1-d8e5-4f56-aedf-75904cf6bcc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:24:23.717560 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0f28ef1-d8e5-4f56-aedf-75904cf6bcc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:24:23.718021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c0f28ef1-d8e5-4f56-aedf-75904cf6bcc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:24:23.731094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-c0f28ef1-d8e5-4f56-aedf-75904cf6bcc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] HTTP exception thrown: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c0f28ef1-d8e5-4f56-aedf-75904cf6bcc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Request method failure captured: Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 HTTP/1.1 Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rUu3YcED0opSArrHM9V_E-nmsU4oucISRsaRvWk457ynGLMM_jS_jaMlflVxT57pDtC8v-lcMX4S2Eh731RKVU_uYV3OrSf7SL0qVKR_PLqs5a92dmXa18vt_FkL5lfZsgMYn0DkE0Ua1laG_qOe9YeGCIIpRnzKaC8v6x4ZZS_2ko Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 1c52341f519e47f59defbd74b623efac Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeTestJSON-914459124 Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:24:23.732757 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:24:23.734126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_1c52341f519e47f59defbd74b623efac", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/1c52341f519e47f59defbd74b623efac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/1c52341f519e47f59defbd74b623efac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/1c52341f519e47f59defbd74b623efac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:24:23.734126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeTestJSON-914459124 Aug 18 22:24:23.734126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 1c52341f519e47f59defbd74b623efac Aug 18 22:24:23.734126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeTestJSON-914459124 Aug 18 22:24:23.734126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeTestJSON-914459124-project Aug 18 22:24:23.734126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:24:23.734126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:24:23.734126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: a01cda302c5841cc937f219d7a06dc56 Aug 18 22:24:23.734126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeTestJSON-914459124-project Aug 18 22:24:23.734126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:24:23.734126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.734126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': 'c1be180e-f545-4063-a9ad-b65ffffe1942'} Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:24:23.734903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. Aug 18 22:24:23.736208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:24:23.737329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c0f28ef1-d8e5-4f56-aedf-75904cf6bcc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Returning 404 to user: Instance c1be180e-f545-4063-a9ad-b65ffffe1942 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:24:23.737329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c0f28ef1-d8e5-4f56-aedf-75904cf6bcc6 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942" status: 404 len: 111 microversion: 2.1 time: 0.031390 Aug 18 22:24:23.737329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2125/4253] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:24:23 2022] GET /compute/v2.1/servers/c1be180e-f545-4063-a9ad-b65ffffe1942 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 22:24:55.562077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:24:55.562669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:24:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:25:02.739649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:25:02.740151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:25:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:26:37.078793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:26:37.079426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:26:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:27:02.760473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:27:02.760968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:27:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:28:15.570246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:28:15.570829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:28:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:28:22.747229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:28:22.748272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:28:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:28:30.255561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:28:30.256217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:28:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:29:35.007005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f9a3e474-2401-4865-847b-5196eb3b7603] AMQP server on 10.222.0.82:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 18 22:29:35.007622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=8 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:29:35.008439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=16 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:29:35.017840 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-104375f4-b80b-4268-ba41-498bed0de527 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:35.022475 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-104375f4-b80b-4268-ba41-498bed0de527 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:35.030024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-104375f4-b80b-4268-ba41-498bed0de527 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:35.030611 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-104375f4-b80b-4268-ba41-498bed0de527 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:35.031224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-104375f4-b80b-4268-ba41-498bed0de527 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:35.031997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-104375f4-b80b-4268-ba41-498bed0de527 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:35.032589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-104375f4-b80b-4268-ba41-498bed0de527 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:35.033216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-104375f4-b80b-4268-ba41-498bed0de527 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:35.051987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR oslo.messaging._drivers.impl_rabbit [-] [04d64680-efd9-482c-a7ed-271a3a67a0fa] AMQP server on 10.222.0.82:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 18 22:29:35.056822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fd6ef65a-b493-472f-849c-b7b771498cfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:35.057519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fd6ef65a-b493-472f-849c-b7b771498cfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:35.073851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-104375f4-b80b-4268-ba41-498bed0de527 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:29:35.087047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:29:35.089483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:29:35.091960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd6ef65a-b493-472f-849c-b7b771498cfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:35.092628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd6ef65a-b493-472f-849c-b7b771498cfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:35.093233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd6ef65a-b493-472f-849c-b7b771498cfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:35.094205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd6ef65a-b493-472f-849c-b7b771498cfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:35.094825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd6ef65a-b493-472f-849c-b7b771498cfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:35.095844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fd6ef65a-b493-472f-849c-b7b771498cfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:35.131135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fd6ef65a-b493-472f-849c-b7b771498cfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:29:35.173566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-104375f4-b80b-4268-ba41-498bed0de527 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 204 len: 0 microversion: 2.1 time: 0.169510 Aug 18 22:29:35.174486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2129/4254] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:29:35 2022] DELETE /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:29:35.182962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64f766fd-b602-4dc7-ae42-f093464014ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:35.187948 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64f766fd-b602-4dc7-ae42-f093464014ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:35.202674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64f766fd-b602-4dc7-ae42-f093464014ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:35.204324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64f766fd-b602-4dc7-ae42-f093464014ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:35.204925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64f766fd-b602-4dc7-ae42-f093464014ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:35.206876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64f766fd-b602-4dc7-ae42-f093464014ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:35.211595 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64f766fd-b602-4dc7-ae42-f093464014ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:35.212352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64f766fd-b602-4dc7-ae42-f093464014ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:35.290202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fd6ef65a-b493-472f-849c-b7b771498cfe tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 204 len: 0 microversion: 2.20 time: 0.239744 Aug 18 22:29:35.294496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2126/4255] 10.222.0.82 () {60 vars in 1280 bytes} [Thu Aug 18 22:29:35 2022] DELETE /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 22:29:35.302707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-17a0bcf9-8ffc-4b27-98b2-cfb60139553b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:35.303598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-17a0bcf9-8ffc-4b27-98b2-cfb60139553b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:35.311037 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17a0bcf9-8ffc-4b27-98b2-cfb60139553b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:35.313087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17a0bcf9-8ffc-4b27-98b2-cfb60139553b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:35.313648 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17a0bcf9-8ffc-4b27-98b2-cfb60139553b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:35.314408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17a0bcf9-8ffc-4b27-98b2-cfb60139553b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:35.314954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17a0bcf9-8ffc-4b27-98b2-cfb60139553b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:35.315402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-17a0bcf9-8ffc-4b27-98b2-cfb60139553b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:35.493459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-64f766fd-b602-4dc7-ae42-f093464014ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:35.502126 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64f766fd-b602-4dc7-ae42-f093464014ee tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1681 microversion: 2.1 time: 0.322333 Aug 18 22:29:35.515705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2130/4256] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:35 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1681 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:35.576468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-17a0bcf9-8ffc-4b27-98b2-cfb60139553b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:35.589528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-17a0bcf9-8ffc-4b27-98b2-cfb60139553b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:35.591593 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-17a0bcf9-8ffc-4b27-98b2-cfb60139553b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:35.592768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-17a0bcf9-8ffc-4b27-98b2-cfb60139553b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1722 microversion: 2.20 time: 0.296084 Aug 18 22:29:35.593322 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2127/4257] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:29:35 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:29:36.185086 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-99f17d15-d94a-40d8-884b-3cadfbd047c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:36.185883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-99f17d15-d94a-40d8-884b-3cadfbd047c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:36.193318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99f17d15-d94a-40d8-884b-3cadfbd047c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.193825 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99f17d15-d94a-40d8-884b-3cadfbd047c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.194257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99f17d15-d94a-40d8-884b-3cadfbd047c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:36.194943 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99f17d15-d94a-40d8-884b-3cadfbd047c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.195392 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99f17d15-d94a-40d8-884b-3cadfbd047c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.195814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99f17d15-d94a-40d8-884b-3cadfbd047c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:36.201809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] [f9a3e474-2401-4865-847b-5196eb3b7603] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 59426. Aug 18 22:29:36.222047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-99f17d15-d94a-40d8-884b-3cadfbd047c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:29:36.290851 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-99f17d15-d94a-40d8-884b-3cadfbd047c7 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "DELETE /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 204 len: 0 microversion: 2.1 time: 0.109871 Aug 18 22:29:36.291506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2131/4258] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:29:36 2022] DELETE /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:29:36.299589 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:36.300201 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:36.312175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.313237 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.313852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:36.314666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.315225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.316212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:36.316669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] [04d64680-efd9-482c-a7ed-271a3a67a0fa] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 59432. Aug 18 22:29:36.318901 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a5b8f728-b9d3-42ec-85fe-2fea1c79b37a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:36.319492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a5b8f728-b9d3-42ec-85fe-2fea1c79b37a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:36.326985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b8f728-b9d3-42ec-85fe-2fea1c79b37a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.327684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b8f728-b9d3-42ec-85fe-2fea1c79b37a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.328127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b8f728-b9d3-42ec-85fe-2fea1c79b37a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:36.328837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b8f728-b9d3-42ec-85fe-2fea1c79b37a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.329910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b8f728-b9d3-42ec-85fe-2fea1c79b37a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.330351 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b8f728-b9d3-42ec-85fe-2fea1c79b37a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:36.352224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.352967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.353408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:36.353888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lazy-loading 'fault' on Instance uuid b3851c11-f4ba-40cd-946e-d113ddb6e3b3 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:29:36.356717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a5b8f728-b9d3-42ec-85fe-2fea1c79b37a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:29:36.420747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a01cda302c5841cc937f219d7a06dc56', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c52341f519e47f59defbd74b623efac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:36.429591 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0765d0f1-feb7-4c98-81d2-1d325a32dcf8 tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 200 len: 1468 microversion: 2.1 time: 0.133791 Aug 18 22:29:36.430397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2128/4259] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:36 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 1468 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:36.438166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a5b8f728-b9d3-42ec-85fe-2fea1c79b37a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "DELETE /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 204 len: 0 microversion: 2.1 time: 0.123516 Aug 18 22:29:36.438910 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2132/4260] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:29:36 2022] DELETE /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 22:29:36.446965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07c90cf8-f9e0-4761-9128-cfd77ad306b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:36.447579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07c90cf8-f9e0-4761-9128-cfd77ad306b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:36.454181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07c90cf8-f9e0-4761-9128-cfd77ad306b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.454670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07c90cf8-f9e0-4761-9128-cfd77ad306b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.455113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07c90cf8-f9e0-4761-9128-cfd77ad306b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:36.455806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07c90cf8-f9e0-4761-9128-cfd77ad306b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.456264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07c90cf8-f9e0-4761-9128-cfd77ad306b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.456702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07c90cf8-f9e0-4761-9128-cfd77ad306b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:36.524004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0cff8da-13a6-4e61-8a20-22530b923755 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:36.524842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c0cff8da-13a6-4e61-8a20-22530b923755 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:36.531470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0cff8da-13a6-4e61-8a20-22530b923755 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.533575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0cff8da-13a6-4e61-8a20-22530b923755 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.533575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0cff8da-13a6-4e61-8a20-22530b923755 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:36.533575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0cff8da-13a6-4e61-8a20-22530b923755 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.534544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0cff8da-13a6-4e61-8a20-22530b923755 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.535753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0cff8da-13a6-4e61-8a20-22530b923755 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:36.788907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c0cff8da-13a6-4e61-8a20-22530b923755 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:36.821869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c0cff8da-13a6-4e61-8a20-22530b923755 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1681 microversion: 2.1 time: 0.302007 Aug 18 22:29:36.823350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2133/4261] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:36 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1681 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:36.828229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b4ad00ba-5308-4c79-a8e6-263478112152 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:36.830041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b4ad00ba-5308-4c79-a8e6-263478112152 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:36.836874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4ad00ba-5308-4c79-a8e6-263478112152 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.837616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4ad00ba-5308-4c79-a8e6-263478112152 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.838227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4ad00ba-5308-4c79-a8e6-263478112152 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:36.839082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4ad00ba-5308-4c79-a8e6-263478112152 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:36.839692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4ad00ba-5308-4c79-a8e6-263478112152 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:36.840291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b4ad00ba-5308-4c79-a8e6-263478112152 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:37.204505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b4ad00ba-5308-4c79-a8e6-263478112152 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:37.215219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b4ad00ba-5308-4c79-a8e6-263478112152 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:37.217161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-07c90cf8-f9e0-4761-9128-cfd77ad306b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:37.217535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b4ad00ba-5308-4c79-a8e6-263478112152 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:37.219132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b4ad00ba-5308-4c79-a8e6-263478112152 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1722 microversion: 2.20 time: 0.394702 Aug 18 22:29:37.229652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07c90cf8-f9e0-4761-9128-cfd77ad306b2 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1508 microversion: 2.1 time: 0.781678 Aug 18 22:29:37.229652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2129/4262] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:36 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1508 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:29:37.230433 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2134/4263] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:29:36 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1722 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:29:37.453077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c468a408-9a50-4666-b383-9efe4726cabe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:37.453796 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c468a408-9a50-4666-b383-9efe4726cabe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] [instance: b3851c11-f4ba-40cd-946e-d113ddb6e3b3] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:37.460626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c468a408-9a50-4666-b383-9efe4726cabe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:37.461409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c468a408-9a50-4666-b383-9efe4726cabe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:37.461930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c468a408-9a50-4666-b383-9efe4726cabe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:37.462829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c468a408-9a50-4666-b383-9efe4726cabe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:37.463464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c468a408-9a50-4666-b383-9efe4726cabe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:37.464027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c468a408-9a50-4666-b383-9efe4726cabe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:37.479290 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-c468a408-9a50-4666-b383-9efe4726cabe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] HTTP exception thrown: Instance b3851c11-f4ba-40cd-946e-d113ddb6e3b3 could not be found. Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c468a408-9a50-4666-b383-9efe4726cabe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Request method failure captured: Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 HTTP/1.1 Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rUu3YcED0opSArrHM9V_E-nmsU4oucISRsaRvWk457ynGLMM_jS_jaMlflVxT57pDtC8v-lcMX4S2Eh731RKVU_uYV3OrSf7SL0qVKR_PLqs5a92dmXa18vt_FkL5lfZsgMYn0DkE0Ua1laG_qOe9YeGCIIpRnzKaC8v6x4ZZS_2ko Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 1c52341f519e47f59defbd74b623efac Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeTestJSON-914459124 Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:29:37.481211 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:29:37.482440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_1c52341f519e47f59defbd74b623efac", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/1c52341f519e47f59defbd74b623efac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/1c52341f519e47f59defbd74b623efac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/1c52341f519e47f59defbd74b623efac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:37.482440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeTestJSON-914459124 Aug 18 22:29:37.482440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 1c52341f519e47f59defbd74b623efac Aug 18 22:29:37.482440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeTestJSON-914459124 Aug 18 22:29:37.482440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeTestJSON-914459124-project Aug 18 22:29:37.482440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:29:37.482440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:29:37.482440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: a01cda302c5841cc937f219d7a06dc56 Aug 18 22:29:37.482440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeTestJSON-914459124-project Aug 18 22:29:37.482440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:29:37.482440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance b3851c11-f4ba-40cd-946e-d113ddb6e3b3 could not be found. Aug 18 22:29:37.482440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': 'b3851c11-f4ba-40cd-946e-d113ddb6e3b3'} Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3851c11-f4ba-40cd-946e-d113ddb6e3b3 could not be found. Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:37.483103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3851c11-f4ba-40cd-946e-d113ddb6e3b3 could not be found. Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3851c11-f4ba-40cd-946e-d113ddb6e3b3 could not be found. Aug 18 22:29:37.484241 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:37.485280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c468a408-9a50-4666-b383-9efe4726cabe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] Returning 404 to user: Instance b3851c11-f4ba-40cd-946e-d113ddb6e3b3 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:37.485280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c468a408-9a50-4666-b383-9efe4726cabe tempest-AttachVolumeTestJSON-914459124 tempest-AttachVolumeTestJSON-914459124-project] 10.222.0.82 "GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3" status: 404 len: 111 microversion: 2.1 time: 0.034377 Aug 18 22:29:37.485280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2130/4264] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:37 2022] GET /compute/v2.1/servers/b3851c11-f4ba-40cd-946e-d113ddb6e3b3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:29:37.844700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8d73b28c-7b20-4360-9cf2-9e9c01d5a431 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:37.845328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8d73b28c-7b20-4360-9cf2-9e9c01d5a431 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:37.866274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d73b28c-7b20-4360-9cf2-9e9c01d5a431 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:37.867004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d73b28c-7b20-4360-9cf2-9e9c01d5a431 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:37.870945 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d73b28c-7b20-4360-9cf2-9e9c01d5a431 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:37.873155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d73b28c-7b20-4360-9cf2-9e9c01d5a431 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:37.874008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d73b28c-7b20-4360-9cf2-9e9c01d5a431 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:37.874624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8d73b28c-7b20-4360-9cf2-9e9c01d5a431 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:37.995423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8d73b28c-7b20-4360-9cf2-9e9c01d5a431 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:38.007420 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-6d697512-f656-49fb-8389-228506136d49 req-2b7ee1b1-b788-45fe-819e-5c4b806a6990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb", "name": "network-vif-deleted", "tag": "ff8ff962-990d-4a4b-b5eb-71ff8e49cee2"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:38.019316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8d73b28c-7b20-4360-9cf2-9e9c01d5a431 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1614 microversion: 2.1 time: 0.178602 Aug 18 22:29:38.020251 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2135/4265] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:37 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1614 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:38.023755 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6d697512-f656-49fb-8389-228506136d49 req-2b7ee1b1-b788-45fe-819e-5c4b806a6990 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:38.034328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6d697512-f656-49fb-8389-228506136d49 req-2b7ee1b1-b788-45fe-819e-5c4b806a6990 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:38.034914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-6d697512-f656-49fb-8389-228506136d49 req-2b7ee1b1-b788-45fe-819e-5c4b806a6990 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:38.056339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-6d697512-f656-49fb-8389-228506136d49 req-2b7ee1b1-b788-45fe-819e-5c4b806a6990 service nova] Creating event network-vif-deleted:ff8ff962-990d-4a4b-b5eb-71ff8e49cee2 for instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb on hv-cinder-85367 Aug 18 22:29:38.072060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-6d697512-f656-49fb-8389-228506136d49 req-2b7ee1b1-b788-45fe-819e-5c4b806a6990 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173495 Aug 18 22:29:38.072826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2131/4266] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:29:38.151805 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-cc117158-0622-437a-baff-02045696d105 req-6e79e201-25bd-4c89-9721-cd5b1f05f88c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b11b63-0232-4f27-bacb-2e3872f6ae18", "name": "network-vif-deleted", "tag": "98ccabc6-a7d1-4192-af56-2e746060a479"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:38.162334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cc117158-0622-437a-baff-02045696d105 req-6e79e201-25bd-4c89-9721-cd5b1f05f88c service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:38.162829 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cc117158-0622-437a-baff-02045696d105 req-6e79e201-25bd-4c89-9721-cd5b1f05f88c service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:38.163263 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-cc117158-0622-437a-baff-02045696d105 req-6e79e201-25bd-4c89-9721-cd5b1f05f88c service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:38.187499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-cc117158-0622-437a-baff-02045696d105 req-6e79e201-25bd-4c89-9721-cd5b1f05f88c service nova] Creating event network-vif-deleted:98ccabc6-a7d1-4192-af56-2e746060a479 for instance e7b11b63-0232-4f27-bacb-2e3872f6ae18 on hv-cinder-85367 Aug 18 22:29:38.193491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-cc117158-0622-437a-baff-02045696d105 req-6e79e201-25bd-4c89-9721-cd5b1f05f88c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169411 Aug 18 22:29:38.194572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2136/4267] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:29:38.243075 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-44607213-bc56-4d38-988f-2d42a7126b80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:38.243806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-44607213-bc56-4d38-988f-2d42a7126b80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:38.262022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44607213-bc56-4d38-988f-2d42a7126b80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:38.262954 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44607213-bc56-4d38-988f-2d42a7126b80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:38.263552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44607213-bc56-4d38-988f-2d42a7126b80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:38.264598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-95169cab-b3d3-4a6f-acea-2ebf8652d0cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:38.265976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-95169cab-b3d3-4a6f-acea-2ebf8652d0cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:38.266386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44607213-bc56-4d38-988f-2d42a7126b80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:38.267018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44607213-bc56-4d38-988f-2d42a7126b80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:38.267594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-44607213-bc56-4d38-988f-2d42a7126b80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:38.284296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95169cab-b3d3-4a6f-acea-2ebf8652d0cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:38.294979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95169cab-b3d3-4a6f-acea-2ebf8652d0cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:38.295657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95169cab-b3d3-4a6f-acea-2ebf8652d0cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:38.296557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95169cab-b3d3-4a6f-acea-2ebf8652d0cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:38.297168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95169cab-b3d3-4a6f-acea-2ebf8652d0cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:38.298914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-95169cab-b3d3-4a6f-acea-2ebf8652d0cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:38.427754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-44607213-bc56-4d38-988f-2d42a7126b80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:38.439500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-44607213-bc56-4d38-988f-2d42a7126b80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:38.449818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-44607213-bc56-4d38-988f-2d42a7126b80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:38.451209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-44607213-bc56-4d38-988f-2d42a7126b80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1654 microversion: 2.20 time: 0.212403 Aug 18 22:29:38.452099 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2132/4268] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:29:38 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1654 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:29:38.940544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-95169cab-b3d3-4a6f-acea-2ebf8652d0cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:38.948312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-95169cab-b3d3-4a6f-acea-2ebf8652d0cf tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1508 microversion: 2.1 time: 0.699685 Aug 18 22:29:38.949298 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2137/4269] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:38 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1508 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:39.043766 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ee80f269-08a9-4652-8885-967440237079 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:39.045240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ee80f269-08a9-4652-8885-967440237079 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:39.053032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee80f269-08a9-4652-8885-967440237079 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:39.054625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee80f269-08a9-4652-8885-967440237079 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:39.055283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee80f269-08a9-4652-8885-967440237079 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:39.056204 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee80f269-08a9-4652-8885-967440237079 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:39.056866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee80f269-08a9-4652-8885-967440237079 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:39.057498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ee80f269-08a9-4652-8885-967440237079 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:39.160249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ee80f269-08a9-4652-8885-967440237079 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:39.172312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ee80f269-08a9-4652-8885-967440237079 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1614 microversion: 2.1 time: 0.131042 Aug 18 22:29:39.173453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2133/4270] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:39 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1614 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:39.475586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-722465ce-b1af-46e9-a29d-f992c5c35b03 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:39.476360 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-722465ce-b1af-46e9-a29d-f992c5c35b03 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:39.489322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-722465ce-b1af-46e9-a29d-f992c5c35b03 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:39.490916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-722465ce-b1af-46e9-a29d-f992c5c35b03 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:39.491567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-722465ce-b1af-46e9-a29d-f992c5c35b03 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:39.492532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-722465ce-b1af-46e9-a29d-f992c5c35b03 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:39.493217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-722465ce-b1af-46e9-a29d-f992c5c35b03 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:39.493848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-722465ce-b1af-46e9-a29d-f992c5c35b03 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:39.569110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-722465ce-b1af-46e9-a29d-f992c5c35b03 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:39.578669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-722465ce-b1af-46e9-a29d-f992c5c35b03 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:39.580174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-722465ce-b1af-46e9-a29d-f992c5c35b03 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:39.581419 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-722465ce-b1af-46e9-a29d-f992c5c35b03 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1654 microversion: 2.20 time: 0.109731 Aug 18 22:29:39.582505 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2138/4271] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:29:39 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1654 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:29:39.976185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-fe829b6b-8c21-4756-86e0-4002280d9538 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:39.976812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-fe829b6b-8c21-4756-86e0-4002280d9538 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:39.983746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe829b6b-8c21-4756-86e0-4002280d9538 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:39.984700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe829b6b-8c21-4756-86e0-4002280d9538 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:39.985577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe829b6b-8c21-4756-86e0-4002280d9538 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:39.986638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe829b6b-8c21-4756-86e0-4002280d9538 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:39.987115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe829b6b-8c21-4756-86e0-4002280d9538 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:39.987854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-fe829b6b-8c21-4756-86e0-4002280d9538 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:40.195852 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-36a2bf63-1550-439b-a8eb-4bca36ac4a56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:40.196714 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-36a2bf63-1550-439b-a8eb-4bca36ac4a56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:40.205738 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36a2bf63-1550-439b-a8eb-4bca36ac4a56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:40.206615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36a2bf63-1550-439b-a8eb-4bca36ac4a56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:40.207296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36a2bf63-1550-439b-a8eb-4bca36ac4a56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:40.208388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36a2bf63-1550-439b-a8eb-4bca36ac4a56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:40.209122 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36a2bf63-1550-439b-a8eb-4bca36ac4a56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:40.209763 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-36a2bf63-1550-439b-a8eb-4bca36ac4a56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:40.276131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-fe829b6b-8c21-4756-86e0-4002280d9538 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:40.284431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-fe829b6b-8c21-4756-86e0-4002280d9538 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1508 microversion: 2.1 time: 0.313260 Aug 18 22:29:40.285084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2134/4272] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:39 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1508 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:40.288313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-36a2bf63-1550-439b-a8eb-4bca36ac4a56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:40.298319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-36a2bf63-1550-439b-a8eb-4bca36ac4a56 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1614 microversion: 2.1 time: 0.107201 Aug 18 22:29:40.310087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2139/4273] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:40 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1614 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:29:40.383059 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-5ad4197b-aca2-4e3a-b004-523e48622c92 req-3bdf4ec9-77ac-47d4-a7a4-3922017d4cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efddf778-cd30-48e6-b04a-2a6277976fbd", "name": "network-vif-deleted", "tag": "310cc3a7-4b4d-47e3-8d1b-8a713e646929"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:40.392969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-5ad4197b-aca2-4e3a-b004-523e48622c92 req-3bdf4ec9-77ac-47d4-a7a4-3922017d4cd2 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:40.393831 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-5ad4197b-aca2-4e3a-b004-523e48622c92 req-3bdf4ec9-77ac-47d4-a7a4-3922017d4cd2 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:40.394337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-5ad4197b-aca2-4e3a-b004-523e48622c92 req-3bdf4ec9-77ac-47d4-a7a4-3922017d4cd2 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:40.406898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-5ad4197b-aca2-4e3a-b004-523e48622c92 req-3bdf4ec9-77ac-47d4-a7a4-3922017d4cd2 service nova] Creating event network-vif-deleted:310cc3a7-4b4d-47e3-8d1b-8a713e646929 for instance efddf778-cd30-48e6-b04a-2a6277976fbd on hv-cinder-85367 Aug 18 22:29:40.412262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-5ad4197b-aca2-4e3a-b004-523e48622c92 req-3bdf4ec9-77ac-47d4-a7a4-3922017d4cd2 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032903 Aug 18 22:29:40.413289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2135/4274] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:29:40.605342 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:40.605996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:40.618627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:40.622569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:40.623192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:40.624071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:40.624683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:40.626043 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:40.671341 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:40.671838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:40.672558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:40.673023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lazy-loading 'fault' on Instance uuid c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:29:40.742340 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:40.752959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:29:40.756797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:40.758400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e280bab439a3446b993c721bc98c1c6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb811ce4fca47728e61489adbf97434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:40.759552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-146e10fe-2ee9-4b40-9c15-67d1fc807157 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 200 len: 1371 microversion: 2.20 time: 0.158578 Aug 18 22:29:40.760115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2140/4275] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:29:40 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 22:29:41.307559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4134e694-1761-40fb-8312-5359e048ee75 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:41.308947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4134e694-1761-40fb-8312-5359e048ee75 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:41.318923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4134e694-1761-40fb-8312-5359e048ee75 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:41.319669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4134e694-1761-40fb-8312-5359e048ee75 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:41.320274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4134e694-1761-40fb-8312-5359e048ee75 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:41.321149 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4134e694-1761-40fb-8312-5359e048ee75 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:41.321858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4134e694-1761-40fb-8312-5359e048ee75 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:41.322615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4134e694-1761-40fb-8312-5359e048ee75 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:41.325878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:41.326498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:41.338057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:41.339217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:41.339731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:41.341308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:41.342156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:41.342734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:41.383685 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:41.384690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:41.385277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:41.386065 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lazy-loading 'fault' on Instance uuid efddf778-cd30-48e6-b04a-2a6277976fbd {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:29:41.410337 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4134e694-1761-40fb-8312-5359e048ee75 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:41.427601 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4134e694-1761-40fb-8312-5359e048ee75 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 200 len: 1292 microversion: 2.1 time: 0.124881 Aug 18 22:29:41.428945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2136/4276] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:41 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 1292 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:41.440194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:41.452270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e0331689-53a0-4e8c-81a0-fcf25c6a5a21 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 200 len: 1330 microversion: 2.1 time: 0.135185 Aug 18 22:29:41.452919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2141/4277] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:41 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 1330 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:29:41.788035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-906c890e-a893-47db-852a-813e324cc556 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:41.788739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-906c890e-a893-47db-852a-813e324cc556 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:41.799138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-906c890e-a893-47db-852a-813e324cc556 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:41.800996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-906c890e-a893-47db-852a-813e324cc556 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:41.804233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-906c890e-a893-47db-852a-813e324cc556 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:41.805179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-906c890e-a893-47db-852a-813e324cc556 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:41.805793 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-906c890e-a893-47db-852a-813e324cc556 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:41.806310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-906c890e-a893-47db-852a-813e324cc556 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:41.899823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-906c890e-a893-47db-852a-813e324cc556 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] HTTP exception thrown: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-906c890e-a893-47db-852a-813e324cc556 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Request method failure captured: Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb HTTP/1.1 Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rUw1-xoBPZuOmNGKjBB2kBQHrPZhuJXq6f1rOX5cZrSj1xpc6JSOM-3k71i_sAh5ys2h2aX-v5twLaZtVy3izjmy4hwvqR669HkOsxVNFaEt2gwAPBnJ68TgPmbIo1C6MqdYjitqH4tlKB5RBhFwThRMAeHbeUMf6kHor7besxcitQ Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: efb811ce4fca47728e61489adbf97434 Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:29:41.905580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:29:41.907163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_efb811ce4fca47728e61489adbf97434", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/efb811ce4fca47728e61489adbf97434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/efb811ce4fca47728e61489adbf97434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/efb811ce4fca47728e61489adbf97434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:41.907163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:41.907163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: efb811ce4fca47728e61489adbf97434 Aug 18 22:29:41.907163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:41.907163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeShelveTestJSON-836496132-project Aug 18 22:29:41.907163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:29:41.907163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:29:41.907163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: e280bab439a3446b993c721bc98c1c6e Aug 18 22:29:41.907163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeShelveTestJSON-836496132-project Aug 18 22:29:41.907163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:29:41.907163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:41.907163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': 'c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb'} Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:41.908089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:41.909475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:41.915298 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-906c890e-a893-47db-852a-813e324cc556 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Returning 404 to user: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:41.920051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-906c890e-a893-47db-852a-813e324cc556 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 404 len: 111 microversion: 2.20 time: 0.134973 Aug 18 22:29:41.921875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2137/4278] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:29:41 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 22:29:41.936042 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5a0f6bd5-5bfd-421f-bea7-cb459482275b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '.version_select at 0x7fd88e532040>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:41.995268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5a0f6bd5-5bfd-421f-bea7-cb459482275b tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011985393" status: 204 len: 0 microversion: 2.20 time: 0.068174 Aug 18 22:29:42.000087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2142/4279] 10.222.0.82 () {60 vars in 1262 bytes} [Thu Aug 18 22:29:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2011985393 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 22:29:42.440052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-ee5b5d7f-2075-4b75-8223-079395568d7d req-bfc47b6a-c81e-4b0d-b8e8-34a44a661b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b079c0d4-5952-4bbf-a148-c34875a08105", "name": "network-vif-deleted", "tag": "5a6d88bc-3090-4c5e-ab16-bbb9ec7a68f3"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:42.451881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-239a9345-9448-401c-8f54-293561d5f18f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:42.452509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-239a9345-9448-401c-8f54-293561d5f18f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: b079c0d4-5952-4bbf-a148-c34875a08105] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:42.465333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-ee5b5d7f-2075-4b75-8223-079395568d7d req-bfc47b6a-c81e-4b0d-b8e8-34a44a661b49 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:42.467265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-ee5b5d7f-2075-4b75-8223-079395568d7d req-bfc47b6a-c81e-4b0d-b8e8-34a44a661b49 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:42.468689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-ee5b5d7f-2075-4b75-8223-079395568d7d req-bfc47b6a-c81e-4b0d-b8e8-34a44a661b49 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:42.471025 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-239a9345-9448-401c-8f54-293561d5f18f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:42.471737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-239a9345-9448-401c-8f54-293561d5f18f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:42.472352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-239a9345-9448-401c-8f54-293561d5f18f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:42.473222 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-239a9345-9448-401c-8f54-293561d5f18f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:42.473862 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-239a9345-9448-401c-8f54-293561d5f18f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:42.474450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-239a9345-9448-401c-8f54-293561d5f18f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:42.491777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-239a9345-9448-401c-8f54-293561d5f18f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] HTTP exception thrown: Instance b079c0d4-5952-4bbf-a148-c34875a08105 could not be found. Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-239a9345-9448-401c-8f54-293561d5f18f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Request method failure captured: Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 HTTP/1.1 Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rUzAZHR_MTPG4eJ3KFYVTA565onzDKJxO1xSy-9It6A9DtmJ6F300Tyn7MqouaxuXCF3bBRuEPysbl4Qlry_Z0Mjpi9pocsEF0UrU9WWgJizF4d5s1BWfgp-r109oWhu2RDYnEoBMuaK1MUk3rKA7u7FJnLkZ8ikFqp1sSliWh_1qU Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 9894625c04a341e3a82584481410cd35 Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1925617752 Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:29:42.493996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:29:42.495413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9894625c04a341e3a82584481410cd35", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9894625c04a341e3a82584481410cd35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9894625c04a341e3a82584481410cd35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9894625c04a341e3a82584481410cd35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:42.495413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1925617752 Aug 18 22:29:42.495413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 9894625c04a341e3a82584481410cd35 Aug 18 22:29:42.495413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1925617752 Aug 18 22:29:42.495413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-ServerRescueNegativeTestJSON-1925617752-project Aug 18 22:29:42.495413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:29:42.495413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:29:42.495413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 42072422001c4f1684f68baa25517a9e Aug 18 22:29:42.495413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1925617752-project Aug 18 22:29:42.495413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:29:42.495413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance b079c0d4-5952-4bbf-a148-c34875a08105 could not be found. Aug 18 22:29:42.495413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': 'b079c0d4-5952-4bbf-a148-c34875a08105'} Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b079c0d4-5952-4bbf-a148-c34875a08105 could not be found. Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:42.496284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b079c0d4-5952-4bbf-a148-c34875a08105 could not be found. Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b079c0d4-5952-4bbf-a148-c34875a08105 could not be found. Aug 18 22:29:42.497695 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:42.498808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-ee5b5d7f-2075-4b75-8223-079395568d7d req-bfc47b6a-c81e-4b0d-b8e8-34a44a661b49 service nova] Creating event network-vif-deleted:5a6d88bc-3090-4c5e-ab16-bbb9ec7a68f3 for instance b079c0d4-5952-4bbf-a148-c34875a08105 on hv-cinder-85367 Aug 18 22:29:42.500102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-239a9345-9448-401c-8f54-293561d5f18f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Returning 404 to user: Instance b079c0d4-5952-4bbf-a148-c34875a08105 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:42.501200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-239a9345-9448-401c-8f54-293561d5f18f tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105" status: 404 len: 111 microversion: 2.1 time: 0.055006 Aug 18 22:29:42.502375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2143/4280] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:42 2022] GET /compute/v2.1/servers/b079c0d4-5952-4bbf-a148-c34875a08105 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 22:29:42.509790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b01f45a-d530-4067-8b6a-72f5f7d90c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:42.510970 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5b01f45a-d530-4067-8b6a-72f5f7d90c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:42.520152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b01f45a-d530-4067-8b6a-72f5f7d90c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:42.520886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b01f45a-d530-4067-8b6a-72f5f7d90c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:42.522073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b01f45a-d530-4067-8b6a-72f5f7d90c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:42.523355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b01f45a-d530-4067-8b6a-72f5f7d90c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:42.524115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b01f45a-d530-4067-8b6a-72f5f7d90c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:42.524737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5b01f45a-d530-4067-8b6a-72f5f7d90c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:42.532695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-ee5b5d7f-2075-4b75-8223-079395568d7d req-bfc47b6a-c81e-4b0d-b8e8-34a44a661b49 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097731 Aug 18 22:29:42.534101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2138/4281] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:29:42.554072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-47b4026a-90b2-4afa-8621-bd3d933012a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:42.554903 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-47b4026a-90b2-4afa-8621-bd3d933012a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:42.564653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47b4026a-90b2-4afa-8621-bd3d933012a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:42.565587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47b4026a-90b2-4afa-8621-bd3d933012a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:42.566200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-5b01f45a-d530-4067-8b6a-72f5f7d90c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] HTTP exception thrown: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:29:42.566633 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47b4026a-90b2-4afa-8621-bd3d933012a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:42.567611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47b4026a-90b2-4afa-8621-bd3d933012a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b01f45a-d530-4067-8b6a-72f5f7d90c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Request method failure captured: Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd HTTP/1.1 Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rWBIsfITIm8B5aAadYoYtda0awBoPJQ3oDuqOGHktq7_2BFfV86yckT-Pvy_DdsU84CbBgXzQDDx-uKH3hBO1dZNixUXGb6LhK0N9LZHsMdm_6JnJoe2wAQi1un1nAf2qs4VMjOEM8E7JksAIf_9lzrYLB1p3BpYyJ_ip384PM_XwU Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:29:42.567777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:29:42.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_aa6929ebd282417cb6ba149f50281240", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:42.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:29:42.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:29:42.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:29:42.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:29:42.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:29:42.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:29:42.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 7790a2ef47644d62863aafc890d03249 Aug 18 22:29:42.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:29:42.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:29:42.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:29:42.569306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': 'efddf778-cd30-48e6-b04a-2a6277976fbd'} Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:42.570180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:29:42.571459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:42.572616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5b01f45a-d530-4067-8b6a-72f5f7d90c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Returning 404 to user: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:42.572616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5b01f45a-d530-4067-8b6a-72f5f7d90c7b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 404 len: 111 microversion: 2.1 time: 0.065619 Aug 18 22:29:42.573726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2144/4282] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:42 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:29:42.574908 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47b4026a-90b2-4afa-8621-bd3d933012a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:42.576327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-47b4026a-90b2-4afa-8621-bd3d933012a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:42.580539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-60ae9e05-468f-4020-9dc9-6d337ea4f6c9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '.version_select at 0x7fd88e5323a0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:42.611245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-60ae9e05-468f-4020-9dc9-6d337ea4f6c9 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-172772601" status: 202 len: 0 microversion: 2.1 time: 0.035956 Aug 18 22:29:42.612967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2145/4283] 10.222.0.82 () {58 vars in 1218 bytes} [Thu Aug 18 22:29:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-172772601 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 22:29:42.817363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-47b4026a-90b2-4afa-8621-bd3d933012a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:29:42.930255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-47b4026a-90b2-4afa-8621-bd3d933012a6 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "DELETE /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 204 len: 0 microversion: 2.1 time: 0.393567 Aug 18 22:29:42.930885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2139/4284] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:29:42 2022] DELETE /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:29:42.940236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-dca02143-7f97-4462-b043-6cb033ced4cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:42.940686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-dca02143-7f97-4462-b043-6cb033ced4cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:42.953542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dca02143-7f97-4462-b043-6cb033ced4cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:42.954064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dca02143-7f97-4462-b043-6cb033ced4cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:42.954702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dca02143-7f97-4462-b043-6cb033ced4cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:42.955568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dca02143-7f97-4462-b043-6cb033ced4cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:42.956178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dca02143-7f97-4462-b043-6cb033ced4cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:42.957068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-dca02143-7f97-4462-b043-6cb033ced4cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:43.199548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-dca02143-7f97-4462-b043-6cb033ced4cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:43.211625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dca02143-7f97-4462-b043-6cb033ced4cd tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.275827 Aug 18 22:29:43.212427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2146/4285] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:42 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:43.709440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-782b57d3-cbd2-432c-8d42-687cd8a06943 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Action: 'create', calling method: .version_select at 0x7fd88e56e8b0>, body: {"keypair": {"name": "tempest-keypair-757840277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBH6IbZcL0h7UtB8aQM42G56cEUbfp1FBcMVqMFUrs/B/xIYLXY7Yrs6lBg3DxlXRrUgPGCzAMcL3R9JwmqHQQMJISafNkcPcEZvgYDa8EPX2uV4znNyhEtCSFC01PoGWA=="}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:43.728193 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-782b57d3-cbd2-432c-8d42-687cd8a06943 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for project aa6929ebd282417cb6ba149f50281240. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:29:43.733319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-782b57d3-cbd2-432c-8d42-687cd8a06943 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for user 7790a2ef47644d62863aafc890d03249 and project aa6929ebd282417cb6ba149f50281240. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:29:43.748126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR oslo.messaging._drivers.impl_rabbit [None req-782b57d3-cbd2-432c-8d42-687cd8a06943 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [bcec16ae-de5e-4f2f-995f-1bf59c566193] AMQP server on 10.222.0.82:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 22:29:44.312221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9939df77-1ab0-4f87-83d9-3ef6c460724b tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] Action: 'create', calling method: .version_select at 0x7fd88964e940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1519878204", "metadata": {"Type": "work"}}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:44.649144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9939df77-1ab0-4f87-83d9-3ef6c460724b tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.475579 Aug 18 22:29:44.649940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2147/4286] 10.222.0.82 () {60 vars in 1156 bytes} [Thu Aug 18 22:29:44 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 477 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 18 22:29:44.664469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-64440741-da79-475a-bc5a-4c7e892fbd8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:44.665155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-64440741-da79-475a-bc5a-4c7e892fbd8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:44.672785 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64440741-da79-475a-bc5a-4c7e892fbd8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:44.673391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64440741-da79-475a-bc5a-4c7e892fbd8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:44.674121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64440741-da79-475a-bc5a-4c7e892fbd8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:44.675032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64440741-da79-475a-bc5a-4c7e892fbd8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:44.675645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64440741-da79-475a-bc5a-4c7e892fbd8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:44.676186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-64440741-da79-475a-bc5a-4c7e892fbd8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:44.757215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [None req-782b57d3-cbd2-432c-8d42-687cd8a06943 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [bcec16ae-de5e-4f2f-995f-1bf59c566193] Reconnected to AMQP server on 10.222.0.82:5672 via [amqp] client with port 59608. Aug 18 22:29:44.774422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-782b57d3-cbd2-432c-8d42-687cd8a06943 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.068965 Aug 18 22:29:44.781502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2140/4287] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 22:29:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:29:44.786575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-64ad412a-910b-4e00-8246-aac6f9c0bd88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:44.787682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-64ad412a-910b-4e00-8246-aac6f9c0bd88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:44.794712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64ad412a-910b-4e00-8246-aac6f9c0bd88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:44.795310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64ad412a-910b-4e00-8246-aac6f9c0bd88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:44.795833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64ad412a-910b-4e00-8246-aac6f9c0bd88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:44.796622 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64ad412a-910b-4e00-8246-aac6f9c0bd88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:44.797200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64ad412a-910b-4e00-8246-aac6f9c0bd88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:44.797756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-64ad412a-910b-4e00-8246-aac6f9c0bd88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:44.812463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-64ad412a-910b-4e00-8246-aac6f9c0bd88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] HTTP exception thrown: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-64ad412a-910b-4e00-8246-aac6f9c0bd88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Request method failure captured: Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb HTTP/1.1 Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rUw1-xoBPZuOmNGKjBB2kBQHrPZhuJXq6f1rOX5cZrSj1xpc6JSOM-3k71i_sAh5ys2h2aX-v5twLaZtVy3izjmy4hwvqR669HkOsxVNFaEt2gwAPBnJ68TgPmbIo1C6MqdYjitqH4tlKB5RBhFwThRMAeHbeUMf6kHor7besxcitQ Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: efb811ce4fca47728e61489adbf97434 Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:29:44.814606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:29:44.815869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_efb811ce4fca47728e61489adbf97434", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/efb811ce4fca47728e61489adbf97434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/efb811ce4fca47728e61489adbf97434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/efb811ce4fca47728e61489adbf97434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:44.815869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:44.815869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: efb811ce4fca47728e61489adbf97434 Aug 18 22:29:44.815869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:44.815869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeShelveTestJSON-836496132-project Aug 18 22:29:44.815869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:29:44.815869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:29:44.815869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: e280bab439a3446b993c721bc98c1c6e Aug 18 22:29:44.815869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeShelveTestJSON-836496132-project Aug 18 22:29:44.815869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:29:44.815869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:44.815869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': 'c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb'} Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:44.816542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:44.817579 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:44.818656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-64ad412a-910b-4e00-8246-aac6f9c0bd88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Returning 404 to user: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:44.818656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-64ad412a-910b-4e00-8246-aac6f9c0bd88 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "DELETE /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 404 len: 111 microversion: 2.20 time: 0.033314 Aug 18 22:29:44.819542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2141/4288] 10.222.0.82 () {60 vars in 1280 bytes} [Thu Aug 18 22:29:44 2022] DELETE /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 22:29:44.824719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-b69dd9b3-5731-40bd-b13f-ef3418983984 req-d2d0c40d-4cdb-47dc-947f-53669de08c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca6f2dae-a492-46e5-ab40-5884ff13d01e", "name": "network-vif-deleted", "tag": "4a3c71ba-f9de-4571-b035-a9ed943dcc83"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:44.839825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b69dd9b3-5731-40bd-b13f-ef3418983984 req-d2d0c40d-4cdb-47dc-947f-53669de08c67 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:44.840395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b69dd9b3-5731-40bd-b13f-ef3418983984 req-d2d0c40d-4cdb-47dc-947f-53669de08c67 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:44.840962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-b69dd9b3-5731-40bd-b13f-ef3418983984 req-d2d0c40d-4cdb-47dc-947f-53669de08c67 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:44.846458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-64440741-da79-475a-bc5a-4c7e892fbd8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:44.855411 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-64440741-da79-475a-bc5a-4c7e892fbd8a tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1522 microversion: 2.1 time: 0.194826 Aug 18 22:29:44.856100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2148/4289] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:44 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:44.868627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d96ae2af-c008-49b3-ab17-552e618342c4 tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] Calling method '.version_select at 0x7fd8896a0f70>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:44.876627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-b69dd9b3-5731-40bd-b13f-ef3418983984 req-d2d0c40d-4cdb-47dc-947f-53669de08c67 service nova] Creating event network-vif-deleted:4a3c71ba-f9de-4571-b035-a9ed943dcc83 for instance ca6f2dae-a492-46e5-ab40-5884ff13d01e on hv-cinder-85367 Aug 18 22:29:44.888453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-b69dd9b3-5731-40bd-b13f-ef3418983984 req-d2d0c40d-4cdb-47dc-947f-53669de08c67 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067293 Aug 18 22:29:44.890012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2142/4290] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:29:44.898021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7bdeaae-4487-494a-9db4-264557d0fd80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:44.899142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f7bdeaae-4487-494a-9db4-264557d0fd80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:44.906919 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bdeaae-4487-494a-9db4-264557d0fd80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:44.907715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bdeaae-4487-494a-9db4-264557d0fd80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:44.908364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bdeaae-4487-494a-9db4-264557d0fd80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:44.909343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bdeaae-4487-494a-9db4-264557d0fd80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:44.910094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bdeaae-4487-494a-9db4-264557d0fd80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:44.910734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f7bdeaae-4487-494a-9db4-264557d0fd80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:44.928332 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-f7bdeaae-4487-494a-9db4-264557d0fd80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] HTTP exception thrown: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7bdeaae-4487-494a-9db4-264557d0fd80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Request method failure captured: Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb HTTP/1.1 Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rUw1-xoBPZuOmNGKjBB2kBQHrPZhuJXq6f1rOX5cZrSj1xpc6JSOM-3k71i_sAh5ys2h2aX-v5twLaZtVy3izjmy4hwvqR669HkOsxVNFaEt2gwAPBnJ68TgPmbIo1C6MqdYjitqH4tlKB5RBhFwThRMAeHbeUMf6kHor7besxcitQ Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: efb811ce4fca47728e61489adbf97434 Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:29:44.930906 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:29:44.932346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_efb811ce4fca47728e61489adbf97434", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/efb811ce4fca47728e61489adbf97434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/efb811ce4fca47728e61489adbf97434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/efb811ce4fca47728e61489adbf97434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:44.932346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:44.932346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: efb811ce4fca47728e61489adbf97434 Aug 18 22:29:44.932346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:44.932346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeShelveTestJSON-836496132-project Aug 18 22:29:44.932346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:29:44.932346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:29:44.932346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: e280bab439a3446b993c721bc98c1c6e Aug 18 22:29:44.932346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeShelveTestJSON-836496132-project Aug 18 22:29:44.932346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:29:44.932346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:44.932346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': 'c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb'} Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:44.933121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. Aug 18 22:29:44.935073 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:44.936288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7bdeaae-4487-494a-9db4-264557d0fd80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Returning 404 to user: Instance c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:44.936288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f7bdeaae-4487-494a-9db4-264557d0fd80 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb" status: 404 len: 111 microversion: 2.20 time: 0.041110 Aug 18 22:29:44.936288 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2143/4291] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:29:44 2022] GET /compute/v2.1/servers/c34d3926-a2f5-4e79-8ef8-7e52fdd5d1eb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 22:29:44.950009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d96ae2af-c008-49b3-ab17-552e618342c4 tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/4b9cb22d-f4fd-4e03-810b-bda58e5cae6c" status: 200 len: 354 microversion: 2.1 time: 0.092002 Aug 18 22:29:44.950585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2149/4292] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 22:29:44 2022] GET /compute/v2.1/os-volumes/4b9cb22d-f4fd-4e03-810b-bda58e5cae6c => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:29:44.964329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6b7f7cb6-df33-4771-8e90-b90b16053097 tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] Calling method '.version_select at 0x7fd88e53baf0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:45.041161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6b7f7cb6-df33-4771-8e90-b90b16053097 tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/4b9cb22d-f4fd-4e03-810b-bda58e5cae6c" status: 200 len: 354 microversion: 2.1 time: 0.081355 Aug 18 22:29:45.041808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2144/4293] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 22:29:44 2022] GET /compute/v2.1/os-volumes/4b9cb22d-f4fd-4e03-810b-bda58e5cae6c => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:29:45.061693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fcf60331-fcdf-49f3-afb3-5ce8f29010d4 tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] Calling method '.version_select at 0x7fd8896a01f0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:45.179660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fcf60331-fcdf-49f3-afb3-5ce8f29010d4 tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/4b9cb22d-f4fd-4e03-810b-bda58e5cae6c" status: 202 len: 0 microversion: 2.1 time: 0.123375 Aug 18 22:29:45.180769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2150/4294] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 22:29:45 2022] DELETE /compute/v2.1/os-volumes/4b9cb22d-f4fd-4e03-810b-bda58e5cae6c => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:29:45.194788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eb495ebc-4569-41a3-bd75-cf231a0da7dc tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] Calling method '.version_select at 0x7fd88e54cdc0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:45.280621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eb495ebc-4569-41a3-bd75-cf231a0da7dc tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/4b9cb22d-f4fd-4e03-810b-bda58e5cae6c" status: 200 len: 353 microversion: 2.1 time: 0.094421 Aug 18 22:29:45.281496 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2145/4295] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 22:29:45 2022] GET /compute/v2.1/os-volumes/4b9cb22d-f4fd-4e03-810b-bda58e5cae6c => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:29:45.881194 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:45.883393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:45.896568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:45.897320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:45.898560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:45.899678 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:45.900472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:45.901200 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:45.941935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:45.942438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:45.943101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:45.943576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lazy-loading 'fault' on Instance uuid 44bde447-4f59-4989-822c-8125ab3befeb {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:29:45.989460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42072422001c4f1684f68baa25517a9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9894625c04a341e3a82584481410cd35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:46.000087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-696440fd-5ef2-4f8c-a627-195a95484cca tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 200 len: 1311 microversion: 2.1 time: 0.125226 Aug 18 22:29:46.000782 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2151/4296] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:45 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:46.108842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-70b515ad-5f58-4a0d-8504-428f7c135123 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:46.109210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-70b515ad-5f58-4a0d-8504-428f7c135123 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:46.121695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70b515ad-5f58-4a0d-8504-428f7c135123 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:46.125405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70b515ad-5f58-4a0d-8504-428f7c135123 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:46.138476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70b515ad-5f58-4a0d-8504-428f7c135123 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:46.142537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70b515ad-5f58-4a0d-8504-428f7c135123 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:46.144768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70b515ad-5f58-4a0d-8504-428f7c135123 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:46.146639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-70b515ad-5f58-4a0d-8504-428f7c135123 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:46.176872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-70b515ad-5f58-4a0d-8504-428f7c135123 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] HTTP exception thrown: Instance 0426bb7b-e862-4873-9c1e-7878b89cde47 could not be found. Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-70b515ad-5f58-4a0d-8504-428f7c135123 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Request method failure captured: Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 HTTP/1.1 Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rUw1-xoBPZuOmNGKjBB2kBQHrPZhuJXq6f1rOX5cZrSj1xpc6JSOM-3k71i_sAh5ys2h2aX-v5twLaZtVy3izjmy4hwvqR669HkOsxVNFaEt2gwAPBnJ68TgPmbIo1C6MqdYjitqH4tlKB5RBhFwThRMAeHbeUMf6kHor7besxcitQ Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: efb811ce4fca47728e61489adbf97434 Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:29:46.179150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:29:46.180569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_efb811ce4fca47728e61489adbf97434", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/efb811ce4fca47728e61489adbf97434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/efb811ce4fca47728e61489adbf97434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/efb811ce4fca47728e61489adbf97434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:46.180569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:46.180569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: efb811ce4fca47728e61489adbf97434 Aug 18 22:29:46.180569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:46.180569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeShelveTestJSON-836496132-project Aug 18 22:29:46.180569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:29:46.180569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:29:46.180569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: e280bab439a3446b993c721bc98c1c6e Aug 18 22:29:46.180569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeShelveTestJSON-836496132-project Aug 18 22:29:46.180569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:29:46.180569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance 0426bb7b-e862-4873-9c1e-7878b89cde47 could not be found. Aug 18 22:29:46.180569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': '0426bb7b-e862-4873-9c1e-7878b89cde47'} Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0426bb7b-e862-4873-9c1e-7878b89cde47 could not be found. Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:46.181230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0426bb7b-e862-4873-9c1e-7878b89cde47 could not be found. Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0426bb7b-e862-4873-9c1e-7878b89cde47 could not be found. Aug 18 22:29:46.182329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.185457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-70b515ad-5f58-4a0d-8504-428f7c135123 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Returning 404 to user: Instance 0426bb7b-e862-4873-9c1e-7878b89cde47 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:46.187064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-70b515ad-5f58-4a0d-8504-428f7c135123 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 404 len: 111 microversion: 2.20 time: 0.084449 Aug 18 22:29:46.188653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2146/4297] 10.222.0.82 () {60 vars in 1280 bytes} [Thu Aug 18 22:29:46 2022] DELETE /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 22:29:46.196533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-761de126-b970-474f-8875-fb3092db8080 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:46.197582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-761de126-b970-474f-8875-fb3092db8080 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] [instance: 0426bb7b-e862-4873-9c1e-7878b89cde47] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:46.211525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761de126-b970-474f-8875-fb3092db8080 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:46.213658 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761de126-b970-474f-8875-fb3092db8080 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:46.214838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761de126-b970-474f-8875-fb3092db8080 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:46.216583 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761de126-b970-474f-8875-fb3092db8080 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:46.217210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761de126-b970-474f-8875-fb3092db8080 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:46.217880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-761de126-b970-474f-8875-fb3092db8080 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:46.236242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-761de126-b970-474f-8875-fb3092db8080 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] HTTP exception thrown: Instance 0426bb7b-e862-4873-9c1e-7878b89cde47 could not be found. Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-761de126-b970-474f-8875-fb3092db8080 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Request method failure captured: Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 HTTP/1.1 Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rUw1-xoBPZuOmNGKjBB2kBQHrPZhuJXq6f1rOX5cZrSj1xpc6JSOM-3k71i_sAh5ys2h2aX-v5twLaZtVy3izjmy4hwvqR669HkOsxVNFaEt2gwAPBnJ68TgPmbIo1C6MqdYjitqH4tlKB5RBhFwThRMAeHbeUMf6kHor7besxcitQ Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: efb811ce4fca47728e61489adbf97434 Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:29:46.238486 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:29:46.240176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_efb811ce4fca47728e61489adbf97434", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/efb811ce4fca47728e61489adbf97434"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/efb811ce4fca47728e61489adbf97434"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/efb811ce4fca47728e61489adbf97434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:46.240176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:46.240176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: efb811ce4fca47728e61489adbf97434 Aug 18 22:29:46.240176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-836496132 Aug 18 22:29:46.240176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeShelveTestJSON-836496132-project Aug 18 22:29:46.240176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:29:46.240176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:29:46.240176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: e280bab439a3446b993c721bc98c1c6e Aug 18 22:29:46.240176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeShelveTestJSON-836496132-project Aug 18 22:29:46.240176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:29:46.240176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance 0426bb7b-e862-4873-9c1e-7878b89cde47 could not be found. Aug 18 22:29:46.240176 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': '0426bb7b-e862-4873-9c1e-7878b89cde47'} Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0426bb7b-e862-4873-9c1e-7878b89cde47 could not be found. Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:46.240881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0426bb7b-e862-4873-9c1e-7878b89cde47 could not be found. Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0426bb7b-e862-4873-9c1e-7878b89cde47 could not be found. Aug 18 22:29:46.241928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.246382 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-761de126-b970-474f-8875-fb3092db8080 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] Returning 404 to user: Instance 0426bb7b-e862-4873-9c1e-7878b89cde47 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:46.248448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-761de126-b970-474f-8875-fb3092db8080 tempest-AttachVolumeShelveTestJSON-836496132 tempest-AttachVolumeShelveTestJSON-836496132-project] 10.222.0.82 "GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47" status: 404 len: 111 microversion: 2.20 time: 0.055996 Aug 18 22:29:46.249066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2152/4298] 10.222.0.82 () {60 vars in 1277 bytes} [Thu Aug 18 22:29:46 2022] GET /compute/v2.1/servers/0426bb7b-e862-4873-9c1e-7878b89cde47 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 22:29:46.295095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e346f907-8718-4d8e-af14-024cea00022b tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] Calling method '.version_select at 0x7fd88e5dd5e0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:46.340432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-e346f907-8718-4d8e-af14-024cea00022b tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] HTTP exception thrown: Volume 4b9cb22d-f4fd-4e03-810b-bda58e5cae6c could not be found. Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e346f907-8718-4d8e-af14-024cea00022b tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] Request method failure captured: Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/os-volumes/4b9cb22d-f4fd-4e03-810b-bda58e5cae6c HTTP/1.1 Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_r1YeQYmOWulmyH4YeGH-eYlKVc_SDxGYaBywpwPnufpHz5aVybRJx9e293_jNrlbPiRHvw4hdiehnoEAvXrBpYHVlcXcuIIM05M3D6xc67U9mggVxhs441sqnX1lPo9NdpHUx9JsObSdyG42VBJXZCbaYtEhKUWYSUzUd5YGeKGfas Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: e2642252d638481098b8fc1d814011be Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesGetTestJSON-276473017 Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:29:46.343691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_e2642252d638481098b8fc1d814011be", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/e2642252d638481098b8fc1d814011be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/e2642252d638481098b8fc1d814011be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/e2642252d638481098b8fc1d814011be"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesGetTestJSON-276473017 Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: e2642252d638481098b8fc1d814011be Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesGetTestJSON-276473017 Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesGetTestJSON-276473017-project Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 9cd2c566e1344155b62da300dd8b510d Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesGetTestJSON-276473017-project Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Volume 4b9cb22d-f4fd-4e03-810b-bda58e5cae6c could not be found. Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': '4b9cb22d-f4fd-4e03-810b-bda58e5cae6c'} Aug 18 22:29:46.345240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b9cb22d-f4fd-4e03-810b-bda58e5cae6c could not be found. (HTTP 404) (Request-ID: req-5e63f022-98ab-4a59-9d8b-d6ebdb5eef7c) Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:46.346299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 22:29:46.347353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b9cb22d-f4fd-4e03-810b-bda58e5cae6c could not be found. Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 22:29:46.348363 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:46.349361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4b9cb22d-f4fd-4e03-810b-bda58e5cae6c could not be found. Aug 18 22:29:46.349361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.349361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:46.349361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.349361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:46.349361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:46.349361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:46.349361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:46.349361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:46.349361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b9cb22d-f4fd-4e03-810b-bda58e5cae6c could not be found. Aug 18 22:29:46.349361 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:46.358213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e346f907-8718-4d8e-af14-024cea00022b tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] Returning 404 to user: Volume 4b9cb22d-f4fd-4e03-810b-bda58e5cae6c could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:46.359250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e346f907-8718-4d8e-af14-024cea00022b tempest-VolumesGetTestJSON-276473017 tempest-VolumesGetTestJSON-276473017-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/4b9cb22d-f4fd-4e03-810b-bda58e5cae6c" status: 404 len: 109 microversion: 2.1 time: 0.068765 Aug 18 22:29:46.359834 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2147/4299] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 22:29:46 2022] GET /compute/v2.1/os-volumes/4b9cb22d-f4fd-4e03-810b-bda58e5cae6c => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:29:46.761267 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1254693202", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4f28e51-196b-4c42-8717-0b4dbb184c81"}], "security_groups": [{"name": "tempest-securitygroup--867481309"}], "key_name": "tempest-keypair-757840277", "user_data": "}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:46.906967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-56bcae2c-b4ff-49bb-84d0-829e1dac0996 req-a504804a-8182-41fc-9362-6631080cb913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3f260fb-84bc-434c-b885-0a8f54494162", "name": "network-vif-deleted", "tag": "859d4e5f-383d-4366-b08c-f0d6c9520205"}, {"server_uuid": "44bde447-4f59-4989-822c-8125ab3befeb", "name": "network-vif-deleted", "tag": "e3b890d9-e4dc-4b1c-b774-b4b2c42f8616"}, {"server_uuid": "3f0b7a98-3ba3-4739-8b60-3c7946107c6e", "name": "network-vif-deleted", "tag": "b3adcd12-7019-4150-9399-0b0bcc04b72b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:46.921891 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-56bcae2c-b4ff-49bb-84d0-829e1dac0996 req-a504804a-8182-41fc-9362-6631080cb913 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:46.923061 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-56bcae2c-b4ff-49bb-84d0-829e1dac0996 req-a504804a-8182-41fc-9362-6631080cb913 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:46.923768 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-56bcae2c-b4ff-49bb-84d0-829e1dac0996 req-a504804a-8182-41fc-9362-6631080cb913 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:46.942262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-56bcae2c-b4ff-49bb-84d0-829e1dac0996 req-a504804a-8182-41fc-9362-6631080cb913 service nova] Creating event network-vif-deleted:859d4e5f-383d-4366-b08c-f0d6c9520205 for instance c3f260fb-84bc-434c-b885-0a8f54494162 on hv-cinder-85367 Aug 18 22:29:46.943057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-56bcae2c-b4ff-49bb-84d0-829e1dac0996 req-a504804a-8182-41fc-9362-6631080cb913 service nova] Creating event network-vif-deleted:e3b890d9-e4dc-4b1c-b774-b4b2c42f8616 for instance 44bde447-4f59-4989-822c-8125ab3befeb on hv-cinder-85367 Aug 18 22:29:46.943998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-56bcae2c-b4ff-49bb-84d0-829e1dac0996 req-a504804a-8182-41fc-9362-6631080cb913 service nova] Creating event network-vif-deleted:b3adcd12-7019-4150-9399-0b0bcc04b72b for instance 3f0b7a98-3ba3-4739-8b60-3c7946107c6e on hv-cinder-85367 Aug 18 22:29:46.956800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-56bcae2c-b4ff-49bb-84d0-829e1dac0996 req-a504804a-8182-41fc-9362-6631080cb913 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.054417 Aug 18 22:29:46.958483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2148/4300] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:29:46 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:29:47.000631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] validate_networks() for [('b4f28e51-196b-4c42-8717-0b4dbb184c81', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 22:29:47.023187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-459d0603-713b-459b-add2-769df9533a42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:47.023924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-459d0603-713b-459b-add2-769df9533a42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] [instance: 44bde447-4f59-4989-822c-8125ab3befeb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:47.031659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-459d0603-713b-459b-add2-769df9533a42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:47.032401 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-459d0603-713b-459b-add2-769df9533a42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:47.033016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-459d0603-713b-459b-add2-769df9533a42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:47.033799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-459d0603-713b-459b-add2-769df9533a42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:47.034262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-459d0603-713b-459b-add2-769df9533a42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:47.034702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-459d0603-713b-459b-add2-769df9533a42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:47.048759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-459d0603-713b-459b-add2-769df9533a42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] HTTP exception thrown: Instance 44bde447-4f59-4989-822c-8125ab3befeb could not be found. Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-459d0603-713b-459b-add2-769df9533a42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Request method failure captured: Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb HTTP/1.1 Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rUzAZHR_MTPG4eJ3KFYVTA565onzDKJxO1xSy-9It6A9DtmJ6F300Tyn7MqouaxuXCF3bBRuEPysbl4Qlry_Z0Mjpi9pocsEF0UrU9WWgJizF4d5s1BWfgp-r109oWhu2RDYnEoBMuaK1MUk3rKA7u7FJnLkZ8ikFqp1sSliWh_1qU Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 9894625c04a341e3a82584481410cd35 Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1925617752 Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:29:47.050543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:29:47.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_9894625c04a341e3a82584481410cd35", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/9894625c04a341e3a82584481410cd35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9894625c04a341e3a82584481410cd35"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/9894625c04a341e3a82584481410cd35"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:47.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1925617752 Aug 18 22:29:47.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 9894625c04a341e3a82584481410cd35 Aug 18 22:29:47.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1925617752 Aug 18 22:29:47.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-ServerRescueNegativeTestJSON-1925617752-project Aug 18 22:29:47.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:29:47.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:29:47.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 42072422001c4f1684f68baa25517a9e Aug 18 22:29:47.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1925617752-project Aug 18 22:29:47.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:29:47.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance 44bde447-4f59-4989-822c-8125ab3befeb could not be found. Aug 18 22:29:47.051812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': '44bde447-4f59-4989-822c-8125ab3befeb'} Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44bde447-4f59-4989-822c-8125ab3befeb could not be found. Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:47.052485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44bde447-4f59-4989-822c-8125ab3befeb could not be found. Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44bde447-4f59-4989-822c-8125ab3befeb could not be found. Aug 18 22:29:47.053512 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:47.055787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-459d0603-713b-459b-add2-769df9533a42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] Returning 404 to user: Instance 44bde447-4f59-4989-822c-8125ab3befeb could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:47.055787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-459d0603-713b-459b-add2-769df9533a42 tempest-ServerRescueNegativeTestJSON-1925617752 tempest-ServerRescueNegativeTestJSON-1925617752-project] 10.222.0.82 "GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb" status: 404 len: 111 microversion: 2.1 time: 0.033296 Aug 18 22:29:47.055787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2149/4301] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:47 2022] GET /compute/v2.1/servers/44bde447-4f59-4989-822c-8125ab3befeb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:29:47.873954 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 22:29:47.874545 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 22:29:47.875506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 22:29:47.875937 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 22:29:47.876352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 22:29:47.898881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:47.899407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:47.900726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:47.902344 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:47.903891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:47.904962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:47.934032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for project aa6929ebd282417cb6ba149f50281240. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:29:47.939774 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Getting quotas for user 7790a2ef47644d62863aafc890d03249 and project aa6929ebd282417cb6ba149f50281240. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:29:47.963742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 22:29:47.969663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 22:29:48.038379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-04c8bc73-1b7e-4f8c-bae2-bd4b4472e652 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.284244 Aug 18 22:29:48.045144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2153/4302] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 22:29:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 22:29:48.050535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-59f605bf-239a-4397-99c5-933b15e5eb0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:48.051895 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-59f605bf-239a-4397-99c5-933b15e5eb0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:48.145097 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-59f605bf-239a-4397-99c5-933b15e5eb0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:48.153967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-59f605bf-239a-4397-99c5-933b15e5eb0b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1241 microversion: 2.1 time: 0.106948 Aug 18 22:29:48.155495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2150/4303] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:48 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:49.176135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1fef12a7-77f2-4e0c-a56b-c872f4f6a1b1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:49.176732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1fef12a7-77f2-4e0c-a56b-c872f4f6a1b1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:49.259334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1fef12a7-77f2-4e0c-a56b-c872f4f6a1b1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:49.269804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1fef12a7-77f2-4e0c-a56b-c872f4f6a1b1 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1241 microversion: 2.1 time: 0.098042 Aug 18 22:29:49.271321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2154/4304] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:49 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:50.291664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-21021dd5-090c-48e7-8ceb-83eb3833fb3d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:50.292387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-21021dd5-090c-48e7-8ceb-83eb3833fb3d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:50.398772 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-21021dd5-090c-48e7-8ceb-83eb3833fb3d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:50.409776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-21021dd5-090c-48e7-8ceb-83eb3833fb3d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1241 microversion: 2.1 time: 0.120627 Aug 18 22:29:50.411754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2151/4305] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:50 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1241 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:51.432226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-212cab22-7ed9-49de-a76c-894798e9e04d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:51.433006 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-212cab22-7ed9-49de-a76c-894798e9e04d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:51.542060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-212cab22-7ed9-49de-a76c-894798e9e04d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:51.551554 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-212cab22-7ed9-49de-a76c-894798e9e04d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1241 microversion: 2.1 time: 0.123949 Aug 18 22:29:51.565056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2155/4306] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:51 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:52.578614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2a5bf2ac-c5d7-4698-a1cb-6fee59e4aaa4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:52.579409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2a5bf2ac-c5d7-4698-a1cb-6fee59e4aaa4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:52.587760 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a5bf2ac-c5d7-4698-a1cb-6fee59e4aaa4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:52.592339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a5bf2ac-c5d7-4698-a1cb-6fee59e4aaa4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:52.592339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a5bf2ac-c5d7-4698-a1cb-6fee59e4aaa4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:52.595774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a5bf2ac-c5d7-4698-a1cb-6fee59e4aaa4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:52.595774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a5bf2ac-c5d7-4698-a1cb-6fee59e4aaa4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:52.595774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2a5bf2ac-c5d7-4698-a1cb-6fee59e4aaa4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:52.600699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:29:52.715116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2a5bf2ac-c5d7-4698-a1cb-6fee59e4aaa4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:52.733535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2a5bf2ac-c5d7-4698-a1cb-6fee59e4aaa4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1245 microversion: 2.1 time: 0.164312 Aug 18 22:29:52.746503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2152/4307] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:52 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1245 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:53.756041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1959c8bb-5c35-46f0-9a29-8c98d4db572a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:53.757234 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1959c8bb-5c35-46f0-9a29-8c98d4db572a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:53.782153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1959c8bb-5c35-46f0-9a29-8c98d4db572a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:53.783571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1959c8bb-5c35-46f0-9a29-8c98d4db572a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:53.785216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1959c8bb-5c35-46f0-9a29-8c98d4db572a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:53.786329 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1959c8bb-5c35-46f0-9a29-8c98d4db572a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:53.786941 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1959c8bb-5c35-46f0-9a29-8c98d4db572a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:53.797036 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1959c8bb-5c35-46f0-9a29-8c98d4db572a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:53.955859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1959c8bb-5c35-46f0-9a29-8c98d4db572a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:53.969033 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1959c8bb-5c35-46f0-9a29-8c98d4db572a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1301 microversion: 2.1 time: 0.215241 Aug 18 22:29:53.974443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2156/4308] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:53 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1301 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:54.160661 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c1941ff1-b235-423e-b199-d72fad1e94cd tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Action: 'create', calling method: .version_select at 0x7fd88e5ddaf0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1295937494", "metadata": {"Type": "work"}}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c1941ff1-b235-423e-b199-d72fad1e94cd tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Request method failure captured: Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 122 Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_r1hxEvi9a7ep0S7Uw60LOkMk-WTX7lyG281QUYo4DAC4qivuoBCsXn8nw5G_ywZbRCZ1EHMkZzH30TqXuacFNhJqSfRqVN5wp7zEL0o2vxmpn_Kywd7DFev1x8urEQ1cAdAhsLBaOGuF_n0I2p3XuJXHlzg70Cyunt13hFm3gSTVWg Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 0a626e05e86b49b09f708bff1307eddd Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:29:54.177698 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0a626e05e86b49b09f708bff1307eddd", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 0a626e05e86b49b09f708bff1307eddd Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesNegativeTest-1950969070-project Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 275fdd34fad04902a38ea3ff88501065 Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesNegativeTest-1950969070-project Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1295937494", "metadata": {"Type": "work"}}} Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: Aug 18 22:29:54.179159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1295937494', 'metadata': {'Type': 'work'}}}} Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise error Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi '#$%' Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:54.180045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 22:29:54.181844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 22:29:54.183665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 22:29:54.183665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.186336 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c1941ff1-b235-423e-b199-d72fad1e94cd tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:54.187814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c1941ff1-b235-423e-b199-d72fad1e94cd tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.399139 Aug 18 22:29:54.192860 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2153/4309] 10.222.0.82 () {60 vars in 1156 bytes} [Thu Aug 18 22:29:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 405 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 22:29:54.198434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae6f057c-e748-4ecd-b45d-7f0a8034bbce tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Action: 'create', calling method: .version_select at 0x7fd8896f0dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1572634476", "metadata": {"Type": "work"}}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae6f057c-e748-4ecd-b45d-7f0a8034bbce tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Request method failure captured: Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 120 Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_r1hxEvi9a7ep0S7Uw60LOkMk-WTX7lyG281QUYo4DAC4qivuoBCsXn8nw5G_ywZbRCZ1EHMkZzH30TqXuacFNhJqSfRqVN5wp7zEL0o2vxmpn_Kywd7DFev1x8urEQ1cAdAhsLBaOGuF_n0I2p3XuJXHlzg70Cyunt13hFm3gSTVWg Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 0a626e05e86b49b09f708bff1307eddd Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:29:54.205014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0a626e05e86b49b09f708bff1307eddd", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 0a626e05e86b49b09f708bff1307eddd Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesNegativeTest-1950969070-project Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 275fdd34fad04902a38ea3ff88501065 Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesNegativeTest-1950969070-project Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1572634476", "metadata": {"Type": "work"}}} Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: Aug 18 22:29:54.206459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1572634476', 'metadata': {'Type': 'work'}}}} Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise error Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi '0' Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:54.207338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 22:29:54.208749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 22:29:54.210254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 22:29:54.210254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.210979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae6f057c-e748-4ecd-b45d-7f0a8034bbce tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:54.212260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ae6f057c-e748-4ecd-b45d-7f0a8034bbce tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018464 Aug 18 22:29:54.214357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2157/4310] 10.222.0.82 () {60 vars in 1156 bytes} [Thu Aug 18 22:29:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 22:29:54.225328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d7886d21-cd71-4b47-9e5c-2e68c30bcf91 tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Action: 'create', calling method: .version_select at 0x7fd88e5741f0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-576923868", "metadata": {"Type": "work"}}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d7886d21-cd71-4b47-9e5c-2e68c30bcf91 tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Request method failure captured: Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 118 Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_r1hxEvi9a7ep0S7Uw60LOkMk-WTX7lyG281QUYo4DAC4qivuoBCsXn8nw5G_ywZbRCZ1EHMkZzH30TqXuacFNhJqSfRqVN5wp7zEL0o2vxmpn_Kywd7DFev1x8urEQ1cAdAhsLBaOGuF_n0I2p3XuJXHlzg70Cyunt13hFm3gSTVWg Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 0a626e05e86b49b09f708bff1307eddd Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:29:54.229142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0a626e05e86b49b09f708bff1307eddd", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 0a626e05e86b49b09f708bff1307eddd Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesNegativeTest-1950969070-project Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 275fdd34fad04902a38ea3ff88501065 Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesNegativeTest-1950969070-project Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-576923868", "metadata": {"Type": "work"}}} Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: Aug 18 22:29:54.230899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-576923868', 'metadata': {'Type': 'work'}}}} Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise error Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi '' Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:54.232153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 22:29:54.233432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 22:29:54.234629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 22:29:54.234629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.234629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d7886d21-cd71-4b47-9e5c-2e68c30bcf91 tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:54.234629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d7886d21-cd71-4b47-9e5c-2e68c30bcf91 tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013122 Aug 18 22:29:54.234629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2154/4311] 10.222.0.82 () {60 vars in 1156 bytes} [Thu Aug 18 22:29:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 22:29:54.243575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c479d907-331b-4c44-ba2d-dd5e739eb447 tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Calling method '.version_select at 0x7fd88964e9d0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:54.281115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-c479d907-331b-4c44-ba2d-dd5e739eb447 tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] HTTP exception thrown: Volume tempest-invalid-1047193931 could not be found. Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c479d907-331b-4c44-ba2d-dd5e739eb447 tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Request method failure captured: Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1047193931 HTTP/1.1 Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_r1hxEvi9a7ep0S7Uw60LOkMk-WTX7lyG281QUYo4DAC4qivuoBCsXn8nw5G_ywZbRCZ1EHMkZzH30TqXuacFNhJqSfRqVN5wp7zEL0o2vxmpn_Kywd7DFev1x8urEQ1cAdAhsLBaOGuF_n0I2p3XuJXHlzg70Cyunt13hFm3gSTVWg Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 0a626e05e86b49b09f708bff1307eddd Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:29:54.284766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0a626e05e86b49b09f708bff1307eddd", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 0a626e05e86b49b09f708bff1307eddd Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesNegativeTest-1950969070-project Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 275fdd34fad04902a38ea3ff88501065 Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesNegativeTest-1950969070-project Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Volume tempest-invalid-1047193931 could not be found. Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': 'tempest-invalid-1047193931'} Aug 18 22:29:54.286396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1047193931 could not be found. (HTTP 404) (Request-ID: req-38541132-a0d9-4b6f-9d6e-58598a859dbe) Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.287306 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 22:29:54.288482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1047193931 could not be found. Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:54.291173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1047193931 could not be found. Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1047193931 could not be found. Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c479d907-331b-4c44-ba2d-dd5e739eb447 tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Returning 404 to user: Volume tempest-invalid-1047193931 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c479d907-331b-4c44-ba2d-dd5e739eb447 tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1047193931" status: 404 len: 99 microversion: 2.1 time: 0.046702 Aug 18 22:29:54.292584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2158/4312] 10.222.0.82 () {58 vars in 1218 bytes} [Thu Aug 18 22:29:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1047193931 => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 18 22:29:54.297467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-22d1b722-b761-4d08-9b14-3e2f667e6865 tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004239 Aug 18 22:29:54.298173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2155/4313] 10.222.0.82 () {58 vars in 1140 bytes} [Thu Aug 18 22:29:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 22:29:54.307514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-dad2e6e7-38f2-4399-971e-de8f76a555eb tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003757 Aug 18 22:29:54.307719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2159/4314] 10.222.0.82 () {58 vars in 1137 bytes} [Thu Aug 18 22:29:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 22:29:54.319227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8e6e735d-893f-4d4f-8342-63a9f37f7e1f tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Calling method '.version_select at 0x7fd88e5ddc10>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:54.360602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-8e6e735d-893f-4d4f-8342-63a9f37f7e1f tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] HTTP exception thrown: Volume c58415c2-a4cc-42cc-a475-de0f8c78d16e could not be found. Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8e6e735d-893f-4d4f-8342-63a9f37f7e1f tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Request method failure captured: Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/os-volumes/c58415c2-a4cc-42cc-a475-de0f8c78d16e HTTP/1.1 Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_r1hxEvi9a7ep0S7Uw60LOkMk-WTX7lyG281QUYo4DAC4qivuoBCsXn8nw5G_ywZbRCZ1EHMkZzH30TqXuacFNhJqSfRqVN5wp7zEL0o2vxmpn_Kywd7DFev1x8urEQ1cAdAhsLBaOGuF_n0I2p3XuJXHlzg70Cyunt13hFm3gSTVWg Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 0a626e05e86b49b09f708bff1307eddd Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:29:54.362977 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0a626e05e86b49b09f708bff1307eddd", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 0a626e05e86b49b09f708bff1307eddd Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesNegativeTest-1950969070-project Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 275fdd34fad04902a38ea3ff88501065 Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesNegativeTest-1950969070-project Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Volume c58415c2-a4cc-42cc-a475-de0f8c78d16e could not be found. Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': 'c58415c2-a4cc-42cc-a475-de0f8c78d16e'} Aug 18 22:29:54.364559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c58415c2-a4cc-42cc-a475-de0f8c78d16e could not be found. (HTTP 404) (Request-ID: req-8183bc9a-d896-473b-9ea0-3256992e29b3) Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.365527 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 22:29:54.366804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c58415c2-a4cc-42cc-a475-de0f8c78d16e could not be found. Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 22:29:54.368425 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:54.370417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c58415c2-a4cc-42cc-a475-de0f8c78d16e could not be found. Aug 18 22:29:54.370417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.370417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.370417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.370417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.370417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:54.370417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:54.370417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:54.370417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:54.370417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c58415c2-a4cc-42cc-a475-de0f8c78d16e could not be found. Aug 18 22:29:54.370417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.370417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8e6e735d-893f-4d4f-8342-63a9f37f7e1f tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Returning 404 to user: Volume c58415c2-a4cc-42cc-a475-de0f8c78d16e could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:54.371319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8e6e735d-893f-4d4f-8342-63a9f37f7e1f tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/c58415c2-a4cc-42cc-a475-de0f8c78d16e" status: 404 len: 109 microversion: 2.1 time: 0.056844 Aug 18 22:29:54.371897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2156/4315] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 22:29:54 2022] DELETE /compute/v2.1/os-volumes/c58415c2-a4cc-42cc-a475-de0f8c78d16e => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:29:54.383429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-af9637e8-4265-44bf-9a0d-a1eb3b414a2b tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Calling method '.version_select at 0x7fd88e5f9e50>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:54.439420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-af9637e8-4265-44bf-9a0d-a1eb3b414a2b tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] HTTP exception thrown: Volume 30eeb49b-6cb8-488c-bd5a-85115e70fe05 could not be found. Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-af9637e8-4265-44bf-9a0d-a1eb3b414a2b tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Request method failure captured: Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/os-volumes/30eeb49b-6cb8-488c-bd5a-85115e70fe05 HTTP/1.1 Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_r1hxEvi9a7ep0S7Uw60LOkMk-WTX7lyG281QUYo4DAC4qivuoBCsXn8nw5G_ywZbRCZ1EHMkZzH30TqXuacFNhJqSfRqVN5wp7zEL0o2vxmpn_Kywd7DFev1x8urEQ1cAdAhsLBaOGuF_n0I2p3XuJXHlzg70Cyunt13hFm3gSTVWg Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 0a626e05e86b49b09f708bff1307eddd Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:29:54.442435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_0a626e05e86b49b09f708bff1307eddd", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/0a626e05e86b49b09f708bff1307eddd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 0a626e05e86b49b09f708bff1307eddd Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesNegativeTest-1950969070 Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesNegativeTest-1950969070-project Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 275fdd34fad04902a38ea3ff88501065 Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesNegativeTest-1950969070-project Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Volume 30eeb49b-6cb8-488c-bd5a-85115e70fe05 could not be found. Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': '30eeb49b-6cb8-488c-bd5a-85115e70fe05'} Aug 18 22:29:54.443879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 30eeb49b-6cb8-488c-bd5a-85115e70fe05 could not be found. (HTTP 404) (Request-ID: req-4caa7185-5748-420e-8c1b-7c10ee7f957e) Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.444816 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 22:29:54.445993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 30eeb49b-6cb8-488c-bd5a-85115e70fe05 could not be found. Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 22:29:54.447377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 30eeb49b-6cb8-488c-bd5a-85115e70fe05 could not be found. Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 30eeb49b-6cb8-488c-bd5a-85115e70fe05 could not be found. Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-af9637e8-4265-44bf-9a0d-a1eb3b414a2b tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] Returning 404 to user: Volume 30eeb49b-6cb8-488c-bd5a-85115e70fe05 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-af9637e8-4265-44bf-9a0d-a1eb3b414a2b tempest-VolumesNegativeTest-1950969070 tempest-VolumesNegativeTest-1950969070-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/30eeb49b-6cb8-488c-bd5a-85115e70fe05" status: 404 len: 109 microversion: 2.1 time: 0.068109 Aug 18 22:29:54.449289 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2160/4316] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 22:29:54 2022] GET /compute/v2.1/os-volumes/30eeb49b-6cb8-488c-bd5a-85115e70fe05 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:29:54.999594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-808c2039-f740-4e0c-8229-8693501a4f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:55.001643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-808c2039-f740-4e0c-8229-8693501a4f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:55.026870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-808c2039-f740-4e0c-8229-8693501a4f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:55.030213 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-808c2039-f740-4e0c-8229-8693501a4f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:55.031338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-808c2039-f740-4e0c-8229-8693501a4f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:55.033123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-808c2039-f740-4e0c-8229-8693501a4f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:55.034162 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-808c2039-f740-4e0c-8229-8693501a4f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:55.035900 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-808c2039-f740-4e0c-8229-8693501a4f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:55.335060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-808c2039-f740-4e0c-8229-8693501a4f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:55.344376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-808c2039-f740-4e0c-8229-8693501a4f52 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1366 microversion: 2.1 time: 0.355612 Aug 18 22:29:55.345276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2157/4317] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:54 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:55.784890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-0baea4e9-dfe7-46d5-803c-8a50c16232ee req-50ed6454-a883-44c9-bbb8-8253c8433ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d6551e6-1c93-4857-8c40-3e345353f113", "tag": "71d29818-272d-4a6b-9437-ad3c2747981b"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:29:55.808618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0baea4e9-dfe7-46d5-803c-8a50c16232ee req-50ed6454-a883-44c9-bbb8-8253c8433ad9 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:55.810974 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0baea4e9-dfe7-46d5-803c-8a50c16232ee req-50ed6454-a883-44c9-bbb8-8253c8433ad9 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:55.811636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0baea4e9-dfe7-46d5-803c-8a50c16232ee req-50ed6454-a883-44c9-bbb8-8253c8433ad9 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:55.829534 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-0baea4e9-dfe7-46d5-803c-8a50c16232ee req-50ed6454-a883-44c9-bbb8-8253c8433ad9 service nova] Creating event network-changed:71d29818-272d-4a6b-9437-ad3c2747981b for instance 7d6551e6-1c93-4857-8c40-3e345353f113 on hv-cinder-85367 Aug 18 22:29:55.851429 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-0baea4e9-dfe7-46d5-803c-8a50c16232ee req-50ed6454-a883-44c9-bbb8-8253c8433ad9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071884 Aug 18 22:29:55.852664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2161/4318] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:29:56.365899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c689c39b-f141-4ce4-af30-c68b1e4d240a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:56.366526 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c689c39b-f141-4ce4-af30-c68b1e4d240a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:56.375200 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c689c39b-f141-4ce4-af30-c68b1e4d240a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:56.375691 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c689c39b-f141-4ce4-af30-c68b1e4d240a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:56.379961 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c689c39b-f141-4ce4-af30-c68b1e4d240a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:56.381523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c689c39b-f141-4ce4-af30-c68b1e4d240a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:56.382117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c689c39b-f141-4ce4-af30-c68b1e4d240a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:56.382877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c689c39b-f141-4ce4-af30-c68b1e4d240a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:56.540113 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c689c39b-f141-4ce4-af30-c68b1e4d240a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:56.548426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c689c39b-f141-4ce4-af30-c68b1e4d240a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1366 microversion: 2.1 time: 0.186765 Aug 18 22:29:56.549233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2158/4319] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:56 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:57.086368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:29:57.086517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:29:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:29:57.570752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-999f1b7a-00cd-4af3-a011-de0751caf8d3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:57.571978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-999f1b7a-00cd-4af3-a011-de0751caf8d3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:57.577293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:29:57.595141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-999f1b7a-00cd-4af3-a011-de0751caf8d3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:57.595501 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-999f1b7a-00cd-4af3-a011-de0751caf8d3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:57.596393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-999f1b7a-00cd-4af3-a011-de0751caf8d3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:57.598664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-999f1b7a-00cd-4af3-a011-de0751caf8d3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:57.599118 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-999f1b7a-00cd-4af3-a011-de0751caf8d3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:57.599609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-999f1b7a-00cd-4af3-a011-de0751caf8d3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:57.846252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-999f1b7a-00cd-4af3-a011-de0751caf8d3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:57.859439 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-999f1b7a-00cd-4af3-a011-de0751caf8d3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1366 microversion: 2.1 time: 0.292204 Aug 18 22:29:57.860292 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2162/4320] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:57 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:29:58.884466 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9216f624-7258-43f3-8df4-e0562d657c71 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:29:58.884965 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9216f624-7258-43f3-8df4-e0562d657c71 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:29:58.892517 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9216f624-7258-43f3-8df4-e0562d657c71 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:58.893280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9216f624-7258-43f3-8df4-e0562d657c71 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:58.894034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9216f624-7258-43f3-8df4-e0562d657c71 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:58.894453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9216f624-7258-43f3-8df4-e0562d657c71 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:29:58.894905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9216f624-7258-43f3-8df4-e0562d657c71 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:29:58.896188 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9216f624-7258-43f3-8df4-e0562d657c71 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:29:59.040568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9216f624-7258-43f3-8df4-e0562d657c71 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:29:59.052032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9216f624-7258-43f3-8df4-e0562d657c71 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1366 microversion: 2.1 time: 0.173082 Aug 18 22:29:59.052850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2159/4321] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:29:58 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:00.074272 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ff9c86b0-cad5-473e-babc-f89728a2298a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:00.075051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ff9c86b0-cad5-473e-babc-f89728a2298a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:00.077883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:00.082618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff9c86b0-cad5-473e-babc-f89728a2298a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:00.083315 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff9c86b0-cad5-473e-babc-f89728a2298a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:00.083752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff9c86b0-cad5-473e-babc-f89728a2298a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:00.084833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff9c86b0-cad5-473e-babc-f89728a2298a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:00.085452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff9c86b0-cad5-473e-babc-f89728a2298a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:00.086071 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ff9c86b0-cad5-473e-babc-f89728a2298a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:00.235768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ff9c86b0-cad5-473e-babc-f89728a2298a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:00.243958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ff9c86b0-cad5-473e-babc-f89728a2298a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1366 microversion: 2.1 time: 0.174302 Aug 18 22:30:00.254628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2163/4322] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:00 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:01.271970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d4b0575e-8f79-411e-ae1c-000c894322f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:01.273172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d4b0575e-8f79-411e-ae1c-000c894322f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:01.279017 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=8 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:01.281564 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4b0575e-8f79-411e-ae1c-000c894322f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:01.282098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4b0575e-8f79-411e-ae1c-000c894322f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:01.282635 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4b0575e-8f79-411e-ae1c-000c894322f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:01.283353 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4b0575e-8f79-411e-ae1c-000c894322f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:01.283814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4b0575e-8f79-411e-ae1c-000c894322f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:01.284247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d4b0575e-8f79-411e-ae1c-000c894322f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:01.420807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d4b0575e-8f79-411e-ae1c-000c894322f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:01.428677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d4b0575e-8f79-411e-ae1c-000c894322f0 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1366 microversion: 2.1 time: 0.160442 Aug 18 22:30:01.429239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2160/4323] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:01 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:02.451639 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f30437c5-12df-4c07-a848-dc994dc44112 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:02.452379 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f30437c5-12df-4c07-a848-dc994dc44112 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:02.465560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=10 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:02.465560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f30437c5-12df-4c07-a848-dc994dc44112 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:02.465560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f30437c5-12df-4c07-a848-dc994dc44112 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:02.465560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f30437c5-12df-4c07-a848-dc994dc44112 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:02.465895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f30437c5-12df-4c07-a848-dc994dc44112 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:02.465895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f30437c5-12df-4c07-a848-dc994dc44112 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:02.465895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f30437c5-12df-4c07-a848-dc994dc44112 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:02.604768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f30437c5-12df-4c07-a848-dc994dc44112 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:02.612513 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f30437c5-12df-4c07-a848-dc994dc44112 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1366 microversion: 2.1 time: 0.165218 Aug 18 22:30:02.613109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2164/4324] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:02 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:03.633693 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d5eaefd0-50c8-4ed2-9e55-5cb0f242d38b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:03.634530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d5eaefd0-50c8-4ed2-9e55-5cb0f242d38b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:03.641533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5eaefd0-50c8-4ed2-9e55-5cb0f242d38b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:03.642144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5eaefd0-50c8-4ed2-9e55-5cb0f242d38b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:03.642656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5eaefd0-50c8-4ed2-9e55-5cb0f242d38b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:03.643455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5eaefd0-50c8-4ed2-9e55-5cb0f242d38b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:03.644027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5eaefd0-50c8-4ed2-9e55-5cb0f242d38b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:03.644529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d5eaefd0-50c8-4ed2-9e55-5cb0f242d38b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:03.781058 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d5eaefd0-50c8-4ed2-9e55-5cb0f242d38b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:03.788825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d5eaefd0-50c8-4ed2-9e55-5cb0f242d38b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1366 microversion: 2.1 time: 0.158978 Aug 18 22:30:03.789397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2161/4325] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:03 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:04.810606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a6cca960-564e-4ebc-8609-eaf411d2f7db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:04.811492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a6cca960-564e-4ebc-8609-eaf411d2f7db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:04.818356 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6cca960-564e-4ebc-8609-eaf411d2f7db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:04.818926 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6cca960-564e-4ebc-8609-eaf411d2f7db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:04.819372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6cca960-564e-4ebc-8609-eaf411d2f7db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:04.820078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6cca960-564e-4ebc-8609-eaf411d2f7db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:04.820565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6cca960-564e-4ebc-8609-eaf411d2f7db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:04.820993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a6cca960-564e-4ebc-8609-eaf411d2f7db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:04.959299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a6cca960-564e-4ebc-8609-eaf411d2f7db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:04.967754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a6cca960-564e-4ebc-8609-eaf411d2f7db tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1366 microversion: 2.1 time: 0.160916 Aug 18 22:30:04.968416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2165/4326] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:04 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:05.531713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-d27e9273-ee45-4e70-8052-d91f5da8f21f req-8cfd1a77-4e1c-43ea-95fb-6b4b9efdbe93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6551e6-1c93-4857-8c40-3e345353f113", "name": "network-vif-plugged", "status": "completed", "tag": "71d29818-272d-4a6b-9437-ad3c2747981b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:30:05.538318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:05.542014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-d27e9273-ee45-4e70-8052-d91f5da8f21f req-8cfd1a77-4e1c-43ea-95fb-6b4b9efdbe93 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:05.542495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-d27e9273-ee45-4e70-8052-d91f5da8f21f req-8cfd1a77-4e1c-43ea-95fb-6b4b9efdbe93 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:05.542928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-d27e9273-ee45-4e70-8052-d91f5da8f21f req-8cfd1a77-4e1c-43ea-95fb-6b4b9efdbe93 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:05.557478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-d27e9273-ee45-4e70-8052-d91f5da8f21f req-8cfd1a77-4e1c-43ea-95fb-6b4b9efdbe93 service nova] Creating event network-vif-plugged:71d29818-272d-4a6b-9437-ad3c2747981b for instance 7d6551e6-1c93-4857-8c40-3e345353f113 on hv-cinder-85367 Aug 18 22:30:05.563923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-d27e9273-ee45-4e70-8052-d91f5da8f21f req-8cfd1a77-4e1c-43ea-95fb-6b4b9efdbe93 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.304448 Aug 18 22:30:05.564505 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2162/4327] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:30:05.993007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae2171ae-9dff-4b4d-ab07-f8007faea5ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:05.993804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ae2171ae-9dff-4b4d-ab07-f8007faea5ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:06.003133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae2171ae-9dff-4b4d-ab07-f8007faea5ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:06.003846 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae2171ae-9dff-4b4d-ab07-f8007faea5ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:06.004296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae2171ae-9dff-4b4d-ab07-f8007faea5ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:06.005236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae2171ae-9dff-4b4d-ab07-f8007faea5ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:06.005864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae2171ae-9dff-4b4d-ab07-f8007faea5ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:06.006491 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae2171ae-9dff-4b4d-ab07-f8007faea5ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:06.186810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ae2171ae-9dff-4b4d-ab07-f8007faea5ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:06.194661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ae2171ae-9dff-4b4d-ab07-f8007faea5ef tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1366 microversion: 2.1 time: 0.207285 Aug 18 22:30:06.195323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2166/4328] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:05 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:07.220151 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7116e40a-9cdd-41d4-be8a-3fd083d0c760 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:07.220979 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7116e40a-9cdd-41d4-be8a-3fd083d0c760 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:07.231587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7116e40a-9cdd-41d4-be8a-3fd083d0c760 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:07.233114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7116e40a-9cdd-41d4-be8a-3fd083d0c760 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:07.233565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7116e40a-9cdd-41d4-be8a-3fd083d0c760 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:07.234542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7116e40a-9cdd-41d4-be8a-3fd083d0c760 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:07.235267 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7116e40a-9cdd-41d4-be8a-3fd083d0c760 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:07.235875 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7116e40a-9cdd-41d4-be8a-3fd083d0c760 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:07.447295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7116e40a-9cdd-41d4-be8a-3fd083d0c760 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:07.455810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7116e40a-9cdd-41d4-be8a-3fd083d0c760 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1366 microversion: 2.1 time: 0.241315 Aug 18 22:30:07.456520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2163/4329] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:07 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:08.477522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-35e3c623-1ffe-4832-9704-9fd119092d75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:08.478380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-35e3c623-1ffe-4832-9704-9fd119092d75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:08.490542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35e3c623-1ffe-4832-9704-9fd119092d75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:08.491265 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35e3c623-1ffe-4832-9704-9fd119092d75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:08.492094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35e3c623-1ffe-4832-9704-9fd119092d75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:08.494576 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35e3c623-1ffe-4832-9704-9fd119092d75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:08.495375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35e3c623-1ffe-4832-9704-9fd119092d75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:08.496656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-35e3c623-1ffe-4832-9704-9fd119092d75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:08.713160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-35e3c623-1ffe-4832-9704-9fd119092d75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:08.731902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-35e3c623-1ffe-4832-9704-9fd119092d75 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1557 microversion: 2.1 time: 0.258872 Aug 18 22:30:08.733018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2167/4330] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:08 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1557 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:08.753836 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eb09eb5e-b02e-4549-91c8-4ae4226c795f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:08.755098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-eb09eb5e-b02e-4549-91c8-4ae4226c795f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:08.762885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb09eb5e-b02e-4549-91c8-4ae4226c795f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:08.764077 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb09eb5e-b02e-4549-91c8-4ae4226c795f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:08.764702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb09eb5e-b02e-4549-91c8-4ae4226c795f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:08.765913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb09eb5e-b02e-4549-91c8-4ae4226c795f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:08.766653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb09eb5e-b02e-4549-91c8-4ae4226c795f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:08.767491 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-eb09eb5e-b02e-4549-91c8-4ae4226c795f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:08.868614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eb09eb5e-b02e-4549-91c8-4ae4226c795f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119072 Aug 18 22:30:08.869404 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2164/4331] 10.222.0.82 () {58 vars in 1275 bytes} [Thu Aug 18 22:30:08 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:30:10.479318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-40828999-fcca-46bb-9a19-1eb6bf981164 req-5226bdca-87bb-4450-8ad2-66d368c18bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d6551e6-1c93-4857-8c40-3e345353f113", "tag": "71d29818-272d-4a6b-9437-ad3c2747981b"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:30:10.493804 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-40828999-fcca-46bb-9a19-1eb6bf981164 req-5226bdca-87bb-4450-8ad2-66d368c18bc3 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:10.494539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-40828999-fcca-46bb-9a19-1eb6bf981164 req-5226bdca-87bb-4450-8ad2-66d368c18bc3 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:10.495075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-40828999-fcca-46bb-9a19-1eb6bf981164 req-5226bdca-87bb-4450-8ad2-66d368c18bc3 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:10.510958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-40828999-fcca-46bb-9a19-1eb6bf981164 req-5226bdca-87bb-4450-8ad2-66d368c18bc3 service nova] Creating event network-changed:71d29818-272d-4a6b-9437-ad3c2747981b for instance 7d6551e6-1c93-4857-8c40-3e345353f113 on hv-cinder-85367 Aug 18 22:30:10.517319 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-40828999-fcca-46bb-9a19-1eb6bf981164 req-5226bdca-87bb-4450-8ad2-66d368c18bc3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041797 Aug 18 22:30:10.518671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2168/4332] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:30:21.589904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=5 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:21.590688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=46 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:21.838880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-eee5eef6-adaa-4c45-8275-72e4e3b902e0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Action: 'create', calling method: .version_select at 0x7fd88e574670>, body: {"keypair": {"name": "tempest-TestShelveInstance-8096190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK7VfTGRAuvsxlUItTUFkhykRtyqiOrXJMfoOKRExZozZyEFxztpjXTZGNW723BsGn+seTfmDyY37SMD8S9QtxnL8kmvIO7m6be3NoQa1gG/XWrVyvIz6XJF44uwqZ2Tg=="}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:30:21.884735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-eee5eef6-adaa-4c45-8275-72e4e3b902e0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Getting quotas for project 6c01cdc6c55b4fdf999fbc75c1f4b51b. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:30:21.890092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-eee5eef6-adaa-4c45-8275-72e4e3b902e0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Getting quotas for user 3e7526ef9eb0426a855f5b2b9be06a8d and project 6c01cdc6c55b4fdf999fbc75c1f4b51b. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:30:21.926643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-eee5eef6-adaa-4c45-8275-72e4e3b902e0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.336990 Aug 18 22:30:21.927459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2165/4333] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 22:30:21 2022] POST /compute/v2.1/os-keypairs => generated 394 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:30:44.754007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=13 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:44.754826 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=82 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:44.759201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1042806475", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "networks": [{"uuid": "3b7157af-9e92-4886-a50d-6e7cba91262e"}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:30:44.818053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] validate_networks() for [('3b7157af-9e92-4886-a50d-6e7cba91262e', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 22:30:45.189579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 22:30:45.190158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 22:30:45.190642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 22:30:45.191075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 22:30:45.191479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 22:30:45.200604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:45.201728 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:45.202238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:45.203107 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:45.203559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:45.203978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:45.222612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Getting quotas for project 61268e79778c4a20b3b7beca375d5706. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:30:45.227362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Getting quotas for user baa2e8e668894ea4b82fea3a2bc1fe9e and project 61268e79778c4a20b3b7beca375d5706. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:30:45.238966 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 22:30:45.241376 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 22:30:45.290227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-92238ae3-e2c5-454a-93d7-ef89bdea1fc3 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.537746 Aug 18 22:30:45.290874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2169/4334] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 22:30:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 22:30:45.299973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:45.300781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:45.305220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-58706996-c5c9-451f-a2fa-ec625c424255 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:45.306176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-58706996-c5c9-451f-a2fa-ec625c424255 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:45.367889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-58706996-c5c9-451f-a2fa-ec625c424255 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:45.375692 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-58706996-c5c9-451f-a2fa-ec625c424255 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1214 microversion: 2.1 time: 0.077427 Aug 18 22:30:45.376265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2166/4335] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:45 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:45.976704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1659668093", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-8096190", "security_groups": [{"name": "tempest-secgroup-smoke-955374143"}], "networks": [{"uuid": "5c848ecd-ad30-4ced-b867-df5fe4130193"}], "block_device_mapping_v2": [{"uuid": "45c93ccc-c356-483b-8020-855fa96a5e74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:30:46.090527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] validate_networks() for [('5c848ecd-ad30-4ced-b867-df5fe4130193', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 22:30:46.396216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3243cea2-f745-4702-a70f-d5f59d9ce852 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:46.396935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3243cea2-f745-4702-a70f-d5f59d9ce852 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:46.403677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3243cea2-f745-4702-a70f-d5f59d9ce852 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:46.405150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3243cea2-f745-4702-a70f-d5f59d9ce852 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:46.405882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3243cea2-f745-4702-a70f-d5f59d9ce852 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:46.407083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3243cea2-f745-4702-a70f-d5f59d9ce852 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:46.407397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3243cea2-f745-4702-a70f-d5f59d9ce852 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:46.408131 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3243cea2-f745-4702-a70f-d5f59d9ce852 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:46.491098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3243cea2-f745-4702-a70f-d5f59d9ce852 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:46.498846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3243cea2-f745-4702-a70f-d5f59d9ce852 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1272 microversion: 2.1 time: 0.106410 Aug 18 22:30:46.514227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2167/4336] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:46 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:46.556076 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 22:30:46.556502 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 22:30:46.557157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 22:30:46.557787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 22:30:46.558210 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 22:30:46.567822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:46.568305 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:46.568743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:46.569495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:46.569986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:46.570414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:46.587955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Getting quotas for project 6c01cdc6c55b4fdf999fbc75c1f4b51b. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:30:46.591811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Getting quotas for user 3e7526ef9eb0426a855f5b2b9be06a8d and project 6c01cdc6c55b4fdf999fbc75c1f4b51b. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:30:46.652152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 22:30:46.654366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45c93ccc-c356-483b-8020-855fa96a5e74',volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 22:30:46.798465 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cd94b6e4-a331-461b-88dc-71f68b58fdc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.825538 Aug 18 22:30:46.799123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2170/4337] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 22:30:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 22:30:46.809736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3d05381f-484d-4fb5-8de0-8ea8b9efbb2d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:46.811145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3d05381f-484d-4fb5-8de0-8ea8b9efbb2d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:46.880604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3d05381f-484d-4fb5-8de0-8ea8b9efbb2d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:46.889071 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3d05381f-484d-4fb5-8de0-8ea8b9efbb2d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1086 microversion: 2.1 time: 0.082275 Aug 18 22:30:46.889901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2168/4338] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:46 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1086 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:47.524642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c4d9ceb9-8b92-4876-85c5-6cd1f827bc0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:47.525266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c4d9ceb9-8b92-4876-85c5-6cd1f827bc0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:47.537047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4d9ceb9-8b92-4876-85c5-6cd1f827bc0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:47.537569 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4d9ceb9-8b92-4876-85c5-6cd1f827bc0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:47.538243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4d9ceb9-8b92-4876-85c5-6cd1f827bc0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:47.539371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4d9ceb9-8b92-4876-85c5-6cd1f827bc0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:47.540023 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4d9ceb9-8b92-4876-85c5-6cd1f827bc0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:47.540460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c4d9ceb9-8b92-4876-85c5-6cd1f827bc0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:47.684422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c4d9ceb9-8b92-4876-85c5-6cd1f827bc0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:47.703246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c4d9ceb9-8b92-4876-85c5-6cd1f827bc0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1314 microversion: 2.1 time: 0.186281 Aug 18 22:30:47.704192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2171/4339] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:47 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:30:47.705731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-e1c875ea-24d9-481e-a835-6aea9060a1a7 req-44ec2eb3-c9d5-484b-99fa-509fb5013176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405", "tag": "d7322213-198b-43f8-96dc-470edce7409b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:30:47.740094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-e1c875ea-24d9-481e-a835-6aea9060a1a7 req-44ec2eb3-c9d5-484b-99fa-509fb5013176 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:47.740519 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-e1c875ea-24d9-481e-a835-6aea9060a1a7 req-44ec2eb3-c9d5-484b-99fa-509fb5013176 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:47.741117 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-e1c875ea-24d9-481e-a835-6aea9060a1a7 req-44ec2eb3-c9d5-484b-99fa-509fb5013176 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:47.752101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-e1c875ea-24d9-481e-a835-6aea9060a1a7 req-44ec2eb3-c9d5-484b-99fa-509fb5013176 service nova] Creating event network-changed:d7322213-198b-43f8-96dc-470edce7409b for instance 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 on hv-cinder-85367 Aug 18 22:30:47.757948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-e1c875ea-24d9-481e-a835-6aea9060a1a7 req-44ec2eb3-c9d5-484b-99fa-509fb5013176 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057042 Aug 18 22:30:47.758554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2169/4340] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:30:47.911987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2d5c02a6-5448-45b9-bfbd-875370b0e1bd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:47.912697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2d5c02a6-5448-45b9-bfbd-875370b0e1bd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:47.919532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d5c02a6-5448-45b9-bfbd-875370b0e1bd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:47.920108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d5c02a6-5448-45b9-bfbd-875370b0e1bd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:47.920677 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d5c02a6-5448-45b9-bfbd-875370b0e1bd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:47.921435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d5c02a6-5448-45b9-bfbd-875370b0e1bd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:47.922142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d5c02a6-5448-45b9-bfbd-875370b0e1bd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:47.922671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2d5c02a6-5448-45b9-bfbd-875370b0e1bd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:47.994521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2d5c02a6-5448-45b9-bfbd-875370b0e1bd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:48.003417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2d5c02a6-5448-45b9-bfbd-875370b0e1bd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1202 microversion: 2.1 time: 0.095728 Aug 18 22:30:48.003971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2172/4341] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:47 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1202 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:48.472132 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-759f8edc-1330-4431-8d26-6ec9431eb597 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:48.472753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-759f8edc-1330-4431-8d26-6ec9431eb597 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:48.479418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-759f8edc-1330-4431-8d26-6ec9431eb597 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:48.480135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-759f8edc-1330-4431-8d26-6ec9431eb597 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:48.480811 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-759f8edc-1330-4431-8d26-6ec9431eb597 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:48.481829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-759f8edc-1330-4431-8d26-6ec9431eb597 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:48.482984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-759f8edc-1330-4431-8d26-6ec9431eb597 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:48.483627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-759f8edc-1330-4431-8d26-6ec9431eb597 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:48.511805 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-759f8edc-1330-4431-8d26-6ec9431eb597 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/ips" status: 200 len: 151 microversion: 2.1 time: 0.044078 Aug 18 22:30:48.512928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2170/4342] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 22:30:48 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:30:48.737051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-26327d33-6f38-47d8-969c-fd08a0e5127e tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:48.746330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-26327d33-6f38-47d8-969c-fd08a0e5127e tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:48.753459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26327d33-6f38-47d8-969c-fd08a0e5127e tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:48.754212 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26327d33-6f38-47d8-969c-fd08a0e5127e tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:48.754800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26327d33-6f38-47d8-969c-fd08a0e5127e tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:48.755649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26327d33-6f38-47d8-969c-fd08a0e5127e tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:48.756423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26327d33-6f38-47d8-969c-fd08a0e5127e tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:48.757260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-26327d33-6f38-47d8-969c-fd08a0e5127e tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:48.942887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-26327d33-6f38-47d8-969c-fd08a0e5127e tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:48.952035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-26327d33-6f38-47d8-969c-fd08a0e5127e tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1314 microversion: 2.1 time: 0.219695 Aug 18 22:30:48.953037 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2173/4343] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:48 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:49.028598 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c04124d0-118b-4089-be12-a6446cbd88fd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:49.033225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c04124d0-118b-4089-be12-a6446cbd88fd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:49.040783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c04124d0-118b-4089-be12-a6446cbd88fd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:49.041708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c04124d0-118b-4089-be12-a6446cbd88fd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:49.042450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c04124d0-118b-4089-be12-a6446cbd88fd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:49.043495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c04124d0-118b-4089-be12-a6446cbd88fd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:49.045503 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c04124d0-118b-4089-be12-a6446cbd88fd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:49.046166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c04124d0-118b-4089-be12-a6446cbd88fd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:49.216838 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c04124d0-118b-4089-be12-a6446cbd88fd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:49.225728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c04124d0-118b-4089-be12-a6446cbd88fd tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1269 microversion: 2.1 time: 0.203318 Aug 18 22:30:49.226688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2171/4344] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:49 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1269 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:49.974232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a7a261c-2904-42ea-9a44-477028a6c905 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:49.974849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0a7a261c-2904-42ea-9a44-477028a6c905 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:49.981236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a7a261c-2904-42ea-9a44-477028a6c905 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:49.981807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a7a261c-2904-42ea-9a44-477028a6c905 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:49.982753 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a7a261c-2904-42ea-9a44-477028a6c905 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:49.983445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a7a261c-2904-42ea-9a44-477028a6c905 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:49.983896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a7a261c-2904-42ea-9a44-477028a6c905 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:49.984316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a7a261c-2904-42ea-9a44-477028a6c905 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:50.049688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-45c36bbb-cacc-48bc-aa35-8af36787bc6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "394e5ff8-f26a-44f4-b12d-de6819deccd4"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:30:50.052546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-45c36bbb-cacc-48bc-aa35-8af36787bc6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:50.064051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c36bbb-cacc-48bc-aa35-8af36787bc6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:50.064746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c36bbb-cacc-48bc-aa35-8af36787bc6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:50.065186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c36bbb-cacc-48bc-aa35-8af36787bc6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:50.065924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c36bbb-cacc-48bc-aa35-8af36787bc6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:50.066378 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c36bbb-cacc-48bc-aa35-8af36787bc6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:50.067320 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-45c36bbb-cacc-48bc-aa35-8af36787bc6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:50.151111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0a7a261c-2904-42ea-9a44-477028a6c905 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:50.159566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a7a261c-2904-42ea-9a44-477028a6c905 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1314 microversion: 2.1 time: 0.188978 Aug 18 22:30:50.160291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2174/4345] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:49 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:50.249488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9bd8b103-ebbd-4258-9f0f-b89fa77904ea tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:50.251049 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9bd8b103-ebbd-4258-9f0f-b89fa77904ea tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:50.260744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd8b103-ebbd-4258-9f0f-b89fa77904ea tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:50.261444 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd8b103-ebbd-4258-9f0f-b89fa77904ea tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:50.262591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd8b103-ebbd-4258-9f0f-b89fa77904ea tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:50.263703 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd8b103-ebbd-4258-9f0f-b89fa77904ea tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:50.264322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd8b103-ebbd-4258-9f0f-b89fa77904ea tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:50.265075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bd8b103-ebbd-4258-9f0f-b89fa77904ea tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:50.383232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-45c36bbb-cacc-48bc-aa35-8af36787bc6d tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "POST /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341947 Aug 18 22:30:50.384088 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2172/4346] 10.222.0.82 () {60 vars in 1323 bytes} [Thu Aug 18 22:30:50 2022] POST /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:30:50.437541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9bd8b103-ebbd-4258-9f0f-b89fa77904ea tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:50.447243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9bd8b103-ebbd-4258-9f0f-b89fa77904ea tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.202992 Aug 18 22:30:50.447828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2175/4347] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:50 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:30:50.469480 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-400caa6c-a02a-4407-b061-9370c23a0a80 req-6f6c4f8c-4c9f-4002-9ca5-7ab8472f70ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e60ed1-0091-4e24-8cfa-b854eed71bf4", "tag": "f7486d36-da4f-4543-8560-136f47b31774"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:30:50.483159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-400caa6c-a02a-4407-b061-9370c23a0a80 req-6f6c4f8c-4c9f-4002-9ca5-7ab8472f70ae service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:50.483653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-400caa6c-a02a-4407-b061-9370c23a0a80 req-6f6c4f8c-4c9f-4002-9ca5-7ab8472f70ae service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:50.489047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-400caa6c-a02a-4407-b061-9370c23a0a80 req-6f6c4f8c-4c9f-4002-9ca5-7ab8472f70ae service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:50.519612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-400caa6c-a02a-4407-b061-9370c23a0a80 req-6f6c4f8c-4c9f-4002-9ca5-7ab8472f70ae service nova] Creating event network-changed:f7486d36-da4f-4543-8560-136f47b31774 for instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 on hv-cinder-85367 Aug 18 22:30:50.525256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-400caa6c-a02a-4407-b061-9370c23a0a80 req-6f6c4f8c-4c9f-4002-9ca5-7ab8472f70ae service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061194 Aug 18 22:30:50.526507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2173/4348] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:30:51.181582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2cccb0a3-4df9-4eb3-8d9b-90a5caf113c9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:51.182388 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2cccb0a3-4df9-4eb3-8d9b-90a5caf113c9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:51.190407 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cccb0a3-4df9-4eb3-8d9b-90a5caf113c9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:51.190890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cccb0a3-4df9-4eb3-8d9b-90a5caf113c9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:51.191591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cccb0a3-4df9-4eb3-8d9b-90a5caf113c9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:51.192455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cccb0a3-4df9-4eb3-8d9b-90a5caf113c9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:51.193074 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cccb0a3-4df9-4eb3-8d9b-90a5caf113c9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:51.193497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2cccb0a3-4df9-4eb3-8d9b-90a5caf113c9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:51.341978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2cccb0a3-4df9-4eb3-8d9b-90a5caf113c9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:51.350035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2cccb0a3-4df9-4eb3-8d9b-90a5caf113c9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1314 microversion: 2.1 time: 0.173428 Aug 18 22:30:51.350616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2176/4349] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:51 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:51.480597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2c113813-ec07-4109-9cd1-e6b3f0421b59 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:51.481381 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2c113813-ec07-4109-9cd1-e6b3f0421b59 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:51.487940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c113813-ec07-4109-9cd1-e6b3f0421b59 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:51.488426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c113813-ec07-4109-9cd1-e6b3f0421b59 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:51.488867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c113813-ec07-4109-9cd1-e6b3f0421b59 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:51.489686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c113813-ec07-4109-9cd1-e6b3f0421b59 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:51.490148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c113813-ec07-4109-9cd1-e6b3f0421b59 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:51.490581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2c113813-ec07-4109-9cd1-e6b3f0421b59 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:51.715896 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2c113813-ec07-4109-9cd1-e6b3f0421b59 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:51.723969 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2c113813-ec07-4109-9cd1-e6b3f0421b59 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.247998 Aug 18 22:30:51.724537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2174/4350] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:51 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:52.370961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-228352d9-abec-4c31-939a-a91089b0a891 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:52.371577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-228352d9-abec-4c31-939a-a91089b0a891 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:52.378001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-228352d9-abec-4c31-939a-a91089b0a891 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:52.378479 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-228352d9-abec-4c31-939a-a91089b0a891 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:52.378916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-228352d9-abec-4c31-939a-a91089b0a891 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:52.379601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-228352d9-abec-4c31-939a-a91089b0a891 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:52.380052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-228352d9-abec-4c31-939a-a91089b0a891 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:52.380474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-228352d9-abec-4c31-939a-a91089b0a891 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:52.520980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-228352d9-abec-4c31-939a-a91089b0a891 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:52.531100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-228352d9-abec-4c31-939a-a91089b0a891 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1314 microversion: 2.1 time: 0.163591 Aug 18 22:30:52.531586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2177/4351] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:52 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:52.745384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-050b60b2-e9a4-4ece-974a-6cdc9aa0d5d1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:52.746130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-050b60b2-e9a4-4ece-974a-6cdc9aa0d5d1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:52.754345 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-050b60b2-e9a4-4ece-974a-6cdc9aa0d5d1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:52.755028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-050b60b2-e9a4-4ece-974a-6cdc9aa0d5d1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:52.755684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-050b60b2-e9a4-4ece-974a-6cdc9aa0d5d1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:52.756637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-050b60b2-e9a4-4ece-974a-6cdc9aa0d5d1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:52.757483 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-050b60b2-e9a4-4ece-974a-6cdc9aa0d5d1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:52.758595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-050b60b2-e9a4-4ece-974a-6cdc9aa0d5d1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:52.903005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-050b60b2-e9a4-4ece-974a-6cdc9aa0d5d1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:52.911595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-050b60b2-e9a4-4ece-974a-6cdc9aa0d5d1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.170601 Aug 18 22:30:52.912169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2175/4352] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:52 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:53.551177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c0f9b34d-0e25-4c4e-9be1-7c4e8f6ddff1 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:53.551794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c0f9b34d-0e25-4c4e-9be1-7c4e8f6ddff1 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:53.558290 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0f9b34d-0e25-4c4e-9be1-7c4e8f6ddff1 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:53.558772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0f9b34d-0e25-4c4e-9be1-7c4e8f6ddff1 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:53.559207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0f9b34d-0e25-4c4e-9be1-7c4e8f6ddff1 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:53.559894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0f9b34d-0e25-4c4e-9be1-7c4e8f6ddff1 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:53.560347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0f9b34d-0e25-4c4e-9be1-7c4e8f6ddff1 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:53.560771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c0f9b34d-0e25-4c4e-9be1-7c4e8f6ddff1 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:53.693453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c0f9b34d-0e25-4c4e-9be1-7c4e8f6ddff1 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:53.702174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c0f9b34d-0e25-4c4e-9be1-7c4e8f6ddff1 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1314 microversion: 2.1 time: 0.154603 Aug 18 22:30:53.715438 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2178/4353] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:53 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:53.932520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2841d3e1-bb98-4d23-bb32-3b9899aae3a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:53.933136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2841d3e1-bb98-4d23-bb32-3b9899aae3a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:53.939690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2841d3e1-bb98-4d23-bb32-3b9899aae3a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:53.940165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2841d3e1-bb98-4d23-bb32-3b9899aae3a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:53.940595 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2841d3e1-bb98-4d23-bb32-3b9899aae3a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:53.941271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2841d3e1-bb98-4d23-bb32-3b9899aae3a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:53.941813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2841d3e1-bb98-4d23-bb32-3b9899aae3a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:53.942233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2841d3e1-bb98-4d23-bb32-3b9899aae3a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:54.074636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2841d3e1-bb98-4d23-bb32-3b9899aae3a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:54.082970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2841d3e1-bb98-4d23-bb32-3b9899aae3a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.154267 Aug 18 22:30:54.083574 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2176/4354] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:53 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:54.383320 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-0bef25a0-f03f-4cb2-b3f5-8dfb3fddc6e8 req-89f12882-a735-4a29-a18d-b3ca4dd921dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405", "name": "network-vif-plugged", "status": "completed", "tag": "d7322213-198b-43f8-96dc-470edce7409b"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:30:54.395616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0bef25a0-f03f-4cb2-b3f5-8dfb3fddc6e8 req-89f12882-a735-4a29-a18d-b3ca4dd921dc service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:54.396266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0bef25a0-f03f-4cb2-b3f5-8dfb3fddc6e8 req-89f12882-a735-4a29-a18d-b3ca4dd921dc service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:54.396794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0bef25a0-f03f-4cb2-b3f5-8dfb3fddc6e8 req-89f12882-a735-4a29-a18d-b3ca4dd921dc service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:54.408918 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-0bef25a0-f03f-4cb2-b3f5-8dfb3fddc6e8 req-89f12882-a735-4a29-a18d-b3ca4dd921dc service nova] Creating event network-vif-plugged:d7322213-198b-43f8-96dc-470edce7409b for instance 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 on hv-cinder-85367 Aug 18 22:30:54.414261 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-0bef25a0-f03f-4cb2-b3f5-8dfb3fddc6e8 req-89f12882-a735-4a29-a18d-b3ca4dd921dc service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035071 Aug 18 22:30:54.414859 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2179/4355] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:30:54.724069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-46eb24eb-5d33-4f0a-9eb3-dd7edbee0e5c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:54.724270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-46eb24eb-5d33-4f0a-9eb3-dd7edbee0e5c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:54.731176 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46eb24eb-5d33-4f0a-9eb3-dd7edbee0e5c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:54.731346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46eb24eb-5d33-4f0a-9eb3-dd7edbee0e5c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:54.732551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46eb24eb-5d33-4f0a-9eb3-dd7edbee0e5c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:54.733250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46eb24eb-5d33-4f0a-9eb3-dd7edbee0e5c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:54.733745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46eb24eb-5d33-4f0a-9eb3-dd7edbee0e5c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:54.734175 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-46eb24eb-5d33-4f0a-9eb3-dd7edbee0e5c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:54.891165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-46eb24eb-5d33-4f0a-9eb3-dd7edbee0e5c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:54.900818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-46eb24eb-5d33-4f0a-9eb3-dd7edbee0e5c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1314 microversion: 2.1 time: 0.180957 Aug 18 22:30:54.901387 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2177/4356] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:54 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:55.103102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-25ebef8c-9218-413e-9337-3ac1ce7aca09 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:55.104364 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-25ebef8c-9218-413e-9337-3ac1ce7aca09 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:55.112893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ebef8c-9218-413e-9337-3ac1ce7aca09 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:55.113369 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ebef8c-9218-413e-9337-3ac1ce7aca09 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:55.113841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ebef8c-9218-413e-9337-3ac1ce7aca09 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:55.114541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ebef8c-9218-413e-9337-3ac1ce7aca09 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:55.115009 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ebef8c-9218-413e-9337-3ac1ce7aca09 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:55.115417 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-25ebef8c-9218-413e-9337-3ac1ce7aca09 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:55.248508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-25ebef8c-9218-413e-9337-3ac1ce7aca09 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:55.256145 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-25ebef8c-9218-413e-9337-3ac1ce7aca09 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.157147 Aug 18 22:30:55.256717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2180/4357] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:55 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:55.922654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3d3dddac-8408-435c-8890-86526b3dc048 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:55.923205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3d3dddac-8408-435c-8890-86526b3dc048 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:55.929749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d3dddac-8408-435c-8890-86526b3dc048 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:55.930235 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d3dddac-8408-435c-8890-86526b3dc048 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:55.930675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d3dddac-8408-435c-8890-86526b3dc048 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:55.931368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d3dddac-8408-435c-8890-86526b3dc048 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:55.931828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d3dddac-8408-435c-8890-86526b3dc048 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:55.932256 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3d3dddac-8408-435c-8890-86526b3dc048 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:56.062331 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3d3dddac-8408-435c-8890-86526b3dc048 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:56.069935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3d3dddac-8408-435c-8890-86526b3dc048 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1314 microversion: 2.1 time: 0.151666 Aug 18 22:30:56.070513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2178/4358] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:55 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:56.276989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7fd45ca2-4306-4784-afd3-d737227d7b33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:56.277632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7fd45ca2-4306-4784-afd3-d737227d7b33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:56.284765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fd45ca2-4306-4784-afd3-d737227d7b33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:56.285241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fd45ca2-4306-4784-afd3-d737227d7b33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:56.285700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fd45ca2-4306-4784-afd3-d737227d7b33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:56.286397 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fd45ca2-4306-4784-afd3-d737227d7b33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:56.286850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fd45ca2-4306-4784-afd3-d737227d7b33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:56.287276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7fd45ca2-4306-4784-afd3-d737227d7b33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:56.429979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-7fd45ca2-4306-4784-afd3-d737227d7b33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:56.438476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7fd45ca2-4306-4784-afd3-d737227d7b33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.165581 Aug 18 22:30:56.439052 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2181/4359] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:56 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:57.089541 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3f150cad-b5a6-4db6-a93a-d3320cc5a159 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:57.090195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3f150cad-b5a6-4db6-a93a-d3320cc5a159 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:57.092225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:57.098125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f150cad-b5a6-4db6-a93a-d3320cc5a159 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:57.098611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f150cad-b5a6-4db6-a93a-d3320cc5a159 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:57.099080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f150cad-b5a6-4db6-a93a-d3320cc5a159 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:57.099779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f150cad-b5a6-4db6-a93a-d3320cc5a159 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:57.100240 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f150cad-b5a6-4db6-a93a-d3320cc5a159 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:57.100670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3f150cad-b5a6-4db6-a93a-d3320cc5a159 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:57.230490 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3f150cad-b5a6-4db6-a93a-d3320cc5a159 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:57.238094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3f150cad-b5a6-4db6-a93a-d3320cc5a159 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1497 microversion: 2.1 time: 0.152408 Aug 18 22:30:57.238670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2179/4360] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:57 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:57.459017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0f3fdda4-0ead-411a-8313-08e09e640f61 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:57.459628 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0f3fdda4-0ead-411a-8313-08e09e640f61 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:57.461568 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:57.462243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=12 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:30:57.468174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f3fdda4-0ead-411a-8313-08e09e640f61 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:57.468650 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f3fdda4-0ead-411a-8313-08e09e640f61 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:57.469080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f3fdda4-0ead-411a-8313-08e09e640f61 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:57.469793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f3fdda4-0ead-411a-8313-08e09e640f61 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:57.470241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f3fdda4-0ead-411a-8313-08e09e640f61 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:57.470660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0f3fdda4-0ead-411a-8313-08e09e640f61 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:57.606450 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0f3fdda4-0ead-411a-8313-08e09e640f61 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:57.614633 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0f3fdda4-0ead-411a-8313-08e09e640f61 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.159415 Aug 18 22:30:57.615129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2182/4361] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:57 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:58.635282 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1ac1bdb5-2bd9-499f-9920-68630fdf1a55 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:58.635902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1ac1bdb5-2bd9-499f-9920-68630fdf1a55 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:58.642936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ac1bdb5-2bd9-499f-9920-68630fdf1a55 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:58.643431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ac1bdb5-2bd9-499f-9920-68630fdf1a55 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:58.643870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ac1bdb5-2bd9-499f-9920-68630fdf1a55 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:58.644561 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ac1bdb5-2bd9-499f-9920-68630fdf1a55 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:58.645019 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ac1bdb5-2bd9-499f-9920-68630fdf1a55 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:58.645449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1ac1bdb5-2bd9-499f-9920-68630fdf1a55 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:58.776847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1ac1bdb5-2bd9-499f-9920-68630fdf1a55 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:58.784394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1ac1bdb5-2bd9-499f-9920-68630fdf1a55 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.152990 Aug 18 22:30:58.784966 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2180/4362] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:58 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:30:59.805105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-83a20ec2-6cd4-4598-af6a-94485a2e0042 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:30:59.805752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-83a20ec2-6cd4-4598-af6a-94485a2e0042 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:30:59.812414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83a20ec2-6cd4-4598-af6a-94485a2e0042 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:59.812896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83a20ec2-6cd4-4598-af6a-94485a2e0042 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:59.813334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83a20ec2-6cd4-4598-af6a-94485a2e0042 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:59.814053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83a20ec2-6cd4-4598-af6a-94485a2e0042 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:30:59.814508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83a20ec2-6cd4-4598-af6a-94485a2e0042 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:30:59.814932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-83a20ec2-6cd4-4598-af6a-94485a2e0042 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:30:59.947657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-83a20ec2-6cd4-4598-af6a-94485a2e0042 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:30:59.956207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-83a20ec2-6cd4-4598-af6a-94485a2e0042 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.154987 Aug 18 22:30:59.956721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2183/4363] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:30:59 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:00.608084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-622c87d8-c311-4ea4-822c-9d8ab3da1620 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:00.608631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-622c87d8-c311-4ea4-822c-9d8ab3da1620 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:00.615368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-622c87d8-c311-4ea4-822c-9d8ab3da1620 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:00.615913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-622c87d8-c311-4ea4-822c-9d8ab3da1620 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:00.616410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-622c87d8-c311-4ea4-822c-9d8ab3da1620 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:00.617159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-622c87d8-c311-4ea4-822c-9d8ab3da1620 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:00.617647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-622c87d8-c311-4ea4-822c-9d8ab3da1620 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:00.618087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-622c87d8-c311-4ea4-822c-9d8ab3da1620 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:00.643156 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-622c87d8-c311-4ea4-822c-9d8ab3da1620 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:31:00.722308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-622c87d8-c311-4ea4-822c-9d8ab3da1620 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "DELETE /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 204 len: 0 microversion: 2.1 time: 0.118234 Aug 18 22:31:00.722897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2181/4364] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:31:00 2022] DELETE /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:31:00.731394 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1a7ae05f-f00a-4cb6-9161-a851c23ec9d4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:00.732512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1a7ae05f-f00a-4cb6-9161-a851c23ec9d4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:00.738509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a7ae05f-f00a-4cb6-9161-a851c23ec9d4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:00.738989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a7ae05f-f00a-4cb6-9161-a851c23ec9d4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:00.739421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a7ae05f-f00a-4cb6-9161-a851c23ec9d4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:00.740104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a7ae05f-f00a-4cb6-9161-a851c23ec9d4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:00.740555 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a7ae05f-f00a-4cb6-9161-a851c23ec9d4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:00.740978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1a7ae05f-f00a-4cb6-9161-a851c23ec9d4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:00.876373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1a7ae05f-f00a-4cb6-9161-a851c23ec9d4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:00.883953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1a7ae05f-f00a-4cb6-9161-a851c23ec9d4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1503 microversion: 2.1 time: 0.156569 Aug 18 22:31:00.884660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2184/4365] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:00 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:00.976948 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3ad3d6a6-4d07-4457-b7d7-ec84f91535a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:00.977700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3ad3d6a6-4d07-4457-b7d7-ec84f91535a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:00.984479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ad3d6a6-4d07-4457-b7d7-ec84f91535a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:00.984973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ad3d6a6-4d07-4457-b7d7-ec84f91535a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:00.985448 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ad3d6a6-4d07-4457-b7d7-ec84f91535a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:00.986166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ad3d6a6-4d07-4457-b7d7-ec84f91535a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:00.986627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ad3d6a6-4d07-4457-b7d7-ec84f91535a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:00.987055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3ad3d6a6-4d07-4457-b7d7-ec84f91535a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:01.123060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3ad3d6a6-4d07-4457-b7d7-ec84f91535a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:01.130637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3ad3d6a6-4d07-4457-b7d7-ec84f91535a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.157959 Aug 18 22:31:01.131205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2182/4366] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:00 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:01.904069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0494a944-1409-49a4-8f0e-b88b242cb0b5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:01.904690 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0494a944-1409-49a4-8f0e-b88b242cb0b5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:01.911464 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0494a944-1409-49a4-8f0e-b88b242cb0b5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:01.911951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0494a944-1409-49a4-8f0e-b88b242cb0b5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:01.912386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0494a944-1409-49a4-8f0e-b88b242cb0b5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:01.913092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0494a944-1409-49a4-8f0e-b88b242cb0b5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:01.913577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0494a944-1409-49a4-8f0e-b88b242cb0b5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:01.914030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0494a944-1409-49a4-8f0e-b88b242cb0b5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:02.046692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0494a944-1409-49a4-8f0e-b88b242cb0b5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:02.056643 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0494a944-1409-49a4-8f0e-b88b242cb0b5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1503 microversion: 2.1 time: 0.156397 Aug 18 22:31:02.057257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2185/4367] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:01 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:02.151344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b83dc515-3755-420b-8926-9222cb7d72ef tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:02.152078 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b83dc515-3755-420b-8926-9222cb7d72ef tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:02.159148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83dc515-3755-420b-8926-9222cb7d72ef tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:02.159631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83dc515-3755-420b-8926-9222cb7d72ef tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:02.160068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83dc515-3755-420b-8926-9222cb7d72ef tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:02.160752 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83dc515-3755-420b-8926-9222cb7d72ef tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:02.161202 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83dc515-3755-420b-8926-9222cb7d72ef tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:02.161651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b83dc515-3755-420b-8926-9222cb7d72ef tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:02.165810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:02.311385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b83dc515-3755-420b-8926-9222cb7d72ef tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:02.321164 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b83dc515-3755-420b-8926-9222cb7d72ef tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.173564 Aug 18 22:31:02.322581 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2183/4368] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:02 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:02.995567 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-38b8ec72-0f39-40ce-a62b-1146449caa01 req-de7ede69-4151-4734-9c13-19ab65cd3744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405", "name": "network-vif-deleted", "tag": "d7322213-198b-43f8-96dc-470edce7409b"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:31:03.006111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-38b8ec72-0f39-40ce-a62b-1146449caa01 req-de7ede69-4151-4734-9c13-19ab65cd3744 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:03.006601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-38b8ec72-0f39-40ce-a62b-1146449caa01 req-de7ede69-4151-4734-9c13-19ab65cd3744 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:03.007019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-38b8ec72-0f39-40ce-a62b-1146449caa01 req-de7ede69-4151-4734-9c13-19ab65cd3744 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:03.019461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-38b8ec72-0f39-40ce-a62b-1146449caa01 req-de7ede69-4151-4734-9c13-19ab65cd3744 service nova] Creating event network-vif-deleted:d7322213-198b-43f8-96dc-470edce7409b for instance 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 on hv-cinder-85367 Aug 18 22:31:03.024996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-38b8ec72-0f39-40ce-a62b-1146449caa01 req-de7ede69-4151-4734-9c13-19ab65cd3744 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033041 Aug 18 22:31:03.025873 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2186/4369] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:31:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:03.079266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:03.079890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:03.086105 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:03.086597 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:03.087049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:03.087756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:03.088225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:03.088654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:03.120206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:03.120695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:03.121139 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:03.121612 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lazy-loading 'fault' on Instance uuid 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:31:03.164605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:03.172981 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d9d9bd7d-c1ec-4662-b894-8e87bd4412e0 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 200 len: 1304 microversion: 2.1 time: 0.097699 Aug 18 22:31:03.173568 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2184/4370] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:03 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:03.346180 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aadea2d5-9c0d-4391-a3b0-7159a549e00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:03.346958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aadea2d5-9c0d-4391-a3b0-7159a549e00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:03.353672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aadea2d5-9c0d-4391-a3b0-7159a549e00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:03.354422 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aadea2d5-9c0d-4391-a3b0-7159a549e00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:03.355070 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aadea2d5-9c0d-4391-a3b0-7159a549e00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:03.356185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aadea2d5-9c0d-4391-a3b0-7159a549e00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:03.357507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aadea2d5-9c0d-4391-a3b0-7159a549e00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:03.358299 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aadea2d5-9c0d-4391-a3b0-7159a549e00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:03.365736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d23570bc-ce26-4c6d-a46b-2e826ede6559 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:03.366467 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d23570bc-ce26-4c6d-a46b-2e826ede6559 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:03.372799 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d23570bc-ce26-4c6d-a46b-2e826ede6559 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:03.373277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d23570bc-ce26-4c6d-a46b-2e826ede6559 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:03.373767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d23570bc-ce26-4c6d-a46b-2e826ede6559 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:03.374727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d23570bc-ce26-4c6d-a46b-2e826ede6559 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:03.375435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d23570bc-ce26-4c6d-a46b-2e826ede6559 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:03.376072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d23570bc-ce26-4c6d-a46b-2e826ede6559 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:03.511098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-d23570bc-ce26-4c6d-a46b-2e826ede6559 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lazy-loading 'services' on Instance uuid 7d6551e6-1c93-4857-8c40-3e345353f113 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:31:03.519717 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aadea2d5-9c0d-4391-a3b0-7159a549e00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:03.530133 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aadea2d5-9c0d-4391-a3b0-7159a549e00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.188915 Aug 18 22:31:03.533641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2187/4371] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:03 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:03.597339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d23570bc-ce26-4c6d-a46b-2e826ede6559 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments/394e5ff8-f26a-44f4-b12d-de6819deccd4" status: 202 len: 0 microversion: 2.1 time: 0.237947 Aug 18 22:31:03.598355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2185/4372] 10.222.0.82 () {58 vars in 1416 bytes} [Thu Aug 18 22:31:03 2022] DELETE /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments/394e5ff8-f26a-44f4-b12d-de6819deccd4 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:31:03.607704 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d1f29606-9800-45f0-913a-b8677dc94df7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:03.609881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d1f29606-9800-45f0-913a-b8677dc94df7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:03.616715 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1f29606-9800-45f0-913a-b8677dc94df7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:03.617584 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1f29606-9800-45f0-913a-b8677dc94df7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:03.618207 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1f29606-9800-45f0-913a-b8677dc94df7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:03.618921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1f29606-9800-45f0-913a-b8677dc94df7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:03.619416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1f29606-9800-45f0-913a-b8677dc94df7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:03.619856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d1f29606-9800-45f0-913a-b8677dc94df7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:03.624322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:03.657185 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d1f29606-9800-45f0-913a-b8677dc94df7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053749 Aug 18 22:31:03.659868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2188/4373] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:03 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:04.194438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2070dec-3202-48df-a8fe-6908374914a4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:04.195136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e2070dec-3202-48df-a8fe-6908374914a4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:04.203428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2070dec-3202-48df-a8fe-6908374914a4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:04.204244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2070dec-3202-48df-a8fe-6908374914a4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:04.205028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2070dec-3202-48df-a8fe-6908374914a4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:04.206249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2070dec-3202-48df-a8fe-6908374914a4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:04.206710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2070dec-3202-48df-a8fe-6908374914a4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:04.207137 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e2070dec-3202-48df-a8fe-6908374914a4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:04.221725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-e2070dec-3202-48df-a8fe-6908374914a4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] HTTP exception thrown: Instance 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 could not be found. Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2070dec-3202-48df-a8fe-6908374914a4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Request method failure captured: Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 HTTP/1.1 Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_r2Rx-jPTO3pABxAZ0DIye2TaEoaiDeanCJRaq0Vx9TKXLVb7bauisGOLhP6v5LN4gSRKhVS_DYaeapajvaZY7byZ-as35ewZXQJzM18nRc--jacohWeU-C7tZagSLPkUr-Dh9dGGvF2cpw_Ss_qiHC2dfpAWb6Qv9x1_0u_TZNPcC8 Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 61268e79778c4a20b3b7beca375d5706 Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesActionsTest-1168494609 Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:31:04.223395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:31:04.224854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_61268e79778c4a20b3b7beca375d5706", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/61268e79778c4a20b3b7beca375d5706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/61268e79778c4a20b3b7beca375d5706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/61268e79778c4a20b3b7beca375d5706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:04.224854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesActionsTest-1168494609 Aug 18 22:31:04.224854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 61268e79778c4a20b3b7beca375d5706 Aug 18 22:31:04.224854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesActionsTest-1168494609 Aug 18 22:31:04.224854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesActionsTest-1168494609-project Aug 18 22:31:04.224854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:31:04.224854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:31:04.224854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: baa2e8e668894ea4b82fea3a2bc1fe9e Aug 18 22:31:04.224854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesActionsTest-1168494609-project Aug 18 22:31:04.224854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:31:04.224854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 could not be found. Aug 18 22:31:04.224854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': '5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405'} Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 could not be found. Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:04.225646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 could not be found. Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 could not be found. Aug 18 22:31:04.226850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:04.227892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e2070dec-3202-48df-a8fe-6908374914a4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Returning 404 to user: Instance 5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:04.227892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e2070dec-3202-48df-a8fe-6908374914a4 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405" status: 404 len: 111 microversion: 2.1 time: 0.034610 Aug 18 22:31:04.227892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2186/4374] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:04 2022] GET /compute/v2.1/servers/5c455be1-d9f9-4ddd-ba4a-0d1a6ba37405 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:04.332834 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1332804039", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452", "networks": [{"uuid": "3b7157af-9e92-4886-a50d-6e7cba91262e"}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:31:04.387975 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] validate_networks() for [('3b7157af-9e92-4886-a50d-6e7cba91262e', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 22:31:04.551068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ea4e0d33-83c8-4bfd-bc09-abf5b41e9c1a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:04.551689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ea4e0d33-83c8-4bfd-bc09-abf5b41e9c1a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:04.557756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea4e0d33-83c8-4bfd-bc09-abf5b41e9c1a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:04.558244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea4e0d33-83c8-4bfd-bc09-abf5b41e9c1a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:04.558957 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea4e0d33-83c8-4bfd-bc09-abf5b41e9c1a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:04.559723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea4e0d33-83c8-4bfd-bc09-abf5b41e9c1a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:04.560638 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea4e0d33-83c8-4bfd-bc09-abf5b41e9c1a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:04.560735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ea4e0d33-83c8-4bfd-bc09-abf5b41e9c1a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:04.733631 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ea4e0d33-83c8-4bfd-bc09-abf5b41e9c1a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:04.741459 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ea4e0d33-83c8-4bfd-bc09-abf5b41e9c1a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.194144 Aug 18 22:31:04.742441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2187/4375] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:04 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:31:04.747063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9cc6c501-93c5-4566-bce2-24d615398c9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:04.749917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9cc6c501-93c5-4566-bce2-24d615398c9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:04.756233 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9cc6c501-93c5-4566-bce2-24d615398c9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:04.756782 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9cc6c501-93c5-4566-bce2-24d615398c9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:04.757396 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9cc6c501-93c5-4566-bce2-24d615398c9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:04.758346 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9cc6c501-93c5-4566-bce2-24d615398c9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:04.758800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9cc6c501-93c5-4566-bce2-24d615398c9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:04.759221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9cc6c501-93c5-4566-bce2-24d615398c9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:04.766209 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 22:31:04.766629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 22:31:04.767101 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 22:31:04.767506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 22:31:04.767913 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 22:31:04.777847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:04.778410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:04.779414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:04.780339 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:04.781024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:04.781516 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:04.790520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9cc6c501-93c5-4566-bce2-24d615398c9a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046971 Aug 18 22:31:04.791255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2188/4376] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:04 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:04.802682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Getting quotas for project 61268e79778c4a20b3b7beca375d5706. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:31:04.806855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Getting quotas for user baa2e8e668894ea4b82fea3a2bc1fe9e and project 61268e79778c4a20b3b7beca375d5706. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:31:04.818368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 22:31:04.820640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 22:31:04.867295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b72596ae-c970-4a7b-8926-4735b4a4304a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538228 Aug 18 22:31:04.869780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2189/4377] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 22:31:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 22:31:04.879489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e1f05321-43af-4715-b1f8-d71bee2c8339 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:04.880369 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e1f05321-43af-4715-b1f8-d71bee2c8339 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:04.934630 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e1f05321-43af-4715-b1f8-d71bee2c8339 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:04.941923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e1f05321-43af-4715-b1f8-d71bee2c8339 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1214 microversion: 2.1 time: 0.066922 Aug 18 22:31:04.942489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2189/4378] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:04 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:05.762773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e240b54d-a2d6-46b0-b3a2-d75d9fdf748a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:05.763393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e240b54d-a2d6-46b0-b3a2-d75d9fdf748a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:05.770073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e240b54d-a2d6-46b0-b3a2-d75d9fdf748a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:05.770564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e240b54d-a2d6-46b0-b3a2-d75d9fdf748a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:05.771005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e240b54d-a2d6-46b0-b3a2-d75d9fdf748a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:05.771734 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e240b54d-a2d6-46b0-b3a2-d75d9fdf748a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:05.772193 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e240b54d-a2d6-46b0-b3a2-d75d9fdf748a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:05.772622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e240b54d-a2d6-46b0-b3a2-d75d9fdf748a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:05.803710 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-82a6b76e-7c2c-4be6-a561-13b79a15e03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:05.805871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-82a6b76e-7c2c-4be6-a561-13b79a15e03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:05.814025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82a6b76e-7c2c-4be6-a561-13b79a15e03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:05.814627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82a6b76e-7c2c-4be6-a561-13b79a15e03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:05.815093 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82a6b76e-7c2c-4be6-a561-13b79a15e03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:05.815976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82a6b76e-7c2c-4be6-a561-13b79a15e03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:05.816434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82a6b76e-7c2c-4be6-a561-13b79a15e03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:05.816858 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-82a6b76e-7c2c-4be6-a561-13b79a15e03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:05.845871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-82a6b76e-7c2c-4be6-a561-13b79a15e03f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046039 Aug 18 22:31:05.846444 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2190/4379] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:05 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:31:05.911425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e240b54d-a2d6-46b0-b3a2-d75d9fdf748a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:05.919787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e240b54d-a2d6-46b0-b3a2-d75d9fdf748a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.160836 Aug 18 22:31:05.920355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2190/4380] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:05 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:05.965068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-155f95e4-8d68-48c3-bb2b-a08b190bbdff tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:05.965625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-155f95e4-8d68-48c3-bb2b-a08b190bbdff tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:05.971777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-155f95e4-8d68-48c3-bb2b-a08b190bbdff tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:05.972261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-155f95e4-8d68-48c3-bb2b-a08b190bbdff tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:05.972700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-155f95e4-8d68-48c3-bb2b-a08b190bbdff tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:05.973390 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-155f95e4-8d68-48c3-bb2b-a08b190bbdff tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:05.973873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-155f95e4-8d68-48c3-bb2b-a08b190bbdff tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:05.974307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-155f95e4-8d68-48c3-bb2b-a08b190bbdff tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:06.033701 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-155f95e4-8d68-48c3-bb2b-a08b190bbdff tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:06.041303 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-155f95e4-8d68-48c3-bb2b-a08b190bbdff tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1218 microversion: 2.1 time: 0.080130 Aug 18 22:31:06.041893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2191/4381] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:05 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:06.315372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-c1a3ee69-a33f-4fff-9878-34c23e570356 req-ffd9a813-8565-4b76-84cc-d9b084abccbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e60ed1-0091-4e24-8cfa-b854eed71bf4", "name": "network-vif-plugged", "status": "completed", "tag": "f7486d36-da4f-4543-8560-136f47b31774"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:31:06.325091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-c1a3ee69-a33f-4fff-9878-34c23e570356 req-ffd9a813-8565-4b76-84cc-d9b084abccbe service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:06.325563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-c1a3ee69-a33f-4fff-9878-34c23e570356 req-ffd9a813-8565-4b76-84cc-d9b084abccbe service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:06.326020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-c1a3ee69-a33f-4fff-9878-34c23e570356 req-ffd9a813-8565-4b76-84cc-d9b084abccbe service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:06.337260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-c1a3ee69-a33f-4fff-9878-34c23e570356 req-ffd9a813-8565-4b76-84cc-d9b084abccbe service nova] Creating event network-vif-plugged:f7486d36-da4f-4543-8560-136f47b31774 for instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 on hv-cinder-85367 Aug 18 22:31:06.343059 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-c1a3ee69-a33f-4fff-9878-34c23e570356 req-ffd9a813-8565-4b76-84cc-d9b084abccbe service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031588 Aug 18 22:31:06.343661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2191/4382] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:06.859072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-186f76af-4ef4-4631-bb4e-e4a2120ec9d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:06.861632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-186f76af-4ef4-4631-bb4e-e4a2120ec9d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:06.869079 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-186f76af-4ef4-4631-bb4e-e4a2120ec9d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:06.869565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-186f76af-4ef4-4631-bb4e-e4a2120ec9d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:06.870044 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-186f76af-4ef4-4631-bb4e-e4a2120ec9d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:06.870748 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-186f76af-4ef4-4631-bb4e-e4a2120ec9d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:06.871207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-186f76af-4ef4-4631-bb4e-e4a2120ec9d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:06.871637 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-186f76af-4ef4-4631-bb4e-e4a2120ec9d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:06.900103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-186f76af-4ef4-4631-bb4e-e4a2120ec9d4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046145 Aug 18 22:31:06.900667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2192/4383] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:06 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:06.940506 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0028c261-1278-4253-87f3-9089ece4cb15 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:06.941238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0028c261-1278-4253-87f3-9089ece4cb15 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:06.947461 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0028c261-1278-4253-87f3-9089ece4cb15 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:06.947938 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0028c261-1278-4253-87f3-9089ece4cb15 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:06.948372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0028c261-1278-4253-87f3-9089ece4cb15 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:06.949057 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0028c261-1278-4253-87f3-9089ece4cb15 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:06.949511 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0028c261-1278-4253-87f3-9089ece4cb15 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:06.949958 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0028c261-1278-4253-87f3-9089ece4cb15 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:07.061893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-277354c5-d890-4731-9717-19f172796719 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:07.062514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-277354c5-d890-4731-9717-19f172796719 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:07.068474 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-277354c5-d890-4731-9717-19f172796719 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:07.068960 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-277354c5-d890-4731-9717-19f172796719 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:07.069402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-277354c5-d890-4731-9717-19f172796719 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:07.070125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-277354c5-d890-4731-9717-19f172796719 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:07.070583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-277354c5-d890-4731-9717-19f172796719 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:07.071015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-277354c5-d890-4731-9717-19f172796719 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:07.080225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0028c261-1278-4253-87f3-9089ece4cb15 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:07.087950 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0028c261-1278-4253-87f3-9089ece4cb15 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.152201 Aug 18 22:31:07.088525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2192/4384] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:06 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:07.133870 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-277354c5-d890-4731-9717-19f172796719 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:07.141440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-277354c5-d890-4731-9717-19f172796719 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1218 microversion: 2.1 time: 0.083681 Aug 18 22:31:07.142032 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2193/4385] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:07 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:31:07.912229 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-428773b6-b812-4814-beac-216097d0d026 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:07.914452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-428773b6-b812-4814-beac-216097d0d026 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:07.921259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-428773b6-b812-4814-beac-216097d0d026 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:07.921764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-428773b6-b812-4814-beac-216097d0d026 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:07.922201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-428773b6-b812-4814-beac-216097d0d026 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:07.922879 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-428773b6-b812-4814-beac-216097d0d026 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:07.923326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-428773b6-b812-4814-beac-216097d0d026 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:07.923744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-428773b6-b812-4814-beac-216097d0d026 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:07.952693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-428773b6-b812-4814-beac-216097d0d026 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Aug 18 22:31:07.953279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2193/4386] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:07 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:08.108497 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8e0399b1-8857-438a-8367-72ea8a4064ce tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:08.109130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8e0399b1-8857-438a-8367-72ea8a4064ce tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:08.115535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e0399b1-8857-438a-8367-72ea8a4064ce tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:08.116025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e0399b1-8857-438a-8367-72ea8a4064ce tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:08.116470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e0399b1-8857-438a-8367-72ea8a4064ce tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:08.117167 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e0399b1-8857-438a-8367-72ea8a4064ce tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:08.117656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e0399b1-8857-438a-8367-72ea8a4064ce tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:08.118092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8e0399b1-8857-438a-8367-72ea8a4064ce tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:08.162331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-4569e265-b662-427e-99d4-14efdaa75ce7 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:08.162944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-4569e265-b662-427e-99d4-14efdaa75ce7 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:08.168737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4569e265-b662-427e-99d4-14efdaa75ce7 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:08.169735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4569e265-b662-427e-99d4-14efdaa75ce7 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:08.170178 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4569e265-b662-427e-99d4-14efdaa75ce7 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:08.170869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4569e265-b662-427e-99d4-14efdaa75ce7 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:08.171330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4569e265-b662-427e-99d4-14efdaa75ce7 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:08.171759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-4569e265-b662-427e-99d4-14efdaa75ce7 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:08.234927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-4569e265-b662-427e-99d4-14efdaa75ce7 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:08.243154 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-4569e265-b662-427e-99d4-14efdaa75ce7 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1218 microversion: 2.1 time: 0.084625 Aug 18 22:31:08.243921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2194/4387] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:08 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:31:08.248493 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8e0399b1-8857-438a-8367-72ea8a4064ce tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:08.256759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8e0399b1-8857-438a-8367-72ea8a4064ce tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.152501 Aug 18 22:31:08.257335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2194/4388] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:08 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:08.964769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ad24abb4-78f0-45b4-9a1c-925bb9417f19 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:08.967619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ad24abb4-78f0-45b4-9a1c-925bb9417f19 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:08.974069 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad24abb4-78f0-45b4-9a1c-925bb9417f19 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:08.974493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad24abb4-78f0-45b4-9a1c-925bb9417f19 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:08.974933 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad24abb4-78f0-45b4-9a1c-925bb9417f19 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:08.975626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad24abb4-78f0-45b4-9a1c-925bb9417f19 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:08.976083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad24abb4-78f0-45b4-9a1c-925bb9417f19 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:08.976512 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ad24abb4-78f0-45b4-9a1c-925bb9417f19 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:09.005130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ad24abb4-78f0-45b4-9a1c-925bb9417f19 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044248 Aug 18 22:31:09.005705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2195/4389] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:08 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:09.265252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7437a03d-4f02-4b87-81b1-8ade918bca3d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:09.265822 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7437a03d-4f02-4b87-81b1-8ade918bca3d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:09.272347 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7437a03d-4f02-4b87-81b1-8ade918bca3d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:09.272835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7437a03d-4f02-4b87-81b1-8ade918bca3d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:09.273274 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7437a03d-4f02-4b87-81b1-8ade918bca3d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:09.274027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7437a03d-4f02-4b87-81b1-8ade918bca3d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:09.274487 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7437a03d-4f02-4b87-81b1-8ade918bca3d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:09.274914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7437a03d-4f02-4b87-81b1-8ade918bca3d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:09.276131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bf886cf9-502b-4e76-88f6-1bf90fb0f5a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:09.276743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bf886cf9-502b-4e76-88f6-1bf90fb0f5a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:09.279791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:09.283452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf886cf9-502b-4e76-88f6-1bf90fb0f5a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:09.283929 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf886cf9-502b-4e76-88f6-1bf90fb0f5a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:09.284361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf886cf9-502b-4e76-88f6-1bf90fb0f5a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:09.285044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf886cf9-502b-4e76-88f6-1bf90fb0f5a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:09.285493 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf886cf9-502b-4e76-88f6-1bf90fb0f5a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:09.285944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bf886cf9-502b-4e76-88f6-1bf90fb0f5a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:09.336005 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7437a03d-4f02-4b87-81b1-8ade918bca3d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:09.343696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7437a03d-4f02-4b87-81b1-8ade918bca3d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1218 microversion: 2.1 time: 0.082995 Aug 18 22:31:09.345372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2195/4390] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:09 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:09.417494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bf886cf9-502b-4e76-88f6-1bf90fb0f5a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:09.426092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bf886cf9-502b-4e76-88f6-1bf90fb0f5a8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.153815 Aug 18 22:31:09.426667 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2196/4391] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:09 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:31:10.016646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d9f0a01c-f06c-404c-94ab-f83bf0d0fea2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:10.018872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d9f0a01c-f06c-404c-94ab-f83bf0d0fea2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:10.025478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9f0a01c-f06c-404c-94ab-f83bf0d0fea2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:10.025995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9f0a01c-f06c-404c-94ab-f83bf0d0fea2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:10.026441 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9f0a01c-f06c-404c-94ab-f83bf0d0fea2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:10.027143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9f0a01c-f06c-404c-94ab-f83bf0d0fea2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:10.027606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9f0a01c-f06c-404c-94ab-f83bf0d0fea2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:10.028040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d9f0a01c-f06c-404c-94ab-f83bf0d0fea2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:10.057930 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d9f0a01c-f06c-404c-94ab-f83bf0d0fea2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045172 Aug 18 22:31:10.058489 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2196/4392] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:10 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:10.364297 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6b7711a7-1eee-4108-ab6e-19604d9cdb54 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:10.364917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6b7711a7-1eee-4108-ab6e-19604d9cdb54 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:10.371370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b7711a7-1eee-4108-ab6e-19604d9cdb54 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:10.371855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b7711a7-1eee-4108-ab6e-19604d9cdb54 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:10.372294 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b7711a7-1eee-4108-ab6e-19604d9cdb54 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:10.372994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b7711a7-1eee-4108-ab6e-19604d9cdb54 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:10.373451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b7711a7-1eee-4108-ab6e-19604d9cdb54 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:10.373908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6b7711a7-1eee-4108-ab6e-19604d9cdb54 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:10.432832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6b7711a7-1eee-4108-ab6e-19604d9cdb54 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:10.441035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6b7711a7-1eee-4108-ab6e-19604d9cdb54 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1218 microversion: 2.1 time: 0.080624 Aug 18 22:31:10.441624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2197/4393] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:10 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:10.447014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7de52301-1e36-49fb-87eb-051629943749 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:10.447713 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7de52301-1e36-49fb-87eb-051629943749 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:10.454677 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7de52301-1e36-49fb-87eb-051629943749 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:10.455161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7de52301-1e36-49fb-87eb-051629943749 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:10.455604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7de52301-1e36-49fb-87eb-051629943749 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:10.456294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7de52301-1e36-49fb-87eb-051629943749 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:10.456750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7de52301-1e36-49fb-87eb-051629943749 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:10.457180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7de52301-1e36-49fb-87eb-051629943749 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:10.590161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7de52301-1e36-49fb-87eb-051629943749 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:10.597883 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7de52301-1e36-49fb-87eb-051629943749 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.154573 Aug 18 22:31:10.598463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2197/4394] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:10 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:11.070765 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-96948fe4-7841-46f7-a1b4-1dad681a893f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:11.072972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-96948fe4-7841-46f7-a1b4-1dad681a893f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:11.078978 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96948fe4-7841-46f7-a1b4-1dad681a893f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:11.079463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96948fe4-7841-46f7-a1b4-1dad681a893f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:11.079923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96948fe4-7841-46f7-a1b4-1dad681a893f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:11.080595 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96948fe4-7841-46f7-a1b4-1dad681a893f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:11.081053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96948fe4-7841-46f7-a1b4-1dad681a893f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:11.081482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-96948fe4-7841-46f7-a1b4-1dad681a893f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:11.110326 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-96948fe4-7841-46f7-a1b4-1dad681a893f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043767 Aug 18 22:31:11.110877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2198/4395] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:11 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:11.461352 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-caf7fac8-3189-4f2c-be09-cbbca4250979 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:11.461990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-caf7fac8-3189-4f2c-be09-cbbca4250979 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:11.468920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caf7fac8-3189-4f2c-be09-cbbca4250979 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:11.469399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caf7fac8-3189-4f2c-be09-cbbca4250979 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:11.469872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caf7fac8-3189-4f2c-be09-cbbca4250979 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:11.470551 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caf7fac8-3189-4f2c-be09-cbbca4250979 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:11.471015 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caf7fac8-3189-4f2c-be09-cbbca4250979 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:11.471421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-caf7fac8-3189-4f2c-be09-cbbca4250979 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:11.532090 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-caf7fac8-3189-4f2c-be09-cbbca4250979 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:11.539608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-caf7fac8-3189-4f2c-be09-cbbca4250979 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1218 microversion: 2.1 time: 0.082071 Aug 18 22:31:11.540173 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2198/4396] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:11 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:11.619343 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-04a1621a-6355-47b7-a19a-0e9f1c6d6622 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:11.619955 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-04a1621a-6355-47b7-a19a-0e9f1c6d6622 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:11.626414 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04a1621a-6355-47b7-a19a-0e9f1c6d6622 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:11.626895 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04a1621a-6355-47b7-a19a-0e9f1c6d6622 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:11.627332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04a1621a-6355-47b7-a19a-0e9f1c6d6622 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:11.628016 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04a1621a-6355-47b7-a19a-0e9f1c6d6622 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:11.628477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04a1621a-6355-47b7-a19a-0e9f1c6d6622 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:11.628903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-04a1621a-6355-47b7-a19a-0e9f1c6d6622 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:11.763701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-04a1621a-6355-47b7-a19a-0e9f1c6d6622 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:11.771273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-04a1621a-6355-47b7-a19a-0e9f1c6d6622 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.155825 Aug 18 22:31:11.771844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2199/4397] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:11 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:12.123002 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a2972ffd-9bbb-42d5-904a-d501af21aa11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:12.125121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a2972ffd-9bbb-42d5-904a-d501af21aa11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:12.131018 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2972ffd-9bbb-42d5-904a-d501af21aa11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:12.131502 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2972ffd-9bbb-42d5-904a-d501af21aa11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:12.131940 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2972ffd-9bbb-42d5-904a-d501af21aa11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:12.132629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2972ffd-9bbb-42d5-904a-d501af21aa11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:12.133084 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2972ffd-9bbb-42d5-904a-d501af21aa11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:12.133538 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a2972ffd-9bbb-42d5-904a-d501af21aa11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:12.162973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a2972ffd-9bbb-42d5-904a-d501af21aa11 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044275 Aug 18 22:31:12.163539 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2199/4398] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:12 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:12.561115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-71b3226a-6f99-4a29-bf46-61a2578a1eea tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:12.562026 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-71b3226a-6f99-4a29-bf46-61a2578a1eea tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:12.568287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71b3226a-6f99-4a29-bf46-61a2578a1eea tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:12.568772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71b3226a-6f99-4a29-bf46-61a2578a1eea tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:12.569218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71b3226a-6f99-4a29-bf46-61a2578a1eea tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:12.569996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71b3226a-6f99-4a29-bf46-61a2578a1eea tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:12.570455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71b3226a-6f99-4a29-bf46-61a2578a1eea tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:12.570888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71b3226a-6f99-4a29-bf46-61a2578a1eea tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:12.629460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-71b3226a-6f99-4a29-bf46-61a2578a1eea tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:12.636976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-71b3226a-6f99-4a29-bf46-61a2578a1eea tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1218 microversion: 2.1 time: 0.080344 Aug 18 22:31:12.637546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2200/4399] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:12 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:12.792153 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b4dc7a49-05aa-4235-b871-8cf911dc6d7a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:12.792769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b4dc7a49-05aa-4235-b871-8cf911dc6d7a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:12.800074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4dc7a49-05aa-4235-b871-8cf911dc6d7a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:12.800554 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4dc7a49-05aa-4235-b871-8cf911dc6d7a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:12.800989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4dc7a49-05aa-4235-b871-8cf911dc6d7a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:12.801702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4dc7a49-05aa-4235-b871-8cf911dc6d7a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:12.802215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4dc7a49-05aa-4235-b871-8cf911dc6d7a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:12.802664 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b4dc7a49-05aa-4235-b871-8cf911dc6d7a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:12.820341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:12.931823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b4dc7a49-05aa-4235-b871-8cf911dc6d7a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:12.939590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b4dc7a49-05aa-4235-b871-8cf911dc6d7a tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.151313 Aug 18 22:31:12.940158 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2200/4400] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:12 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:13.174833 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-69d0d653-dbfd-44cc-b3fd-89823d42bde7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:13.176960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-69d0d653-dbfd-44cc-b3fd-89823d42bde7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:13.182817 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69d0d653-dbfd-44cc-b3fd-89823d42bde7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:13.183291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69d0d653-dbfd-44cc-b3fd-89823d42bde7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:13.183724 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69d0d653-dbfd-44cc-b3fd-89823d42bde7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:13.184400 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69d0d653-dbfd-44cc-b3fd-89823d42bde7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:13.184878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69d0d653-dbfd-44cc-b3fd-89823d42bde7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:13.185300 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-69d0d653-dbfd-44cc-b3fd-89823d42bde7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:13.216692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-69d0d653-dbfd-44cc-b3fd-89823d42bde7 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045017 Aug 18 22:31:13.217268 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2201/4401] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:13 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:13.657575 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-03321cd1-8e80-484a-94a1-d3199f518999 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:13.658214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-03321cd1-8e80-484a-94a1-d3199f518999 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:13.664305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03321cd1-8e80-484a-94a1-d3199f518999 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:13.664800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03321cd1-8e80-484a-94a1-d3199f518999 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:13.665246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03321cd1-8e80-484a-94a1-d3199f518999 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:13.665978 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03321cd1-8e80-484a-94a1-d3199f518999 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:13.666438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03321cd1-8e80-484a-94a1-d3199f518999 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:13.666867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-03321cd1-8e80-484a-94a1-d3199f518999 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:13.730428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-03321cd1-8e80-484a-94a1-d3199f518999 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:13.738046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-03321cd1-8e80-484a-94a1-d3199f518999 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1218 microversion: 2.1 time: 0.084321 Aug 18 22:31:13.738615 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2201/4402] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:13 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:13.960064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-99e76a17-1553-4a37-9f01-5c67a4b5d1c0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:13.960631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-99e76a17-1553-4a37-9f01-5c67a4b5d1c0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:13.966979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99e76a17-1553-4a37-9f01-5c67a4b5d1c0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:13.967487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99e76a17-1553-4a37-9f01-5c67a4b5d1c0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:13.967920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99e76a17-1553-4a37-9f01-5c67a4b5d1c0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:13.968597 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99e76a17-1553-4a37-9f01-5c67a4b5d1c0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:13.969044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99e76a17-1553-4a37-9f01-5c67a4b5d1c0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:13.969537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-99e76a17-1553-4a37-9f01-5c67a4b5d1c0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:14.095552 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-99e76a17-1553-4a37-9f01-5c67a4b5d1c0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:14.103195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-99e76a17-1553-4a37-9f01-5c67a4b5d1c0 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.147095 Aug 18 22:31:14.103776 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2202/4403] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:13 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:14.228177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dbf2e3c1-5e84-4ea3-b2b6-435cb9217a20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:14.230427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dbf2e3c1-5e84-4ea3-b2b6-435cb9217a20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:14.237447 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbf2e3c1-5e84-4ea3-b2b6-435cb9217a20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:14.237972 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbf2e3c1-5e84-4ea3-b2b6-435cb9217a20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:14.238417 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbf2e3c1-5e84-4ea3-b2b6-435cb9217a20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:14.239120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbf2e3c1-5e84-4ea3-b2b6-435cb9217a20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:14.239582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbf2e3c1-5e84-4ea3-b2b6-435cb9217a20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:14.240014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dbf2e3c1-5e84-4ea3-b2b6-435cb9217a20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:14.270686 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dbf2e3c1-5e84-4ea3-b2b6-435cb9217a20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046311 Aug 18 22:31:14.271246 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2202/4404] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:14 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:31:14.760683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9cba0cf4-7403-4031-9b4d-3f3b5716919c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:14.761421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9cba0cf4-7403-4031-9b4d-3f3b5716919c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:14.768050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9cba0cf4-7403-4031-9b4d-3f3b5716919c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:14.768537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9cba0cf4-7403-4031-9b4d-3f3b5716919c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:14.768973 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9cba0cf4-7403-4031-9b4d-3f3b5716919c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:14.769697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9cba0cf4-7403-4031-9b4d-3f3b5716919c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:14.770153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9cba0cf4-7403-4031-9b4d-3f3b5716919c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:14.770824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9cba0cf4-7403-4031-9b4d-3f3b5716919c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:14.789421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:14.814050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:14.835336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9cba0cf4-7403-4031-9b4d-3f3b5716919c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:14.844091 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9cba0cf4-7403-4031-9b4d-3f3b5716919c tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1218 microversion: 2.1 time: 0.087136 Aug 18 22:31:14.844908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2203/4405] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:14 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:15.124379 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7e8c6b30-b4da-44cc-8b3f-95637ef31924 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:15.124998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7e8c6b30-b4da-44cc-8b3f-95637ef31924 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:15.127041 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:15.132511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e8c6b30-b4da-44cc-8b3f-95637ef31924 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:15.132996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e8c6b30-b4da-44cc-8b3f-95637ef31924 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:15.133419 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e8c6b30-b4da-44cc-8b3f-95637ef31924 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:15.134179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e8c6b30-b4da-44cc-8b3f-95637ef31924 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:15.134606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e8c6b30-b4da-44cc-8b3f-95637ef31924 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:15.135024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7e8c6b30-b4da-44cc-8b3f-95637ef31924 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:15.268534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7e8c6b30-b4da-44cc-8b3f-95637ef31924 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:15.276481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7e8c6b30-b4da-44cc-8b3f-95637ef31924 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.156549 Aug 18 22:31:15.277047 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2203/4406] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:15 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:15.283166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bbe08b0e-9405-433c-ae0f-d02eab8e759f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:15.285323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bbe08b0e-9405-433c-ae0f-d02eab8e759f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:15.291779 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbe08b0e-9405-433c-ae0f-d02eab8e759f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:15.292250 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbe08b0e-9405-433c-ae0f-d02eab8e759f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:15.292682 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbe08b0e-9405-433c-ae0f-d02eab8e759f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:15.293370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbe08b0e-9405-433c-ae0f-d02eab8e759f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:15.293850 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbe08b0e-9405-433c-ae0f-d02eab8e759f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:15.294308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbe08b0e-9405-433c-ae0f-d02eab8e759f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:15.323619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bbe08b0e-9405-433c-ae0f-d02eab8e759f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044458 Aug 18 22:31:15.324183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2204/4407] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:15 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:15.864373 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e87fac34-2dc4-4526-aacd-7a4bf81ee49a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:15.865098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e87fac34-2dc4-4526-aacd-7a4bf81ee49a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:15.866894 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:15.873194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87fac34-2dc4-4526-aacd-7a4bf81ee49a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:15.873708 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87fac34-2dc4-4526-aacd-7a4bf81ee49a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:15.874150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87fac34-2dc4-4526-aacd-7a4bf81ee49a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:15.874844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87fac34-2dc4-4526-aacd-7a4bf81ee49a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:15.875307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87fac34-2dc4-4526-aacd-7a4bf81ee49a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:15.875739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e87fac34-2dc4-4526-aacd-7a4bf81ee49a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:15.935608 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e87fac34-2dc4-4526-aacd-7a4bf81ee49a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:15.943296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e87fac34-2dc4-4526-aacd-7a4bf81ee49a tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1218 microversion: 2.1 time: 0.082858 Aug 18 22:31:15.943861 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2204/4408] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:15 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:16.296087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-948d0817-e25b-43d0-8a8f-9c4584ca560c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:16.296713 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-948d0817-e25b-43d0-8a8f-9c4584ca560c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:16.303124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-948d0817-e25b-43d0-8a8f-9c4584ca560c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:16.304085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-948d0817-e25b-43d0-8a8f-9c4584ca560c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:16.304790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-948d0817-e25b-43d0-8a8f-9c4584ca560c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:16.306020 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-948d0817-e25b-43d0-8a8f-9c4584ca560c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:16.306830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-948d0817-e25b-43d0-8a8f-9c4584ca560c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:16.308944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-948d0817-e25b-43d0-8a8f-9c4584ca560c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:16.336364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4e19fa25-4abc-4ff4-a1bf-ca2d18662d20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:16.338617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4e19fa25-4abc-4ff4-a1bf-ca2d18662d20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:16.345421 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e19fa25-4abc-4ff4-a1bf-ca2d18662d20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:16.345924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e19fa25-4abc-4ff4-a1bf-ca2d18662d20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:16.346358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e19fa25-4abc-4ff4-a1bf-ca2d18662d20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:16.347049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e19fa25-4abc-4ff4-a1bf-ca2d18662d20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:16.347500 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e19fa25-4abc-4ff4-a1bf-ca2d18662d20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:16.347923 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e19fa25-4abc-4ff4-a1bf-ca2d18662d20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:16.377133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4e19fa25-4abc-4ff4-a1bf-ca2d18662d20 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Aug 18 22:31:16.377718 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2205/4409] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:16 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:31:16.440657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-948d0817-e25b-43d0-8a8f-9c4584ca560c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:16.448275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-948d0817-e25b-43d0-8a8f-9c4584ca560c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.155944 Aug 18 22:31:16.448839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2205/4410] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:16 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:16.963726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bf117074-4f85-4990-968a-1be95a4c4400 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:16.964435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bf117074-4f85-4990-968a-1be95a4c4400 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:16.970765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf117074-4f85-4990-968a-1be95a4c4400 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:16.971535 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf117074-4f85-4990-968a-1be95a4c4400 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:16.972011 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf117074-4f85-4990-968a-1be95a4c4400 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:16.972730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf117074-4f85-4990-968a-1be95a4c4400 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:16.973185 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf117074-4f85-4990-968a-1be95a4c4400 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:16.973632 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bf117074-4f85-4990-968a-1be95a4c4400 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:17.033783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bf117074-4f85-4990-968a-1be95a4c4400 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:17.041277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bf117074-4f85-4990-968a-1be95a4c4400 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1266 microversion: 2.1 time: 0.081435 Aug 18 22:31:17.041871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2206/4411] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:16 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:17.389783 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cdf3c3ed-8568-4db5-ac93-34ffa7777a62 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:17.392224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cdf3c3ed-8568-4db5-ac93-34ffa7777a62 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:17.398607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdf3c3ed-8568-4db5-ac93-34ffa7777a62 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:17.399097 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdf3c3ed-8568-4db5-ac93-34ffa7777a62 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:17.399530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdf3c3ed-8568-4db5-ac93-34ffa7777a62 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:17.400236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdf3c3ed-8568-4db5-ac93-34ffa7777a62 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:17.400691 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdf3c3ed-8568-4db5-ac93-34ffa7777a62 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:17.401121 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cdf3c3ed-8568-4db5-ac93-34ffa7777a62 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:17.405440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=100 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:17.432807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cdf3c3ed-8568-4db5-ac93-34ffa7777a62 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048207 Aug 18 22:31:17.433387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2206/4412] 10.222.0.82 () {58 vars in 1302 bytes} [Thu Aug 18 22:31:17 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 22:31:17.471189 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dae56397-f3d2-4aaa-991c-1080feecbbb9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:17.472898 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-dae56397-f3d2-4aaa-991c-1080feecbbb9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:17.479987 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dae56397-f3d2-4aaa-991c-1080feecbbb9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:17.480602 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dae56397-f3d2-4aaa-991c-1080feecbbb9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:17.480915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dae56397-f3d2-4aaa-991c-1080feecbbb9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:17.481647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dae56397-f3d2-4aaa-991c-1080feecbbb9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:17.482212 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dae56397-f3d2-4aaa-991c-1080feecbbb9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:17.483064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-dae56397-f3d2-4aaa-991c-1080feecbbb9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:17.525022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7c7ed37d-7f2b-4cdb-9fd9-1c480189b5c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:17.525748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7c7ed37d-7f2b-4cdb-9fd9-1c480189b5c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:17.533114 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c7ed37d-7f2b-4cdb-9fd9-1c480189b5c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:17.533868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c7ed37d-7f2b-4cdb-9fd9-1c480189b5c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:17.534406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c7ed37d-7f2b-4cdb-9fd9-1c480189b5c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:17.535413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c7ed37d-7f2b-4cdb-9fd9-1c480189b5c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:17.535939 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c7ed37d-7f2b-4cdb-9fd9-1c480189b5c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:17.536593 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-7c7ed37d-7f2b-4cdb-9fd9-1c480189b5c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:17.569423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-7c7ed37d-7f2b-4cdb-9fd9-1c480189b5c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:31:17.660828 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7c7ed37d-7f2b-4cdb-9fd9-1c480189b5c5 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 204 len: 0 microversion: 2.1 time: 0.139420 Aug 18 22:31:17.661740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2207/4413] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:31:17 2022] DELETE /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:31:17.670123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b0f99235-16fd-4cfb-a7d9-fa837cfbe78a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:17.670911 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b0f99235-16fd-4cfb-a7d9-fa837cfbe78a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:17.678308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0f99235-16fd-4cfb-a7d9-fa837cfbe78a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:17.678884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0f99235-16fd-4cfb-a7d9-fa837cfbe78a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:17.679398 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0f99235-16fd-4cfb-a7d9-fa837cfbe78a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:17.680171 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0f99235-16fd-4cfb-a7d9-fa837cfbe78a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:17.680730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0f99235-16fd-4cfb-a7d9-fa837cfbe78a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:17.681232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b0f99235-16fd-4cfb-a7d9-fa837cfbe78a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:17.708848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-dae56397-f3d2-4aaa-991c-1080feecbbb9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:17.725368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dae56397-f3d2-4aaa-991c-1080feecbbb9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.258823 Aug 18 22:31:17.726069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2207/4414] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:17 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:17.838889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b0f99235-16fd-4cfb-a7d9-fa837cfbe78a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:17.858440 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b0f99235-16fd-4cfb-a7d9-fa837cfbe78a tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1682 microversion: 2.1 time: 0.192059 Aug 18 22:31:17.859073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2208/4415] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:17 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1682 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:31:18.063096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-33d4cec4-c1e6-44c5-85a7-fde23f404e0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:18.063719 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-33d4cec4-c1e6-44c5-85a7-fde23f404e0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:18.069532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33d4cec4-c1e6-44c5-85a7-fde23f404e0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:18.070464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33d4cec4-c1e6-44c5-85a7-fde23f404e0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:18.070842 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33d4cec4-c1e6-44c5-85a7-fde23f404e0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:18.071626 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33d4cec4-c1e6-44c5-85a7-fde23f404e0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:18.072248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33d4cec4-c1e6-44c5-85a7-fde23f404e0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:18.072522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-33d4cec4-c1e6-44c5-85a7-fde23f404e0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:18.146569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-33d4cec4-c1e6-44c5-85a7-fde23f404e0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:18.154148 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-33d4cec4-c1e6-44c5-85a7-fde23f404e0d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1272 microversion: 2.1 time: 0.095632 Aug 18 22:31:18.155215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2208/4416] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:18 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:18.746401 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6d4eb069-4195-407c-a5d2-64148c43c0a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:18.747017 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6d4eb069-4195-407c-a5d2-64148c43c0a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:18.753669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d4eb069-4195-407c-a5d2-64148c43c0a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:18.754156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d4eb069-4195-407c-a5d2-64148c43c0a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:18.754663 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d4eb069-4195-407c-a5d2-64148c43c0a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:18.755425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d4eb069-4195-407c-a5d2-64148c43c0a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:18.755884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d4eb069-4195-407c-a5d2-64148c43c0a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:18.756308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6d4eb069-4195-407c-a5d2-64148c43c0a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:18.882707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ecac5990-6d68-4b4c-83ac-69b91dd2a3f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:18.883683 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ecac5990-6d68-4b4c-83ac-69b91dd2a3f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:18.892253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecac5990-6d68-4b4c-83ac-69b91dd2a3f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:18.892939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecac5990-6d68-4b4c-83ac-69b91dd2a3f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:18.893426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecac5990-6d68-4b4c-83ac-69b91dd2a3f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:18.894165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecac5990-6d68-4b4c-83ac-69b91dd2a3f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:18.894679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecac5990-6d68-4b4c-83ac-69b91dd2a3f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:18.895114 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ecac5990-6d68-4b4c-83ac-69b91dd2a3f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:18.895700 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6d4eb069-4195-407c-a5d2-64148c43c0a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:18.903221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6d4eb069-4195-407c-a5d2-64148c43c0a9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1257 microversion: 2.1 time: 0.160535 Aug 18 22:31:18.903800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2209/4417] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:18 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1257 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:19.035817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ecac5990-6d68-4b4c-83ac-69b91dd2a3f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:19.043780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ecac5990-6d68-4b4c-83ac-69b91dd2a3f2 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1682 microversion: 2.1 time: 0.165229 Aug 18 22:31:19.044358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2209/4418] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:18 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:31:19.178073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a5b66973-75f6-4789-819f-d5d52e6b6810 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:19.179437 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a5b66973-75f6-4789-819f-d5d52e6b6810 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:19.187313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b66973-75f6-4789-819f-d5d52e6b6810 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:19.187631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b66973-75f6-4789-819f-d5d52e6b6810 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:19.188174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b66973-75f6-4789-819f-d5d52e6b6810 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:19.189050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b66973-75f6-4789-819f-d5d52e6b6810 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:19.189630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b66973-75f6-4789-819f-d5d52e6b6810 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:19.190247 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a5b66973-75f6-4789-819f-d5d52e6b6810 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:19.330402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a5b66973-75f6-4789-819f-d5d52e6b6810 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:19.338182 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a5b66973-75f6-4789-819f-d5d52e6b6810 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1314 microversion: 2.1 time: 0.164798 Aug 18 22:31:19.338773 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2210/4419] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:19 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:19.751273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-c0318cc0-dcbc-4344-a7dd-59801d05074a req-da5704e3-2b9d-44ae-8f8f-429fd1833ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aae01b7-50f9-4017-a3d1-02c23c2be4c7", "tag": "a6e38cce-8616-4922-91e1-5c0643f08f5a"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:31:19.770335 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-c0318cc0-dcbc-4344-a7dd-59801d05074a req-da5704e3-2b9d-44ae-8f8f-429fd1833ed8 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:19.771065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-c0318cc0-dcbc-4344-a7dd-59801d05074a req-da5704e3-2b9d-44ae-8f8f-429fd1833ed8 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:19.771590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-c0318cc0-dcbc-4344-a7dd-59801d05074a req-da5704e3-2b9d-44ae-8f8f-429fd1833ed8 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:19.787847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-c0318cc0-dcbc-4344-a7dd-59801d05074a req-da5704e3-2b9d-44ae-8f8f-429fd1833ed8 service nova] Creating event network-changed:a6e38cce-8616-4922-91e1-5c0643f08f5a for instance 0aae01b7-50f9-4017-a3d1-02c23c2be4c7 on hv-cinder-85367 Aug 18 22:31:19.805368 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-c0318cc0-dcbc-4344-a7dd-59801d05074a req-da5704e3-2b9d-44ae-8f8f-429fd1833ed8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058219 Aug 18 22:31:19.809629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2210/4420] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:19.923296 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ebb63ae9-70d9-4fe9-9ca9-088c8d33a0b9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:19.924565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ebb63ae9-70d9-4fe9-9ca9-088c8d33a0b9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:19.930884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebb63ae9-70d9-4fe9-9ca9-088c8d33a0b9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:19.931451 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebb63ae9-70d9-4fe9-9ca9-088c8d33a0b9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:19.931976 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebb63ae9-70d9-4fe9-9ca9-088c8d33a0b9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:19.932772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebb63ae9-70d9-4fe9-9ca9-088c8d33a0b9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:19.933308 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebb63ae9-70d9-4fe9-9ca9-088c8d33a0b9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:19.933844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ebb63ae9-70d9-4fe9-9ca9-088c8d33a0b9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:20.068205 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-78b912ac-215d-4b29-aca3-28d44d711ed4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:20.069291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-78b912ac-215d-4b29-aca3-28d44d711ed4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:20.085157 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78b912ac-215d-4b29-aca3-28d44d711ed4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:20.085912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78b912ac-215d-4b29-aca3-28d44d711ed4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:20.086530 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78b912ac-215d-4b29-aca3-28d44d711ed4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:20.088348 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78b912ac-215d-4b29-aca3-28d44d711ed4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:20.088937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78b912ac-215d-4b29-aca3-28d44d711ed4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:20.090285 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-78b912ac-215d-4b29-aca3-28d44d711ed4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:20.092702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ebb63ae9-70d9-4fe9-9ca9-088c8d33a0b9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:20.101640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ebb63ae9-70d9-4fe9-9ca9-088c8d33a0b9 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1441 microversion: 2.1 time: 0.181603 Aug 18 22:31:20.110012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2211/4421] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:19 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1441 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:20.124318 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b70953ae-34fe-441b-ad5b-8a1ca68e2ef5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:20.125453 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b70953ae-34fe-441b-ad5b-8a1ca68e2ef5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:20.133087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b70953ae-34fe-441b-ad5b-8a1ca68e2ef5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:20.133648 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b70953ae-34fe-441b-ad5b-8a1ca68e2ef5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:20.134223 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b70953ae-34fe-441b-ad5b-8a1ca68e2ef5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:20.135005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b70953ae-34fe-441b-ad5b-8a1ca68e2ef5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:20.135519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b70953ae-34fe-441b-ad5b-8a1ca68e2ef5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:20.135888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b70953ae-34fe-441b-ad5b-8a1ca68e2ef5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:20.278857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b70953ae-34fe-441b-ad5b-8a1ca68e2ef5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:20.286870 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b70953ae-34fe-441b-ad5b-8a1ca68e2ef5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1441 microversion: 2.1 time: 0.168257 Aug 18 22:31:20.287538 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2212/4422] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:20 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1441 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:31:20.359370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9f33282f-3dd2-4d8d-997d-19c2e310d928 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:20.360021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9f33282f-3dd2-4d8d-997d-19c2e310d928 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:20.366136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f33282f-3dd2-4d8d-997d-19c2e310d928 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:20.366855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f33282f-3dd2-4d8d-997d-19c2e310d928 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:20.367460 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f33282f-3dd2-4d8d-997d-19c2e310d928 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:20.368354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f33282f-3dd2-4d8d-997d-19c2e310d928 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:20.368810 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f33282f-3dd2-4d8d-997d-19c2e310d928 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:20.369426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9f33282f-3dd2-4d8d-997d-19c2e310d928 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:20.581266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9f33282f-3dd2-4d8d-997d-19c2e310d928 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:20.589653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9f33282f-3dd2-4d8d-997d-19c2e310d928 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1314 microversion: 2.1 time: 0.234020 Aug 18 22:31:20.590572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2213/4423] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:20 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:31:20.669660 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-78b912ac-215d-4b29-aca3-28d44d711ed4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:20.682647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-78b912ac-215d-4b29-aca3-28d44d711ed4 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1682 microversion: 2.1 time: 0.620542 Aug 18 22:31:20.683426 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2211/4424] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:20 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1682 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:21.610144 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d88cd3ae-df86-4007-ab39-60194d1f74c5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:21.611454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d88cd3ae-df86-4007-ab39-60194d1f74c5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:21.618445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d88cd3ae-df86-4007-ab39-60194d1f74c5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:21.619248 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d88cd3ae-df86-4007-ab39-60194d1f74c5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:21.619754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d88cd3ae-df86-4007-ab39-60194d1f74c5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:21.620558 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d88cd3ae-df86-4007-ab39-60194d1f74c5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:21.621418 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d88cd3ae-df86-4007-ab39-60194d1f74c5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:21.622559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d88cd3ae-df86-4007-ab39-60194d1f74c5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:21.705736 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cecb54d6-d35b-44fe-8806-168e3915be84 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:21.707179 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cecb54d6-d35b-44fe-8806-168e3915be84 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:21.715094 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cecb54d6-d35b-44fe-8806-168e3915be84 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:21.730343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cecb54d6-d35b-44fe-8806-168e3915be84 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:21.732430 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cecb54d6-d35b-44fe-8806-168e3915be84 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:21.737654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cecb54d6-d35b-44fe-8806-168e3915be84 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:21.738450 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cecb54d6-d35b-44fe-8806-168e3915be84 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:21.739134 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cecb54d6-d35b-44fe-8806-168e3915be84 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:21.831206 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cecb54d6-d35b-44fe-8806-168e3915be84 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7790a2ef47644d62863aafc890d03249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6929ebd282417cb6ba149f50281240', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:21.840542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cecb54d6-d35b-44fe-8806-168e3915be84 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 200 len: 1615 microversion: 2.1 time: 0.139552 Aug 18 22:31:21.841136 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2212/4425] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:21 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 1615 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:31:21.845812 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-53a05b65-9736-4d94-8850-284901293a12 req-dc7b2278-2b1a-4d30-a508-63d2bad1bf02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d6551e6-1c93-4857-8c40-3e345353f113", "name": "network-vif-deleted", "tag": "71d29818-272d-4a6b-9437-ad3c2747981b"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:31:21.855636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-53a05b65-9736-4d94-8850-284901293a12 req-dc7b2278-2b1a-4d30-a508-63d2bad1bf02 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:21.856051 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-53a05b65-9736-4d94-8850-284901293a12 req-dc7b2278-2b1a-4d30-a508-63d2bad1bf02 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:21.856477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-53a05b65-9736-4d94-8850-284901293a12 req-dc7b2278-2b1a-4d30-a508-63d2bad1bf02 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:21.868216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-53a05b65-9736-4d94-8850-284901293a12 req-dc7b2278-2b1a-4d30-a508-63d2bad1bf02 service nova] Creating event network-vif-deleted:71d29818-272d-4a6b-9437-ad3c2747981b for instance 7d6551e6-1c93-4857-8c40-3e345353f113 on hv-cinder-85367 Aug 18 22:31:21.878299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-53a05b65-9736-4d94-8850-284901293a12 req-dc7b2278-2b1a-4d30-a508-63d2bad1bf02 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035578 Aug 18 22:31:21.879166 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2213/4426] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:21.928275 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d88cd3ae-df86-4007-ab39-60194d1f74c5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:21.944205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d88cd3ae-df86-4007-ab39-60194d1f74c5 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1314 microversion: 2.1 time: 0.337950 Aug 18 22:31:21.949868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2214/4427] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:21 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:22.798913 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-aab2d1af-3339-4ad3-b223-a86859bd73bd req-7ee5e5f4-c3c3-45f2-b5ec-ca3e13349f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e60ed1-0091-4e24-8cfa-b854eed71bf4", "tag": "f7486d36-da4f-4543-8560-136f47b31774"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:31:22.817925 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-aab2d1af-3339-4ad3-b223-a86859bd73bd req-7ee5e5f4-c3c3-45f2-b5ec-ca3e13349f53 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:22.818709 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-aab2d1af-3339-4ad3-b223-a86859bd73bd req-7ee5e5f4-c3c3-45f2-b5ec-ca3e13349f53 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:22.819446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-aab2d1af-3339-4ad3-b223-a86859bd73bd req-7ee5e5f4-c3c3-45f2-b5ec-ca3e13349f53 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:22.838355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-aab2d1af-3339-4ad3-b223-a86859bd73bd req-7ee5e5f4-c3c3-45f2-b5ec-ca3e13349f53 service nova] Creating event network-changed:f7486d36-da4f-4543-8560-136f47b31774 for instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 on hv-cinder-85367 Aug 18 22:31:22.845257 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-aab2d1af-3339-4ad3-b223-a86859bd73bd req-7ee5e5f4-c3c3-45f2-b5ec-ca3e13349f53 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054810 Aug 18 22:31:22.850804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2214/4428] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:31:22.867346 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5f4f8665-2ccb-415e-916c-508e4b7475f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:22.868466 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5f4f8665-2ccb-415e-916c-508e4b7475f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:22.890090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f4f8665-2ccb-415e-916c-508e4b7475f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:22.891762 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f4f8665-2ccb-415e-916c-508e4b7475f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:22.892518 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f4f8665-2ccb-415e-916c-508e4b7475f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:22.894075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f4f8665-2ccb-415e-916c-508e4b7475f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:22.895242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f4f8665-2ccb-415e-916c-508e4b7475f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:22.895986 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5f4f8665-2ccb-415e-916c-508e4b7475f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:22.922186 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-5f4f8665-2ccb-415e-916c-508e4b7475f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] HTTP exception thrown: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5f4f8665-2ccb-415e-916c-508e4b7475f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Request method failure captured: Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 HTTP/1.1 Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rWBIsfITIm8B5aAadYoYtda0awBoPJQ3oDuqOGHktq7_2BFfV86yckT-Pvy_DdsU84CbBgXzQDDx-uKH3hBO1dZNixUXGb6LhK0N9LZHsMdm_6JnJoe2wAQi1un1nAf2qs4VMjOEM8E7JksAIf_9lzrYLB1p3BpYyJ_ip384PM_XwU Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:31:22.926613 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:31:22.928387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_aa6929ebd282417cb6ba149f50281240", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:22.928387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:22.928387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:22.928387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:22.928387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:22.928387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:31:22.928387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:31:22.928387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 7790a2ef47644d62863aafc890d03249 Aug 18 22:31:22.928387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:22.928387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:31:22.928387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:22.928387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': '7d6551e6-1c93-4857-8c40-3e345353f113'} Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:22.929146 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:22.930421 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:22.932592 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5f4f8665-2ccb-415e-916c-508e4b7475f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Returning 404 to user: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:22.935832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5f4f8665-2ccb-415e-916c-508e4b7475f3 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 404 len: 111 microversion: 2.1 time: 0.073974 Aug 18 22:31:22.940503 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2215/4429] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:22 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:22.958670 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-21afa07c-e16c-41da-93f3-b2de39ea95af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '.version_select at 0x7fd88a0df8b0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:22.968402 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-42de664e-d50e-4ebb-a507-4f7f5b56bfce tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:22.969287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-42de664e-d50e-4ebb-a507-4f7f5b56bfce tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:22.977420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42de664e-d50e-4ebb-a507-4f7f5b56bfce tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:22.979160 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42de664e-d50e-4ebb-a507-4f7f5b56bfce tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:22.980018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42de664e-d50e-4ebb-a507-4f7f5b56bfce tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:22.981218 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42de664e-d50e-4ebb-a507-4f7f5b56bfce tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:22.982366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42de664e-d50e-4ebb-a507-4f7f5b56bfce tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:22.983013 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-42de664e-d50e-4ebb-a507-4f7f5b56bfce tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:23.016409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-21afa07c-e16c-41da-93f3-b2de39ea95af tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757840277" status: 202 len: 0 microversion: 2.1 time: 0.073946 Aug 18 22:31:23.017316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2215/4430] 10.222.0.82 () {58 vars in 1218 bytes} [Thu Aug 18 22:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757840277 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:31:23.255566 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-42de664e-d50e-4ebb-a507-4f7f5b56bfce tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:23.265409 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-42de664e-d50e-4ebb-a507-4f7f5b56bfce tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1314 microversion: 2.1 time: 0.302536 Aug 18 22:31:23.267092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2216/4431] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:22 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:24.289522 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-77dfb1ec-4be2-42cc-b71b-322203ad7939 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:24.290790 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-77dfb1ec-4be2-42cc-b71b-322203ad7939 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:24.298730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77dfb1ec-4be2-42cc-b71b-322203ad7939 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:24.299328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77dfb1ec-4be2-42cc-b71b-322203ad7939 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:24.299802 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77dfb1ec-4be2-42cc-b71b-322203ad7939 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:24.300640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77dfb1ec-4be2-42cc-b71b-322203ad7939 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:24.301147 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77dfb1ec-4be2-42cc-b71b-322203ad7939 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:24.301816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-77dfb1ec-4be2-42cc-b71b-322203ad7939 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:24.448920 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-77dfb1ec-4be2-42cc-b71b-322203ad7939 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:24.457287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-77dfb1ec-4be2-42cc-b71b-322203ad7939 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1314 microversion: 2.1 time: 0.174124 Aug 18 22:31:24.458606 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2216/4432] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:24 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:25.097897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bbd40265-d96e-4d57-8e29-1b4043596c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:25.098403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bbd40265-d96e-4d57-8e29-1b4043596c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:25.104896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbd40265-d96e-4d57-8e29-1b4043596c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:25.105380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbd40265-d96e-4d57-8e29-1b4043596c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:25.105880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbd40265-d96e-4d57-8e29-1b4043596c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:25.106582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbd40265-d96e-4d57-8e29-1b4043596c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:25.107039 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbd40265-d96e-4d57-8e29-1b4043596c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:25.107470 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bbd40265-d96e-4d57-8e29-1b4043596c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:25.121228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-bbd40265-d96e-4d57-8e29-1b4043596c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] HTTP exception thrown: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bbd40265-d96e-4d57-8e29-1b4043596c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Request method failure captured: Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: DELETE /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 HTTP/1.1 Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rWBIsfITIm8B5aAadYoYtda0awBoPJQ3oDuqOGHktq7_2BFfV86yckT-Pvy_DdsU84CbBgXzQDDx-uKH3hBO1dZNixUXGb6LhK0N9LZHsMdm_6JnJoe2wAQi1un1nAf2qs4VMjOEM8E7JksAIf_9lzrYLB1p3BpYyJ_ip384PM_XwU Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:31:25.122878 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:31:25.125927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_aa6929ebd282417cb6ba149f50281240", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:25.125927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:25.125927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:25.125927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:25.125927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:25.125927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:31:25.125927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:31:25.125927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 7790a2ef47644d62863aafc890d03249 Aug 18 22:31:25.125927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:25.125927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:31:25.125927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:25.125927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': '7d6551e6-1c93-4857-8c40-3e345353f113'} Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:25.126935 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:25.128872 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:25.131416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bbd40265-d96e-4d57-8e29-1b4043596c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Returning 404 to user: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:25.131416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bbd40265-d96e-4d57-8e29-1b4043596c18 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 404 len: 111 microversion: 2.1 time: 0.030707 Aug 18 22:31:25.131416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2217/4433] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:31:25 2022] DELETE /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:25.135138 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2993fb8b-8695-419b-b96f-fda572f6aa12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:25.135879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2993fb8b-8695-419b-b96f-fda572f6aa12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7d6551e6-1c93-4857-8c40-3e345353f113] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:25.143366 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2993fb8b-8695-419b-b96f-fda572f6aa12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:25.143852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2993fb8b-8695-419b-b96f-fda572f6aa12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:25.144289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2993fb8b-8695-419b-b96f-fda572f6aa12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:25.144995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2993fb8b-8695-419b-b96f-fda572f6aa12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:25.145449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2993fb8b-8695-419b-b96f-fda572f6aa12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:25.145902 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2993fb8b-8695-419b-b96f-fda572f6aa12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:25.159924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-2993fb8b-8695-419b-b96f-fda572f6aa12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] HTTP exception thrown: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2993fb8b-8695-419b-b96f-fda572f6aa12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Request method failure captured: Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 HTTP/1.1 Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rWBIsfITIm8B5aAadYoYtda0awBoPJQ3oDuqOGHktq7_2BFfV86yckT-Pvy_DdsU84CbBgXzQDDx-uKH3hBO1dZNixUXGb6LhK0N9LZHsMdm_6JnJoe2wAQi1un1nAf2qs4VMjOEM8E7JksAIf_9lzrYLB1p3BpYyJ_ip384PM_XwU Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:31:25.161552 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:31:25.163023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_aa6929ebd282417cb6ba149f50281240", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:25.163023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:25.163023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:25.163023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:25.163023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:25.163023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:31:25.163023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:31:25.163023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 7790a2ef47644d62863aafc890d03249 Aug 18 22:31:25.163023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:25.163023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:31:25.163023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:25.163023 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': '7d6551e6-1c93-4857-8c40-3e345353f113'} Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:25.163859 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. Aug 18 22:31:25.165260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:25.166929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2993fb8b-8695-419b-b96f-fda572f6aa12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Returning 404 to user: Instance 7d6551e6-1c93-4857-8c40-3e345353f113 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:25.166929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2993fb8b-8695-419b-b96f-fda572f6aa12 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113" status: 404 len: 111 microversion: 2.1 time: 0.032967 Aug 18 22:31:25.166929 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2217/4434] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:25 2022] GET /compute/v2.1/servers/7d6551e6-1c93-4857-8c40-3e345353f113 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:25.479132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ce29bce1-a60b-4828-a282-1413b1cf3162 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:25.479743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ce29bce1-a60b-4828-a282-1413b1cf3162 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:25.486476 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce29bce1-a60b-4828-a282-1413b1cf3162 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:25.486965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce29bce1-a60b-4828-a282-1413b1cf3162 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:25.487372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce29bce1-a60b-4828-a282-1413b1cf3162 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:25.488167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce29bce1-a60b-4828-a282-1413b1cf3162 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:25.488669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce29bce1-a60b-4828-a282-1413b1cf3162 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:25.489092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce29bce1-a60b-4828-a282-1413b1cf3162 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:25.619467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ce29bce1-a60b-4828-a282-1413b1cf3162 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:25.627370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ce29bce1-a60b-4828-a282-1413b1cf3162 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1314 microversion: 2.1 time: 0.152045 Aug 18 22:31:25.627946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2218/4435] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:25 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:26.304731 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-61a2e948-3ae1-4804-af89-c164d660d3b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:26.305338 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-61a2e948-3ae1-4804-af89-c164d660d3b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:26.312639 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61a2e948-3ae1-4804-af89-c164d660d3b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:26.313133 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61a2e948-3ae1-4804-af89-c164d660d3b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:26.313578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61a2e948-3ae1-4804-af89-c164d660d3b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:26.314301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61a2e948-3ae1-4804-af89-c164d660d3b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:26.314763 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61a2e948-3ae1-4804-af89-c164d660d3b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:26.315198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-61a2e948-3ae1-4804-af89-c164d660d3b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:26.329651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-61a2e948-3ae1-4804-af89-c164d660d3b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] HTTP exception thrown: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-61a2e948-3ae1-4804-af89-c164d660d3b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Request method failure captured: Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd HTTP/1.1 Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rWBIsfITIm8B5aAadYoYtda0awBoPJQ3oDuqOGHktq7_2BFfV86yckT-Pvy_DdsU84CbBgXzQDDx-uKH3hBO1dZNixUXGb6LhK0N9LZHsMdm_6JnJoe2wAQi1un1nAf2qs4VMjOEM8E7JksAIf_9lzrYLB1p3BpYyJ_ip384PM_XwU Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:31:26.331239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:31:26.332754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_aa6929ebd282417cb6ba149f50281240", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:26.332754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:26.332754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:26.332754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:26.332754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:26.332754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:31:26.332754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:31:26.332754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 7790a2ef47644d62863aafc890d03249 Aug 18 22:31:26.332754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:26.332754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:31:26.332754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:31:26.332754 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': 'efddf778-cd30-48e6-b04a-2a6277976fbd'} Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:26.333846 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:31:26.335252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.337007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-61a2e948-3ae1-4804-af89-c164d660d3b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Returning 404 to user: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:26.337007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-61a2e948-3ae1-4804-af89-c164d660d3b8 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 404 len: 111 microversion: 2.1 time: 0.031878 Aug 18 22:31:26.337007 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2218/4436] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:31:26 2022] DELETE /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:26.341243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b28aa2c5-7886-4086-9439-91f039e5fb2b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:26.342089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b28aa2c5-7886-4086-9439-91f039e5fb2b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: efddf778-cd30-48e6-b04a-2a6277976fbd] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:26.349030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b28aa2c5-7886-4086-9439-91f039e5fb2b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:26.349514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b28aa2c5-7886-4086-9439-91f039e5fb2b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:26.350007 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b28aa2c5-7886-4086-9439-91f039e5fb2b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:26.350702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b28aa2c5-7886-4086-9439-91f039e5fb2b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:26.351161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b28aa2c5-7886-4086-9439-91f039e5fb2b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:26.351585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b28aa2c5-7886-4086-9439-91f039e5fb2b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:26.365644 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-b28aa2c5-7886-4086-9439-91f039e5fb2b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] HTTP exception thrown: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b28aa2c5-7886-4086-9439-91f039e5fb2b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Request method failure captured: Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd HTTP/1.1 Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rWBIsfITIm8B5aAadYoYtda0awBoPJQ3oDuqOGHktq7_2BFfV86yckT-Pvy_DdsU84CbBgXzQDDx-uKH3hBO1dZNixUXGb6LhK0N9LZHsMdm_6JnJoe2wAQi1un1nAf2qs4VMjOEM8E7JksAIf_9lzrYLB1p3BpYyJ_ip384PM_XwU Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:31:26.368225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:31:26.370822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_aa6929ebd282417cb6ba149f50281240", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:26.370822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:26.370822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:26.370822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:26.370822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:26.370822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:31:26.370822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:31:26.370822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 7790a2ef47644d62863aafc890d03249 Aug 18 22:31:26.370822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:26.370822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:31:26.370822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:31:26.370822 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': 'efddf778-cd30-48e6-b04a-2a6277976fbd'} Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:26.371661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. Aug 18 22:31:26.373624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.374793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b28aa2c5-7886-4086-9439-91f039e5fb2b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Returning 404 to user: Instance efddf778-cd30-48e6-b04a-2a6277976fbd could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:26.374793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b28aa2c5-7886-4086-9439-91f039e5fb2b tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd" status: 404 len: 111 microversion: 2.1 time: 0.032095 Aug 18 22:31:26.374793 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2219/4437] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:26 2022] GET /compute/v2.1/servers/efddf778-cd30-48e6-b04a-2a6277976fbd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:26.378990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e7c5b903-d79e-4766-88ff-85f2e46023e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:26.379498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e7c5b903-d79e-4766-88ff-85f2e46023e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:26.385548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7c5b903-d79e-4766-88ff-85f2e46023e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:26.386375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7c5b903-d79e-4766-88ff-85f2e46023e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:26.387096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7c5b903-d79e-4766-88ff-85f2e46023e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:26.387807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7c5b903-d79e-4766-88ff-85f2e46023e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:26.388305 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7c5b903-d79e-4766-88ff-85f2e46023e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:26.389340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7c5b903-d79e-4766-88ff-85f2e46023e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:26.404727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-e7c5b903-d79e-4766-88ff-85f2e46023e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] HTTP exception thrown: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e7c5b903-d79e-4766-88ff-85f2e46023e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Request method failure captured: Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb HTTP/1.1 Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rWBIsfITIm8B5aAadYoYtda0awBoPJQ3oDuqOGHktq7_2BFfV86yckT-Pvy_DdsU84CbBgXzQDDx-uKH3hBO1dZNixUXGb6LhK0N9LZHsMdm_6JnJoe2wAQi1un1nAf2qs4VMjOEM8E7JksAIf_9lzrYLB1p3BpYyJ_ip384PM_XwU Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:31:26.406330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:31:26.407816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_aa6929ebd282417cb6ba149f50281240", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:26.407816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:26.407816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:26.407816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:26.407816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:26.407816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:31:26.407816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:31:26.407816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 7790a2ef47644d62863aafc890d03249 Aug 18 22:31:26.407816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:26.407816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:31:26.407816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 22:31:26.407816 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': '7625a2b9-485b-4313-ba1b-b8f88221a6fb'} Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:26.408647 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 22:31:26.410066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.411296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e7c5b903-d79e-4766-88ff-85f2e46023e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Returning 404 to user: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:26.411296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e7c5b903-d79e-4766-88ff-85f2e46023e6 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 404 len: 111 microversion: 2.1 time: 0.032715 Aug 18 22:31:26.411296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2219/4438] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:31:26 2022] DELETE /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:26.417719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d15f7b8d-8e69-4d28-8378-b90a9bc0e5da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:26.418327 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d15f7b8d-8e69-4d28-8378-b90a9bc0e5da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: 7625a2b9-485b-4313-ba1b-b8f88221a6fb] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:26.424442 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d15f7b8d-8e69-4d28-8378-b90a9bc0e5da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:26.424931 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d15f7b8d-8e69-4d28-8378-b90a9bc0e5da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:26.425372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d15f7b8d-8e69-4d28-8378-b90a9bc0e5da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:26.426096 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d15f7b8d-8e69-4d28-8378-b90a9bc0e5da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:26.426731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d15f7b8d-8e69-4d28-8378-b90a9bc0e5da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:26.427165 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d15f7b8d-8e69-4d28-8378-b90a9bc0e5da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:26.443699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-d15f7b8d-8e69-4d28-8378-b90a9bc0e5da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] HTTP exception thrown: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d15f7b8d-8e69-4d28-8378-b90a9bc0e5da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Request method failure captured: Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb HTTP/1.1 Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rWBIsfITIm8B5aAadYoYtda0awBoPJQ3oDuqOGHktq7_2BFfV86yckT-Pvy_DdsU84CbBgXzQDDx-uKH3hBO1dZNixUXGb6LhK0N9LZHsMdm_6JnJoe2wAQi1un1nAf2qs4VMjOEM8E7JksAIf_9lzrYLB1p3BpYyJ_ip384PM_XwU Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:31:26.445586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:31:26.446807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_aa6929ebd282417cb6ba149f50281240", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:26.446807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:26.446807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:26.446807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:26.446807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:26.446807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:31:26.446807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:31:26.446807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 7790a2ef47644d62863aafc890d03249 Aug 18 22:31:26.446807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:26.446807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:31:26.446807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 22:31:26.446807 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': '7625a2b9-485b-4313-ba1b-b8f88221a6fb'} Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:26.447532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. Aug 18 22:31:26.449619 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:26.452262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d15f7b8d-8e69-4d28-8378-b90a9bc0e5da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Returning 404 to user: Instance 7625a2b9-485b-4313-ba1b-b8f88221a6fb could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:26.452262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d15f7b8d-8e69-4d28-8378-b90a9bc0e5da tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb" status: 404 len: 111 microversion: 2.1 time: 0.033811 Aug 18 22:31:26.452262 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2220/4439] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:26 2022] GET /compute/v2.1/servers/7625a2b9-485b-4313-ba1b-b8f88221a6fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:26.452725 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-979ef8cb-fdfc-439c-b7ef-dd8696990a91 req-0a2c0971-b18c-46e5-b975-1ad26ae7315b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aae01b7-50f9-4017-a3d1-02c23c2be4c7", "name": "network-vif-plugged", "status": "completed", "tag": "a6e38cce-8616-4922-91e1-5c0643f08f5a"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:31:26.462470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-979ef8cb-fdfc-439c-b7ef-dd8696990a91 req-0a2c0971-b18c-46e5-b975-1ad26ae7315b service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:26.463066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-979ef8cb-fdfc-439c-b7ef-dd8696990a91 req-0a2c0971-b18c-46e5-b975-1ad26ae7315b service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:26.463609 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-979ef8cb-fdfc-439c-b7ef-dd8696990a91 req-0a2c0971-b18c-46e5-b975-1ad26ae7315b service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:26.475885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-979ef8cb-fdfc-439c-b7ef-dd8696990a91 req-0a2c0971-b18c-46e5-b975-1ad26ae7315b service nova] Creating event network-vif-plugged:a6e38cce-8616-4922-91e1-5c0643f08f5a for instance 0aae01b7-50f9-4017-a3d1-02c23c2be4c7 on hv-cinder-85367 Aug 18 22:31:26.487636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-979ef8cb-fdfc-439c-b7ef-dd8696990a91 req-0a2c0971-b18c-46e5-b975-1ad26ae7315b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039856 Aug 18 22:31:26.488299 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2220/4440] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:26.648335 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-3ee3a72d-f8da-41f8-8b33-b777dc41771d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:26.648944 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-3ee3a72d-f8da-41f8-8b33-b777dc41771d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:26.655582 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ee3a72d-f8da-41f8-8b33-b777dc41771d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:26.656056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ee3a72d-f8da-41f8-8b33-b777dc41771d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:26.656483 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ee3a72d-f8da-41f8-8b33-b777dc41771d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:26.657163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ee3a72d-f8da-41f8-8b33-b777dc41771d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:26.657627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ee3a72d-f8da-41f8-8b33-b777dc41771d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:26.658050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-3ee3a72d-f8da-41f8-8b33-b777dc41771d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:26.800226 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-3ee3a72d-f8da-41f8-8b33-b777dc41771d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:26.808347 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-3ee3a72d-f8da-41f8-8b33-b777dc41771d tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1314 microversion: 2.1 time: 0.163919 Aug 18 22:31:26.809014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2221/4441] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:26 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:27.618170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4e5d648b-601f-4c8b-80ca-bb90edbe6d50 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:27.618767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4e5d648b-601f-4c8b-80ca-bb90edbe6d50 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:27.626284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e5d648b-601f-4c8b-80ca-bb90edbe6d50 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:27.626807 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e5d648b-601f-4c8b-80ca-bb90edbe6d50 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:27.627250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e5d648b-601f-4c8b-80ca-bb90edbe6d50 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:27.627952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e5d648b-601f-4c8b-80ca-bb90edbe6d50 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:27.628407 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e5d648b-601f-4c8b-80ca-bb90edbe6d50 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:27.628828 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4e5d648b-601f-4c8b-80ca-bb90edbe6d50 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:27.642705 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-4e5d648b-601f-4c8b-80ca-bb90edbe6d50 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] HTTP exception thrown: Instance ca6f2dae-a492-46e5-ab40-5884ff13d01e could not be found. Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4e5d648b-601f-4c8b-80ca-bb90edbe6d50 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Request method failure captured: Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e HTTP/1.1 Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_rWBIsfITIm8B5aAadYoYtda0awBoPJQ3oDuqOGHktq7_2BFfV86yckT-Pvy_DdsU84CbBgXzQDDx-uKH3hBO1dZNixUXGb6LhK0N9LZHsMdm_6JnJoe2wAQi1un1nAf2qs4VMjOEM8E7JksAIf_9lzrYLB1p3BpYyJ_ip384PM_XwU Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:31:27.644372 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:31:27.645968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_aa6929ebd282417cb6ba149f50281240", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:27.645968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:27.645968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:27.645968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:27.645968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:27.645968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:31:27.645968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:31:27.645968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 7790a2ef47644d62863aafc890d03249 Aug 18 22:31:27.645968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:27.645968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:31:27.645968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance ca6f2dae-a492-46e5-ab40-5884ff13d01e could not be found. Aug 18 22:31:27.645968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': 'ca6f2dae-a492-46e5-ab40-5884ff13d01e'} Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca6f2dae-a492-46e5-ab40-5884ff13d01e could not be found. Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:27.646759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca6f2dae-a492-46e5-ab40-5884ff13d01e could not be found. Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca6f2dae-a492-46e5-ab40-5884ff13d01e could not be found. Aug 18 22:31:27.648040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:27.649255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4e5d648b-601f-4c8b-80ca-bb90edbe6d50 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Returning 404 to user: Instance ca6f2dae-a492-46e5-ab40-5884ff13d01e could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:27.649255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4e5d648b-601f-4c8b-80ca-bb90edbe6d50 tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "DELETE /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 404 len: 111 microversion: 2.1 time: 0.031948 Aug 18 22:31:27.649255 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2221/4442] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:31:27 2022] DELETE /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:27.654661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab69cbb5-eb03-441b-846a-04af6b7dd09f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:27.655281 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ab69cbb5-eb03-441b-846a-04af6b7dd09f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] [instance: ca6f2dae-a492-46e5-ab40-5884ff13d01e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:27.661664 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab69cbb5-eb03-441b-846a-04af6b7dd09f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:27.662150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab69cbb5-eb03-441b-846a-04af6b7dd09f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:27.662590 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab69cbb5-eb03-441b-846a-04af6b7dd09f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:27.663287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab69cbb5-eb03-441b-846a-04af6b7dd09f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:27.663740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab69cbb5-eb03-441b-846a-04af6b7dd09f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:27.664163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ab69cbb5-eb03-441b-846a-04af6b7dd09f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:27.677908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-ab69cbb5-eb03-441b-846a-04af6b7dd09f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] HTTP exception thrown: Instance ca6f2dae-a492-46e5-ab40-5884ff13d01e could not be found. Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab69cbb5-eb03-441b-846a-04af6b7dd09f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Request method failure captured: Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e HTTP/1.1 Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_rWBIsfITIm8B5aAadYoYtda0awBoPJQ3oDuqOGHktq7_2BFfV86yckT-Pvy_DdsU84CbBgXzQDDx-uKH3hBO1dZNixUXGb6LhK0N9LZHsMdm_6JnJoe2wAQi1un1nAf2qs4VMjOEM8E7JksAIf_9lzrYLB1p3BpYyJ_ip384PM_XwU Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:31:27.679441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:31:27.680874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_aa6929ebd282417cb6ba149f50281240", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/aa6929ebd282417cb6ba149f50281240"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:27.680874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:27.680874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: aa6929ebd282417cb6ba149f50281240 Aug 18 22:31:27.680874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-10339268 Aug 18 22:31:27.680874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:27.680874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:31:27.680874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:31:27.680874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 7790a2ef47644d62863aafc890d03249 Aug 18 22:31:27.680874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-AttachVolumeNegativeTest-10339268-project Aug 18 22:31:27.680874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:31:27.680874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance ca6f2dae-a492-46e5-ab40-5884ff13d01e could not be found. Aug 18 22:31:27.680874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': 'ca6f2dae-a492-46e5-ab40-5884ff13d01e'} Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca6f2dae-a492-46e5-ab40-5884ff13d01e could not be found. Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:27.685158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca6f2dae-a492-46e5-ab40-5884ff13d01e could not be found. Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca6f2dae-a492-46e5-ab40-5884ff13d01e could not be found. Aug 18 22:31:27.687679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:27.688942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ab69cbb5-eb03-441b-846a-04af6b7dd09f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] Returning 404 to user: Instance ca6f2dae-a492-46e5-ab40-5884ff13d01e could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:27.688942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ab69cbb5-eb03-441b-846a-04af6b7dd09f tempest-AttachVolumeNegativeTest-10339268 tempest-AttachVolumeNegativeTest-10339268-project] 10.222.0.82 "GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e" status: 404 len: 111 microversion: 2.1 time: 0.029996 Aug 18 22:31:27.688942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2222/4443] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:27 2022] GET /compute/v2.1/servers/ca6f2dae-a492-46e5-ab40-5884ff13d01e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:27.830095 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c157aab0-dbdf-4239-905c-4fed9bf768ba tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:27.830711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c157aab0-dbdf-4239-905c-4fed9bf768ba tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:27.837096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c157aab0-dbdf-4239-905c-4fed9bf768ba tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:27.838223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c157aab0-dbdf-4239-905c-4fed9bf768ba tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:27.838671 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c157aab0-dbdf-4239-905c-4fed9bf768ba tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:27.839408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c157aab0-dbdf-4239-905c-4fed9bf768ba tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:27.839864 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c157aab0-dbdf-4239-905c-4fed9bf768ba tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:27.840477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c157aab0-dbdf-4239-905c-4fed9bf768ba tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:27.975324 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c157aab0-dbdf-4239-905c-4fed9bf768ba tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:27.984556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c157aab0-dbdf-4239-905c-4fed9bf768ba tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1497 microversion: 2.1 time: 0.158242 Aug 18 22:31:27.985130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2222/4444] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:27 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:28.583187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-980fc6f3-db1a-426a-80b1-09811fc6aeb8 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:28.583797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-980fc6f3-db1a-426a-80b1-09811fc6aeb8 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:28.590018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-980fc6f3-db1a-426a-80b1-09811fc6aeb8 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:28.590580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-980fc6f3-db1a-426a-80b1-09811fc6aeb8 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:28.591127 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-980fc6f3-db1a-426a-80b1-09811fc6aeb8 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:28.592243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-980fc6f3-db1a-426a-80b1-09811fc6aeb8 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:28.592482 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-980fc6f3-db1a-426a-80b1-09811fc6aeb8 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:28.592992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-980fc6f3-db1a-426a-80b1-09811fc6aeb8 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:28.619681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-980fc6f3-db1a-426a-80b1-09811fc6aeb8 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:31:28.648596 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:28.709197 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-980fc6f3-db1a-426a-80b1-09811fc6aeb8 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 204 len: 0 microversion: 2.1 time: 0.128983 Aug 18 22:31:28.709853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2223/4445] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:31:28 2022] DELETE /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:31:28.721991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-3800095c-2c39-4c77-9180-45dfd8287209 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:28.722711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-3800095c-2c39-4c77-9180-45dfd8287209 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:28.730301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3800095c-2c39-4c77-9180-45dfd8287209 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:28.730301 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3800095c-2c39-4c77-9180-45dfd8287209 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:28.730762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3800095c-2c39-4c77-9180-45dfd8287209 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:28.731485 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3800095c-2c39-4c77-9180-45dfd8287209 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:28.731946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3800095c-2c39-4c77-9180-45dfd8287209 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:28.732410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-3800095c-2c39-4c77-9180-45dfd8287209 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:28.752623 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=100 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:28.869272 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-3800095c-2c39-4c77-9180-45dfd8287209 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:28.879688 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-3800095c-2c39-4c77-9180-45dfd8287209 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1503 microversion: 2.1 time: 0.163817 Aug 18 22:31:28.880276 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2223/4446] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:28 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:29.905003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-cbebafeb-ed59-48cf-b505-2931eea56aac tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:29.905932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-cbebafeb-ed59-48cf-b505-2931eea56aac tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:29.913968 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbebafeb-ed59-48cf-b505-2931eea56aac tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:29.914588 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbebafeb-ed59-48cf-b505-2931eea56aac tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:29.915136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbebafeb-ed59-48cf-b505-2931eea56aac tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:29.916965 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbebafeb-ed59-48cf-b505-2931eea56aac tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:29.917786 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbebafeb-ed59-48cf-b505-2931eea56aac tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:29.918336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-cbebafeb-ed59-48cf-b505-2931eea56aac tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:30.176766 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-cbebafeb-ed59-48cf-b505-2931eea56aac tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:30.185187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-cbebafeb-ed59-48cf-b505-2931eea56aac tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1503 microversion: 2.1 time: 0.286397 Aug 18 22:31:30.186646 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2224/4447] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:29 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1503 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:30.978463 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-0e7f8afe-b3c9-46ed-ba8e-79cdafb52955 req-e809b550-2a0a-4ae0-8556-9eba1237a855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aae01b7-50f9-4017-a3d1-02c23c2be4c7", "name": "network-vif-deleted", "tag": "a6e38cce-8616-4922-91e1-5c0643f08f5a"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:31:30.996868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-0e7f8afe-b3c9-46ed-ba8e-79cdafb52955 req-e809b550-2a0a-4ae0-8556-9eba1237a855 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:30.999183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-0e7f8afe-b3c9-46ed-ba8e-79cdafb52955 req-e809b550-2a0a-4ae0-8556-9eba1237a855 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:31.000066 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-0e7f8afe-b3c9-46ed-ba8e-79cdafb52955 req-e809b550-2a0a-4ae0-8556-9eba1237a855 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:31.019283 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-0e7f8afe-b3c9-46ed-ba8e-79cdafb52955 req-e809b550-2a0a-4ae0-8556-9eba1237a855 service nova] Creating event network-vif-deleted:a6e38cce-8616-4922-91e1-5c0643f08f5a for instance 0aae01b7-50f9-4017-a3d1-02c23c2be4c7 on hv-cinder-85367 Aug 18 22:31:31.048983 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-0e7f8afe-b3c9-46ed-ba8e-79cdafb52955 req-e809b550-2a0a-4ae0-8556-9eba1237a855 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068833 Aug 18 22:31:31.049942 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2224/4448] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:31.208707 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:31.209735 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:31.218530 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:31.219113 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:31.219757 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:31.220796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:31.221649 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:31.222124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:31.256565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:31.257141 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:31.257718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:31.258280 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.objects.instance [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lazy-loading 'fault' on Instance uuid 0aae01b7-50f9-4017-a3d1-02c23c2be4c7 {{(pid=120539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:31:31.307587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baa2e8e668894ea4b82fea3a2bc1fe9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61268e79778c4a20b3b7beca375d5706', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:31:31.319524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1d1f4ea9-9033-4243-ac47-7371ca2b2f74 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 200 len: 1304 microversion: 2.1 time: 0.115504 Aug 18 22:31:31.320653 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2225/4449] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:31 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:31:32.342152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0f23ebc-1800-4274-8a08-461fc1b033e9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:32.342769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d0f23ebc-1800-4274-8a08-461fc1b033e9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] [instance: 0aae01b7-50f9-4017-a3d1-02c23c2be4c7] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:31:32.348969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0f23ebc-1800-4274-8a08-461fc1b033e9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:32.349448 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0f23ebc-1800-4274-8a08-461fc1b033e9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:32.349919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0f23ebc-1800-4274-8a08-461fc1b033e9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:32.350598 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0f23ebc-1800-4274-8a08-461fc1b033e9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:31:32.351046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0f23ebc-1800-4274-8a08-461fc1b033e9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:31:32.351463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d0f23ebc-1800-4274-8a08-461fc1b033e9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:31:32.366577 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-d0f23ebc-1800-4274-8a08-461fc1b033e9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] HTTP exception thrown: Instance 0aae01b7-50f9-4017-a3d1-02c23c2be4c7 could not be found. Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0f23ebc-1800-4274-8a08-461fc1b033e9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Request method failure captured: Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 HTTP/1.1 Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_r2Rx-jPTO3pABxAZ0DIye2TaEoaiDeanCJRaq0Vx9TKXLVb7bauisGOLhP6v5LN4gSRKhVS_DYaeapajvaZY7byZ-as35ewZXQJzM18nRc--jacohWeU-C7tZagSLPkUr-Dh9dGGvF2cpw_Ss_qiHC2dfpAWb6Qv9x1_0u_TZNPcC8 Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 61268e79778c4a20b3b7beca375d5706 Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesActionsTest-1168494609 Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:31:32.367855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:31:32.369128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_61268e79778c4a20b3b7beca375d5706", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/61268e79778c4a20b3b7beca375d5706"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/61268e79778c4a20b3b7beca375d5706"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/61268e79778c4a20b3b7beca375d5706"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:32.369128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesActionsTest-1168494609 Aug 18 22:31:32.369128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 61268e79778c4a20b3b7beca375d5706 Aug 18 22:31:32.369128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesActionsTest-1168494609 Aug 18 22:31:32.369128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesActionsTest-1168494609-project Aug 18 22:31:32.369128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:31:32.369128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:31:32.369128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: baa2e8e668894ea4b82fea3a2bc1fe9e Aug 18 22:31:32.369128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesActionsTest-1168494609-project Aug 18 22:31:32.369128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:31:32.369128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance 0aae01b7-50f9-4017-a3d1-02c23c2be4c7 could not be found. Aug 18 22:31:32.369128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': '0aae01b7-50f9-4017-a3d1-02c23c2be4c7'} Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aae01b7-50f9-4017-a3d1-02c23c2be4c7 could not be found. Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:32.369874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aae01b7-50f9-4017-a3d1-02c23c2be4c7 could not be found. Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aae01b7-50f9-4017-a3d1-02c23c2be4c7 could not be found. Aug 18 22:31:32.371014 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:32.372032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d0f23ebc-1800-4274-8a08-461fc1b033e9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] Returning 404 to user: Instance 0aae01b7-50f9-4017-a3d1-02c23c2be4c7 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:32.372032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d0f23ebc-1800-4274-8a08-461fc1b033e9 tempest-VolumesActionsTest-1168494609 tempest-VolumesActionsTest-1168494609-project] 10.222.0.82 "GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7" status: 404 len: 111 microversion: 2.1 time: 0.031714 Aug 18 22:31:32.372032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2226/4450] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:31:32 2022] GET /compute/v2.1/servers/0aae01b7-50f9-4017-a3d1-02c23c2be4c7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:32.459850 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9335406a-e27c-4508-9acd-0ac630dc3bb4 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Action: 'create', calling method: .version_select at 0x7fd889de3820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-521117796"}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:31:32.772765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9335406a-e27c-4508-9acd-0ac630dc3bb4 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.447682 Aug 18 22:31:32.787671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2e6cb782-f3e3-4e4d-8bf5-c57fc8dea458 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd8896a0f70>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:32.788252 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2225/4451] 10.222.0.82 () {60 vars in 1155 bytes} [Thu Aug 18 22:31:32 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 464 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 22:31:32.850604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2e6cb782-f3e3-4e4d-8bf5-c57fc8dea458 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4" status: 200 len: 344 microversion: 2.1 time: 0.064617 Aug 18 22:31:32.850604 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2227/4452] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 22:31:32 2022] GET /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:33.863569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f7a82dc7-7f87-4098-9b4b-30763613ee0c tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd889daca60>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:33.912779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f7a82dc7-7f87-4098-9b4b-30763613ee0c tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4" status: 200 len: 345 microversion: 2.1 time: 0.053463 Aug 18 22:31:33.913360 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2226/4453] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 22:31:33 2022] GET /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:33.927600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0f5f1cbc-bf1a-4a49-9894-c0228598df4a tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Action: 'create', calling method: .version_select at 0x7fd88e60caf0>, body: {"snapshot": {"volume_id": "712fbb2e-256b-4408-8774-46654622dbe4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1891401477"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:31:34.075284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0f5f1cbc-bf1a-4a49-9894-c0228598df4a tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.151971 Aug 18 22:31:34.080131 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2228/4454] 10.222.0.82 () {60 vars in 1162 bytes} [Thu Aug 18 22:31:33 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:34.086596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-558a56a6-ed94-4900-a4c3-31dd46b1ca18 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd889c463a0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:34.118578 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-558a56a6-ed94-4900-a4c3-31dd46b1ca18 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8" status: 200 len: 287 microversion: 2.1 time: 0.036041 Aug 18 22:31:34.119142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2227/4455] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 22:31:34 2022] GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:34.129806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-98e75388-b987-44da-aef1-c81b8592a0ee tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd88e60cc10>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:34.160548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-98e75388-b987-44da-aef1-c81b8592a0ee tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034552 Aug 18 22:31:34.161136 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2229/4456] 10.222.0.82 () {58 vars in 1140 bytes} [Thu Aug 18 22:31:34 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:34.172592 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-dfa789c9-fde0-4a23-82fe-f2698139ef0d tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd889c54160>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:34.206165 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-dfa789c9-fde0-4a23-82fe-f2698139ef0d tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8" status: 200 len: 287 microversion: 2.1 time: 0.037954 Aug 18 22:31:34.206747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2228/4457] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 22:31:34 2022] GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:35.218999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-98bf636e-b7a0-4a9a-b79d-8df158bb16b7 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd8896a08b0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:35.248696 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-98bf636e-b7a0-4a9a-b79d-8df158bb16b7 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8" status: 200 len: 287 microversion: 2.1 time: 0.033456 Aug 18 22:31:35.249260 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2230/4458] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 22:31:35 2022] GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:36.260667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8400c10d-d802-430c-a622-8174df315e80 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd88e5c4670>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:36.291468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8400c10d-d802-430c-a622-8174df315e80 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8" status: 200 len: 287 microversion: 2.1 time: 0.035182 Aug 18 22:31:36.292042 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2229/4459] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 22:31:36 2022] GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:37.304173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-7d783f57-4f2f-47f6-be3d-031325ada3ba tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd88e629ee0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:37.335204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-7d783f57-4f2f-47f6-be3d-031325ada3ba tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8" status: 200 len: 287 microversion: 2.1 time: 0.035168 Aug 18 22:31:37.335564 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2231/4460] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 22:31:37 2022] GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:38.348453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-102c8922-b92b-49a2-a9a5-fd98ed3cf3e5 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd88a024160>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:38.377823 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-102c8922-b92b-49a2-a9a5-fd98ed3cf3e5 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8" status: 200 len: 287 microversion: 2.1 time: 0.033810 Aug 18 22:31:38.378422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2230/4461] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 22:31:38 2022] GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:39.391384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-79b3589c-de5a-4ed9-a207-72d7f896af5e tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd88967a430>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:39.420831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-79b3589c-de5a-4ed9-a207-72d7f896af5e tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8" status: 200 len: 288 microversion: 2.1 time: 0.034526 Aug 18 22:31:39.421396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2232/4462] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 22:31:39 2022] GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8 => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:39.432570 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2b09ef93-ab7f-459d-b96f-6f2de324581a tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd889c469d0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:39.488287 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2b09ef93-ab7f-459d-b96f-6f2de324581a tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "DELETE /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8" status: 202 len: 0 microversion: 2.1 time: 0.059825 Aug 18 22:31:39.488857 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2231/4463] 10.222.0.82 () {58 vars in 1254 bytes} [Thu Aug 18 22:31:39 2022] DELETE /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:31:39.496993 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-619e257d-421b-4a42-bba9-7dd40b258d3c tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd889617c10>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:39.526324 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-619e257d-421b-4a42-bba9-7dd40b258d3c tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8" status: 200 len: 287 microversion: 2.1 time: 0.032945 Aug 18 22:31:39.526888 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2233/4464] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 22:31:39 2022] GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:31:40.539238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a0d50eea-1357-4508-939e-beac4b177d0a tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd88e5741f0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:40.565947 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-a0d50eea-1357-4508-939e-beac4b177d0a tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] HTTP exception thrown: Snapshot c99d7447-61fa-4a11-a721-aec7148ee4c8 could not be found. Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a0d50eea-1357-4508-939e-beac4b177d0a tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Request method failure captured: Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8 HTTP/1.1 Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_r3EIJrp00at7BkZuDE_KuSBC5TPZ8g7zQbwSZ9Wlh5TASHrbN6OfA_LCiTxPEvFsi69b0KSQ05Y5Gri4mMANwj4KlFM5VzKaeIR65peQ_mWCpaH0bCvTS2Ae3Xs9i_cpbHhF6pl1vTwBJWwgnj9QzuGn4RUAQ57ZklF1QwnHtENTCw Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 04a6906275c6465a8a512da45932ce5c Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-381415049 Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:31:40.568451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_04a6906275c6465a8a512da45932ce5c", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/04a6906275c6465a8a512da45932ce5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/04a6906275c6465a8a512da45932ce5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/04a6906275c6465a8a512da45932ce5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesSnapshotsTestJSON-381415049 Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 04a6906275c6465a8a512da45932ce5c Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-381415049 Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesSnapshotsTestJSON-381415049-project Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: b9a7cb4605b54cad9908ab0bd729d74b Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesSnapshotsTestJSON-381415049-project Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Snapshot c99d7447-61fa-4a11-a721-aec7148ee4c8 could not be found. Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': 'c99d7447-61fa-4a11-a721-aec7148ee4c8'} Aug 18 22:31:40.570040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c99d7447-61fa-4a11-a721-aec7148ee4c8 could not be found. (HTTP 404) (Request-ID: req-978cdbff-0b15-4210-b8c5-f25955a6a995) Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:40.571022 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 22:31:40.572927 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c99d7447-61fa-4a11-a721-aec7148ee4c8 could not be found. Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 18 22:31:40.574553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c99d7447-61fa-4a11-a721-aec7148ee4c8 could not be found. Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c99d7447-61fa-4a11-a721-aec7148ee4c8 could not be found. Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a0d50eea-1357-4508-939e-beac4b177d0a tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Returning 404 to user: Snapshot c99d7447-61fa-4a11-a721-aec7148ee4c8 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:40.575989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a0d50eea-1357-4508-939e-beac4b177d0a tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8" status: 404 len: 111 microversion: 2.1 time: 0.034996 Aug 18 22:31:40.576911 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2232/4465] 10.222.0.82 () {58 vars in 1251 bytes} [Thu Aug 18 22:31:40 2022] GET /compute/v2.1/os-snapshots/c99d7447-61fa-4a11-a721-aec7148ee4c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:40.581077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bba59cbe-de7f-4497-b930-2a52e5489d45 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd88e60c5e0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:40.660125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bba59cbe-de7f-4497-b930-2a52e5489d45 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4" status: 202 len: 0 microversion: 2.1 time: 0.084183 Aug 18 22:31:40.661078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2234/4466] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 22:31:40 2022] DELETE /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:31:40.669464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-30fdc932-1417-4b24-a01b-131452cca66b tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd889c46ca0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:40.740402 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-30fdc932-1417-4b24-a01b-131452cca66b tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4" status: 200 len: 344 microversion: 2.1 time: 0.075208 Aug 18 22:31:40.741124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2233/4467] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 22:31:40 2022] GET /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4 => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:31:41.755528 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-67995cdf-a343-415d-916a-c646ce7d1ab6 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd88e60cb80>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:41.785273 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-67995cdf-a343-415d-916a-c646ce7d1ab6 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] HTTP exception thrown: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-67995cdf-a343-415d-916a-c646ce7d1ab6 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Request method failure captured: Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4 HTTP/1.1 Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_r3EIJrp00at7BkZuDE_KuSBC5TPZ8g7zQbwSZ9Wlh5TASHrbN6OfA_LCiTxPEvFsi69b0KSQ05Y5Gri4mMANwj4KlFM5VzKaeIR65peQ_mWCpaH0bCvTS2Ae3Xs9i_cpbHhF6pl1vTwBJWwgnj9QzuGn4RUAQ57ZklF1QwnHtENTCw Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 04a6906275c6465a8a512da45932ce5c Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-381415049 Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:31:41.787336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_04a6906275c6465a8a512da45932ce5c", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/04a6906275c6465a8a512da45932ce5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/04a6906275c6465a8a512da45932ce5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/04a6906275c6465a8a512da45932ce5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesSnapshotsTestJSON-381415049 Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 04a6906275c6465a8a512da45932ce5c Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-381415049 Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesSnapshotsTestJSON-381415049-project Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: b9a7cb4605b54cad9908ab0bd729d74b Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesSnapshotsTestJSON-381415049-project Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': '712fbb2e-256b-4408-8774-46654622dbe4'} Aug 18 22:31:41.789047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. (HTTP 404) (Request-ID: req-24586005-20ca-4169-83d3-7ff895c0ed3f) Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:41.790089 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 22:31:41.791550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 22:31:41.792914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-67995cdf-a343-415d-916a-c646ce7d1ab6 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Returning 404 to user: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-67995cdf-a343-415d-916a-c646ce7d1ab6 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4" status: 404 len: 109 microversion: 2.1 time: 0.037640 Aug 18 22:31:41.797149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2235/4468] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 22:31:41 2022] GET /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:41.804537 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:41.806183 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=4 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:31:41.815091 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d90861fa-f2b9-4e0e-aa85-e4f8c42d012d tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd88e5c40d0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:41.854599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-d90861fa-f2b9-4e0e-aa85-e4f8c42d012d tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] HTTP exception thrown: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d90861fa-f2b9-4e0e-aa85-e4f8c42d012d tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Request method failure captured: Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4 HTTP/1.1 Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_r3EIJrp00at7BkZuDE_KuSBC5TPZ8g7zQbwSZ9Wlh5TASHrbN6OfA_LCiTxPEvFsi69b0KSQ05Y5Gri4mMANwj4KlFM5VzKaeIR65peQ_mWCpaH0bCvTS2Ae3Xs9i_cpbHhF6pl1vTwBJWwgnj9QzuGn4RUAQ57ZklF1QwnHtENTCw Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 04a6906275c6465a8a512da45932ce5c Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-381415049 Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:31:41.856749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_04a6906275c6465a8a512da45932ce5c", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/04a6906275c6465a8a512da45932ce5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/04a6906275c6465a8a512da45932ce5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/04a6906275c6465a8a512da45932ce5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesSnapshotsTestJSON-381415049 Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 04a6906275c6465a8a512da45932ce5c Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-381415049 Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesSnapshotsTestJSON-381415049-project Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: b9a7cb4605b54cad9908ab0bd729d74b Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesSnapshotsTestJSON-381415049-project Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': '712fbb2e-256b-4408-8774-46654622dbe4'} Aug 18 22:31:41.858818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. (HTTP 404) (Request-ID: req-ab124ef7-01c1-4cb2-8d73-8034a6a04419) Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:41.859753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 22:31:41.861083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 22:31:41.862431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:41.863746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.863746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.863746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:41.863746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.863746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:41.863746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:41.863746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:41.863746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:41.863746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:41.863746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.863746 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.865219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d90861fa-f2b9-4e0e-aa85-e4f8c42d012d tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Returning 404 to user: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:41.866124 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d90861fa-f2b9-4e0e-aa85-e4f8c42d012d tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "DELETE /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4" status: 404 len: 109 microversion: 2.1 time: 0.062778 Aug 18 22:31:41.866669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2234/4469] 10.222.0.82 () {58 vars in 1248 bytes} [Thu Aug 18 22:31:41 2022] DELETE /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:31:41.875795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-44a40ef1-927c-4bf6-b39a-ce52c3d51bd7 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Calling method '.version_select at 0x7fd88963c8b0>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:31:41.906581 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-44a40ef1-927c-4bf6-b39a-ce52c3d51bd7 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] HTTP exception thrown: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-44a40ef1-927c-4bf6-b39a-ce52c3d51bd7 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Request method failure captured: Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4 HTTP/1.1 Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_r3EIJrp00at7BkZuDE_KuSBC5TPZ8g7zQbwSZ9Wlh5TASHrbN6OfA_LCiTxPEvFsi69b0KSQ05Y5Gri4mMANwj4KlFM5VzKaeIR65peQ_mWCpaH0bCvTS2Ae3Xs9i_cpbHhF6pl1vTwBJWwgnj9QzuGn4RUAQ57ZklF1QwnHtENTCw Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 04a6906275c6465a8a512da45932ce5c Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-381415049 Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:31:41.908719 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_04a6906275c6465a8a512da45932ce5c", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/04a6906275c6465a8a512da45932ce5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/04a6906275c6465a8a512da45932ce5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/04a6906275c6465a8a512da45932ce5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-VolumesSnapshotsTestJSON-381415049 Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 04a6906275c6465a8a512da45932ce5c Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-381415049 Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-VolumesSnapshotsTestJSON-381415049-project Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: b9a7cb4605b54cad9908ab0bd729d74b Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-VolumesSnapshotsTestJSON-381415049-project Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': '712fbb2e-256b-4408-8774-46654622dbe4'} Aug 18 22:31:41.910256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. (HTTP 404) (Request-ID: req-400fef38-bcec-4b32-a7ca-3c015f418fc6) Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:41.911184 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 22:31:41.912537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 22:31:41.914073 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-44a40ef1-927c-4bf6-b39a-ce52c3d51bd7 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] Returning 404 to user: Volume 712fbb2e-256b-4408-8774-46654622dbe4 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-44a40ef1-927c-4bf6-b39a-ce52c3d51bd7 tempest-VolumesSnapshotsTestJSON-381415049 tempest-VolumesSnapshotsTestJSON-381415049-project] 10.222.0.82 "GET /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4" status: 404 len: 109 microversion: 2.1 time: 0.040922 Aug 18 22:31:41.918660 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2236/4470] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 22:31:41 2022] GET /compute/v2.1/os-volumes/712fbb2e-256b-4408-8774-46654622dbe4 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:32:17.023989 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-08dd301e-0685-4d1c-b88a-88fd18f157dd tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Action: 'create', calling method: .version_select at 0x7fd88e5afca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1846540149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVsRZoj6SqJRoBUt1m9/ihsjS7IZWqUctOz8KtO9ASLK6nuhI7VxV6iufc5ULyyIoJ+A5Szgz88+o011MvfPPuZvpdSbmg2MQv1mtMoEwvNNdlqVZ39FVQXdQrv7SrBoA=="}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:32:17.041730 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-08dd301e-0685-4d1c-b88a-88fd18f157dd tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Getting quotas for project 5a5733a14ade43e48f6a039a5075e63c. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:32:17.045892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.quota [None req-08dd301e-0685-4d1c-b88a-88fd18f157dd tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Getting quotas for user 4b4e033fbc0d438ca9a3f954d53c891e and project 5a5733a14ade43e48f6a039a5075e63c. Resources: {'key_pairs'} {{(pid=120538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:32:17.081089 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-08dd301e-0685-4d1c-b88a-88fd18f157dd tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.304971 Aug 18 22:32:17.088130 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2235/4471] 10.222.0.82 () {60 vars in 1159 bytes} [Thu Aug 18 22:32:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:32:23.884585 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:32:23.885350 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:32:23.891848 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-333814527", "imageRef": "44004e9f-a102-4af1-bc06-d85d54cfbc16", "flavorRef": "452"}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:32:23.947457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] validate_networks() for None {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 22:32:24.241254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 22:32:24.241702 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 22:32:24.242204 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 22:32:24.242614 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 22:32:24.243053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 22:32:24.252349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:24.253064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:24.253253 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:24.254027 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:24.254480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:24.254903 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:24.271312 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Getting quotas for project 817eab2135d748a3aaef16bf2b6a694a. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:32:24.275231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Getting quotas for user 9f5f64f1c3ed4f148a13da8db367da38 and project 817eab2135d748a3aaef16bf2b6a694a. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:32:24.286697 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 22:32:24.288962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='44004e9f-a102-4af1-bc06-d85d54cfbc16',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 22:32:24.334221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d30c47b7-edb1-4f4e-9139-9bf63296a1a1 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.450236 Aug 18 22:32:24.334790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2237/4472] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 22:32:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 22:32:24.346263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-49c12bea-e806-4e93-a81b-fe4c6272f8ee tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:24.346998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-49c12bea-e806-4e93-a81b-fe4c6272f8ee tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:24.400027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-49c12bea-e806-4e93-a81b-fe4c6272f8ee tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:24.408260 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-49c12bea-e806-4e93-a81b-fe4c6272f8ee tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1214 microversion: 2.1 time: 0.066756 Aug 18 22:32:24.408844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2236/4473] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:24 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:25.429519 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-97be7ade-3b1f-4068-a447-c589ad88f9d6 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:25.431004 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-97be7ade-3b1f-4068-a447-c589ad88f9d6 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:25.438729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97be7ade-3b1f-4068-a447-c589ad88f9d6 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:25.439796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97be7ade-3b1f-4068-a447-c589ad88f9d6 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:25.440257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97be7ade-3b1f-4068-a447-c589ad88f9d6 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:25.441213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97be7ade-3b1f-4068-a447-c589ad88f9d6 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:25.441890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97be7ade-3b1f-4068-a447-c589ad88f9d6 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:25.442488 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-97be7ade-3b1f-4068-a447-c589ad88f9d6 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:25.516044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-97be7ade-3b1f-4068-a447-c589ad88f9d6 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:25.524321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-97be7ade-3b1f-4068-a447-c589ad88f9d6 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1272 microversion: 2.1 time: 0.099515 Aug 18 22:32:25.537750 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2238/4474] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:25 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1272 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:26.547750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8d4b733c-aaac-4dc7-8361-059c434c3132 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:26.549438 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8d4b733c-aaac-4dc7-8361-059c434c3132 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:26.556935 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d4b733c-aaac-4dc7-8361-059c434c3132 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:26.557702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d4b733c-aaac-4dc7-8361-059c434c3132 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:26.558365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d4b733c-aaac-4dc7-8361-059c434c3132 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:26.559341 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d4b733c-aaac-4dc7-8361-059c434c3132 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:26.559995 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d4b733c-aaac-4dc7-8361-059c434c3132 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:26.560440 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8d4b733c-aaac-4dc7-8361-059c434c3132 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:26.756848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8d4b733c-aaac-4dc7-8361-059c434c3132 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:26.765242 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8d4b733c-aaac-4dc7-8361-059c434c3132 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1314 microversion: 2.1 time: 0.222729 Aug 18 22:32:26.766224 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2237/4475] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:26 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:27.066008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-de964df5-e622-4e21-b996-febdfee2d297 req-343024c9-56b5-46a3-bf64-867c6e6e1a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "345c727b-f0fa-45dd-9794-036969c6ebb0", "tag": "f61e9efa-2476-4857-a13d-961a81872f28"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:32:27.077688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-de964df5-e622-4e21-b996-febdfee2d297 req-343024c9-56b5-46a3-bf64-867c6e6e1a8b service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:27.078174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-de964df5-e622-4e21-b996-febdfee2d297 req-343024c9-56b5-46a3-bf64-867c6e6e1a8b service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:27.078609 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-de964df5-e622-4e21-b996-febdfee2d297 req-343024c9-56b5-46a3-bf64-867c6e6e1a8b service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:27.089956 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-de964df5-e622-4e21-b996-febdfee2d297 req-343024c9-56b5-46a3-bf64-867c6e6e1a8b service nova] Creating event network-changed:f61e9efa-2476-4857-a13d-961a81872f28 for instance 345c727b-f0fa-45dd-9794-036969c6ebb0 on hv-cinder-85367 Aug 18 22:32:27.094811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-de964df5-e622-4e21-b996-febdfee2d297 req-343024c9-56b5-46a3-bf64-867c6e6e1a8b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032701 Aug 18 22:32:27.095606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2239/4476] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:32:27.787785 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-496f7c91-9e43-4836-b459-3a3884c8db66 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:27.788410 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-496f7c91-9e43-4836-b459-3a3884c8db66 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:27.795580 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-496f7c91-9e43-4836-b459-3a3884c8db66 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:27.796067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-496f7c91-9e43-4836-b459-3a3884c8db66 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:27.796514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-496f7c91-9e43-4836-b459-3a3884c8db66 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:27.797209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-496f7c91-9e43-4836-b459-3a3884c8db66 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:27.797700 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-496f7c91-9e43-4836-b459-3a3884c8db66 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:27.798265 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-496f7c91-9e43-4836-b459-3a3884c8db66 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:27.931993 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-496f7c91-9e43-4836-b459-3a3884c8db66 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:27.939890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-496f7c91-9e43-4836-b459-3a3884c8db66 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1314 microversion: 2.1 time: 0.156014 Aug 18 22:32:27.940461 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2238/4477] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:27 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:28.961177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ae640e53-e60b-43af-a9f3-e65f4c5fb498 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:28.961907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ae640e53-e60b-43af-a9f3-e65f4c5fb498 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:28.968784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae640e53-e60b-43af-a9f3-e65f4c5fb498 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:28.969269 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae640e53-e60b-43af-a9f3-e65f4c5fb498 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:28.969741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae640e53-e60b-43af-a9f3-e65f4c5fb498 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:28.970441 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae640e53-e60b-43af-a9f3-e65f4c5fb498 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:28.970928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae640e53-e60b-43af-a9f3-e65f4c5fb498 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:28.971352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ae640e53-e60b-43af-a9f3-e65f4c5fb498 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:29.104627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ae640e53-e60b-43af-a9f3-e65f4c5fb498 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:29.112427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ae640e53-e60b-43af-a9f3-e65f4c5fb498 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1314 microversion: 2.1 time: 0.155805 Aug 18 22:32:29.113010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2240/4478] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:28 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:30.134116 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-655e401a-161e-4e95-a27f-e8dc5790a610 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:30.134733 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-655e401a-161e-4e95-a27f-e8dc5790a610 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:30.141187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-655e401a-161e-4e95-a27f-e8dc5790a610 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:30.141702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-655e401a-161e-4e95-a27f-e8dc5790a610 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:30.142144 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-655e401a-161e-4e95-a27f-e8dc5790a610 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:30.142829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-655e401a-161e-4e95-a27f-e8dc5790a610 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:30.143284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-655e401a-161e-4e95-a27f-e8dc5790a610 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:30.143711 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-655e401a-161e-4e95-a27f-e8dc5790a610 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:30.304150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-655e401a-161e-4e95-a27f-e8dc5790a610 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:30.312261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-655e401a-161e-4e95-a27f-e8dc5790a610 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1314 microversion: 2.1 time: 0.181946 Aug 18 22:32:30.313108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2239/4479] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:30 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:31.332896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-71a78670-2df7-4e47-9f78-faf72c06912e tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:31.333509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-71a78670-2df7-4e47-9f78-faf72c06912e tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:31.339915 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71a78670-2df7-4e47-9f78-faf72c06912e tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:31.340396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71a78670-2df7-4e47-9f78-faf72c06912e tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:31.340831 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71a78670-2df7-4e47-9f78-faf72c06912e tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:31.341521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71a78670-2df7-4e47-9f78-faf72c06912e tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:31.342005 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71a78670-2df7-4e47-9f78-faf72c06912e tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:31.342423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-71a78670-2df7-4e47-9f78-faf72c06912e tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:31.485669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-71a78670-2df7-4e47-9f78-faf72c06912e tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:31.496167 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-71a78670-2df7-4e47-9f78-faf72c06912e tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1314 microversion: 2.1 time: 0.167046 Aug 18 22:32:31.496764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2241/4480] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:31 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:32.519264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bc31ee5b-9540-4a2d-9b4a-982bb88722cb tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:32.519892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bc31ee5b-9540-4a2d-9b4a-982bb88722cb tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:32.526904 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc31ee5b-9540-4a2d-9b4a-982bb88722cb tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:32.527399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc31ee5b-9540-4a2d-9b4a-982bb88722cb tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:32.528277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc31ee5b-9540-4a2d-9b4a-982bb88722cb tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:32.529679 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc31ee5b-9540-4a2d-9b4a-982bb88722cb tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:32.530009 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc31ee5b-9540-4a2d-9b4a-982bb88722cb tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:32.530646 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bc31ee5b-9540-4a2d-9b4a-982bb88722cb tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:32.660767 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-bc31ee5b-9540-4a2d-9b4a-982bb88722cb tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:32.668434 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bc31ee5b-9540-4a2d-9b4a-982bb88722cb tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1314 microversion: 2.1 time: 0.152995 Aug 18 22:32:32.669220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2240/4481] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:32 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:32.793706 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-709ae735-f9a3-46dd-9aa5-0953c60330fa req-c154e3ae-a412-456a-8856-6b6942c5a7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345c727b-f0fa-45dd-9794-036969c6ebb0", "name": "network-vif-plugged", "status": "completed", "tag": "f61e9efa-2476-4857-a13d-961a81872f28"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:32:32.805246 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-709ae735-f9a3-46dd-9aa5-0953c60330fa req-c154e3ae-a412-456a-8856-6b6942c5a7a4 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:32.805495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-709ae735-f9a3-46dd-9aa5-0953c60330fa req-c154e3ae-a412-456a-8856-6b6942c5a7a4 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:32.806362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-709ae735-f9a3-46dd-9aa5-0953c60330fa req-c154e3ae-a412-456a-8856-6b6942c5a7a4 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:32.819245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-709ae735-f9a3-46dd-9aa5-0953c60330fa req-c154e3ae-a412-456a-8856-6b6942c5a7a4 service nova] Creating event network-vif-plugged:f61e9efa-2476-4857-a13d-961a81872f28 for instance 345c727b-f0fa-45dd-9794-036969c6ebb0 on hv-cinder-85367 Aug 18 22:32:32.824469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-709ae735-f9a3-46dd-9aa5-0953c60330fa req-c154e3ae-a412-456a-8856-6b6942c5a7a4 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034585 Aug 18 22:32:32.825093 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2242/4482] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:32:33.691142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-baeeb3ca-5bb7-4616-b71f-d8f352f8b5cf tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:33.692658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-baeeb3ca-5bb7-4616-b71f-d8f352f8b5cf tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:33.699437 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baeeb3ca-5bb7-4616-b71f-d8f352f8b5cf tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:33.699932 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baeeb3ca-5bb7-4616-b71f-d8f352f8b5cf tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:33.700383 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baeeb3ca-5bb7-4616-b71f-d8f352f8b5cf tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:33.701697 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baeeb3ca-5bb7-4616-b71f-d8f352f8b5cf tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:33.702191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baeeb3ca-5bb7-4616-b71f-d8f352f8b5cf tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:33.702644 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-baeeb3ca-5bb7-4616-b71f-d8f352f8b5cf tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:33.732855 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-412586158", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1846540149", "security_groups": [{"name": "tempest-secgroup-smoke-572671450"}], "block_device_mapping_v2": [{"uuid": "816e91ba-ae0e-4ee1-9d9a-fb1032a5925c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b548c6e2-7c22-43ce-bce7-a8a12822a8af"}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:32:33.835364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-baeeb3ca-5bb7-4616-b71f-d8f352f8b5cf tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:33.843398 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-baeeb3ca-5bb7-4616-b71f-d8f352f8b5cf tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1314 microversion: 2.1 time: 0.156312 Aug 18 22:32:33.844029 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2241/4483] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:33 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:33.848837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] validate_networks() for [('b548c6e2-7c22-43ce-bce7-a8a12822a8af', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 22:32:34.219510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 22:32:34.219927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 22:32:34.220425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 22:32:34.220830 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 22:32:34.221236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 22:32:34.229820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:34.230293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:34.230723 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:34.231428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:34.232426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:34.232874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:34.249718 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Getting quotas for project 5a5733a14ade43e48f6a039a5075e63c. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:32:34.253808 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Getting quotas for user 4b4e033fbc0d438ca9a3f954d53c891e and project 5a5733a14ade43e48f6a039a5075e63c. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:32:34.310716 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 22:32:34.313199 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='816e91ba-ae0e-4ee1-9d9a-fb1032a5925c',volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 22:32:34.445893 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-745f4639-0e2b-43e1-a93e-72483c4d05a3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.717199 Aug 18 22:32:34.446527 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2243/4484] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 22:32:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 22:32:34.458030 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1bdd3ab2-b142-4e5b-9311-3a7bb36ab7aa tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:34.458743 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1bdd3ab2-b142-4e5b-9311-3a7bb36ab7aa tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:34.461936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=6 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:32:34.519520 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1bdd3ab2-b142-4e5b-9311-3a7bb36ab7aa tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:34.526959 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1bdd3ab2-b142-4e5b-9311-3a7bb36ab7aa tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1094 microversion: 2.1 time: 0.072943 Aug 18 22:32:34.527702 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2242/4485] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:34 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:34.864578 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e26b2a34-317b-4b3e-88aa-3fe0a47f2937 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:34.865285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e26b2a34-317b-4b3e-88aa-3fe0a47f2937 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:34.872278 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e26b2a34-317b-4b3e-88aa-3fe0a47f2937 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:34.873580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e26b2a34-317b-4b3e-88aa-3fe0a47f2937 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:34.874463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e26b2a34-317b-4b3e-88aa-3fe0a47f2937 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:34.875242 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e26b2a34-317b-4b3e-88aa-3fe0a47f2937 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:34.875777 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e26b2a34-317b-4b3e-88aa-3fe0a47f2937 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:34.876288 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e26b2a34-317b-4b3e-88aa-3fe0a47f2937 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:35.011236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e26b2a34-317b-4b3e-88aa-3fe0a47f2937 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:35.019192 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e26b2a34-317b-4b3e-88aa-3fe0a47f2937 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1463 microversion: 2.1 time: 0.158973 Aug 18 22:32:35.019839 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2244/4486] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:34 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:35.070675 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-218694fd-8023-4961-8915-58f936164c12 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:35.071214 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-218694fd-8023-4961-8915-58f936164c12 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:35.079065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-218694fd-8023-4961-8915-58f936164c12 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:35.080096 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-218694fd-8023-4961-8915-58f936164c12 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:35.080546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-218694fd-8023-4961-8915-58f936164c12 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:35.081451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-218694fd-8023-4961-8915-58f936164c12 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:35.081955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-218694fd-8023-4961-8915-58f936164c12 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:35.082385 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-218694fd-8023-4961-8915-58f936164c12 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:35.106316 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-218694fd-8023-4961-8915-58f936164c12 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:32:35.178747 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-218694fd-8023-4961-8915-58f936164c12 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "DELETE /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 204 len: 0 microversion: 2.1 time: 0.111657 Aug 18 22:32:35.179433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2243/4487] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:32:35 2022] DELETE /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:32:35.188348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-f0db5db5-81c7-41a7-9795-bd8e29f8a02c tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:35.188971 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-f0db5db5-81c7-41a7-9795-bd8e29f8a02c tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:35.194892 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0db5db5-81c7-41a7-9795-bd8e29f8a02c tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:35.195375 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0db5db5-81c7-41a7-9795-bd8e29f8a02c tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:35.195813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0db5db5-81c7-41a7-9795-bd8e29f8a02c tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:35.196504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0db5db5-81c7-41a7-9795-bd8e29f8a02c tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:35.196964 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0db5db5-81c7-41a7-9795-bd8e29f8a02c tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:35.197403 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-f0db5db5-81c7-41a7-9795-bd8e29f8a02c tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:35.329731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-f0db5db5-81c7-41a7-9795-bd8e29f8a02c tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:35.338507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-f0db5db5-81c7-41a7-9795-bd8e29f8a02c tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1469 microversion: 2.1 time: 0.154694 Aug 18 22:32:35.339090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2245/4488] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:35 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:35.549243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-40ce71d2-13de-479a-aa65-bfbe9b458a94 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:35.549922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-40ce71d2-13de-479a-aa65-bfbe9b458a94 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:35.555855 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40ce71d2-13de-479a-aa65-bfbe9b458a94 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:35.556339 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40ce71d2-13de-479a-aa65-bfbe9b458a94 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:35.556780 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40ce71d2-13de-479a-aa65-bfbe9b458a94 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:35.557468 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40ce71d2-13de-479a-aa65-bfbe9b458a94 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:35.557962 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40ce71d2-13de-479a-aa65-bfbe9b458a94 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:35.558395 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-40ce71d2-13de-479a-aa65-bfbe9b458a94 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:35.619808 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-40ce71d2-13de-479a-aa65-bfbe9b458a94 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:35.627576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-40ce71d2-13de-479a-aa65-bfbe9b458a94 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1200 microversion: 2.1 time: 0.083283 Aug 18 22:32:35.628142 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2244/4489] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:35 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:36.360542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1eab0dc4-113a-4316-a83a-ebbde30ecfe8 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:36.361213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1eab0dc4-113a-4316-a83a-ebbde30ecfe8 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:36.367496 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1eab0dc4-113a-4316-a83a-ebbde30ecfe8 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:36.368050 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1eab0dc4-113a-4316-a83a-ebbde30ecfe8 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:36.368688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1eab0dc4-113a-4316-a83a-ebbde30ecfe8 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:36.369386 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1eab0dc4-113a-4316-a83a-ebbde30ecfe8 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:36.369860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1eab0dc4-113a-4316-a83a-ebbde30ecfe8 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:36.370282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1eab0dc4-113a-4316-a83a-ebbde30ecfe8 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:36.502775 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1eab0dc4-113a-4316-a83a-ebbde30ecfe8 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:36.510849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1eab0dc4-113a-4316-a83a-ebbde30ecfe8 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1469 microversion: 2.1 time: 0.154633 Aug 18 22:32:36.511627 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2246/4490] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:36 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:36.648481 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-422b4e03-f081-46f6-b1c9-13dbdcd5b00d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:36.648996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-422b4e03-f081-46f6-b1c9-13dbdcd5b00d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:36.655739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-422b4e03-f081-46f6-b1c9-13dbdcd5b00d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:36.656221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-422b4e03-f081-46f6-b1c9-13dbdcd5b00d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:36.656658 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-422b4e03-f081-46f6-b1c9-13dbdcd5b00d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:36.657344 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-422b4e03-f081-46f6-b1c9-13dbdcd5b00d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:36.657827 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-422b4e03-f081-46f6-b1c9-13dbdcd5b00d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:36.658254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-422b4e03-f081-46f6-b1c9-13dbdcd5b00d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:36.759510 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-422b4e03-f081-46f6-b1c9-13dbdcd5b00d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:36.768098 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-422b4e03-f081-46f6-b1c9-13dbdcd5b00d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1210 microversion: 2.1 time: 0.123580 Aug 18 22:32:36.768729 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2245/4491] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:36 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1210 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:37.437215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-d61f668d-2f5d-4abd-9554-b24aab9e63b3 req-25812b1c-f157-4b63-ab84-5381a3ff9042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "345c727b-f0fa-45dd-9794-036969c6ebb0", "name": "network-vif-deleted", "tag": "f61e9efa-2476-4857-a13d-961a81872f28"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:32:37.451100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d61f668d-2f5d-4abd-9554-b24aab9e63b3 req-25812b1c-f157-4b63-ab84-5381a3ff9042 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:37.451886 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d61f668d-2f5d-4abd-9554-b24aab9e63b3 req-25812b1c-f157-4b63-ab84-5381a3ff9042 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:37.452683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d61f668d-2f5d-4abd-9554-b24aab9e63b3 req-25812b1c-f157-4b63-ab84-5381a3ff9042 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:37.464767 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-d61f668d-2f5d-4abd-9554-b24aab9e63b3 req-25812b1c-f157-4b63-ab84-5381a3ff9042 service nova] Creating event network-vif-deleted:f61e9efa-2476-4857-a13d-961a81872f28 for instance 345c727b-f0fa-45dd-9794-036969c6ebb0 on hv-cinder-85367 Aug 18 22:32:37.472393 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-d61f668d-2f5d-4abd-9554-b24aab9e63b3 req-25812b1c-f157-4b63-ab84-5381a3ff9042 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038774 Aug 18 22:32:37.474820 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2247/4492] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:32:37.536284 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:37.541843 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:37.556956 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:37.557548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:37.558086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:37.558901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:37.559449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:37.559996 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:37.610694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:37.611223 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:37.611761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:37.612304 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lazy-loading 'fault' on Instance uuid 345c727b-f0fa-45dd-9794-036969c6ebb0 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:32:37.666946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f5f64f1c3ed4f148a13da8db367da38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817eab2135d748a3aaef16bf2b6a694a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:37.674999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0014b317-4531-41df-95a0-6e82f0e6aac9 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 200 len: 1304 microversion: 2.1 time: 0.144231 Aug 18 22:32:37.675788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2246/4493] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:37 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:37.792615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-62da4f18-f1d2-4d3c-a301-87c5d44be82e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:37.793321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-62da4f18-f1d2-4d3c-a301-87c5d44be82e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:37.799670 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62da4f18-f1d2-4d3c-a301-87c5d44be82e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:37.800157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62da4f18-f1d2-4d3c-a301-87c5d44be82e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:37.800591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62da4f18-f1d2-4d3c-a301-87c5d44be82e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:37.801282 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62da4f18-f1d2-4d3c-a301-87c5d44be82e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:37.801780 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62da4f18-f1d2-4d3c-a301-87c5d44be82e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:37.802217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-62da4f18-f1d2-4d3c-a301-87c5d44be82e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:37.941930 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-62da4f18-f1d2-4d3c-a301-87c5d44be82e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:37.950034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-62da4f18-f1d2-4d3c-a301-87c5d44be82e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1265 microversion: 2.1 time: 0.161737 Aug 18 22:32:37.950919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2248/4494] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:37 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:38.698035 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c15992d1-9ca4-40b2-b3b0-5e759fef06f3 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:38.698584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c15992d1-9ca4-40b2-b3b0-5e759fef06f3 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] [instance: 345c727b-f0fa-45dd-9794-036969c6ebb0] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:38.706069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c15992d1-9ca4-40b2-b3b0-5e759fef06f3 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:38.706569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c15992d1-9ca4-40b2-b3b0-5e759fef06f3 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:38.707038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c15992d1-9ca4-40b2-b3b0-5e759fef06f3 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:38.707739 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c15992d1-9ca4-40b2-b3b0-5e759fef06f3 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:38.708195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c15992d1-9ca4-40b2-b3b0-5e759fef06f3 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:38.708621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c15992d1-9ca4-40b2-b3b0-5e759fef06f3 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:38.724145 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-c15992d1-9ca4-40b2-b3b0-5e759fef06f3 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] HTTP exception thrown: Instance 345c727b-f0fa-45dd-9794-036969c6ebb0 could not be found. Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c15992d1-9ca4-40b2-b3b0-5e759fef06f3 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Request method failure captured: Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 HTTP/1.1 Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_r32UV72cYYeINYYS2ewhgjpyS0Y7l4d0KRYceBMVz8pRGDmdbDtQ6eiZ3tkVRMs2qFZDyea-NkD-r4sy9V0HDIssOfHSBbakTc02GCE3CDOjqSZHGPDId8gMwHUqGPOhGUmCgxQSTrRfOtQMAUwhlPYzeScOJZHA4zJ2S6nhEhT_K8 Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 817eab2135d748a3aaef16bf2b6a694a Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-VolumesNegativeTest-1582785800 Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:32:38.725852 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:32:38.727356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_817eab2135d748a3aaef16bf2b6a694a", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/817eab2135d748a3aaef16bf2b6a694a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/817eab2135d748a3aaef16bf2b6a694a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/817eab2135d748a3aaef16bf2b6a694a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:32:38.727356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-VolumesNegativeTest-1582785800 Aug 18 22:32:38.727356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 817eab2135d748a3aaef16bf2b6a694a Aug 18 22:32:38.727356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-VolumesNegativeTest-1582785800 Aug 18 22:32:38.727356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-VolumesNegativeTest-1582785800-project Aug 18 22:32:38.727356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:32:38.727356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:32:38.727356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 9f5f64f1c3ed4f148a13da8db367da38 Aug 18 22:32:38.727356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-VolumesNegativeTest-1582785800-project Aug 18 22:32:38.727356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:32:38.727356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance 345c727b-f0fa-45dd-9794-036969c6ebb0 could not be found. Aug 18 22:32:38.727356 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': '345c727b-f0fa-45dd-9794-036969c6ebb0'} Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 345c727b-f0fa-45dd-9794-036969c6ebb0 could not be found. Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:32:38.728110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 345c727b-f0fa-45dd-9794-036969c6ebb0 could not be found. Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 345c727b-f0fa-45dd-9794-036969c6ebb0 could not be found. Aug 18 22:32:38.729340 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:32:38.730473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c15992d1-9ca4-40b2-b3b0-5e759fef06f3 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] Returning 404 to user: Instance 345c727b-f0fa-45dd-9794-036969c6ebb0 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:32:38.730473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c15992d1-9ca4-40b2-b3b0-5e759fef06f3 tempest-VolumesNegativeTest-1582785800 tempest-VolumesNegativeTest-1582785800-project] 10.222.0.82 "GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0" status: 404 len: 111 microversion: 2.1 time: 0.033193 Aug 18 22:32:38.730473 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2247/4495] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:38 2022] GET /compute/v2.1/servers/345c727b-f0fa-45dd-9794-036969c6ebb0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:32:38.971791 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-70cd54cb-3d21-4f67-a5cc-555bc261951c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:38.972416 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-70cd54cb-3d21-4f67-a5cc-555bc261951c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:38.979008 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70cd54cb-3d21-4f67-a5cc-555bc261951c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:38.979522 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70cd54cb-3d21-4f67-a5cc-555bc261951c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:38.979962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70cd54cb-3d21-4f67-a5cc-555bc261951c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:38.980671 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70cd54cb-3d21-4f67-a5cc-555bc261951c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:38.981156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70cd54cb-3d21-4f67-a5cc-555bc261951c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:38.981656 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-70cd54cb-3d21-4f67-a5cc-555bc261951c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:39.127038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-70cd54cb-3d21-4f67-a5cc-555bc261951c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:39.135405 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-70cd54cb-3d21-4f67-a5cc-555bc261951c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1265 microversion: 2.1 time: 0.167424 Aug 18 22:32:39.136075 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2249/4496] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:38 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:39.522135 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-a16e8770-a40f-4cb5-afe2-26deeac99dc1 req-328a0803-ec69-46d0-86be-47c699562cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5853a22c-5f4b-4973-b408-d9783a6fc922", "tag": "d5f45013-eec2-4a4e-a519-e1ed2b8a1f52"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:32:39.531694 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-a16e8770-a40f-4cb5-afe2-26deeac99dc1 req-328a0803-ec69-46d0-86be-47c699562cf1 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:39.532172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-a16e8770-a40f-4cb5-afe2-26deeac99dc1 req-328a0803-ec69-46d0-86be-47c699562cf1 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:39.532599 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-a16e8770-a40f-4cb5-afe2-26deeac99dc1 req-328a0803-ec69-46d0-86be-47c699562cf1 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:39.543628 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-a16e8770-a40f-4cb5-afe2-26deeac99dc1 req-328a0803-ec69-46d0-86be-47c699562cf1 service nova] Creating event network-changed:d5f45013-eec2-4a4e-a519-e1ed2b8a1f52 for instance 5853a22c-5f4b-4973-b408-d9783a6fc922 on hv-cinder-85367 Aug 18 22:32:39.549247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-a16e8770-a40f-4cb5-afe2-26deeac99dc1 req-328a0803-ec69-46d0-86be-47c699562cf1 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030812 Aug 18 22:32:39.549869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2248/4497] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:32:40.157191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d7f9c67c-b797-46bc-96e5-d1e8785a08db tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:40.157996 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d7f9c67c-b797-46bc-96e5-d1e8785a08db tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:40.165480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7f9c67c-b797-46bc-96e5-d1e8785a08db tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:40.166022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7f9c67c-b797-46bc-96e5-d1e8785a08db tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:40.166463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7f9c67c-b797-46bc-96e5-d1e8785a08db tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:40.167190 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7f9c67c-b797-46bc-96e5-d1e8785a08db tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:40.167626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7f9c67c-b797-46bc-96e5-d1e8785a08db tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:40.168056 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d7f9c67c-b797-46bc-96e5-d1e8785a08db tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:40.303623 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d7f9c67c-b797-46bc-96e5-d1e8785a08db tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:40.312163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d7f9c67c-b797-46bc-96e5-d1e8785a08db tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1265 microversion: 2.1 time: 0.159676 Aug 18 22:32:40.312699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2250/4498] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:40 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:41.333734 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-d26dc3ce-4521-430b-bca5-8d59e11c0391 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:41.334559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-d26dc3ce-4521-430b-bca5-8d59e11c0391 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:41.340562 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26dc3ce-4521-430b-bca5-8d59e11c0391 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:41.341087 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26dc3ce-4521-430b-bca5-8d59e11c0391 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:41.341565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26dc3ce-4521-430b-bca5-8d59e11c0391 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:41.342271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26dc3ce-4521-430b-bca5-8d59e11c0391 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:41.342726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26dc3ce-4521-430b-bca5-8d59e11c0391 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:41.343152 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-d26dc3ce-4521-430b-bca5-8d59e11c0391 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:41.482614 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-d26dc3ce-4521-430b-bca5-8d59e11c0391 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:41.490294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-d26dc3ce-4521-430b-bca5-8d59e11c0391 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1265 microversion: 2.1 time: 0.161302 Aug 18 22:32:41.490866 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2249/4499] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:41 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:42.511580 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fa0735b0-6fa9-4c4b-9d4b-3c8cdfdf2ff5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:42.512195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fa0735b0-6fa9-4c4b-9d4b-3c8cdfdf2ff5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:42.519601 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa0735b0-6fa9-4c4b-9d4b-3c8cdfdf2ff5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:42.520082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa0735b0-6fa9-4c4b-9d4b-3c8cdfdf2ff5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:42.520524 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa0735b0-6fa9-4c4b-9d4b-3c8cdfdf2ff5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:42.521219 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa0735b0-6fa9-4c4b-9d4b-3c8cdfdf2ff5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:42.521709 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa0735b0-6fa9-4c4b-9d4b-3c8cdfdf2ff5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:42.522130 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fa0735b0-6fa9-4c4b-9d4b-3c8cdfdf2ff5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:42.664284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fa0735b0-6fa9-4c4b-9d4b-3c8cdfdf2ff5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:42.673426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fa0735b0-6fa9-4c4b-9d4b-3c8cdfdf2ff5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1265 microversion: 2.1 time: 0.165551 Aug 18 22:32:42.674391 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2251/4500] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:42 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:43.695454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-29fe17c3-28f7-4fe5-bb45-050ecb5bc704 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:43.696067 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-29fe17c3-28f7-4fe5-bb45-050ecb5bc704 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:43.703181 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29fe17c3-28f7-4fe5-bb45-050ecb5bc704 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:43.703684 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29fe17c3-28f7-4fe5-bb45-050ecb5bc704 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:43.704273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29fe17c3-28f7-4fe5-bb45-050ecb5bc704 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:43.704967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29fe17c3-28f7-4fe5-bb45-050ecb5bc704 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:43.705418 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29fe17c3-28f7-4fe5-bb45-050ecb5bc704 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:43.705937 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-29fe17c3-28f7-4fe5-bb45-050ecb5bc704 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:43.835594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-29fe17c3-28f7-4fe5-bb45-050ecb5bc704 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:43.843317 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-29fe17c3-28f7-4fe5-bb45-050ecb5bc704 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1265 microversion: 2.1 time: 0.151725 Aug 18 22:32:43.843880 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2250/4501] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:43 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:44.863205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b38ff7d2-8c28-4d67-b226-afb7307db248 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:44.863824 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b38ff7d2-8c28-4d67-b226-afb7307db248 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:44.866231 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=4 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:32:44.866898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=12 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:32:44.872844 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b38ff7d2-8c28-4d67-b226-afb7307db248 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:44.873328 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b38ff7d2-8c28-4d67-b226-afb7307db248 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:44.873798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b38ff7d2-8c28-4d67-b226-afb7307db248 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:44.874494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b38ff7d2-8c28-4d67-b226-afb7307db248 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:44.874952 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b38ff7d2-8c28-4d67-b226-afb7307db248 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:44.875385 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b38ff7d2-8c28-4d67-b226-afb7307db248 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:45.006455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b38ff7d2-8c28-4d67-b226-afb7307db248 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:45.014684 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b38ff7d2-8c28-4d67-b226-afb7307db248 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1265 microversion: 2.1 time: 0.155347 Aug 18 22:32:45.015254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2252/4502] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:44 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:46.035600 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-456c0694-69bf-4141-bdf2-cbb88f864296 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:46.036227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-456c0694-69bf-4141-bdf2-cbb88f864296 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:46.038186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:32:46.045074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-456c0694-69bf-4141-bdf2-cbb88f864296 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:46.045569 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-456c0694-69bf-4141-bdf2-cbb88f864296 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:46.046028 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-456c0694-69bf-4141-bdf2-cbb88f864296 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:46.046722 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-456c0694-69bf-4141-bdf2-cbb88f864296 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:46.047177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-456c0694-69bf-4141-bdf2-cbb88f864296 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:46.047605 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-456c0694-69bf-4141-bdf2-cbb88f864296 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:46.179897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-456c0694-69bf-4141-bdf2-cbb88f864296 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:46.187617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-456c0694-69bf-4141-bdf2-cbb88f864296 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1265 microversion: 2.1 time: 0.155916 Aug 18 22:32:46.188449 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2251/4503] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:46 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:47.208679 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-057f7fd4-43f3-4d92-b6ed-dd811ef8d01b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:47.209336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-057f7fd4-43f3-4d92-b6ed-dd811ef8d01b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:47.216019 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-057f7fd4-43f3-4d92-b6ed-dd811ef8d01b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:47.216557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-057f7fd4-43f3-4d92-b6ed-dd811ef8d01b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:47.216992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-057f7fd4-43f3-4d92-b6ed-dd811ef8d01b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:47.217743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-057f7fd4-43f3-4d92-b6ed-dd811ef8d01b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:47.218205 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-057f7fd4-43f3-4d92-b6ed-dd811ef8d01b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:47.218618 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-057f7fd4-43f3-4d92-b6ed-dd811ef8d01b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:47.350654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-057f7fd4-43f3-4d92-b6ed-dd811ef8d01b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:47.358781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-057f7fd4-43f3-4d92-b6ed-dd811ef8d01b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1265 microversion: 2.1 time: 0.153957 Aug 18 22:32:47.359352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2253/4504] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:47 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:48.380010 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-67d5bc5f-4738-46ed-805b-6a3041050804 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:48.380620 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-67d5bc5f-4738-46ed-805b-6a3041050804 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:48.382951 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:32:48.388351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d5bc5f-4738-46ed-805b-6a3041050804 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:48.389012 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d5bc5f-4738-46ed-805b-6a3041050804 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:48.389428 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d5bc5f-4738-46ed-805b-6a3041050804 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:48.390040 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d5bc5f-4738-46ed-805b-6a3041050804 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:48.390507 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d5bc5f-4738-46ed-805b-6a3041050804 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:48.390936 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-67d5bc5f-4738-46ed-805b-6a3041050804 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:48.395750 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:32:48.521230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-67d5bc5f-4738-46ed-805b-6a3041050804 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:48.529899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-67d5bc5f-4738-46ed-805b-6a3041050804 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1265 microversion: 2.1 time: 0.153629 Aug 18 22:32:48.530465 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2252/4505] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:48 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:48.880520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-9373a978-7115-4c98-9959-81256cf75e5e req-1de0423c-74f7-49a7-9a52-11a813a55f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5853a22c-5f4b-4973-b408-d9783a6fc922", "name": "network-vif-plugged", "status": "completed", "tag": "d5f45013-eec2-4a4e-a519-e1ed2b8a1f52"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:32:48.890842 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-9373a978-7115-4c98-9959-81256cf75e5e req-1de0423c-74f7-49a7-9a52-11a813a55f2b service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:48.891332 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-9373a978-7115-4c98-9959-81256cf75e5e req-1de0423c-74f7-49a7-9a52-11a813a55f2b service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:48.891771 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-9373a978-7115-4c98-9959-81256cf75e5e req-1de0423c-74f7-49a7-9a52-11a813a55f2b service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:48.903224 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-9373a978-7115-4c98-9959-81256cf75e5e req-1de0423c-74f7-49a7-9a52-11a813a55f2b service nova] Creating event network-vif-plugged:d5f45013-eec2-4a4e-a519-e1ed2b8a1f52 for instance 5853a22c-5f4b-4973-b408-d9783a6fc922 on hv-cinder-85367 Aug 18 22:32:48.908781 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-9373a978-7115-4c98-9959-81256cf75e5e req-1de0423c-74f7-49a7-9a52-11a813a55f2b service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031928 Aug 18 22:32:48.909383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2254/4506] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:32:49.549848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1e715d45-006b-43dc-9959-b171bb51193a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:49.550469 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1e715d45-006b-43dc-9959-b171bb51193a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:49.556952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e715d45-006b-43dc-9959-b171bb51193a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:49.557435 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e715d45-006b-43dc-9959-b171bb51193a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:49.557976 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e715d45-006b-43dc-9959-b171bb51193a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:49.558666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e715d45-006b-43dc-9959-b171bb51193a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:49.559121 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e715d45-006b-43dc-9959-b171bb51193a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:49.559548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1e715d45-006b-43dc-9959-b171bb51193a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:49.689394 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-1e715d45-006b-43dc-9959-b171bb51193a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:49.697310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1e715d45-006b-43dc-9959-b171bb51193a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1265 microversion: 2.1 time: 0.151287 Aug 18 22:32:49.697917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2253/4507] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:49 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:50.719731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b54dd69f-1a12-418c-af22-9305fc8b4752 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:50.720238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b54dd69f-1a12-418c-af22-9305fc8b4752 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:50.726449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b54dd69f-1a12-418c-af22-9305fc8b4752 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:50.726940 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b54dd69f-1a12-418c-af22-9305fc8b4752 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:50.727389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b54dd69f-1a12-418c-af22-9305fc8b4752 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:50.728078 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b54dd69f-1a12-418c-af22-9305fc8b4752 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:50.728535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b54dd69f-1a12-418c-af22-9305fc8b4752 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:50.728962 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b54dd69f-1a12-418c-af22-9305fc8b4752 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:50.862051 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b54dd69f-1a12-418c-af22-9305fc8b4752 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:50.869809 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b54dd69f-1a12-418c-af22-9305fc8b4752 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1452 microversion: 2.1 time: 0.154906 Aug 18 22:32:50.870383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2255/4508] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:50 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:50.890391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7a48b257-27ce-474d-8a78-afca1c8f2e34 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:32:50.891013 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7a48b257-27ce-474d-8a78-afca1c8f2e34 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:32:50.897329 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a48b257-27ce-474d-8a78-afca1c8f2e34 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:50.897848 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a48b257-27ce-474d-8a78-afca1c8f2e34 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:50.898294 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a48b257-27ce-474d-8a78-afca1c8f2e34 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:50.898982 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a48b257-27ce-474d-8a78-afca1c8f2e34 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:50.899436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a48b257-27ce-474d-8a78-afca1c8f2e34 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:50.899862 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a48b257-27ce-474d-8a78-afca1c8f2e34 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:51.028306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7a48b257-27ce-474d-8a78-afca1c8f2e34 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:32:51.037076 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7a48b257-27ce-474d-8a78-afca1c8f2e34 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1452 microversion: 2.1 time: 0.150418 Aug 18 22:32:51.037776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2254/4509] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:32:50 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:32:52.976546 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-8e0ed0ec-e1da-4d6a-890a-f49f66d42d8e req-4425fba2-9ecf-4dd9-8bd0-c0706d237454 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5853a22c-5f4b-4973-b408-d9783a6fc922", "tag": "d5f45013-eec2-4a4e-a519-e1ed2b8a1f52"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:32:52.986994 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-8e0ed0ec-e1da-4d6a-890a-f49f66d42d8e req-4425fba2-9ecf-4dd9-8bd0-c0706d237454 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:32:52.987472 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-8e0ed0ec-e1da-4d6a-890a-f49f66d42d8e req-4425fba2-9ecf-4dd9-8bd0-c0706d237454 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:32:52.987896 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-8e0ed0ec-e1da-4d6a-890a-f49f66d42d8e req-4425fba2-9ecf-4dd9-8bd0-c0706d237454 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:32:52.998686 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-8e0ed0ec-e1da-4d6a-890a-f49f66d42d8e req-4425fba2-9ecf-4dd9-8bd0-c0706d237454 service nova] Creating event network-changed:d5f45013-eec2-4a4e-a519-e1ed2b8a1f52 for instance 5853a22c-5f4b-4973-b408-d9783a6fc922 on hv-cinder-85367 Aug 18 22:32:53.003756 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-8e0ed0ec-e1da-4d6a-890a-f49f66d42d8e req-4425fba2-9ecf-4dd9-8bd0-c0706d237454 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031219 Aug 18 22:32:53.004563 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2256/4510] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:33:17.097619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:33:17.098221 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:33:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:33:39.599306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-0a50106b-e0bc-4c32-bd5c-3343fc362e54 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:33:39.599934 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-0a50106b-e0bc-4c32-bd5c-3343fc362e54 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:39.602048 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=5 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:33:39.602764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=17 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:33:39.608178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a50106b-e0bc-4c32-bd5c-3343fc362e54 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:39.608653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a50106b-e0bc-4c32-bd5c-3343fc362e54 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:39.609086 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a50106b-e0bc-4c32-bd5c-3343fc362e54 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:39.609798 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a50106b-e0bc-4c32-bd5c-3343fc362e54 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:39.610250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a50106b-e0bc-4c32-bd5c-3343fc362e54 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:39.610669 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-0a50106b-e0bc-4c32-bd5c-3343fc362e54 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:39.633728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-0a50106b-e0bc-4c32-bd5c-3343fc362e54 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lazy-loading 'flavor' on Instance uuid a3e60ed1-0091-4e24-8cfa-b854eed71bf4 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:33:39.705172 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-0a50106b-e0bc-4c32-bd5c-3343fc362e54 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "POST /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4/action" status: 202 len: 0 microversion: 2.1 time: 0.109559 Aug 18 22:33:39.705806 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2255/4511] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 22:33:39 2022] POST /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:33:39.715751 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-aa8248ac-40fd-4914-bf06-d3465b45abfb tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:39.716423 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-aa8248ac-40fd-4914-bf06-d3465b45abfb tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:39.719692 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:33:39.720366 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=92 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:33:39.725034 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa8248ac-40fd-4914-bf06-d3465b45abfb tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:39.726295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa8248ac-40fd-4914-bf06-d3465b45abfb tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:39.726811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa8248ac-40fd-4914-bf06-d3465b45abfb tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:39.727514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa8248ac-40fd-4914-bf06-d3465b45abfb tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:39.728157 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa8248ac-40fd-4914-bf06-d3465b45abfb tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:39.728589 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-aa8248ac-40fd-4914-bf06-d3465b45abfb tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:39.865732 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-aa8248ac-40fd-4914-bf06-d3465b45abfb tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:39.873521 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-aa8248ac-40fd-4914-bf06-d3465b45abfb tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.162503 Aug 18 22:33:39.874132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2257/4512] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:39 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:40.897146 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-5c3dcdac-b11b-40de-8385-f21a777656ad tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:40.897905 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-5c3dcdac-b11b-40de-8385-f21a777656ad tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:40.904498 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c3dcdac-b11b-40de-8385-f21a777656ad tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:40.905194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c3dcdac-b11b-40de-8385-f21a777656ad tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:40.905829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c3dcdac-b11b-40de-8385-f21a777656ad tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:40.906657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c3dcdac-b11b-40de-8385-f21a777656ad tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:40.907277 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c3dcdac-b11b-40de-8385-f21a777656ad tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:40.907868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-5c3dcdac-b11b-40de-8385-f21a777656ad tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:41.045313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-5c3dcdac-b11b-40de-8385-f21a777656ad tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:41.053901 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-5c3dcdac-b11b-40de-8385-f21a777656ad tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.162231 Aug 18 22:33:41.054476 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2256/4513] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:40 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:42.075631 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1ebd05d6-850f-4375-b946-88c1ad3a6314 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:42.076239 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1ebd05d6-850f-4375-b946-88c1ad3a6314 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:42.083215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ebd05d6-850f-4375-b946-88c1ad3a6314 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:42.083688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ebd05d6-850f-4375-b946-88c1ad3a6314 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:42.084115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ebd05d6-850f-4375-b946-88c1ad3a6314 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:42.084801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ebd05d6-850f-4375-b946-88c1ad3a6314 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:42.085285 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ebd05d6-850f-4375-b946-88c1ad3a6314 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:42.085694 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1ebd05d6-850f-4375-b946-88c1ad3a6314 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:42.218565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-1ebd05d6-850f-4375-b946-88c1ad3a6314 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:42.227535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1ebd05d6-850f-4375-b946-88c1ad3a6314 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.155786 Aug 18 22:33:42.228094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2258/4514] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:42 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:43.247355 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-9132ace6-ad9d-40ff-8bac-cc6dcdae2bc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:43.247973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-9132ace6-ad9d-40ff-8bac-cc6dcdae2bc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:43.254556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9132ace6-ad9d-40ff-8bac-cc6dcdae2bc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:43.255043 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9132ace6-ad9d-40ff-8bac-cc6dcdae2bc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:43.255478 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9132ace6-ad9d-40ff-8bac-cc6dcdae2bc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:43.256186 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9132ace6-ad9d-40ff-8bac-cc6dcdae2bc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:43.256643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9132ace6-ad9d-40ff-8bac-cc6dcdae2bc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:43.257072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-9132ace6-ad9d-40ff-8bac-cc6dcdae2bc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:43.386446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-9132ace6-ad9d-40ff-8bac-cc6dcdae2bc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:43.394220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-9132ace6-ad9d-40ff-8bac-cc6dcdae2bc7 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.150740 Aug 18 22:33:43.394787 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2257/4515] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:43 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:44.416227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-84432b6f-52d4-432f-8485-a0a25612c940 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:44.416764 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-84432b6f-52d4-432f-8485-a0a25612c940 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:44.423189 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84432b6f-52d4-432f-8485-a0a25612c940 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:44.423657 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84432b6f-52d4-432f-8485-a0a25612c940 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:44.424094 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84432b6f-52d4-432f-8485-a0a25612c940 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:44.424784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84432b6f-52d4-432f-8485-a0a25612c940 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:44.425244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84432b6f-52d4-432f-8485-a0a25612c940 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:44.425708 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-84432b6f-52d4-432f-8485-a0a25612c940 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:44.560124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-84432b6f-52d4-432f-8485-a0a25612c940 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:44.568279 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-84432b6f-52d4-432f-8485-a0a25612c940 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.156098 Aug 18 22:33:44.568856 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2259/4516] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:44 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:45.589307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-97bf0b33-1dd3-400d-965a-2bdb227965b3 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:45.589991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-97bf0b33-1dd3-400d-965a-2bdb227965b3 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:45.596651 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97bf0b33-1dd3-400d-965a-2bdb227965b3 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:45.597141 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97bf0b33-1dd3-400d-965a-2bdb227965b3 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:45.597584 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97bf0b33-1dd3-400d-965a-2bdb227965b3 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:45.598405 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97bf0b33-1dd3-400d-965a-2bdb227965b3 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:45.598871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97bf0b33-1dd3-400d-965a-2bdb227965b3 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:45.599307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-97bf0b33-1dd3-400d-965a-2bdb227965b3 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:45.730892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-97bf0b33-1dd3-400d-965a-2bdb227965b3 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:45.738556 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-97bf0b33-1dd3-400d-965a-2bdb227965b3 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.153084 Aug 18 22:33:45.739810 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2258/4517] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:45 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:46.761354 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-e46bdc9a-3c59-4ff9-9266-1526f5698ef1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:46.762002 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-e46bdc9a-3c59-4ff9-9266-1526f5698ef1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:46.768362 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e46bdc9a-3c59-4ff9-9266-1526f5698ef1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:46.768849 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e46bdc9a-3c59-4ff9-9266-1526f5698ef1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:46.769291 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e46bdc9a-3c59-4ff9-9266-1526f5698ef1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:46.770701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e46bdc9a-3c59-4ff9-9266-1526f5698ef1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:46.771177 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e46bdc9a-3c59-4ff9-9266-1526f5698ef1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:46.771612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-e46bdc9a-3c59-4ff9-9266-1526f5698ef1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:46.902168 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-e46bdc9a-3c59-4ff9-9266-1526f5698ef1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:46.909959 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-e46bdc9a-3c59-4ff9-9266-1526f5698ef1 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.152460 Aug 18 22:33:46.910536 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2260/4518] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:46 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:47.929800 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e27f147f-ba8e-4f76-a80c-ea2eff292f33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:47.930409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e27f147f-ba8e-4f76-a80c-ea2eff292f33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:47.936833 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e27f147f-ba8e-4f76-a80c-ea2eff292f33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:47.937318 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e27f147f-ba8e-4f76-a80c-ea2eff292f33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:47.937784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e27f147f-ba8e-4f76-a80c-ea2eff292f33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:47.938470 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e27f147f-ba8e-4f76-a80c-ea2eff292f33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:47.939180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e27f147f-ba8e-4f76-a80c-ea2eff292f33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:47.939604 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e27f147f-ba8e-4f76-a80c-ea2eff292f33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:48.068706 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e27f147f-ba8e-4f76-a80c-ea2eff292f33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:48.076445 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e27f147f-ba8e-4f76-a80c-ea2eff292f33 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.150532 Aug 18 22:33:48.077016 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2259/4519] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:47 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:49.097737 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2b7033c4-dde0-4609-a31f-76585a33f995 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:49.098426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2b7033c4-dde0-4609-a31f-76585a33f995 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:49.104832 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b7033c4-dde0-4609-a31f-76585a33f995 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:49.105322 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b7033c4-dde0-4609-a31f-76585a33f995 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:49.105790 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b7033c4-dde0-4609-a31f-76585a33f995 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:49.106485 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b7033c4-dde0-4609-a31f-76585a33f995 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:49.106942 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b7033c4-dde0-4609-a31f-76585a33f995 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:49.107372 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2b7033c4-dde0-4609-a31f-76585a33f995 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:49.236836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2b7033c4-dde0-4609-a31f-76585a33f995 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:49.244508 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2b7033c4-dde0-4609-a31f-76585a33f995 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.150696 Aug 18 22:33:49.245080 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2261/4520] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:49 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:50.265064 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7db7e54f-3bbd-4292-97c1-4b2b8a7993dc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:50.265844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7db7e54f-3bbd-4292-97c1-4b2b8a7993dc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:50.272865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7db7e54f-3bbd-4292-97c1-4b2b8a7993dc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:50.273349 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7db7e54f-3bbd-4292-97c1-4b2b8a7993dc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:50.273821 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7db7e54f-3bbd-4292-97c1-4b2b8a7993dc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:50.274617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7db7e54f-3bbd-4292-97c1-4b2b8a7993dc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:50.275069 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7db7e54f-3bbd-4292-97c1-4b2b8a7993dc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:50.275492 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7db7e54f-3bbd-4292-97c1-4b2b8a7993dc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:50.462707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7db7e54f-3bbd-4292-97c1-4b2b8a7993dc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:50.470629 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7db7e54f-3bbd-4292-97c1-4b2b8a7993dc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.209460 Aug 18 22:33:50.471207 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2260/4521] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:50 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:51.491796 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6e846d83-0a66-4f7f-88aa-09ba7f7ee00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:51.492348 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6e846d83-0a66-4f7f-88aa-09ba7f7ee00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:51.498845 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e846d83-0a66-4f7f-88aa-09ba7f7ee00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:51.499331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e846d83-0a66-4f7f-88aa-09ba7f7ee00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:51.499770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e846d83-0a66-4f7f-88aa-09ba7f7ee00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:51.500494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e846d83-0a66-4f7f-88aa-09ba7f7ee00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:51.500951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e846d83-0a66-4f7f-88aa-09ba7f7ee00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:51.501380 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6e846d83-0a66-4f7f-88aa-09ba7f7ee00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:51.636960 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6e846d83-0a66-4f7f-88aa-09ba7f7ee00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:51.644666 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6e846d83-0a66-4f7f-88aa-09ba7f7ee00c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.157360 Aug 18 22:33:51.645769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2262/4522] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:51 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:52.666351 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-c38b0675-2b56-49f0-b848-773e183eb876 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:52.667006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-c38b0675-2b56-49f0-b848-773e183eb876 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:52.673393 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c38b0675-2b56-49f0-b848-773e183eb876 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:52.673917 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c38b0675-2b56-49f0-b848-773e183eb876 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:52.674362 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c38b0675-2b56-49f0-b848-773e183eb876 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:52.675053 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c38b0675-2b56-49f0-b848-773e183eb876 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:52.675514 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c38b0675-2b56-49f0-b848-773e183eb876 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:52.675946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-c38b0675-2b56-49f0-b848-773e183eb876 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:52.807506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-c38b0675-2b56-49f0-b848-773e183eb876 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:52.815559 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-c38b0675-2b56-49f0-b848-773e183eb876 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1507 microversion: 2.1 time: 0.153059 Aug 18 22:33:52.816126 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2261/4523] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:52 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:52.835331 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-5bf8f252-c301-49fb-981d-438dc89170fe tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:33:52.835932 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5bf8f252-c301-49fb-981d-438dc89170fe tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:52.842208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bf8f252-c301-49fb-981d-438dc89170fe tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:52.842687 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bf8f252-c301-49fb-981d-438dc89170fe tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:52.843115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bf8f252-c301-49fb-981d-438dc89170fe tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:52.843794 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bf8f252-c301-49fb-981d-438dc89170fe tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:52.844245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bf8f252-c301-49fb-981d-438dc89170fe tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:52.844669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-5bf8f252-c301-49fb-981d-438dc89170fe tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:52.883814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-5bf8f252-c301-49fb-981d-438dc89170fe tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120539) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 22:33:52.946979 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-5bf8f252-c301-49fb-981d-438dc89170fe tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "POST /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4/action" status: 202 len: 0 microversion: 2.1 time: 0.115383 Aug 18 22:33:52.947543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2263/4524] 10.222.0.82 () {60 vars in 1278 bytes} [Thu Aug 18 22:33:52 2022] POST /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:33:52.955762 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-766da7c1-61b8-4561-af0b-7d838728945d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:52.956565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-766da7c1-61b8-4561-af0b-7d838728945d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:52.962634 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-766da7c1-61b8-4561-af0b-7d838728945d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:52.963128 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-766da7c1-61b8-4561-af0b-7d838728945d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:52.963572 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-766da7c1-61b8-4561-af0b-7d838728945d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:52.964278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-766da7c1-61b8-4561-af0b-7d838728945d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:52.964741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-766da7c1-61b8-4561-af0b-7d838728945d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:52.965249 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-766da7c1-61b8-4561-af0b-7d838728945d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:53.137052 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-766da7c1-61b8-4561-af0b-7d838728945d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:53.145376 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-766da7c1-61b8-4561-af0b-7d838728945d tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1515 microversion: 2.1 time: 0.193549 Aug 18 22:33:53.145986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2262/4525] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:52 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:54.167227 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a829716f-1388-4eb4-a2e9-068d5fed01cc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:54.167838 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a829716f-1388-4eb4-a2e9-068d5fed01cc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:54.174149 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a829716f-1388-4eb4-a2e9-068d5fed01cc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:54.174651 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a829716f-1388-4eb4-a2e9-068d5fed01cc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:54.175085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a829716f-1388-4eb4-a2e9-068d5fed01cc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:54.175768 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a829716f-1388-4eb4-a2e9-068d5fed01cc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:54.176215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a829716f-1388-4eb4-a2e9-068d5fed01cc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:54.176634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a829716f-1388-4eb4-a2e9-068d5fed01cc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:54.309115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a829716f-1388-4eb4-a2e9-068d5fed01cc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:54.317254 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a829716f-1388-4eb4-a2e9-068d5fed01cc tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1517 microversion: 2.1 time: 0.154712 Aug 18 22:33:54.317784 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2264/4526] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:54 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:55.081892 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-1d4d8cbb-d196-486e-8875-b7b222ae4ff9 req-beaf8651-5f1c-4686-908a-0cbaf2fa31d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e60ed1-0091-4e24-8cfa-b854eed71bf4", "name": "network-vif-unplugged", "status": "completed", "tag": "f7486d36-da4f-4543-8560-136f47b31774"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:33:55.096123 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-1d4d8cbb-d196-486e-8875-b7b222ae4ff9 req-beaf8651-5f1c-4686-908a-0cbaf2fa31d4 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:55.096765 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-1d4d8cbb-d196-486e-8875-b7b222ae4ff9 req-beaf8651-5f1c-4686-908a-0cbaf2fa31d4 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:55.097386 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-1d4d8cbb-d196-486e-8875-b7b222ae4ff9 req-beaf8651-5f1c-4686-908a-0cbaf2fa31d4 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:55.108779 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-1d4d8cbb-d196-486e-8875-b7b222ae4ff9 req-beaf8651-5f1c-4686-908a-0cbaf2fa31d4 service nova] Creating event network-vif-unplugged:f7486d36-da4f-4543-8560-136f47b31774 for instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 on hv-cinder-85367 Aug 18 22:33:55.113888 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-1d4d8cbb-d196-486e-8875-b7b222ae4ff9 req-beaf8651-5f1c-4686-908a-0cbaf2fa31d4 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035964 Aug 18 22:33:55.114488 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2263/4527] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:33:55.339142 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a112545e-1ed1-4caf-8a53-c89a22b120a2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:55.339752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a112545e-1ed1-4caf-8a53-c89a22b120a2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:55.346427 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a112545e-1ed1-4caf-8a53-c89a22b120a2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:55.346908 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a112545e-1ed1-4caf-8a53-c89a22b120a2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:55.347336 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a112545e-1ed1-4caf-8a53-c89a22b120a2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:55.348018 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a112545e-1ed1-4caf-8a53-c89a22b120a2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:55.348463 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a112545e-1ed1-4caf-8a53-c89a22b120a2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:55.348883 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a112545e-1ed1-4caf-8a53-c89a22b120a2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:55.483082 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a112545e-1ed1-4caf-8a53-c89a22b120a2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:55.490841 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a112545e-1ed1-4caf-8a53-c89a22b120a2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1573 microversion: 2.1 time: 0.155779 Aug 18 22:33:55.491458 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2265/4528] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:55 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:56.513586 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-04d6be14-f395-4a1e-9443-2c8e8216b020 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:56.514263 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-04d6be14-f395-4a1e-9443-2c8e8216b020 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:56.521115 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04d6be14-f395-4a1e-9443-2c8e8216b020 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:56.521764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04d6be14-f395-4a1e-9443-2c8e8216b020 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:56.522250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04d6be14-f395-4a1e-9443-2c8e8216b020 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:56.523014 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04d6be14-f395-4a1e-9443-2c8e8216b020 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:56.523477 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04d6be14-f395-4a1e-9443-2c8e8216b020 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:56.523910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-04d6be14-f395-4a1e-9443-2c8e8216b020 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:56.657950 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-04d6be14-f395-4a1e-9443-2c8e8216b020 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:56.665650 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-04d6be14-f395-4a1e-9443-2c8e8216b020 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1573 microversion: 2.1 time: 0.156351 Aug 18 22:33:56.666227 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2264/4529] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:56 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:57.686876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9034fb03-97a2-47f7-9c0e-9ecfc5d0d5c2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:57.687497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9034fb03-97a2-47f7-9c0e-9ecfc5d0d5c2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:57.695044 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9034fb03-97a2-47f7-9c0e-9ecfc5d0d5c2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:57.695615 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9034fb03-97a2-47f7-9c0e-9ecfc5d0d5c2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:57.696055 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9034fb03-97a2-47f7-9c0e-9ecfc5d0d5c2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:57.696748 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9034fb03-97a2-47f7-9c0e-9ecfc5d0d5c2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:57.697198 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9034fb03-97a2-47f7-9c0e-9ecfc5d0d5c2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:57.697642 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9034fb03-97a2-47f7-9c0e-9ecfc5d0d5c2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:57.825919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9034fb03-97a2-47f7-9c0e-9ecfc5d0d5c2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:57.833559 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9034fb03-97a2-47f7-9c0e-9ecfc5d0d5c2 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1573 microversion: 2.1 time: 0.150510 Aug 18 22:33:57.834151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2266/4530] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:57 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:33:58.855544 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-55546ed1-e375-4936-816e-aee468c77f60 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:33:58.856163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-55546ed1-e375-4936-816e-aee468c77f60 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:33:58.862624 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55546ed1-e375-4936-816e-aee468c77f60 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:58.863110 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55546ed1-e375-4936-816e-aee468c77f60 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:58.863548 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55546ed1-e375-4936-816e-aee468c77f60 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:58.864238 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55546ed1-e375-4936-816e-aee468c77f60 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:33:58.864695 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55546ed1-e375-4936-816e-aee468c77f60 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:33:58.865125 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-55546ed1-e375-4936-816e-aee468c77f60 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:33:58.993528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-55546ed1-e375-4936-816e-aee468c77f60 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:33:59.001270 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-55546ed1-e375-4936-816e-aee468c77f60 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1573 microversion: 2.1 time: 0.150215 Aug 18 22:33:59.001867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2265/4531] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:33:58 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:00.021999 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-0a4bb611-34f9-4eb3-a00f-817ec3b90ae8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:00.022629 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-0a4bb611-34f9-4eb3-a00f-817ec3b90ae8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:00.028985 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a4bb611-34f9-4eb3-a00f-817ec3b90ae8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:00.029457 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a4bb611-34f9-4eb3-a00f-817ec3b90ae8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:00.029927 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a4bb611-34f9-4eb3-a00f-817ec3b90ae8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:00.030634 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a4bb611-34f9-4eb3-a00f-817ec3b90ae8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:00.031081 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a4bb611-34f9-4eb3-a00f-817ec3b90ae8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:00.031499 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-0a4bb611-34f9-4eb3-a00f-817ec3b90ae8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:00.162819 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-0a4bb611-34f9-4eb3-a00f-817ec3b90ae8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:34:00.171396 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-0a4bb611-34f9-4eb3-a00f-817ec3b90ae8 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1573 microversion: 2.1 time: 0.153248 Aug 18 22:34:00.171967 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2267/4532] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:00 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:01.193783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-132bc86f-3cf4-4788-b583-8c66b69f698c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:01.194511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-132bc86f-3cf4-4788-b583-8c66b69f698c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:01.201092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-132bc86f-3cf4-4788-b583-8c66b69f698c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:01.201577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-132bc86f-3cf4-4788-b583-8c66b69f698c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:01.202055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-132bc86f-3cf4-4788-b583-8c66b69f698c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:01.202742 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-132bc86f-3cf4-4788-b583-8c66b69f698c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:01.203199 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-132bc86f-3cf4-4788-b583-8c66b69f698c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:01.203652 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-132bc86f-3cf4-4788-b583-8c66b69f698c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:01.338174 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-132bc86f-3cf4-4788-b583-8c66b69f698c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:34:01.345865 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-132bc86f-3cf4-4788-b583-8c66b69f698c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1573 microversion: 2.1 time: 0.156033 Aug 18 22:34:01.346436 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2266/4533] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:01 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:02.367258 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9a590a24-cd59-44e9-81cd-87bab8ce360c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:02.367867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9a590a24-cd59-44e9-81cd-87bab8ce360c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:02.374374 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a590a24-cd59-44e9-81cd-87bab8ce360c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:02.374853 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a590a24-cd59-44e9-81cd-87bab8ce360c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:02.375313 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a590a24-cd59-44e9-81cd-87bab8ce360c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:02.376001 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a590a24-cd59-44e9-81cd-87bab8ce360c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:02.376480 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a590a24-cd59-44e9-81cd-87bab8ce360c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:02.376902 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9a590a24-cd59-44e9-81cd-87bab8ce360c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:02.505355 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9a590a24-cd59-44e9-81cd-87bab8ce360c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:34:02.513378 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9a590a24-cd59-44e9-81cd-87bab8ce360c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1560 microversion: 2.1 time: 0.150453 Aug 18 22:34:02.513980 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2268/4534] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:02 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:05.190893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [req-1a8a429d-23a3-4a35-be63-c9761b82f07e req-b3a11357-bd8e-4fb3-b44d-d5b550fd743d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e60ed1-0091-4e24-8cfa-b854eed71bf4", "name": "network-vif-plugged", "status": "completed", "tag": "f7486d36-da4f-4543-8560-136f47b31774"}]} {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:34:05.202533 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-1a8a429d-23a3-4a35-be63-c9761b82f07e req-b3a11357-bd8e-4fb3-b44d-d5b550fd743d service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:05.203056 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-1a8a429d-23a3-4a35-be63-c9761b82f07e req-b3a11357-bd8e-4fb3-b44d-d5b550fd743d service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:05.203529 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [req-1a8a429d-23a3-4a35-be63-c9761b82f07e req-b3a11357-bd8e-4fb3-b44d-d5b550fd743d service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:05.215596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.compute.server_external_events [req-1a8a429d-23a3-4a35-be63-c9761b82f07e req-b3a11357-bd8e-4fb3-b44d-d5b550fd743d service nova] Creating event network-vif-plugged:f7486d36-da4f-4543-8560-136f47b31774 for instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 on hv-cinder-85367 Aug 18 22:34:05.220508 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [req-1a8a429d-23a3-4a35-be63-c9761b82f07e req-b3a11357-bd8e-4fb3-b44d-d5b550fd743d service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033554 Aug 18 22:34:05.221251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2267/4535] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:34:48.274800 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-521d1587-50f8-433f-878f-0c4ada68c148 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:48.275424 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-521d1587-50f8-433f-878f-0c4ada68c148 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:48.277310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:34:48.278151 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:34:48.283494 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-521d1587-50f8-433f-878f-0c4ada68c148 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:48.283969 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-521d1587-50f8-433f-878f-0c4ada68c148 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:48.284431 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-521d1587-50f8-433f-878f-0c4ada68c148 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:48.285123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-521d1587-50f8-433f-878f-0c4ada68c148 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:48.285572 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-521d1587-50f8-433f-878f-0c4ada68c148 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:48.286046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-521d1587-50f8-433f-878f-0c4ada68c148 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:48.312215 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-521d1587-50f8-433f-878f-0c4ada68c148 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Going to try to terminate instance {{(pid=120539) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:34:48.386517 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-521d1587-50f8-433f-878f-0c4ada68c148 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "DELETE /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 204 len: 0 microversion: 2.1 time: 0.115412 Aug 18 22:34:48.387111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2269/4536] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:34:48 2022] DELETE /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:34:48.396528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-4b2a0e3d-ef40-4a7e-aafd-48ba0644ffb6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:48.397232 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-4b2a0e3d-ef40-4a7e-aafd-48ba0644ffb6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:48.399973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=26 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:34:48.400617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:34:48.407759 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b2a0e3d-ef40-4a7e-aafd-48ba0644ffb6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:48.408653 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b2a0e3d-ef40-4a7e-aafd-48ba0644ffb6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:48.409108 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b2a0e3d-ef40-4a7e-aafd-48ba0644ffb6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:48.409841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b2a0e3d-ef40-4a7e-aafd-48ba0644ffb6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:48.410306 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b2a0e3d-ef40-4a7e-aafd-48ba0644ffb6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:48.410745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-4b2a0e3d-ef40-4a7e-aafd-48ba0644ffb6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:48.597786 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-4b2a0e3d-ef40-4a7e-aafd-48ba0644ffb6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:34:48.606143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-4b2a0e3d-ef40-4a7e-aafd-48ba0644ffb6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1576 microversion: 2.1 time: 0.213715 Aug 18 22:34:48.606715 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2268/4537] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:48 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1576 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:49.628256 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-6a077fe6-9fee-4bbc-96d8-2ae9133481da tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:49.628898 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-6a077fe6-9fee-4bbc-96d8-2ae9133481da tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:49.636245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a077fe6-9fee-4bbc-96d8-2ae9133481da tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:49.636729 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a077fe6-9fee-4bbc-96d8-2ae9133481da tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:49.637166 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a077fe6-9fee-4bbc-96d8-2ae9133481da tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:49.637884 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a077fe6-9fee-4bbc-96d8-2ae9133481da tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:49.638367 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a077fe6-9fee-4bbc-96d8-2ae9133481da tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:49.638818 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-6a077fe6-9fee-4bbc-96d8-2ae9133481da tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:49.824041 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-6a077fe6-9fee-4bbc-96d8-2ae9133481da tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:34:49.831814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-6a077fe6-9fee-4bbc-96d8-2ae9133481da tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1576 microversion: 2.1 time: 0.207911 Aug 18 22:34:49.832384 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2270/4538] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:49 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:50.854289 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2ef24e52-3f47-4865-9e06-e3aeef4f13f6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:50.854914 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2ef24e52-3f47-4865-9e06-e3aeef4f13f6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:50.861479 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ef24e52-3f47-4865-9e06-e3aeef4f13f6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:50.862191 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ef24e52-3f47-4865-9e06-e3aeef4f13f6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:50.862825 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ef24e52-3f47-4865-9e06-e3aeef4f13f6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:50.863528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ef24e52-3f47-4865-9e06-e3aeef4f13f6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:50.864424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ef24e52-3f47-4865-9e06-e3aeef4f13f6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:50.864814 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ef24e52-3f47-4865-9e06-e3aeef4f13f6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:50.954122 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2ef24e52-3f47-4865-9e06-e3aeef4f13f6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:34:50.962952 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2ef24e52-3f47-4865-9e06-e3aeef4f13f6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 200 len: 1509 microversion: 2.1 time: 0.112380 Aug 18 22:34:50.963769 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2269/4539] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:50 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 1509 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:51.062760 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-084c8f7e-7a75-4c62-b62b-abcf186bd47f req-1596f726-2f4a-4237-8827-bb873b8334c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5853a22c-5f4b-4973-b408-d9783a6fc922", "name": "network-vif-deleted", "tag": "d5f45013-eec2-4a4e-a519-e1ed2b8a1f52"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:34:51.073105 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-084c8f7e-7a75-4c62-b62b-abcf186bd47f req-1596f726-2f4a-4237-8827-bb873b8334c8 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:51.073693 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-084c8f7e-7a75-4c62-b62b-abcf186bd47f req-1596f726-2f4a-4237-8827-bb873b8334c8 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:51.074195 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-084c8f7e-7a75-4c62-b62b-abcf186bd47f req-1596f726-2f4a-4237-8827-bb873b8334c8 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:51.085115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-084c8f7e-7a75-4c62-b62b-abcf186bd47f req-1596f726-2f4a-4237-8827-bb873b8334c8 service nova] Creating event network-vif-deleted:d5f45013-eec2-4a4e-a519-e1ed2b8a1f52 for instance 5853a22c-5f4b-4973-b408-d9783a6fc922 on hv-cinder-85367 Aug 18 22:34:51.090443 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-084c8f7e-7a75-4c62-b62b-abcf186bd47f req-1596f726-2f4a-4237-8827-bb873b8334c8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103911 Aug 18 22:34:51.091179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2271/4540] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:34:51.984155 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bbb4eff4-4f9b-4b21-8024-83c938f3fe03 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:51.984803 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-bbb4eff4-4f9b-4b21-8024-83c938f3fe03 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:51.991208 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbb4eff4-4f9b-4b21-8024-83c938f3fe03 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:51.991699 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbb4eff4-4f9b-4b21-8024-83c938f3fe03 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:51.992143 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbb4eff4-4f9b-4b21-8024-83c938f3fe03 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:51.992835 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbb4eff4-4f9b-4b21-8024-83c938f3fe03 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:51.993364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbb4eff4-4f9b-4b21-8024-83c938f3fe03 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:51.993826 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-bbb4eff4-4f9b-4b21-8024-83c938f3fe03 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:52.007968 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-bbb4eff4-4f9b-4b21-8024-83c938f3fe03 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] HTTP exception thrown: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bbb4eff4-4f9b-4b21-8024-83c938f3fe03 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Request method failure captured: Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 HTTP/1.1 Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_r3qFiO4E5e6qC6yntVZ937UD8bJC1NMf0Al0UXDcHu6MNQXbiFRTJr1TlyOvzryDeUE9Yq65cNeeLLiEsyj1tfKdEunOFcejOF4xAmslU-CuhRFGcYyO98hV9Um8HF_UedgnH-3nsuYPDE0VFs7VZ1V7o_c7sPgwjgVX_nHIAk1rlM Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 5a5733a14ade43e48f6a039a5075e63c Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:34:52.010243 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:34:52.011689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_5a5733a14ade43e48f6a039a5075e63c", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:34:52.011689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:34:52.011689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 5a5733a14ade43e48f6a039a5075e63c Aug 18 22:34:52.011689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:34:52.011689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-TestVolumeBootPattern-1066322283-project Aug 18 22:34:52.011689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:34:52.011689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:34:52.011689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 4b4e033fbc0d438ca9a3f954d53c891e Aug 18 22:34:52.011689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-TestVolumeBootPattern-1066322283-project Aug 18 22:34:52.011689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:34:52.011689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:34:52.011689 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': '5853a22c-5f4b-4973-b408-d9783a6fc922'} Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:34:52.012455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:34:52.013844 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:34:52.015169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-bbb4eff4-4f9b-4b21-8024-83c938f3fe03 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Returning 404 to user: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:34:52.015169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-bbb4eff4-4f9b-4b21-8024-83c938f3fe03 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 404 len: 111 microversion: 2.1 time: 0.031336 Aug 18 22:34:52.015169 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2270/4541] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:51 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:34:52.107880 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1432780609", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1846540149", "security_groups": [{"name": "tempest-secgroup-smoke-572671450"}], "block_device_mapping_v2": [{"uuid": "816e91ba-ae0e-4ee1-9d9a-fb1032a5925c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b548c6e2-7c22-43ce-bce7-a8a12822a8af"}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:34:52.222917 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] validate_networks() for [('b548c6e2-7c22-43ce-bce7-a8a12822a8af', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 22:34:52.623914 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 22:34:52.624338 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 22:34:52.624814 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 22:34:52.625221 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 22:34:52.625662 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 22:34:52.634410 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:52.635504 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:52.635936 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:52.636654 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:52.637109 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:52.637535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:52.653949 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Getting quotas for project 5a5733a14ade43e48f6a039a5075e63c. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:34:52.657868 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Getting quotas for user 4b4e033fbc0d438ca9a3f954d53c891e and project 5a5733a14ade43e48f6a039a5075e63c. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:34:52.715548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 22:34:52.717787 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='816e91ba-ae0e-4ee1-9d9a-fb1032a5925c',volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 22:34:52.851575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c36e0aa8-b720-416d-ad10-54d04efdc941 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.749021 Aug 18 22:34:52.852225 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2272/4542] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 22:34:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 22:34:52.863573 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b2d44ed9-2d3b-46ec-9bbe-e4bc5a8d3f19 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:52.864184 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b2d44ed9-2d3b-46ec-9bbe-e4bc5a8d3f19 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:52.920065 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b2d44ed9-2d3b-46ec-9bbe-e4bc5a8d3f19 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:34:52.926899 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b2d44ed9-2d3b-46ec-9bbe-e4bc5a8d3f19 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1095 microversion: 2.1 time: 0.067177 Aug 18 22:34:52.927464 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2271/4543] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:52 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:53.948245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-91382335-6bd7-46f7-bc4d-45ef194b4f6b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:53.949174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-91382335-6bd7-46f7-bc4d-45ef194b4f6b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:53.955266 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91382335-6bd7-46f7-bc4d-45ef194b4f6b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:53.955752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91382335-6bd7-46f7-bc4d-45ef194b4f6b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:53.956183 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91382335-6bd7-46f7-bc4d-45ef194b4f6b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:53.956876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91382335-6bd7-46f7-bc4d-45ef194b4f6b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:53.957325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91382335-6bd7-46f7-bc4d-45ef194b4f6b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:53.957789 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-91382335-6bd7-46f7-bc4d-45ef194b4f6b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:54.023462 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-91382335-6bd7-46f7-bc4d-45ef194b4f6b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:34:54.031420 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-91382335-6bd7-46f7-bc4d-45ef194b4f6b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1211 microversion: 2.1 time: 0.087570 Aug 18 22:34:54.032003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2273/4544] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:53 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:55.052924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-98996285-60ec-49e5-afc4-6388524bf92b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:55.053668 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-98996285-60ec-49e5-afc4-6388524bf92b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:55.061889 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98996285-60ec-49e5-afc4-6388524bf92b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:55.062333 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98996285-60ec-49e5-afc4-6388524bf92b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:55.062847 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98996285-60ec-49e5-afc4-6388524bf92b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:55.063571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98996285-60ec-49e5-afc4-6388524bf92b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:55.064034 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98996285-60ec-49e5-afc4-6388524bf92b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:55.064924 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-98996285-60ec-49e5-afc4-6388524bf92b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:55.106535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-62d03c77-5e3d-4636-b540-2b870f24d76c req-d19e0184-c923-4853-8da8-d0d920515ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b2888c2-c26d-4ddb-b900-fada5522f01c", "tag": "e0061d6f-1eed-49fd-a2a1-d7048b9d07de"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:34:55.118495 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-62d03c77-5e3d-4636-b540-2b870f24d76c req-d19e0184-c923-4853-8da8-d0d920515ca3 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:55.119526 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-62d03c77-5e3d-4636-b540-2b870f24d76c req-d19e0184-c923-4853-8da8-d0d920515ca3 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:55.119961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-62d03c77-5e3d-4636-b540-2b870f24d76c req-d19e0184-c923-4853-8da8-d0d920515ca3 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:55.131984 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-62d03c77-5e3d-4636-b540-2b870f24d76c req-d19e0184-c923-4853-8da8-d0d920515ca3 service nova] Creating event network-changed:e0061d6f-1eed-49fd-a2a1-d7048b9d07de for instance 8b2888c2-c26d-4ddb-b900-fada5522f01c on hv-cinder-85367 Aug 18 22:34:55.137387 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-62d03c77-5e3d-4636-b540-2b870f24d76c req-d19e0184-c923-4853-8da8-d0d920515ca3 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034960 Aug 18 22:34:55.138030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2274/4545] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:34:55.331295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-98996285-60ec-49e5-afc4-6388524bf92b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:34:55.339309 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-98996285-60ec-49e5-afc4-6388524bf92b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1266 microversion: 2.1 time: 0.290371 Aug 18 22:34:55.340643 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2272/4546] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:55 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:55.583236 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:34:55.583430 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:34:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:34:56.361129 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-c3d81f4d-da2b-4153-a18d-766e69bfe371 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:56.361894 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-c3d81f4d-da2b-4153-a18d-766e69bfe371 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:56.368092 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3d81f4d-da2b-4153-a18d-766e69bfe371 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:56.368573 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3d81f4d-da2b-4153-a18d-766e69bfe371 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:56.369525 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3d81f4d-da2b-4153-a18d-766e69bfe371 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:56.370241 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3d81f4d-da2b-4153-a18d-766e69bfe371 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:56.370699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3d81f4d-da2b-4153-a18d-766e69bfe371 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:56.371128 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-c3d81f4d-da2b-4153-a18d-766e69bfe371 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:56.499622 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-c3d81f4d-da2b-4153-a18d-766e69bfe371 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:34:56.507749 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-c3d81f4d-da2b-4153-a18d-766e69bfe371 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1266 microversion: 2.1 time: 0.151232 Aug 18 22:34:56.508323 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2275/4547] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:56 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:57.506745 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:34:57.507319 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:34:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:34:57.528625 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e132860b-7608-4dae-a967-95fd45b20e8c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:57.529278 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e132860b-7608-4dae-a967-95fd45b20e8c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:57.536457 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e132860b-7608-4dae-a967-95fd45b20e8c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:57.536988 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e132860b-7608-4dae-a967-95fd45b20e8c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:57.537427 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e132860b-7608-4dae-a967-95fd45b20e8c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:57.538161 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e132860b-7608-4dae-a967-95fd45b20e8c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:57.538619 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e132860b-7608-4dae-a967-95fd45b20e8c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:57.539045 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e132860b-7608-4dae-a967-95fd45b20e8c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:57.671879 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-e132860b-7608-4dae-a967-95fd45b20e8c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:34:57.679841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e132860b-7608-4dae-a967-95fd45b20e8c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1266 microversion: 2.1 time: 0.155618 Aug 18 22:34:57.680408 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2273/4548] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:57 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:58.700725 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-fec87f5d-1048-4b42-923e-0f34867acfa3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:58.701365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-fec87f5d-1048-4b42-923e-0f34867acfa3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:58.707881 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fec87f5d-1048-4b42-923e-0f34867acfa3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:58.708363 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fec87f5d-1048-4b42-923e-0f34867acfa3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:58.708811 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fec87f5d-1048-4b42-923e-0f34867acfa3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:58.710029 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fec87f5d-1048-4b42-923e-0f34867acfa3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:58.710837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fec87f5d-1048-4b42-923e-0f34867acfa3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:58.711587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-fec87f5d-1048-4b42-923e-0f34867acfa3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:58.841492 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-fec87f5d-1048-4b42-923e-0f34867acfa3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:34:58.849110 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-fec87f5d-1048-4b42-923e-0f34867acfa3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1266 microversion: 2.1 time: 0.152333 Aug 18 22:34:58.849961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2276/4549] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:58 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:34:59.871251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ab7ccf97-a44f-44bf-96ee-0335c6bba4b3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:34:59.871871 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ab7ccf97-a44f-44bf-96ee-0335c6bba4b3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:34:59.878958 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab7ccf97-a44f-44bf-96ee-0335c6bba4b3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:59.879454 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab7ccf97-a44f-44bf-96ee-0335c6bba4b3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:59.879910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab7ccf97-a44f-44bf-96ee-0335c6bba4b3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:34:59.880621 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab7ccf97-a44f-44bf-96ee-0335c6bba4b3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:34:59.881082 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab7ccf97-a44f-44bf-96ee-0335c6bba4b3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:34:59.881513 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ab7ccf97-a44f-44bf-96ee-0335c6bba4b3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:00.014804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-ab7ccf97-a44f-44bf-96ee-0335c6bba4b3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:35:00.024382 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ab7ccf97-a44f-44bf-96ee-0335c6bba4b3 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1266 microversion: 2.1 time: 0.157382 Aug 18 22:35:00.025150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2274/4550] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:34:59 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:35:01.045085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b2ed0e6b-31ea-4c78-b396-a7c8cc04799b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:01.046022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b2ed0e6b-31ea-4c78-b396-a7c8cc04799b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:35:01.052797 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2ed0e6b-31ea-4c78-b396-a7c8cc04799b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:01.053357 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2ed0e6b-31ea-4c78-b396-a7c8cc04799b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:01.053867 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2ed0e6b-31ea-4c78-b396-a7c8cc04799b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:01.054705 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2ed0e6b-31ea-4c78-b396-a7c8cc04799b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:01.055213 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2ed0e6b-31ea-4c78-b396-a7c8cc04799b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:01.055683 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b2ed0e6b-31ea-4c78-b396-a7c8cc04799b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:01.187469 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b2ed0e6b-31ea-4c78-b396-a7c8cc04799b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:35:01.195467 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b2ed0e6b-31ea-4c78-b396-a7c8cc04799b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1266 microversion: 2.1 time: 0.154243 Aug 18 22:35:01.196032 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2277/4551] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:35:01 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:35:02.216774 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-7a989c15-e7f4-4030-84f0-193316606a44 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:02.217364 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-7a989c15-e7f4-4030-84f0-193316606a44 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:35:02.223994 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a989c15-e7f4-4030-84f0-193316606a44 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:02.224583 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a989c15-e7f4-4030-84f0-193316606a44 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:02.225027 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a989c15-e7f4-4030-84f0-193316606a44 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:02.225753 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a989c15-e7f4-4030-84f0-193316606a44 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:02.226218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a989c15-e7f4-4030-84f0-193316606a44 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:02.226649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-7a989c15-e7f4-4030-84f0-193316606a44 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:02.356726 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-7a989c15-e7f4-4030-84f0-193316606a44 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:35:02.364409 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-7a989c15-e7f4-4030-84f0-193316606a44 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1266 microversion: 2.1 time: 0.152084 Aug 18 22:35:02.364986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2275/4552] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:35:02 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:35:03.388535 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8335b192-d36b-43a3-96fb-cda348f89283 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:03.389876 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8335b192-d36b-43a3-96fb-cda348f89283 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:35:03.392321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:35:03.393053 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:35:03.400606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8335b192-d36b-43a3-96fb-cda348f89283 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:03.401090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8335b192-d36b-43a3-96fb-cda348f89283 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:03.401557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8335b192-d36b-43a3-96fb-cda348f89283 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:03.402274 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8335b192-d36b-43a3-96fb-cda348f89283 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:03.402731 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8335b192-d36b-43a3-96fb-cda348f89283 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:03.403155 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8335b192-d36b-43a3-96fb-cda348f89283 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:03.538875 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8335b192-d36b-43a3-96fb-cda348f89283 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:35:03.546454 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8335b192-d36b-43a3-96fb-cda348f89283 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1266 microversion: 2.1 time: 0.163829 Aug 18 22:35:03.547021 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2278/4553] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:35:03 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:35:04.567946 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6f2ba307-706a-4b09-885a-7469b474b8ba tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:04.568555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6f2ba307-706a-4b09-885a-7469b474b8ba tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:35:04.570431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:35:04.576296 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f2ba307-706a-4b09-885a-7469b474b8ba tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:04.576818 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f2ba307-706a-4b09-885a-7469b474b8ba tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:04.577264 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f2ba307-706a-4b09-885a-7469b474b8ba tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:04.577999 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f2ba307-706a-4b09-885a-7469b474b8ba tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:04.578458 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f2ba307-706a-4b09-885a-7469b474b8ba tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:04.578890 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-6f2ba307-706a-4b09-885a-7469b474b8ba tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:04.711523 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6f2ba307-706a-4b09-885a-7469b474b8ba tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:35:04.720776 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6f2ba307-706a-4b09-885a-7469b474b8ba tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1266 microversion: 2.1 time: 0.156695 Aug 18 22:35:04.721215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2276/4554] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:35:04 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:35:05.599321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-4be0b3cd-710c-4532-8bc6-0d77c5786394 req-2eebc9d3-3a28-4f8e-8a77-df5a9025c1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2888c2-c26d-4ddb-b900-fada5522f01c", "name": "network-vif-plugged", "status": "completed", "tag": "e0061d6f-1eed-49fd-a2a1-d7048b9d07de"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:35:05.609148 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-4be0b3cd-710c-4532-8bc6-0d77c5786394 req-2eebc9d3-3a28-4f8e-8a77-df5a9025c1a6 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:05.609641 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-4be0b3cd-710c-4532-8bc6-0d77c5786394 req-2eebc9d3-3a28-4f8e-8a77-df5a9025c1a6 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:05.610068 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-4be0b3cd-710c-4532-8bc6-0d77c5786394 req-2eebc9d3-3a28-4f8e-8a77-df5a9025c1a6 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:05.624310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-4be0b3cd-710c-4532-8bc6-0d77c5786394 req-2eebc9d3-3a28-4f8e-8a77-df5a9025c1a6 service nova] Creating event network-vif-plugged:e0061d6f-1eed-49fd-a2a1-d7048b9d07de for instance 8b2888c2-c26d-4ddb-b900-fada5522f01c on hv-cinder-85367 Aug 18 22:35:05.629310 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-4be0b3cd-710c-4532-8bc6-0d77c5786394 req-2eebc9d3-3a28-4f8e-8a77-df5a9025c1a6 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095486 Aug 18 22:35:05.629874 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2279/4555] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:35:05.742072 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f5b8ec69-9c6e-4ec9-bf63-d791c14d968c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:05.742707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f5b8ec69-9c6e-4ec9-bf63-d791c14d968c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:35:05.750696 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5b8ec69-9c6e-4ec9-bf63-d791c14d968c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:05.751244 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5b8ec69-9c6e-4ec9-bf63-d791c14d968c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:05.751712 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5b8ec69-9c6e-4ec9-bf63-d791c14d968c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:05.752424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5b8ec69-9c6e-4ec9-bf63-d791c14d968c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:05.753004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5b8ec69-9c6e-4ec9-bf63-d791c14d968c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:05.753521 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f5b8ec69-9c6e-4ec9-bf63-d791c14d968c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:05.947617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f5b8ec69-9c6e-4ec9-bf63-d791c14d968c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:35:05.955196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f5b8ec69-9c6e-4ec9-bf63-d791c14d968c tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1266 microversion: 2.1 time: 0.217263 Aug 18 22:35:05.955756 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2277/4556] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:35:05 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:35:06.976544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-be0ce747-d183-445b-aa07-bd83b1354938 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:06.977158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-be0ce747-d183-445b-aa07-bd83b1354938 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:35:06.983358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be0ce747-d183-445b-aa07-bd83b1354938 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:06.983890 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be0ce747-d183-445b-aa07-bd83b1354938 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:06.984309 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be0ce747-d183-445b-aa07-bd83b1354938 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:06.984992 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be0ce747-d183-445b-aa07-bd83b1354938 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:06.985445 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be0ce747-d183-445b-aa07-bd83b1354938 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:06.985919 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-be0ce747-d183-445b-aa07-bd83b1354938 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:07.119435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-be0ce747-d183-445b-aa07-bd83b1354938 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:35:07.127174 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-be0ce747-d183-445b-aa07-bd83b1354938 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1452 microversion: 2.1 time: 0.155468 Aug 18 22:35:07.127730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2280/4557] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:35:06 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:35:07.148416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-50cbdfe4-8b20-4e9d-b707-7454f4a528cc tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:07.149038 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-50cbdfe4-8b20-4e9d-b707-7454f4a528cc tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:35:07.155286 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50cbdfe4-8b20-4e9d-b707-7454f4a528cc tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:07.155781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50cbdfe4-8b20-4e9d-b707-7454f4a528cc tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:07.156254 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50cbdfe4-8b20-4e9d-b707-7454f4a528cc tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:07.156986 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50cbdfe4-8b20-4e9d-b707-7454f4a528cc tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:07.157451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50cbdfe4-8b20-4e9d-b707-7454f4a528cc tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:07.157922 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-50cbdfe4-8b20-4e9d-b707-7454f4a528cc tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:07.288215 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-50cbdfe4-8b20-4e9d-b707-7454f4a528cc tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:35:07.296587 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-50cbdfe4-8b20-4e9d-b707-7454f4a528cc tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1452 microversion: 2.1 time: 0.152971 Aug 18 22:35:07.297163 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2278/4558] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:35:07 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:35:08.851863 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-c9b7ba03-148c-460f-aed4-866ac8f7091c req-3204fa62-d652-4453-95f1-cdd9cfdfcd9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b2888c2-c26d-4ddb-b900-fada5522f01c", "tag": "e0061d6f-1eed-49fd-a2a1-d7048b9d07de"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:35:08.862011 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-c9b7ba03-148c-460f-aed4-866ac8f7091c req-3204fa62-d652-4453-95f1-cdd9cfdfcd9a service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:08.862490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-c9b7ba03-148c-460f-aed4-866ac8f7091c req-3204fa62-d652-4453-95f1-cdd9cfdfcd9a service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:08.862921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-c9b7ba03-148c-460f-aed4-866ac8f7091c req-3204fa62-d652-4453-95f1-cdd9cfdfcd9a service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:08.873769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-c9b7ba03-148c-460f-aed4-866ac8f7091c req-3204fa62-d652-4453-95f1-cdd9cfdfcd9a service nova] Creating event network-changed:e0061d6f-1eed-49fd-a2a1-d7048b9d07de for instance 8b2888c2-c26d-4ddb-b900-fada5522f01c on hv-cinder-85367 Aug 18 22:35:08.878579 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-c9b7ba03-148c-460f-aed4-866ac8f7091c req-3204fa62-d652-4453-95f1-cdd9cfdfcd9a service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030429 Aug 18 22:35:08.879243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2281/4559] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:35:16.393654 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-1dc9f0d8-8871-438c-9247-1658884343e5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:16.394159 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1dc9f0d8-8871-438c-9247-1658884343e5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:35:16.401528 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dc9f0d8-8871-438c-9247-1658884343e5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:16.402074 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dc9f0d8-8871-438c-9247-1658884343e5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:16.402515 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dc9f0d8-8871-438c-9247-1658884343e5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:16.403219 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dc9f0d8-8871-438c-9247-1658884343e5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:16.403676 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dc9f0d8-8871-438c-9247-1658884343e5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:16.404103 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-1dc9f0d8-8871-438c-9247-1658884343e5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:16.429253 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-1dc9f0d8-8871-438c-9247-1658884343e5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:35:16.447487 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-1901e920-9237-4fbb-aec0-b2c32f42f82f req-4738f099-70ed-4918-84e9-ed23624c8eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3e60ed1-0091-4e24-8cfa-b854eed71bf4", "tag": "f7486d36-da4f-4543-8560-136f47b31774"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:35:16.457045 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1901e920-9237-4fbb-aec0-b2c32f42f82f req-4738f099-70ed-4918-84e9-ed23624c8eb0 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:16.457529 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1901e920-9237-4fbb-aec0-b2c32f42f82f req-4738f099-70ed-4918-84e9-ed23624c8eb0 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:16.457988 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-1901e920-9237-4fbb-aec0-b2c32f42f82f req-4738f099-70ed-4918-84e9-ed23624c8eb0 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:16.469803 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-1901e920-9237-4fbb-aec0-b2c32f42f82f req-4738f099-70ed-4918-84e9-ed23624c8eb0 service nova] Creating event network-changed:f7486d36-da4f-4543-8560-136f47b31774 for instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 on hv-cinder-85367 Aug 18 22:35:16.474957 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-1901e920-9237-4fbb-aec0-b2c32f42f82f req-4738f099-70ed-4918-84e9-ed23624c8eb0 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088590 Aug 18 22:35:16.476459 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2282/4560] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:35:16.535092 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-1dc9f0d8-8871-438c-9247-1658884343e5 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "DELETE /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 204 len: 0 microversion: 2.1 time: 0.150431 Aug 18 22:35:16.535854 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2279/4561] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:35:16 2022] DELETE /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:35:16.545426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-9bbefdab-ec29-4a61-9379-81dfef98bc70 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:16.546277 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-9bbefdab-ec29-4a61-9379-81dfef98bc70 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:35:16.552837 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bbefdab-ec29-4a61-9379-81dfef98bc70 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:16.553389 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bbefdab-ec29-4a61-9379-81dfef98bc70 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:16.554100 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bbefdab-ec29-4a61-9379-81dfef98bc70 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:16.554869 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bbefdab-ec29-4a61-9379-81dfef98bc70 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:16.555452 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bbefdab-ec29-4a61-9379-81dfef98bc70 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:16.555972 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-9bbefdab-ec29-4a61-9379-81dfef98bc70 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:16.692752 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-9bbefdab-ec29-4a61-9379-81dfef98bc70 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:35:16.702668 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-9bbefdab-ec29-4a61-9379-81dfef98bc70 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.161960 Aug 18 22:35:16.703259 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2283/4562] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:35:16 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:35:17.724784 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-81bf3ad0-c848-4417-b0d5-6468f2a156f6 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:17.725499 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-81bf3ad0-c848-4417-b0d5-6468f2a156f6 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:35:17.732576 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81bf3ad0-c848-4417-b0d5-6468f2a156f6 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:17.733068 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81bf3ad0-c848-4417-b0d5-6468f2a156f6 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:17.733511 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81bf3ad0-c848-4417-b0d5-6468f2a156f6 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:17.734271 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81bf3ad0-c848-4417-b0d5-6468f2a156f6 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:17.734735 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81bf3ad0-c848-4417-b0d5-6468f2a156f6 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:17.735170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-81bf3ad0-c848-4417-b0d5-6468f2a156f6 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:17.939737 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-81bf3ad0-c848-4417-b0d5-6468f2a156f6 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:35:17.948210 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-81bf3ad0-c848-4417-b0d5-6468f2a156f6 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1566 microversion: 2.1 time: 0.227658 Aug 18 22:35:17.948788 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2280/4563] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:35:17 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1566 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:35:18.650316 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-f1ce27b6-ca0c-440c-97e7-b46eda2a40d4 req-c42eab0d-7565-447f-b311-5ed6bdd86b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3e60ed1-0091-4e24-8cfa-b854eed71bf4", "name": "network-vif-deleted", "tag": "f7486d36-da4f-4543-8560-136f47b31774"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:35:18.656847 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:35:18.664077 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-f1ce27b6-ca0c-440c-97e7-b46eda2a40d4 req-c42eab0d-7565-447f-b311-5ed6bdd86b23 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:18.664672 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-f1ce27b6-ca0c-440c-97e7-b46eda2a40d4 req-c42eab0d-7565-447f-b311-5ed6bdd86b23 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:18.665158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-f1ce27b6-ca0c-440c-97e7-b46eda2a40d4 req-c42eab0d-7565-447f-b311-5ed6bdd86b23 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:18.670201 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:35:18.681885 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-f1ce27b6-ca0c-440c-97e7-b46eda2a40d4 req-c42eab0d-7565-447f-b311-5ed6bdd86b23 service nova] Creating event network-vif-deleted:f7486d36-da4f-4543-8560-136f47b31774 for instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 on hv-cinder-85367 Aug 18 22:35:18.686889 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-f1ce27b6-ca0c-440c-97e7-b46eda2a40d4 req-c42eab0d-7565-447f-b311-5ed6bdd86b23 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039949 Aug 18 22:35:18.687490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2284/4564] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:35:18.969781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:18.971049 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:35:18.974781 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:35:18.979928 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:18.980667 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:18.981178 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:18.982083 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:18.982545 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:18.982991 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:18.988590 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:35:19.022384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:19.022868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:19.023307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:19.023764 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lazy-loading 'fault' on Instance uuid a3e60ed1-0091-4e24-8cfa-b854eed71bf4 {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:35:19.067432 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e7526ef9eb0426a855f5b2b9be06a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c01cdc6c55b4fdf999fbc75c1f4b51b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:35:19.075534 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-58284c87-71bb-492a-a0ee-a0ff3cdf4b6c tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 200 len: 1222 microversion: 2.1 time: 0.109846 Aug 18 22:35:19.076475 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2281/4565] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:35:18 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 1222 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:35:20.097371 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-58af7d82-04b7-4fbd-aa17-984789425046 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:20.098112 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-58af7d82-04b7-4fbd-aa17-984789425046 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] [instance: a3e60ed1-0091-4e24-8cfa-b854eed71bf4] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:35:20.106083 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58af7d82-04b7-4fbd-aa17-984789425046 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:20.106560 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58af7d82-04b7-4fbd-aa17-984789425046 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:20.106991 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58af7d82-04b7-4fbd-aa17-984789425046 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:20.107675 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58af7d82-04b7-4fbd-aa17-984789425046 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:35:20.108123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58af7d82-04b7-4fbd-aa17-984789425046 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:35:20.108550 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-58af7d82-04b7-4fbd-aa17-984789425046 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:35:20.121798 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-58af7d82-04b7-4fbd-aa17-984789425046 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] HTTP exception thrown: Instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 could not be found. Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-58af7d82-04b7-4fbd-aa17-984789425046 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Request method failure captured: Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 HTTP/1.1 Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_r12GHytGqf2jgomI3XUV-XV83bYB9KIQbrUx0-27jKwkLr6-F7b7CEnVU2WkU9L0DO2KXSLYz0_dkFahmBT2cga-RYRNEWbd-7P2JqTLdLvPgDvO8HJ9T7ZJP95-vIu-GuCiscRix_al_zQVSSzGx150OOk221-OGsl7eamc5dfP_k Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 6c01cdc6c55b4fdf999fbc75c1f4b51b Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestShelveInstance-518655587 Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:35:20.123425 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:35:20.125047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_6c01cdc6c55b4fdf999fbc75c1f4b51b", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/6c01cdc6c55b4fdf999fbc75c1f4b51b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6c01cdc6c55b4fdf999fbc75c1f4b51b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/6c01cdc6c55b4fdf999fbc75c1f4b51b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:35:20.125047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestShelveInstance-518655587 Aug 18 22:35:20.125047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 6c01cdc6c55b4fdf999fbc75c1f4b51b Aug 18 22:35:20.125047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestShelveInstance-518655587 Aug 18 22:35:20.125047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-TestShelveInstance-518655587-project Aug 18 22:35:20.125047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:35:20.125047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:35:20.125047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 3e7526ef9eb0426a855f5b2b9be06a8d Aug 18 22:35:20.125047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestShelveInstance-518655587-project Aug 18 22:35:20.125047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:35:20.125047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 could not be found. Aug 18 22:35:20.125047 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': 'a3e60ed1-0091-4e24-8cfa-b854eed71bf4'} Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 could not be found. Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:35:20.126087 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 could not be found. Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 could not be found. Aug 18 22:35:20.127587 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:35:20.129132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-58af7d82-04b7-4fbd-aa17-984789425046 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Returning 404 to user: Instance a3e60ed1-0091-4e24-8cfa-b854eed71bf4 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:35:20.129132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-58af7d82-04b7-4fbd-aa17-984789425046 tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4" status: 404 len: 111 microversion: 2.1 time: 0.032252 Aug 18 22:35:20.129132 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2285/4566] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:35:20 2022] GET /compute/v2.1/servers/a3e60ed1-0091-4e24-8cfa-b854eed71bf4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:35:20.287596 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-294f5d54-d128-49cd-ab93-07aea45fb74b tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] Calling method '.version_select at 0x7fd88e574940>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:35:20.310882 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-294f5d54-d128-49cd-ab93-07aea45fb74b tempest-TestShelveInstance-518655587 tempest-TestShelveInstance-518655587-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-8096190" status: 202 len: 0 microversion: 2.1 time: 0.027103 Aug 18 22:35:20.311603 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2282/4567] 10.222.0.82 () {58 vars in 1245 bytes} [Thu Aug 18 22:35:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-8096190 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:36:37.106268 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:36:37.106912 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:36:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:36:47.097772 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:36:47.098520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:36:47.103533 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1544605616", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1846540149", "security_groups": [{"name": "tempest-secgroup-smoke-572671450"}], "block_device_mapping_v2": [{"uuid": "b16fd886-ed6d-4efa-b3d7-cf3ba6b0fc4b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b548c6e2-7c22-43ce-bce7-a8a12822a8af"}]}} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:36:47.218228 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.network.neutron [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] validate_networks() for [('b548c6e2-7c22-43ce-bce7-a8a12822a8af', None, None, None, None, None)] {{(pid=120539) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 22:36:47.581801 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Flavor limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 22:36:47.582232 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Image limits 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 22:36:47.582710 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Flavor pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 22:36:47.583125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Image pref 0:0:0 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 22:36:47.583541 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.virt.hardware [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 22:36:47.592381 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:47.592861 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:47.593295 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:47.594046 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:47.594497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:47.594921 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:47.611406 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Getting quotas for project 5a5733a14ade43e48f6a039a5075e63c. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 22:36:47.615368 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.quota [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Getting quotas for user 4b4e033fbc0d438ca9a3f954d53c891e and project 5a5733a14ade43e48f6a039a5075e63c. Resources: {'instances', 'cores', 'ram'} {{(pid=120539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 22:36:47.671377 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Going to run 1 instances... {{(pid=120539) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 22:36:47.673474 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b16fd886-ed6d-4efa-b3d7-cf3ba6b0fc4b',volume_size=None,volume_type=None)] {{(pid=120539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 22:36:47.806769 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-838f307b-ba8a-4ad1-b4c9-7a7330d0fa54 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.710663 Aug 18 22:36:47.807383 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2286/4568] 10.222.0.82 () {60 vars in 1147 bytes} [Thu Aug 18 22:36:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 22:36:47.816571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=7 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:36:47.817297 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:36:47.821509 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-6d35fef2-bb66-4df2-a312-4979bdf09999 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:36:47.822262 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-6d35fef2-bb66-4df2-a312-4979bdf09999 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:36:47.877656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-6d35fef2-bb66-4df2-a312-4979bdf09999 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:36:47.884546 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-6d35fef2-bb66-4df2-a312-4979bdf09999 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1095 microversion: 2.1 time: 0.070219 Aug 18 22:36:47.885080 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2283/4569] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:36:47 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:36:48.904607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-b681af16-2cc0-4309-9c90-741981ff259d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:36:48.905365 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-b681af16-2cc0-4309-9c90-741981ff259d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:36:48.912022 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b681af16-2cc0-4309-9c90-741981ff259d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:48.912510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b681af16-2cc0-4309-9c90-741981ff259d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:48.912961 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b681af16-2cc0-4309-9c90-741981ff259d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:48.913699 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b681af16-2cc0-4309-9c90-741981ff259d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:48.914156 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b681af16-2cc0-4309-9c90-741981ff259d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:48.914575 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-b681af16-2cc0-4309-9c90-741981ff259d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:48.982399 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-b681af16-2cc0-4309-9c90-741981ff259d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:36:48.990111 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-b681af16-2cc0-4309-9c90-741981ff259d tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1211 microversion: 2.1 time: 0.089525 Aug 18 22:36:48.990923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2287/4570] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:36:48 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:36:50.011177 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-f67bea66-fad1-4ab6-a619-b443a02bc2af tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:36:50.011804 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-f67bea66-fad1-4ab6-a619-b443a02bc2af tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:36:50.017945 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f67bea66-fad1-4ab6-a619-b443a02bc2af tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:50.018431 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f67bea66-fad1-4ab6-a619-b443a02bc2af tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:50.018868 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f67bea66-fad1-4ab6-a619-b443a02bc2af tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:50.019565 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f67bea66-fad1-4ab6-a619-b443a02bc2af tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:50.020020 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f67bea66-fad1-4ab6-a619-b443a02bc2af tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:50.020451 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-f67bea66-fad1-4ab6-a619-b443a02bc2af tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:50.066630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-b23ad872-689e-42c8-81c1-bf5259b24936 req-e9d0f5da-66c4-4ede-803c-e892bc43e2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e7efca6-fb65-4938-9120-d56c34d6462e", "tag": "c9af087a-2930-4248-a079-9b5c5d7190d2"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:36:50.076871 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b23ad872-689e-42c8-81c1-bf5259b24936 req-e9d0f5da-66c4-4ede-803c-e892bc43e2b9 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:50.077358 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b23ad872-689e-42c8-81c1-bf5259b24936 req-e9d0f5da-66c4-4ede-803c-e892bc43e2b9 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:50.078123 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-b23ad872-689e-42c8-81c1-bf5259b24936 req-e9d0f5da-66c4-4ede-803c-e892bc43e2b9 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:50.089435 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-b23ad872-689e-42c8-81c1-bf5259b24936 req-e9d0f5da-66c4-4ede-803c-e892bc43e2b9 service nova] Creating event network-changed:c9af087a-2930-4248-a079-9b5c5d7190d2 for instance 0e7efca6-fb65-4938-9120-d56c34d6462e on hv-cinder-85367 Aug 18 22:36:50.094216 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-b23ad872-689e-42c8-81c1-bf5259b24936 req-e9d0f5da-66c4-4ede-803c-e892bc43e2b9 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031873 Aug 18 22:36:50.094806 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2288/4571] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:36:50.289455 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-f67bea66-fad1-4ab6-a619-b443a02bc2af tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:36:50.297867 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-f67bea66-fad1-4ab6-a619-b443a02bc2af tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1266 microversion: 2.1 time: 0.290373 Aug 18 22:36:50.298453 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2284/4572] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:36:50 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:36:51.320509 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-d5d4af31-baa4-4b10-84ef-5ef572a09758 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:36:51.321907 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-d5d4af31-baa4-4b10-84ef-5ef572a09758 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:36:51.328208 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5d4af31-baa4-4b10-84ef-5ef572a09758 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:51.328689 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5d4af31-baa4-4b10-84ef-5ef572a09758 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:51.329125 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5d4af31-baa4-4b10-84ef-5ef572a09758 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:51.329835 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5d4af31-baa4-4b10-84ef-5ef572a09758 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:51.330287 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5d4af31-baa4-4b10-84ef-5ef572a09758 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:51.330711 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-d5d4af31-baa4-4b10-84ef-5ef572a09758 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:51.459726 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-d5d4af31-baa4-4b10-84ef-5ef572a09758 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:36:51.467304 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-d5d4af31-baa4-4b10-84ef-5ef572a09758 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1266 microversion: 2.1 time: 0.151699 Aug 18 22:36:51.467864 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2289/4573] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:36:51 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:36:52.488611 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-07fe608c-3687-48e4-836b-a6433114e14e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:36:52.489261 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-07fe608c-3687-48e4-836b-a6433114e14e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:36:52.495728 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07fe608c-3687-48e4-836b-a6433114e14e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:52.496216 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07fe608c-3687-48e4-836b-a6433114e14e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:52.496659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07fe608c-3687-48e4-836b-a6433114e14e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:52.497358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07fe608c-3687-48e4-836b-a6433114e14e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:52.497845 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07fe608c-3687-48e4-836b-a6433114e14e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:52.498313 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-07fe608c-3687-48e4-836b-a6433114e14e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:52.633060 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-07fe608c-3687-48e4-836b-a6433114e14e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:36:52.641399 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-07fe608c-3687-48e4-836b-a6433114e14e tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1266 microversion: 2.1 time: 0.156773 Aug 18 22:36:52.641984 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2285/4574] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:36:52 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:36:53.661744 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-ce76ee55-2e12-4eb6-8323-7ba767fb0244 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:36:53.662413 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-ce76ee55-2e12-4eb6-8323-7ba767fb0244 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:36:53.669571 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce76ee55-2e12-4eb6-8323-7ba767fb0244 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:53.670104 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce76ee55-2e12-4eb6-8323-7ba767fb0244 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:53.670537 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce76ee55-2e12-4eb6-8323-7ba767fb0244 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:53.671217 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce76ee55-2e12-4eb6-8323-7ba767fb0244 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:53.671669 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce76ee55-2e12-4eb6-8323-7ba767fb0244 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:53.672090 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-ce76ee55-2e12-4eb6-8323-7ba767fb0244 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:53.799754 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-ce76ee55-2e12-4eb6-8323-7ba767fb0244 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:36:53.807415 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-ce76ee55-2e12-4eb6-8323-7ba767fb0244 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1266 microversion: 2.1 time: 0.149514 Aug 18 22:36:53.807987 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2290/4575] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:36:53 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:36:54.827967 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-8f091165-86bf-4eef-8aa5-533bb4b9fba9 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:36:54.828594 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-8f091165-86bf-4eef-8aa5-533bb4b9fba9 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:36:54.835251 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f091165-86bf-4eef-8aa5-533bb4b9fba9 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:54.835741 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f091165-86bf-4eef-8aa5-533bb4b9fba9 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:54.836187 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f091165-86bf-4eef-8aa5-533bb4b9fba9 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:54.837375 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f091165-86bf-4eef-8aa5-533bb4b9fba9 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:54.837873 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f091165-86bf-4eef-8aa5-533bb4b9fba9 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:54.838308 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-8f091165-86bf-4eef-8aa5-533bb4b9fba9 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:54.971783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-8f091165-86bf-4eef-8aa5-533bb4b9fba9 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:36:54.980230 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-8f091165-86bf-4eef-8aa5-533bb4b9fba9 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1266 microversion: 2.1 time: 0.156161 Aug 18 22:36:54.980815 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2286/4576] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:36:54 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:36:56.001813 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-8a9b2045-da60-4540-a038-144a006aa958 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:36:56.002352 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-8a9b2045-da60-4540-a038-144a006aa958 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:36:56.008989 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a9b2045-da60-4540-a038-144a006aa958 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:56.009477 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a9b2045-da60-4540-a038-144a006aa958 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:56.009946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a9b2045-da60-4540-a038-144a006aa958 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:56.010645 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a9b2045-da60-4540-a038-144a006aa958 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:56.011102 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a9b2045-da60-4540-a038-144a006aa958 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:56.011561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-8a9b2045-da60-4540-a038-144a006aa958 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:56.144532 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-8a9b2045-da60-4540-a038-144a006aa958 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:36:56.153739 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-8a9b2045-da60-4540-a038-144a006aa958 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1266 microversion: 2.1 time: 0.155769 Aug 18 22:36:56.154321 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2291/4577] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:36:55 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:36:57.174829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2ed6c8de-8792-4cec-9805-73905f5c6b04 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:36:57.175446 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2ed6c8de-8792-4cec-9805-73905f5c6b04 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:36:57.182571 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ed6c8de-8792-4cec-9805-73905f5c6b04 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:57.183057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ed6c8de-8792-4cec-9805-73905f5c6b04 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:57.183495 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ed6c8de-8792-4cec-9805-73905f5c6b04 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:57.184182 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ed6c8de-8792-4cec-9805-73905f5c6b04 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:57.184641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ed6c8de-8792-4cec-9805-73905f5c6b04 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:57.185063 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2ed6c8de-8792-4cec-9805-73905f5c6b04 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:57.313524 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2ed6c8de-8792-4cec-9805-73905f5c6b04 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:36:57.321506 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2ed6c8de-8792-4cec-9805-73905f5c6b04 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1266 microversion: 2.1 time: 0.150529 Aug 18 22:36:57.322777 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2287/4578] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:36:57 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:36:58.344836 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-65a2214b-d0a5-4f5f-ab0e-fda62f7f5117 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:36:58.345498 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-65a2214b-d0a5-4f5f-ab0e-fda62f7f5117 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:36:58.348925 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=2 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:36:58.349741 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell0:SELECT=6 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:36:58.354035 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65a2214b-d0a5-4f5f-ab0e-fda62f7f5117 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:58.354520 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65a2214b-d0a5-4f5f-ab0e-fda62f7f5117 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:58.354951 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65a2214b-d0a5-4f5f-ab0e-fda62f7f5117 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:58.355636 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65a2214b-d0a5-4f5f-ab0e-fda62f7f5117 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:58.356085 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65a2214b-d0a5-4f5f-ab0e-fda62f7f5117 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:58.356507 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-65a2214b-d0a5-4f5f-ab0e-fda62f7f5117 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:58.485565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-65a2214b-d0a5-4f5f-ab0e-fda62f7f5117 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:36:58.494188 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-65a2214b-d0a5-4f5f-ab0e-fda62f7f5117 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1266 microversion: 2.1 time: 0.152976 Aug 18 22:36:58.494928 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2292/4579] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:36:58 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:36:59.514720 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-cb16f641-bc89-4694-9817-ab2bd6f11b43 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:36:59.515280 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-cb16f641-bc89-4694-9817-ab2bd6f11b43 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:36:59.517150 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell0:SELECT=2 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:36:59.522998 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb16f641-bc89-4694-9817-ab2bd6f11b43 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:59.523486 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb16f641-bc89-4694-9817-ab2bd6f11b43 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:59.523931 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb16f641-bc89-4694-9817-ab2bd6f11b43 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:59.524627 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb16f641-bc89-4694-9817-ab2bd6f11b43 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:36:59.525588 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb16f641-bc89-4694-9817-ab2bd6f11b43 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:36:59.526050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-cb16f641-bc89-4694-9817-ab2bd6f11b43 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:36:59.662970 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-cb16f641-bc89-4694-9817-ab2bd6f11b43 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:36:59.671343 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-cb16f641-bc89-4694-9817-ab2bd6f11b43 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1266 microversion: 2.1 time: 0.160553 Aug 18 22:36:59.671909 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2288/4580] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:36:59 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:37:00.052557 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-d9984b2b-78d3-4be8-8741-3c41ad9d888c req-322469d2-a792-47e9-9b28-1a2f1a61f514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7efca6-fb65-4938-9120-d56c34d6462e", "name": "network-vif-plugged", "status": "completed", "tag": "c9af087a-2930-4248-a079-9b5c5d7190d2"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:37:00.063158 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d9984b2b-78d3-4be8-8741-3c41ad9d888c req-322469d2-a792-47e9-9b28-1a2f1a61f514 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:37:00.063640 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d9984b2b-78d3-4be8-8741-3c41ad9d888c req-322469d2-a792-47e9-9b28-1a2f1a61f514 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:37:00.064066 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-d9984b2b-78d3-4be8-8741-3c41ad9d888c req-322469d2-a792-47e9-9b28-1a2f1a61f514 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:37:00.076404 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-d9984b2b-78d3-4be8-8741-3c41ad9d888c req-322469d2-a792-47e9-9b28-1a2f1a61f514 service nova] Creating event network-vif-plugged:c9af087a-2930-4248-a079-9b5c5d7190d2 for instance 0e7efca6-fb65-4938-9120-d56c34d6462e on hv-cinder-85367 Aug 18 22:37:00.081249 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-d9984b2b-78d3-4be8-8741-3c41ad9d888c req-322469d2-a792-47e9-9b28-1a2f1a61f514 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032530 Aug 18 22:37:00.081877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2293/4581] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:37:00.691220 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a9876120-d20d-463e-b8bf-f56be0c4b955 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:37:00.692682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-a9876120-d20d-463e-b8bf-f56be0c4b955 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:37:00.699311 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9876120-d20d-463e-b8bf-f56be0c4b955 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:37:00.699797 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9876120-d20d-463e-b8bf-f56be0c4b955 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:37:00.700239 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9876120-d20d-463e-b8bf-f56be0c4b955 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:37:00.700933 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9876120-d20d-463e-b8bf-f56be0c4b955 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:37:00.701424 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9876120-d20d-463e-b8bf-f56be0c4b955 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:37:00.701885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-a9876120-d20d-463e-b8bf-f56be0c4b955 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:37:00.828893 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-a9876120-d20d-463e-b8bf-f56be0c4b955 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:37:00.836543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a9876120-d20d-463e-b8bf-f56be0c4b955 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1266 microversion: 2.1 time: 0.149281 Aug 18 22:37:00.837104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2289/4582] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:37:00 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:37:01.858553 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bedad80d-e9e7-42bb-9236-adcf75d54f9b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:37:01.859252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bedad80d-e9e7-42bb-9236-adcf75d54f9b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:37:01.865857 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bedad80d-e9e7-42bb-9236-adcf75d54f9b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:37:01.866325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bedad80d-e9e7-42bb-9236-adcf75d54f9b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:37:01.866759 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bedad80d-e9e7-42bb-9236-adcf75d54f9b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:37:01.867455 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bedad80d-e9e7-42bb-9236-adcf75d54f9b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:37:01.867906 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bedad80d-e9e7-42bb-9236-adcf75d54f9b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:37:01.868325 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bedad80d-e9e7-42bb-9236-adcf75d54f9b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:37:02.005349 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-bedad80d-e9e7-42bb-9236-adcf75d54f9b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:37:02.013038 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bedad80d-e9e7-42bb-9236-adcf75d54f9b tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1452 microversion: 2.1 time: 0.159253 Aug 18 22:37:02.013632 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2294/4583] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:37:01 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:37:02.032939 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-2fc0a5da-0ae2-4f52-8b91-56131232bdf1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:37:02.033553 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-2fc0a5da-0ae2-4f52-8b91-56131232bdf1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:37:02.040391 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fc0a5da-0ae2-4f52-8b91-56131232bdf1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:37:02.041456 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fc0a5da-0ae2-4f52-8b91-56131232bdf1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:37:02.041872 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fc0a5da-0ae2-4f52-8b91-56131232bdf1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:37:02.042555 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fc0a5da-0ae2-4f52-8b91-56131232bdf1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:37:02.043003 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fc0a5da-0ae2-4f52-8b91-56131232bdf1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:37:02.043422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-2fc0a5da-0ae2-4f52-8b91-56131232bdf1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:37:02.174801 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-2fc0a5da-0ae2-4f52-8b91-56131232bdf1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:37:02.183248 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-2fc0a5da-0ae2-4f52-8b91-56131232bdf1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1452 microversion: 2.1 time: 0.153412 Aug 18 22:37:02.183727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2290/4584] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:37:02 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:37:03.974257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-8abdf4d1-abf4-4919-859e-23357fd13720 req-59d0c12b-5635-4afc-8cc0-7b91279426e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e7efca6-fb65-4938-9120-d56c34d6462e", "tag": "c9af087a-2930-4248-a079-9b5c5d7190d2"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:37:03.984426 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-8abdf4d1-abf4-4919-859e-23357fd13720 req-59d0c12b-5635-4afc-8cc0-7b91279426e8 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:37:03.984905 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-8abdf4d1-abf4-4919-859e-23357fd13720 req-59d0c12b-5635-4afc-8cc0-7b91279426e8 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:37:03.985334 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-8abdf4d1-abf4-4919-859e-23357fd13720 req-59d0c12b-5635-4afc-8cc0-7b91279426e8 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:37:03.996179 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-8abdf4d1-abf4-4919-859e-23357fd13720 req-59d0c12b-5635-4afc-8cc0-7b91279426e8 service nova] Creating event network-changed:c9af087a-2930-4248-a079-9b5c5d7190d2 for instance 0e7efca6-fb65-4938-9120-d56c34d6462e on hv-cinder-85367 Aug 18 22:37:04.000923 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-8abdf4d1-abf4-4919-859e-23357fd13720 req-59d0c12b-5635-4afc-8cc0-7b91279426e8 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030503 Aug 18 22:37:04.001698 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2295/4585] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:38:15.593135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:38:15.593891 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:38:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:38:17.515813 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:38:17.516400 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:38:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:38:31.885218 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_api:SELECT=18 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:38:31.886196 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG dbcounter [-] [120538] Writing DB stats nova_cell1:SELECT=42 {{(pid=120538) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:38:31.887997 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:38:31.888730 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG dbcounter [-] [120539] Writing DB stats nova_cell1:SELECT=44 {{(pid=120539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 22:38:31.892649 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-e7f7e68d-d341-4f4e-ac80-7640545bb665 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:31.893244 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-377a739d-c2bd-40a7-a481-d190de4d42f8 req-be8e71a1-c249-492b-8929-ef278e5b73fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e7efca6-fb65-4938-9120-d56c34d6462e", "tag": "c9af087a-2930-4248-a079-9b5c5d7190d2"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:38:31.893384 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e7f7e68d-d341-4f4e-ac80-7640545bb665 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:38:31.900678 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7f7e68d-d341-4f4e-ac80-7640545bb665 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:31.901433 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7f7e68d-d341-4f4e-ac80-7640545bb665 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:31.901656 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7f7e68d-d341-4f4e-ac80-7640545bb665 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:31.902532 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7f7e68d-d341-4f4e-ac80-7640545bb665 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:31.902921 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7f7e68d-d341-4f4e-ac80-7640545bb665 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:31.903727 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-e7f7e68d-d341-4f4e-ac80-7640545bb665 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:31.904270 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-377a739d-c2bd-40a7-a481-d190de4d42f8 req-be8e71a1-c249-492b-8929-ef278e5b73fb service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:31.904747 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-377a739d-c2bd-40a7-a481-d190de4d42f8 req-be8e71a1-c249-492b-8929-ef278e5b73fb service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:31.905173 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-377a739d-c2bd-40a7-a481-d190de4d42f8 req-be8e71a1-c249-492b-8929-ef278e5b73fb service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:31.918117 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-377a739d-c2bd-40a7-a481-d190de4d42f8 req-be8e71a1-c249-492b-8929-ef278e5b73fb service nova] Creating event network-changed:c9af087a-2930-4248-a079-9b5c5d7190d2 for instance 0e7efca6-fb65-4938-9120-d56c34d6462e on hv-cinder-85367 Aug 18 22:38:31.923795 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-377a739d-c2bd-40a7-a481-d190de4d42f8 req-be8e71a1-c249-492b-8929-ef278e5b73fb service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038329 Aug 18 22:38:31.924606 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2296/4586] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:38:31.931666 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-e7f7e68d-d341-4f4e-ac80-7640545bb665 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:38:32.021050 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-e7f7e68d-d341-4f4e-ac80-7640545bb665 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "DELETE /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 204 len: 0 microversion: 2.1 time: 0.137900 Aug 18 22:38:32.022247 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2291/4587] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:38:31 2022] DELETE /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:38:32.031637 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-2c0be4cf-ec1e-4faa-8044-173412feb737 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:32.032612 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-2c0be4cf-ec1e-4faa-8044-173412feb737 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:38:32.039010 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c0be4cf-ec1e-4faa-8044-173412feb737 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:32.039497 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c0be4cf-ec1e-4faa-8044-173412feb737 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:32.040187 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c0be4cf-ec1e-4faa-8044-173412feb737 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:32.040887 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c0be4cf-ec1e-4faa-8044-173412feb737 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:32.041490 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c0be4cf-ec1e-4faa-8044-173412feb737 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:32.041792 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-2c0be4cf-ec1e-4faa-8044-173412feb737 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:32.183607 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-2c0be4cf-ec1e-4faa-8044-173412feb737 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:38:32.192755 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-2c0be4cf-ec1e-4faa-8044-173412feb737 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1576 microversion: 2.1 time: 0.165267 Aug 18 22:38:32.193565 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2297/4588] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:38:32 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:38:33.215273 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-89030924-50c8-4d79-a29d-f07ad4b817d6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:33.215985 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-89030924-50c8-4d79-a29d-f07ad4b817d6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:38:33.223198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89030924-50c8-4d79-a29d-f07ad4b817d6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:33.223617 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89030924-50c8-4d79-a29d-f07ad4b817d6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:33.224057 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89030924-50c8-4d79-a29d-f07ad4b817d6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:33.224740 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89030924-50c8-4d79-a29d-f07ad4b817d6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:33.225192 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89030924-50c8-4d79-a29d-f07ad4b817d6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:33.225636 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-89030924-50c8-4d79-a29d-f07ad4b817d6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:33.427025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-89030924-50c8-4d79-a29d-f07ad4b817d6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:38:33.434761 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-89030924-50c8-4d79-a29d-f07ad4b817d6 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1576 microversion: 2.1 time: 0.223780 Aug 18 22:38:33.435429 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2292/4589] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:38:33 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1576 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 22:38:34.409245 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-136573f8-0256-432c-b567-9c42a3c8128d req-a2f12cab-2327-42d9-8c47-c689593da7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7efca6-fb65-4938-9120-d56c34d6462e", "name": "network-vif-deleted", "tag": "c9af087a-2930-4248-a079-9b5c5d7190d2"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:38:34.420012 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-136573f8-0256-432c-b567-9c42a3c8128d req-a2f12cab-2327-42d9-8c47-c689593da7a4 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:34.420591 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-136573f8-0256-432c-b567-9c42a3c8128d req-a2f12cab-2327-42d9-8c47-c689593da7a4 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:34.421064 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-136573f8-0256-432c-b567-9c42a3c8128d req-a2f12cab-2327-42d9-8c47-c689593da7a4 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:34.432742 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-136573f8-0256-432c-b567-9c42a3c8128d req-a2f12cab-2327-42d9-8c47-c689593da7a4 service nova] Creating event network-vif-deleted:c9af087a-2930-4248-a079-9b5c5d7190d2 for instance 0e7efca6-fb65-4938-9120-d56c34d6462e on hv-cinder-85367 Aug 18 22:38:34.437539 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-136573f8-0256-432c-b567-9c42a3c8128d req-a2f12cab-2327-42d9-8c47-c689593da7a4 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032596 Aug 18 22:38:34.438238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2298/4590] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 22:38:34.460055 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-b73e6671-9097-46ae-9efd-52c1184365e1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:34.461120 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-b73e6671-9097-46ae-9efd-52c1184365e1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:38:34.471194 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b73e6671-9097-46ae-9efd-52c1184365e1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:34.471973 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b73e6671-9097-46ae-9efd-52c1184365e1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:34.472682 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b73e6671-9097-46ae-9efd-52c1184365e1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:34.473841 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b73e6671-9097-46ae-9efd-52c1184365e1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:34.474607 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b73e6671-9097-46ae-9efd-52c1184365e1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:34.475312 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-b73e6671-9097-46ae-9efd-52c1184365e1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:34.539659 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-b73e6671-9097-46ae-9efd-52c1184365e1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:38:34.547582 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-b73e6671-9097-46ae-9efd-52c1184365e1 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 200 len: 1226 microversion: 2.1 time: 0.094071 Aug 18 22:38:34.548154 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2293/4591] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:38:34 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:38:35.569330 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d62185d-6175-4004-92f0-d5cba1e238cb tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:35.570060 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-1d62185d-6175-4004-92f0-d5cba1e238cb tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 0e7efca6-fb65-4938-9120-d56c34d6462e] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:38:35.576124 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d62185d-6175-4004-92f0-d5cba1e238cb tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:35.576600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d62185d-6175-4004-92f0-d5cba1e238cb tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:35.577031 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d62185d-6175-4004-92f0-d5cba1e238cb tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:35.577740 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d62185d-6175-4004-92f0-d5cba1e238cb tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:35.578191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d62185d-6175-4004-92f0-d5cba1e238cb tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:35.578610 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-1d62185d-6175-4004-92f0-d5cba1e238cb tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:35.591543 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-1d62185d-6175-4004-92f0-d5cba1e238cb tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] HTTP exception thrown: Instance 0e7efca6-fb65-4938-9120-d56c34d6462e could not be found. Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d62185d-6175-4004-92f0-d5cba1e238cb tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Request method failure captured: Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e HTTP/1.1 Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_r3qFiO4E5e6qC6yntVZ937UD8bJC1NMf0Al0UXDcHu6MNQXbiFRTJr1TlyOvzryDeUE9Yq65cNeeLLiEsyj1tfKdEunOFcejOF4xAmslU-CuhRFGcYyO98hV9Um8HF_UedgnH-3nsuYPDE0VFs7VZ1V7o_c7sPgwjgVX_nHIAk1rlM Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 5a5733a14ade43e48f6a039a5075e63c Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:38:35.593676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:38:35.595276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_5a5733a14ade43e48f6a039a5075e63c", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:38:35.595276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:38:35.595276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 5a5733a14ade43e48f6a039a5075e63c Aug 18 22:38:35.595276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:38:35.595276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-TestVolumeBootPattern-1066322283-project Aug 18 22:38:35.595276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:38:35.595276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:38:35.595276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 4b4e033fbc0d438ca9a3f954d53c891e Aug 18 22:38:35.595276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestVolumeBootPattern-1066322283-project Aug 18 22:38:35.595276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:38:35.595276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance 0e7efca6-fb65-4938-9120-d56c34d6462e could not be found. Aug 18 22:38:35.595276 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': '0e7efca6-fb65-4938-9120-d56c34d6462e'} Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7efca6-fb65-4938-9120-d56c34d6462e could not be found. Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:38:35.596163 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7efca6-fb65-4938-9120-d56c34d6462e could not be found. Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7efca6-fb65-4938-9120-d56c34d6462e could not be found. Aug 18 22:38:35.597630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:35.599048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-1d62185d-6175-4004-92f0-d5cba1e238cb tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Returning 404 to user: Instance 0e7efca6-fb65-4938-9120-d56c34d6462e could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:38:35.599048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-1d62185d-6175-4004-92f0-d5cba1e238cb tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e" status: 404 len: 111 microversion: 2.1 time: 0.030556 Aug 18 22:38:35.599048 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2299/4592] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:38:35 2022] GET /compute/v2.1/servers/0e7efca6-fb65-4938-9120-d56c34d6462e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:38:38.888990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-ad35ed3d-9b07-43ea-ad6b-4f08bd792f33 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:38.889501 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ad35ed3d-9b07-43ea-ad6b-4f08bd792f33 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:38:38.891361 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-0d17c997-9438-4491-be13-77f9244a7e1a req-38a24287-2fef-441a-b3ea-ff0e083419f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b2888c2-c26d-4ddb-b900-fada5522f01c", "tag": "e0061d6f-1eed-49fd-a2a1-d7048b9d07de"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:38:38.896657 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad35ed3d-9b07-43ea-ad6b-4f08bd792f33 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:38.897101 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad35ed3d-9b07-43ea-ad6b-4f08bd792f33 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:38.897543 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad35ed3d-9b07-43ea-ad6b-4f08bd792f33 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:38.898310 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad35ed3d-9b07-43ea-ad6b-4f08bd792f33 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:38.898749 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad35ed3d-9b07-43ea-ad6b-4f08bd792f33 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:38.899180 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-ad35ed3d-9b07-43ea-ad6b-4f08bd792f33 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:38.902500 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0d17c997-9438-4491-be13-77f9244a7e1a req-38a24287-2fef-441a-b3ea-ff0e083419f2 service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:38.903238 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0d17c997-9438-4491-be13-77f9244a7e1a req-38a24287-2fef-441a-b3ea-ff0e083419f2 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:38.903743 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0d17c997-9438-4491-be13-77f9244a7e1a req-38a24287-2fef-441a-b3ea-ff0e083419f2 service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:38.916544 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-0d17c997-9438-4491-be13-77f9244a7e1a req-38a24287-2fef-441a-b3ea-ff0e083419f2 service nova] Creating event network-changed:e0061d6f-1eed-49fd-a2a1-d7048b9d07de for instance 8b2888c2-c26d-4ddb-b900-fada5522f01c on hv-cinder-85367 Aug 18 22:38:38.922243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-0d17c997-9438-4491-be13-77f9244a7e1a req-38a24287-2fef-441a-b3ea-ff0e083419f2 service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035131 Aug 18 22:38:38.923510 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2300/4593] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:38:38.925021 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-ad35ed3d-9b07-43ea-ad6b-4f08bd792f33 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Going to try to terminate instance {{(pid=120538) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 22:38:39.018025 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-ad35ed3d-9b07-43ea-ad6b-4f08bd792f33 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "DELETE /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 204 len: 0 microversion: 2.1 time: 0.132696 Aug 18 22:38:39.022006 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2294/4594] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:38:38 2022] DELETE /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 22:38:39.028143 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-a3b56f2f-b0e9-4550-b7c5-0034ea1327d5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:39.028877 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-a3b56f2f-b0e9-4550-b7c5-0034ea1327d5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:38:39.037108 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3b56f2f-b0e9-4550-b7c5-0034ea1327d5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:39.038370 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3b56f2f-b0e9-4550-b7c5-0034ea1327d5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:39.038920 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3b56f2f-b0e9-4550-b7c5-0034ea1327d5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:39.039721 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3b56f2f-b0e9-4550-b7c5-0034ea1327d5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:39.040257 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3b56f2f-b0e9-4550-b7c5-0034ea1327d5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:39.040897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-a3b56f2f-b0e9-4550-b7c5-0034ea1327d5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:39.177616 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.policy [None req-a3b56f2f-b0e9-4550-b7c5-0034ea1327d5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120539) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:38:39.185548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-a3b56f2f-b0e9-4550-b7c5-0034ea1327d5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1577 microversion: 2.1 time: 0.161895 Aug 18 22:38:39.186152 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2301/4595] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:38:39 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:38:40.207330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-71bb1410-a0a5-4a67-bf9a-e90093766f6a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:40.208046 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-71bb1410-a0a5-4a67-bf9a-e90093766f6a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:38:40.214170 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71bb1410-a0a5-4a67-bf9a-e90093766f6a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:40.214662 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71bb1410-a0a5-4a67-bf9a-e90093766f6a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:40.215104 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71bb1410-a0a5-4a67-bf9a-e90093766f6a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:40.215829 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71bb1410-a0a5-4a67-bf9a-e90093766f6a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:40.216291 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71bb1410-a0a5-4a67-bf9a-e90093766f6a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:40.216723 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-71bb1410-a0a5-4a67-bf9a-e90093766f6a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:40.372129 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-71bb1410-a0a5-4a67-bf9a-e90093766f6a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:38:40.379839 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-71bb1410-a0a5-4a67-bf9a-e90093766f6a tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1577 microversion: 2.1 time: 0.176699 Aug 18 22:38:40.380422 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2295/4596] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:38:40 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:38:40.902630 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [req-0513e17b-16bb-4abf-b572-3f3002b34712 req-c4b7d897-c025-4b3b-96a9-24c48965174c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2888c2-c26d-4ddb-b900-fada5522f01c", "name": "network-vif-deleted", "tag": "e0061d6f-1eed-49fd-a2a1-d7048b9d07de"}]} {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 22:38:40.915661 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0513e17b-16bb-4abf-b572-3f3002b34712 req-c4b7d897-c025-4b3b-96a9-24c48965174c service nova] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:40.916150 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0513e17b-16bb-4abf-b572-3f3002b34712 req-c4b7d897-c025-4b3b-96a9-24c48965174c service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:40.916586 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [req-0513e17b-16bb-4abf-b572-3f3002b34712 req-c4b7d897-c025-4b3b-96a9-24c48965174c service nova] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:40.928024 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.compute.server_external_events [req-0513e17b-16bb-4abf-b572-3f3002b34712 req-c4b7d897-c025-4b3b-96a9-24c48965174c service nova] Creating event network-vif-deleted:e0061d6f-1eed-49fd-a2a1-d7048b9d07de for instance 8b2888c2-c26d-4ddb-b900-fada5522f01c on hv-cinder-85367 Aug 18 22:38:40.932626 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [req-0513e17b-16bb-4abf-b572-3f3002b34712 req-c4b7d897-c025-4b3b-96a9-24c48965174c service nova] 10.222.0.82 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033696 Aug 18 22:38:40.933243 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2302/4597] 10.222.0.82 () {64 vars in 1317 bytes} [Thu Aug 18 22:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 22:38:41.400334 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:41.400955 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:38:41.407397 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:41.407885 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:41.408327 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:41.409024 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:41.409482 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:41.410542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:41.443328 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:41.443910 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:41.444358 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:41.444817 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.objects.instance [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lazy-loading 'fault' on Instance uuid 8b2888c2-c26d-4ddb-b900-fada5522f01c {{(pid=120538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 22:38:41.487004 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.policy [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e033fbc0d438ca9a3f954d53c891e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a5733a14ade43e48f6a039a5075e63c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120538) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 22:38:41.495307 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-11baa50f-9961-4add-889c-d7cb6729cbb0 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 200 len: 1231 microversion: 2.1 time: 0.098823 Aug 18 22:38:41.495877 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2296/4598] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:38:41 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 22:38:42.520953 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-86f40d58-90ea-41a6-9f13-140616aa9859 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:42.521681 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-86f40d58-90ea-41a6-9f13-140616aa9859 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 8b2888c2-c26d-4ddb-b900-fada5522f01c] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:38:42.527770 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86f40d58-90ea-41a6-9f13-140616aa9859 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:42.528252 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86f40d58-90ea-41a6-9f13-140616aa9859 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:42.528688 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86f40d58-90ea-41a6-9f13-140616aa9859 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:42.529373 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86f40d58-90ea-41a6-9f13-140616aa9859 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:42.529860 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86f40d58-90ea-41a6-9f13-140616aa9859 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:42.530293 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-86f40d58-90ea-41a6-9f13-140616aa9859 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:42.543284 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-86f40d58-90ea-41a6-9f13-140616aa9859 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] HTTP exception thrown: Instance 8b2888c2-c26d-4ddb-b900-fada5522f01c could not be found. Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-86f40d58-90ea-41a6-9f13-140616aa9859 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Request method failure captured: Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c HTTP/1.1 Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_r3qFiO4E5e6qC6yntVZ937UD8bJC1NMf0Al0UXDcHu6MNQXbiFRTJr1TlyOvzryDeUE9Yq65cNeeLLiEsyj1tfKdEunOFcejOF4xAmslU-CuhRFGcYyO98hV9Um8HF_UedgnH-3nsuYPDE0VFs7VZ1V7o_c7sPgwjgVX_nHIAk1rlM Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 5a5733a14ade43e48f6a039a5075e63c Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:38:42.544866 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:38:42.546600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_5a5733a14ade43e48f6a039a5075e63c", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:38:42.546600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:38:42.546600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 5a5733a14ade43e48f6a039a5075e63c Aug 18 22:38:42.546600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:38:42.546600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-TestVolumeBootPattern-1066322283-project Aug 18 22:38:42.546600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:38:42.546600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:38:42.546600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 4b4e033fbc0d438ca9a3f954d53c891e Aug 18 22:38:42.546600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestVolumeBootPattern-1066322283-project Aug 18 22:38:42.546600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:38:42.546600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance 8b2888c2-c26d-4ddb-b900-fada5522f01c could not be found. Aug 18 22:38:42.546600 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': '8b2888c2-c26d-4ddb-b900-fada5522f01c'} Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b2888c2-c26d-4ddb-b900-fada5522f01c could not be found. Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:38:42.547428 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b2888c2-c26d-4ddb-b900-fada5522f01c could not be found. Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b2888c2-c26d-4ddb-b900-fada5522f01c could not be found. Aug 18 22:38:42.548947 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:42.550548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-86f40d58-90ea-41a6-9f13-140616aa9859 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Returning 404 to user: Instance 8b2888c2-c26d-4ddb-b900-fada5522f01c could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:38:42.550548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-86f40d58-90ea-41a6-9f13-140616aa9859 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c" status: 404 len: 111 microversion: 2.1 time: 0.030488 Aug 18 22:38:42.550548 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2303/4599] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:38:42 2022] GET /compute/v2.1/servers/8b2888c2-c26d-4ddb-b900-fada5522f01c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:38:42.981198 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-affbbeff-6945-46f8-8c9a-12726af932c5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:42.981724 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.compute.api [None req-affbbeff-6945-46f8-8c9a-12726af932c5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120538) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:38:42.988707 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-affbbeff-6945-46f8-8c9a-12726af932c5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:42.989195 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-affbbeff-6945-46f8-8c9a-12726af932c5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:42.989641 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-affbbeff-6945-46f8-8c9a-12726af932c5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:42.990330 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-affbbeff-6945-46f8-8c9a-12726af932c5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:42.990783 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-affbbeff-6945-46f8-8c9a-12726af932c5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:42.991209 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG oslo_concurrency.lockutils [None req-affbbeff-6945-46f8-8c9a-12726af932c5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:43.004897 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.wsgi [None req-affbbeff-6945-46f8-8c9a-12726af932c5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] HTTP exception thrown: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-affbbeff-6945-46f8-8c9a-12726af932c5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Request method failure captured: Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: request: DELETE /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 HTTP/1.1 Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept: application/json Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Accept-Encoding: identity Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Connection: close Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Length: 0 Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Content-Type: application/json Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Host: 10.222.0.82 Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Openstack-System-Scope: None Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: User-Agent: python-urllib3/1.26.11 Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Auth-Token: gAAAAABi_r3qFiO4E5e6qC6yntVZ937UD8bJC1NMf0Al0UXDcHu6MNQXbiFRTJr1TlyOvzryDeUE9Yq65cNeeLLiEsyj1tfKdEunOFcejOF4xAmslU-CuhRFGcYyO98hV9Um8HF_UedgnH-3nsuYPDE0VFs7VZ1V7o_c7sPgwjgVX_nHIAk1rlM Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Id: None Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Domain-Name: None Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Identity-Status: Confirmed Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Is-Admin-Project: True Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Id: default Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Domain-Name: Default Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Id: 5a5733a14ade43e48f6a039a5075e63c Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Project-Name: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Role: member,reader Aug 18 22:38:43.006577 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Roles: member,reader Aug 18 22:38:43.008295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_5a5733a14ade43e48f6a039a5075e63c", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:38:43.008295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:38:43.008295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Id: 5a5733a14ade43e48f6a039a5075e63c Aug 18 22:38:43.008295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-Tenant-Name: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:38:43.008295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User: tempest-TestVolumeBootPattern-1066322283-project Aug 18 22:38:43.008295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Id: default Aug 18 22:38:43.008295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Domain-Name: Default Aug 18 22:38:43.008295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Id: 4b4e033fbc0d438ca9a3f954d53c891e Aug 18 22:38:43.008295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: X-User-Name: tempest-TestVolumeBootPattern-1066322283-project Aug 18 22:38:43.008295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: method: > Aug 18 22:38:43.008295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: exception: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:38:43.008295 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: action_args: {'id': '5853a22c-5f4b-4973-b408-d9783a6fc922'} Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:38:43.009365 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:38:43.010990 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: ERROR nova.api.openstack.wsgi Aug 18 22:38:43.012531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-affbbeff-6945-46f8-8c9a-12726af932c5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Returning 404 to user: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. {{(pid=120538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:38:43.012531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-affbbeff-6945-46f8-8c9a-12726af932c5 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "DELETE /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 404 len: 111 microversion: 2.1 time: 0.030611 Aug 18 22:38:43.012531 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2297/4600] 10.222.0.82 () {58 vars in 1239 bytes} [Thu Aug 18 22:38:42 2022] DELETE /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 22:38:43.016674 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bc5dc421-8444-4d57-9ff2-268f23dbce32 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '>' {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:43.018135 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.compute.api [None req-bc5dc421-8444-4d57-9ff2-268f23dbce32 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] [instance: 5853a22c-5f4b-4973-b408-d9783a6fc922] Fetching instance by UUID {{(pid=120539) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 22:38:43.023624 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc5dc421-8444-4d57-9ff2-268f23dbce32 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:43.024191 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc5dc421-8444-4d57-9ff2-268f23dbce32 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:43.024701 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc5dc421-8444-4d57-9ff2-268f23dbce32 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:43.025514 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc5dc421-8444-4d57-9ff2-268f23dbce32 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Acquiring lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 22:38:43.026003 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc5dc421-8444-4d57-9ff2-268f23dbce32 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 22:38:43.026434 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG oslo_concurrency.lockutils [None req-bc5dc421-8444-4d57-9ff2-268f23dbce32 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Lock "ef789987-a8d4-40c7-ba3b-98c8afa02e62" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 22:38:43.043030 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.wsgi [None req-bc5dc421-8444-4d57-9ff2-268f23dbce32 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] HTTP exception thrown: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bc5dc421-8444-4d57-9ff2-268f23dbce32 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Request method failure captured: Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: request: GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 HTTP/1.1 Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept: application/json Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Accept-Encoding: identity Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Connection: close Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Length: 0 Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Content-Type: application/json Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Host: 10.222.0.82 Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Openstack-System-Scope: None Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: User-Agent: python-urllib3/1.26.11 Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Auth-Token: gAAAAABi_r3qFiO4E5e6qC6yntVZ937UD8bJC1NMf0Al0UXDcHu6MNQXbiFRTJr1TlyOvzryDeUE9Yq65cNeeLLiEsyj1tfKdEunOFcejOF4xAmslU-CuhRFGcYyO98hV9Um8HF_UedgnH-3nsuYPDE0VFs7VZ1V7o_c7sPgwjgVX_nHIAk1rlM Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Id: None Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Domain-Name: None Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Identity-Status: Confirmed Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Is-Admin-Project: True Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Id: default Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Domain-Name: Default Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Id: 5a5733a14ade43e48f6a039a5075e63c Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Project-Name: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Role: member,reader Aug 18 22:38:43.044542 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Roles: member,reader Aug 18 22:38:43.046676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82:8080/v1/AUTH_5a5733a14ade43e48f6a039a5075e63c", "adminURL": "http://10.222.0.82:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/volume/v3/5a5733a14ade43e48f6a039a5075e63c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.82/image"}]}] Aug 18 22:38:43.046676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:38:43.046676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Id: 5a5733a14ade43e48f6a039a5075e63c Aug 18 22:38:43.046676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-Tenant-Name: tempest-TestVolumeBootPattern-1066322283 Aug 18 22:38:43.046676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User: tempest-TestVolumeBootPattern-1066322283-project Aug 18 22:38:43.046676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Id: default Aug 18 22:38:43.046676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Domain-Name: Default Aug 18 22:38:43.046676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Id: 4b4e033fbc0d438ca9a3f954d53c891e Aug 18 22:38:43.046676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: X-User-Name: tempest-TestVolumeBootPattern-1066322283-project Aug 18 22:38:43.046676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: method: > Aug 18 22:38:43.046676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: exception: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:38:43.046676 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: action_args: {'id': '5853a22c-5f4b-4973-b408-d9783a6fc922'} Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: {{(pid=120539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 22:38:43.047561 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. Aug 18 22:38:43.048946 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: ERROR nova.api.openstack.wsgi Aug 18 22:38:43.050115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: DEBUG nova.api.openstack.wsgi [None req-bc5dc421-8444-4d57-9ff2-268f23dbce32 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Returning 404 to user: Instance 5853a22c-5f4b-4973-b408-d9783a6fc922 could not be found. {{(pid=120539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 22:38:43.050115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO nova.api.openstack.requestlog [None req-bc5dc421-8444-4d57-9ff2-268f23dbce32 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922" status: 404 len: 111 microversion: 2.1 time: 0.033240 Aug 18 22:38:43.050115 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: [pid: 120539|app: 0|req: 2304/4601] 10.222.0.82 () {58 vars in 1236 bytes} [Thu Aug 18 22:38:43 2022] GET /compute/v2.1/servers/5853a22c-5f4b-4973-b408-d9783a6fc922 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 22:38:44.345685 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: DEBUG nova.api.openstack.wsgi [None req-a1049ea4-e886-4d54-b9bc-d6ad6cac7390 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] Calling method '.version_select at 0x7fd889dac5e0>' {{(pid=120538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 22:38:44.369416 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO nova.api.openstack.requestlog [None req-a1049ea4-e886-4d54-b9bc-d6ad6cac7390 tempest-TestVolumeBootPattern-1066322283 tempest-TestVolumeBootPattern-1066322283-project] 10.222.0.82 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1846540149" status: 202 len: 0 microversion: 2.1 time: 0.027623 Aug 18 22:38:44.373690 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: [pid: 120538|app: 0|req: 2298/4602] 10.222.0.82 () {58 vars in 1263 bytes} [Thu Aug 18 22:38:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1846540149 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 22:39:57.114542 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:39:57.115250 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:39:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:40:02.764449 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:40:02.764916 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:40:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:41:35.601175 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:41:35.601897 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:41:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:41:37.523640 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:41:37.524225 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:41:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:41:50.273161 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:41:50.273720 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:41:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:43:17.122266 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:43:17.122869 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:43:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:43:22.772153 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:43:22.772625 dv-cinder-853678-3-iscsi devstack@n-api.service[120539]: Thu Aug 18 22:43:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 22:43:42.782915 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 22:43:42.783665 dv-cinder-853678-3-iscsi devstack@n-api.service[120538]: Thu Aug 18 22:43:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!